Skip to content
Benchmark

llama_sampling_sample with default args is more naively usable #310

Sign in to view logs

llama_sampling_sample with default args is more naively usable

llama_sampling_sample with default args is more naively usable #310

Run time

Learn about OS pricing on GitHub Actions
Job Run time
bench-server-baseline (phi-2, q4_0)
1s
bench-server-baseline (phi-2, q8_0)
1s
bench-server-baseline (phi-2, f16)
1s
3s