Latest results.
New benchmarks from the lab. Published with configurations, measurements, and methodology.
-
2.18×
output throughput vs SGLang
Gemma 4 12B at BF16 on one RTX PRO 6000 Blackwell GPU, with 1K-token prompts and 64 concurrent requests.
Read the results -
p90 interactivity vs SGLang FP8
Backboard at BF16 versus the published SGLang FP8 baseline on 8×H100. The largest p90 streaming-rate gain occurred at one active session.
Read the results 12.8×
-
44.4×
Time until the answer startsEach bar loads until the model starts replying · median, 64 requests at once44.4× faster than vLLM
faster median time to first token than vLLM
Higher output throughput than vLLM and SGLang across all eight tested combinations of input length and concurrency on one RTX PRO 6000 Blackwell GPU.
Read the results
View all posts
Make more of the infrastructure you operate.
- Cloud and inference providers
- Evaluate how much more demand your existing GPU fleet can serve within your response-time requirements.
- Enterprise AI teams
- Measure performance against your own models, applications, and workloads within your environment.
- Dedicated and sovereign infrastructure
- Assess additional serving capacity on the compute you own or operate, within your deployment requirements.
Bring us your workload.
The most useful benchmark is yours.
Share your models, hardware, and current serving stack. We’ll work with your team to measure the difference.
Request an evaluation
