Tag
throughput
Also taggedaeon-benchbenchmarkingdflashdgx-sparkrecipe-tuningspeculative-decodingvllm
Posts and projects tagged throughput
- AEON Bench recipe lab: tuning vLLM flags one at a time on a DGX Spark
The AEON Bench recipe lab treats a serve recipe as an experiment: change one flag, bench, read the curve. The knobs in order of effect, the speculative decoding trap behind 33 versus 517 tok/s on a DGX Spark, the 816 tok/s recipe to steal, and four traps that fake a result.
The Aeon Forge11 min read