Tag
recipe-tuning
Also taggeddflashdgx-sparkspeculative-decodingvllmaeon-benchbenchmarkinggemma-4mixture-of-experts
Posts and projects tagged recipe-tuning
- Gemma 4 26B-A4B at NVFP4: a mixture-of-experts recipe for a DGX Spark
How I serve Gemma 4 26B-A4B, a mixture-of-experts model at NVFP4, on one DGX Spark with a DFlash drafter: the production recipe, the bench recipe behind 816 tok/s at c64, and the drafter defects that made my earlier numbers wrong.
The Aeon Forge10 min read - AEON Bench recipe lab: tuning vLLM flags one at a time on a DGX Spark
The AEON Bench recipe lab treats a serve recipe as an experiment: change one flag, bench, read the curve. The knobs in order of effect, the speculative decoding trap behind 33 versus 517 tok/s on a DGX Spark, the 816 tok/s recipe to steal, and four traps that fake a result.
The Aeon Forge11 min read