Tag
gemma-4
Also taggeddflashdgx-sparknvfp4speculative-decodingvllmabliterationapple-siliconeagle
Posts and projects tagged gemma-4
- Gemma 4 31B DECKARD HERETIC at NVFP4 with DFlash on a DGX Spark
A dense, uncensored Gemma 4 31B with thinking, quantized to NVFP4 and served through a DFlash drafter on one DGX Spark. Single-stream decode went from 11 to 39 tokens per second, 32 concurrent requests reach 427, and reasoning and tool calling stay intact.
The Aeon Forge11 min read - Gemma 4 26B-A4B at NVFP4: a mixture-of-experts recipe for a DGX Spark
How I serve Gemma 4 26B-A4B, a mixture-of-experts model at NVFP4, on one DGX Spark with a DFlash drafter: the production recipe, the bench recipe behind 816 tok/s at c64, and the drafter defects that made my earlier numbers wrong.
The Aeon Forge10 min read - Gemma 4 12B AEON Abliterated on a Mac: the MLX toolkit and server
Two MLX builds of Gemma 4 12B AEON Abliterated for Apple Silicon, 13.4 GB and 9.3 GB, served through an OpenAI-compatible API by one pasted uv command: what an M4 Pro measures, how images and speech go in, and why the quantization recipe is mixed.
The Aeon Forge8 min read