Tag
qwen3-6
Also taggedspeculative-decodingdflashdgx-sparkvllmapple-siliconddtreegated-deltanetlocal-llm
Posts and projects tagged qwen3-6
- Serving Qwen 3.6 35B-A3B heretic at NVFP4 with DFlash on a DGX Spark
How I serve an uncensored Qwen 3.6 35B-A3B at NVFP4 with DFlash speculative decoding on one DGX Spark: the seven container fixes, the mixture-of-experts angle, the drafter, the measured numbers and the exact command that works today.
The Aeon Forge11 min read - Qwen 3.6 27B AEON Ultimate on Apple Silicon: native MLX quants
Two native MLX builds of Qwen 3.6 27B AEON Ultimate for Apple Silicon: which Mac fits the 29.5 GB 8-bit or the 16 GB FP4, why the SSM, vision tower and MTP head stay BF16, the 1.78x lossless self-speculation, and a uv quick start.
The Aeon Forge9 min read - DDTree on vLLM: candid research notes on tree speculation for Qwen3.6
DDTree puts tree-shaped speculative decoding into vLLM for Qwen3.6 on a DGX Spark. These lab notes show what works, what breaks inside a hybrid attention model, the numbers so far, and why production should stay on DFlash.
The Aeon Forge8 min read