Tag
qwen3-8
Also taggedvllmabliterationamddflashdflash2dgx-sparklong-contextmxfp4
Posts and projects tagged qwen3-8
- Qwen 3.8 27B AEON Ultimate: the current flagship and how to serve it
Qwen3.8-27B AEON Ultimate Uncensored is the model I now serve on one Spark, two Sparks and the RTX box: what coherent abliteration removes and keeps, the NVFP4-MIXED weight lattice, the three seat recipes with their commands, and the rules that keep them running.
The Aeon Forge14 min read - AEON vLLM Ultimate for ROCm: early access on vLLM 0.31
AEON vLLM Ultimate for ROCm is a vLLM 0.31 image that serves Qwen3.8-27B AEON ULTIMATE in MXFP4 and MXFP6 on AMD GPUs. It covers what is built, why the stock path decoded at 1.7 tok/s, what is still unmeasured, and how to test the 2x R9700 recipe.
The Aeon Forge6 min read