Tag
mxfp4
Posts and projects tagged mxfp4
- AEON vLLM Ultimate for ROCm: early access on vLLM 0.31
AEON vLLM Ultimate for ROCm is a vLLM 0.31 image that serves Qwen3.8-27B AEON ULTIMATE in MXFP4 and MXFP6 on AMD GPUs. It covers what is built, why the stock path decoded at 1.7 tok/s, what is still unmeasured, and how to test the 2x R9700 recipe.
The Aeon Forge6 min read