Tag
blackwell
Also taggeddockernvfp4vllmdflashdgx-sparkgb10rtx-5090rtx-pro-6000
Posts and projects tagged blackwell
- AEON vLLM Ultimate RTX: vLLM for the RTX 5090 and Blackwell sm_120
A slim vLLM image for the RTX 5090 and RTX PRO 6000 Blackwell, why it must never be crossed with the DGX Spark image, what changes on a 32 GB card, four serving recipes for a 27B NVFP4 model, and the WSL2 fault that passed every test.
The Aeon Forge9 min read - AEON vLLM Ultimate: one serving image for the DGX Spark
AEON vLLM Ultimate is vLLM built from source for the DGX Spark's GB10 and shipped as one 18.3 GB image that serves the whole AEON fleet with speculative decoding and NVFP4 weights. Here is why it exists, what broke on the way, and how to pull and run it.
The Aeon Forge14 min read