Tag
local-llm
Also taggedapple-siliconmlxmlx-vlmabliterationgemma-4macosmtpmultimodal
Posts and projects tagged local-llm
- Qwen 3.6 27B AEON Ultimate on Apple Silicon: native MLX quants
Two native MLX builds of Qwen 3.6 27B AEON Ultimate for Apple Silicon: which Mac fits the 29.5 GB 8-bit or the 16 GB FP4, why the SSM, vision tower and MTP head stay BF16, the 1.78x lossless self-speculation, and a uv quick start.
The Aeon Forge9 min read - Gemma 4 12B AEON Abliterated on a Mac: the MLX toolkit and server
Two MLX builds of Gemma 4 12B AEON Abliterated for Apple Silicon, 13.4 GB and 9.3 GB, served through an OpenAI-compatible API by one pasted uv command: what an M4 Pro measures, how images and speech go in, and why the quantization recipe is mixed.
The Aeon Forge8 min read