Tag
openai-compatible
Also taggeddgx-sparkabliterationapple-siliconfaster-qwen3-ttsflash-attentiongemma-4local-llmmlx
Posts and projects tagged openai-compatible
- Qwen3-TTS server: streaming speech that starts in 0.4 seconds
An OpenAI-compatible Qwen3-TTS server for the DGX Spark that streams audio while the GPU is still generating: first audio in about 0.4 s, voice design and voice cloning loaded side by side, a voices library endpoint, and the version drift to check before you deploy.
The Aeon Forge8 min read - Qwen3-ASR server: transcription at 16 times real time on a DGX Spark
Qwen3-ASR on vLLM gives a DGX Spark a self-hosted, Whisper-compatible transcription endpoint for 30 languages and 22 Chinese dialects at about 16 times real time. Here is the pre-built image, the 0.6B and 1.7B variants, and the lessons from running it.
The Aeon Forge7 min read - Gemma 4 12B AEON Abliterated on a Mac: the MLX toolkit and server
Two MLX builds of Gemma 4 12B AEON Abliterated for Apple Silicon, 13.4 GB and 9.3 GB, served through an OpenAI-compatible API by one pasted uv command: what an M4 Pro measures, how images and speech go in, and why the quantization recipe is mixed.
The Aeon Forge8 min read