Tag
flash-attention
Also taggeddgx-sparkopenai-compatibleqwen3-asrspeech-recognitionspeech-to-textvllmwhisper-compatible
Posts and projects tagged flash-attention
- Qwen3-ASR server: transcription at 16 times real time on a DGX Spark
Qwen3-ASR on vLLM gives a DGX Spark a self-hosted, Whisper-compatible transcription endpoint for 30 languages and 22 Chinese dialects at about 16 times real time. Here is the pre-built image, the 0.6B and 1.7B variants, and the lessons from running it.
The Aeon Forge7 min read