MODEL · OPENMOSS / MOSI.AI · ~9B TOTAL (8B LLM + AUDIO ENCODER)
MOSS-Music-8B (Instruct + Thinking)
The first open-weight music-understanding LLM worth flagging — does lyrics ASR with time-aligned transcription, musical captioning, key/tempo/chord reasoning, structural analysis (intro/verse/chorus/bridge/outro), instrument + voice recognition, and music QA. Audio encoder runs at 12.5 Hz temporal resolution. 80.38% avg accuracy across 8 music-QA benchmarks; 15.88% avg WER/CER on lyrics; 4.36/5.0 MusicCaps captioning. Thinking variant adds chain-of-thought reasoning over audio.
License: Apache 2.0 · Context: inherits 8B backbone · Released: May 1, 2026
The decision in five lines
- The call
- Consider — runnable locally, family reference
- Best for
- Local evaluation and family reference
- Runs on
- 23 hardware picks fit (cheapest: Intel Arc B580 12 GB · $310)
- Watch out
- You want music GENERATION — this is understanding-only (audio in, text out).
- Evidence
- Estimated
- ~9B total (8B LLM + audio encoder)
- PARAMETERS
- MUSIC UNDERSTANDING
- TYPE
- inherits
- CONTEXT
- ~6–8 GB (Q4) / ~18 GB (FP16, est.)
- VRAM AT Q4
Where we recommend this
This model isn’t currently in an active planner slot. See the runner notes below if you’re running it anyway.
The call
The first open-weight music-understanding LLM worth flagging — does lyrics ASR with time-aligned transcription, musical captioning, key/tempo/chord reasoning, structural analysis (intro/verse/chorus/bridge/outro), instrument + voice recognition, and music QA. Audio encoder runs at 12.5 Hz temporal resolution. 80.38% avg accuracy across 8 music-QA benchmarks; 15.88% avg WER/CER on lyrics; 4.36/5.0 MusicCaps captioning. Thinking variant adds chain-of-thought reasoning over audio.
When not to use: You want music GENERATION — this is understanding-only (audio in, text out). For text-to-music try Suno / Udio (hosted) or Stable Audio (open-weight, separate model). And it's English-leaning on lyrics ASR; non-Latin script lyrics may suffer.
Runner notes
Recommended runtime is SGLang Serving (`sglang serve --model-path ./weights/MOSS-Music-8B-Instruct --trust-remote-code`). PyTorch 2.9+cu128 + FlashAttention 2 + FFmpeg 7. Python 3.12. Gradio app for local UI. No GGUF / Ollama route yet (non-standard audio-LLM arch). Sibling MOSS-Music-8B-Thinking for reasoning over audio.
Hardware that fits
Every hardware pick whose memory fits this model at the quant we recommend. Sorted cheapest-first — the top row is your best-value fit. Click through for the full buyer’s guide.
- Intel Arc B580 12 GBPerfect · 1.7× 12 GB · $310–$429 new / $190–$260 refurb
- Minisforum UM890 ProPerfect · 3.3× 32 GB DDR5 (shared) · $463 barebone (no RAM / SSD); $991 with 32 GB / 1 TB — Minisforum US store, Sep 15 2026
- NVIDIA RTX 3060 12 GBPerfect · 1.7× 12 GB · $480–$660
- RTX 5060 Ti 16 GBPerfect · 2.2× 16 GB · $700 (refurb / open box) – $970 (new)
- AMD Radeon RX 9070 XTPerfect · 2.2× 16 GB · $750–$870
- Mac Mini M4 16 GBPerfect · 1.5× 16 GB unified · $899 (M6 successor, 16 GB / 256 GB, pre-order) / M4 residuals $499–$799
- NVIDIA RTX 3090 (used, single)Perfect · 3.3× 24 GB · $950–$1,200
- NVIDIA RTX 5070 TiPerfect · 2.2× 16 GB · $1,150–$1,300 new; open-box / refurb from ~$1,020
- AMD Radeon RX 7900 XTXPerfect · 3.3× 24 GB · $1,300–$1,500 new (no refurb in stock Sep 15 2026)
- NVIDIA RTX 5080Perfect · 2.2× 16 GB · $1,430–$1,700
- MacBook Air M5 24 GBPerfect · 2.2× 24 GB unified · $1,499–$1,899
- Mac Mini M4 Pro 24 GBPerfect · 2.2× 24 GB unified · $1,699 (M5 Pro successor, 24 GB / 512 GB, pre-order; M4 Pro discontinued Aug 25 2026)
- Dual RTX 3090 (used)Perfect · 6.6× 48 GB · $1,800–$2,500 all-in
- NVIDIA RTX 4090Perfect · 3.3× 24 GB · $2,200–$2,800
- M5 Pro MacBook Pro 48 GBPerfect · 4.5× 48 GB unified · $2,999–$3,599
- Framework Desktop (Ryzen AI Max+ 395)Perfect · 11.9× 128 GB unified · $3,449 (128 GB config)
- NVIDIA RTX A6000 (48 GB, used)Perfect · 6.6× 48 GB ECC · $3,500–$4,500
- Mac Studio M4 Max 64 GBPerfect · 5.9× 64 GB unified · $3,799 (M5 Max successor, 64 GB / 1 TB, pre-order; M4 Max discontinued Aug 25 2026)
- NVIDIA DGX SparkPerfect · 11.9× 128 GB unified · $4,699
- M5 Max MacBook Pro 64 GBPerfect · 5.9× 64 GB unified · ~$5,199 (est.; June 25 2026 increase)
- Mac Studio M3 Ultra 96 GBPerfect · 8.9× 96 GB unified · $5,499 (M5 Ultra successor, 96 GB / 1 TB, pre-order; M3 Ultra discontinued Aug 25 2026)
- NVIDIA RTX 5090Perfect · 4.4× 32 GB · $6,450–$7,000 (new, in stock)
- Dual RTX 5090Perfect · 8.9× 64 GB (2×32) · $13,300–$14,000 all-in (two cards alone are ~$12,900 at the Sep 15 2026 Newegg floor)
Next step
Find-by-model — see what hardware runs this→