MODEL · MICROSOFT · ~4.7B (4B QWEN3 DECODER + MAGE-VIT, A FROM-SCRATCH CODEC-NATIVE VISUAL ENCODER)
Mage-VL (4B codec-native video VLM)
The most interesting genuinely-local drop of the window, and a real architecture rather than another fine-tune. Instead of sampling video frames uniformly, Mage-VL reads the video codec itself: it keeps every anchor (I) frame patch and only the motion-salient predicted (P) frame patches, using where the codec spent its bits as the signal for where the detail is. That cuts visual tokens by over 75% and yields up to a 3.5× wall-clock speedup at matched accuracy. It is codec-agnostic — traditional H.264/HEVC via motion vectors, or a neural codec via its learned rate map, with no retraining. A single checkpoint covers image understanding, offline video, and a "proactive streaming" mode where a lightweight gate stays quiet during routine footage and wakes the full model only when something worth commenting on completes.
License: Apache 2.0 · Context: Inherits the Qwen3 4B decoder; trained on rolling codec windows up to 384–768 frames · Released: July 25, 2026
The decision in five lines
- The call
- Consider — runnable locally, family reference
- Best for
- Local evaluation and family reference
- Runs on
- 23 hardware picks fit (cheapest: Intel Arc B580 12 GB · $249)
- Watch out
- Text-only work — it is a vision-language model, and a 4B decoder is not a general chat or coding model.
- Evidence
- Estimated
- ~4.7B (4B Qwen3 decoder + Mage-ViT, a from-scratch codec-native visual encoder)
- PARAMETERS
- VISION-LANGUAGE
- TYPE
- Inherits
- CONTEXT
- ~10 GB BF16 / ~3–4 GB at Q4 — runs on almost anything
- VRAM AT Q4
Where we recommend this
This model isn’t currently in an active planner slot. See the runner notes below if you’re running it anyway.
The call
The most interesting genuinely-local drop of the window, and a real architecture rather than another fine-tune. Instead of sampling video frames uniformly, Mage-VL reads the video codec itself: it keeps every anchor (I) frame patch and only the motion-salient predicted (P) frame patches, using where the codec spent its bits as the signal for where the detail is. That cuts visual tokens by over 75% and yields up to a 3.5× wall-clock speedup at matched accuracy. It is codec-agnostic — traditional H.264/HEVC via motion vectors, or a neural codec via its learned rate map, with no retraining. A single checkpoint covers image understanding, offline video, and a "proactive streaming" mode where a lightweight gate stays quiet during routine footage and wakes the full model only when something worth commenting on completes.
When not to use: Text-only work — it is a vision-language model, and a 4B decoder is not a general chat or coding model. Also not a video *generator*; this is understanding only. Microsoft reports the gains against Qwen3-VL-4B with the backbone held fixed and only the encoder swapped, which is the honest comparison, but the numbers are still vendor-run — verify on your own footage before building around the streaming gate.
Runner notes
Not in the Ollama library. Runs via transformers (`trust_remote_code=True`) or SGLang (`--model-path microsoft/Mage-VL`); the repo bundles the codec processor, the neural codec package, and the gate weights, so there is no separate checkpoint to assemble. Eight community quantizations already exist. The adoption signal is unusually strong for something this new — 272K downloads inside about nine days.
Hardware that fits
Every hardware pick whose memory fits this model at the quant we recommend. Sorted cheapest-first — the top row is your best-value fit. Click through for the full buyer’s guide.
- Intel Arc B580 12 GBPerfect · 2.7× 12 GB · $249–$299
- NVIDIA RTX 3060 12 GBPerfect · 2.7× 12 GB · $280–$400
- Minisforum UM890 ProPerfect · 5.5× 32 GB DDR5 (shared) · $463–$580 all-in
- RTX 5060 Ti 16 GBPerfect · 3.7× 16 GB · $560–$610
- AMD Radeon RX 9070 XTPerfect · 3.7× 16 GB · $649–$779
- Mac Mini M4 16 GBPerfect · 2.5× 16 GB unified · $799 (new floor) / $499–$599 (eBay/residuals)
- AMD Radeon RX 7900 XTXPerfect · 5.5× 24 GB · $810 used / ~$1,340 new
- NVIDIA RTX 3090 (used, single)Perfect · 5.5× 24 GB · $950–$1,200
- NVIDIA RTX 5070 TiPerfect · 3.7× 16 GB · $980–$1,300
- NVIDIA RTX 5080Perfect · 3.7× 16 GB · $1,250–$1,400
- MacBook Air M5 24 GBPerfect · 3.7× 24 GB unified · $1,499–$1,899
- Mac Mini M4 Pro 24 GBPerfect · 3.7× 24 GB unified · $1,599
- Dual RTX 3090 (used)Perfect · 11.0× 48 GB · $1,800–$2,500 all-in
- NVIDIA RTX 4090Perfect · 5.5× 24 GB · $2,200–$2,800
- M5 Pro MacBook Pro 48 GBPerfect · 7.4× 48 GB unified · $2,999–$3,599
- Framework Desktop (Ryzen AI Max+ 395)Perfect · 19.6× 128 GB unified · $3,449 (128 GB config)
- NVIDIA RTX 5090Perfect · 7.3× 32 GB · $3,500–$4,300
- NVIDIA RTX A6000 (48 GB, used)Perfect · 11.0× 48 GB ECC · $3,500–$4,500
- Mac Studio M4 Max 64 GBPerfect · 9.8× 64 GB unified · $3,799
- NVIDIA DGX SparkPerfect · 19.6× 128 GB unified · $4,699
- M5 Max MacBook Pro 64 GBPerfect · 9.8× 64 GB unified · ~$5,199 (est.; June 25 2026 increase)
- Mac Studio M3 Ultra 96 GBPerfect · 14.7× 96 GB unified · $5,299
- Dual RTX 5090Perfect · 14.6× 64 GB (2×32) · $8,500–$10,500
Next step
Find-by-model — see what hardware runs this→