the AI bench
VERIFIED JUNE 2026
All hardware

HARDWARE · USED VALUE · 24 GB

NVIDIA RTX 3090 (used, single)

The single card r/LocalLLaMA has been recommending for five years straight.

24 GB of GDDR6X at 936 GB/s for ~$1,050 on the used market in June 2026 — every dollar you spend on a 3090 still buys more usable VRAM than any other card in the lineup, even after the used-market floor lifted ~$200 since April as buyers priced out of 5090 scarcity moved a tier down. The tradeoff is age, heat, and a GDDR6X memory package that runs hot after half a decade.

The decision in five lines

The call
Buy — The single card r/LocalLLaMA has been recommending for five years straight.
Best for
Used value
Runs well
Qwen3-Coder-30B-A3B (MoE, fits 24GB) · Qwen 3.5 35B-A3B (MoE, fits 24GB) · Gemma 4 31B (256K context)
Watch out
GDDR6X memory runs hot at age 5+. Community consensus: budget $20–40 for a thermal-pad replacement before heavy inference load. Memory-junction temps above 100 °C are common on un-serviced cards.
Evidence
Estimated · last verified June 2026

24
GB GDDR6X
936
GB/S BANDWIDTH
350
W TDP
~$1,050
USED (COMMON)

What fits at this tier

Fits everything the RTX 4090 fits at Q4: MoE 30B-A3B and 35B-A3B with context, 14B dense with comfort, Qwen 3.5 27B with Q4_K_M headroom. Measured TG 92.5 tok/s on Llama 3.1 8B Q4 (LocalScore 938). 70B dense Q4 (~40 GB) does NOT fit 24 GB; dual-3090 at 48 GB is the honest path there.

CODING
Qwen3-Coder-30B-A3B (MoE, fits 24GB) 3B-active MoE — benchmark champion for local coding at this tier.
CHAT / GENERAL
Qwen 3.5 35B-A3B (MoE, fits 24GB) 3B active MoE — 30B quality at 3B inference speed.
DOCS & RETRIEVAL
Gemma 4 31B (256K context) 31B dense with 256K context; Gemma commercial-permissive terms; Arena top 5.
IMAGE
HiDream-O1-Image (8B, MIT) May 8, 2026 release. Pixel-space (no VAE, no disjoint text encoder) — debuted top-10 on Artificial Analysis T2I Arena. MIT-licensed 8B; one model handles T2I + edit + subject-driven personalization at up to 2,048².
AGENTS
Qwen 3.5 35B-A3B (MoE, fits 24GB) MoE with native tool use; fits 24GB at Q4; Apache 2.0.
VOICE
VoxCPM2 (2B, Apache 2.0) 30 languages, 48 kHz, tokenizer-free diffusion AR; voice design from text. April 2026 release.

The call

Buy it if you want the most VRAM-per-dollar on the market and don't mind a 5-year-old card. Two of these at ~$2,100 all-in = 48 GB of 70B-Q4 capability — still the cheapest path to that band.

Skip it if you can afford an RTX 4090 ($2,200–$2,800 used) — same VRAM class, newer cooling, longer remaining service life, and no repad lottery. At the new $950–$1,200 used 3090 floor, the gap to 4090-used has narrowed; the math is closer than it was in April.

Watchouts

  • GDDR6X memory runs hot at age 5+. Community consensus: budget $20–40 for a thermal-pad replacement before heavy inference load. Memory-junction temps above 100 °C are common on un-serviced cards.
  • Used 3090 floor lifted from ~$800 (April) to $950–$1,200 in May 2026 as 5090 scarcity pushed buyers down a tier. Amazon new third-party listings reach $1,488; refurb units $1,519. eBay used $1,050 is the new median.
  • Coil whine is common on Founders and AIB models alike. Harmless but audible under sustained compute — factor this in if the rig sits in a bedroom or next to a microphone.
  • Used warranty: most sales are as-is. Buy from high-feedback sellers; test immediately; return window closes fast. 350 W sustained with a loud blower (FE) or triple-fan AIB — mid-tower cases with honest airflow needed.

Local vs cloud at this tier

● LOCAL WINS

Best VRAM-per-dollar for 30B-A3B MoE and 14B dense work. At ~$1,050 used, the break-even vs Claude Pro ($20/mo) is ~36 months on cost alone — but the real win is running MoE unbounded at home.

● CLOUD WINS

Cloud wins on frontier quality (Opus 4.8, GPT-5.4) and zero hardware risk. Used GPUs have a failure rate; cloud has an SLA.

At the 24 GB tier, the 3090 is still the value king — but the lifted floor narrowed the 4090-used delta from $1,400 to $1,100. If you find a 3090 under $1,000 the answer hasn't changed; above $1,200, the 4090 used at $2,200 is in the conversation for the newer service life.

Next step

Load this setup into the planner