localLLMriglocal, on your table

estimate

Can I run Qwen2.5 32B on an RTX 3060 12GB?

No: needs ~22.6 GB, this card has ~11.4 GB usable (estimate)

Can I run Qwen2.5 32B on an RTX 3060 12GB? No: needs ~22.6 GB, this card has ~11.4 GB usable (estimate). About 22.6 GB at Q4_K_M (estimate).

Updated . The later of the hardware price date and the formula date.

Qwen2.5 32B on RTX 3060 12GB, formula estimate
QuantContextWeightsKVOverheadTotalUsableFitEst. tok/s
Q4 Q4_K_M8,192 tokens19.7 GB estimate2.1 GB estimate0.8 GB estimate22.6 GB estimate11.4 GB estimateno—
Q5 Q5 (~0.71 bytes/param)8,192 tokens23.3 GB estimate2.1 GB estimate0.8 GB estimate26.2 GB estimate11.4 GB estimateno—
Q8 Q88,192 tokens35.1 GB estimate2.1 GB estimate0.8 GB estimate38.0 GB estimate11.4 GB estimateno—
FP16 FP168,192 tokens65.6 GB estimate2.1 GB estimate0.8 GB estimate68.5 GB estimate11.4 GB estimateno—
Q4, longer context32,768 tokens19.7 GB estimate8.6 GB estimate0.8 GB estimate29.1 GB estimate11.4 GB estimateno—

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Radeon RX 7900 XTX 24GB, new (out of stock), €1,050, dated 2026-10-16. No buy link.

This hardware

$288€257

used (median of sold listings)

price as of 16 Oct 2026

pcprice.watch

Used median €257, typical €236–€280, 1,378 sales. The buying-guide page says Updated Oct 15, 2026. Recorded here on 16 Oct 2026. Not an EU retail listing. No separate new in-stock figure is stored for this card.

Embed this

Qwen2.5 32B on RTX 3060 12GB

[![Qwen2.5 32B Q4 on RTX 3060 12GB: ✗ · needs 22.6 GB (estimate)](https://localllmrig.com/badge/qwen2.5-32b/rtx-3060-12gb.svg)](https://localllmrig.com/can-i-run/qwen2.5-32b/rtx-3060-12gb?utm_source=badge)

Questions

Can I run Qwen2.5 32B on an RTX 3060 12GB?
No: needs ~22.6 GB, this card has ~11.4 GB usable (estimate).
How much memory does Qwen2.5 32B need at Q4?
About 22.6 GB at 8,192 tokens (estimate): 19.7 GB weights, 2.1 GB KV cache, 0.8 GB overhead.
How fast is Qwen2.5 32B on RTX 3060 12GB (estimate)?
No tokens-per-second estimate. The Q4 fit is not full and not offload, so this page leaves speed blank.
Qwen2.5 32B on RTX 3060 12GB (estimate) · localLLMrig