localLLMriglocal, on your table

estimate

Can I run Qwen2.5 14B on an RTX 3090?

Yes, fully in VRAM (estimate)

Can I run Qwen2.5 14B on an RTX 3090? Yes, fully in VRAM (estimate). About 11.2 GB at Q4_K_M (estimate).

Updated . The later of the hardware price date and the formula date.

Qwen2.5 14B on RTX 3090, formula estimate
QuantContextWeightsKVOverheadTotalUsableFitEst. tok/s
Q4 Q4_K_M8,192 tokens8.8 GB estimate1.6 GB estimate0.8 GB estimate11.2 GB estimate23.4 GB estimatefull69 tok/s estimate
Q5 Q5 (~0.71 bytes/param)8,192 tokens10.4 GB estimate1.6 GB estimate0.8 GB estimate12.8 GB estimate23.4 GB estimatefull60 tok/s estimate
Q8 Q88,192 tokens15.7 GB estimate1.6 GB estimate0.8 GB estimate18.1 GB estimate23.4 GB estimatefull42 tok/s estimate
FP16 FP168,192 tokens29.4 GB estimate1.6 GB estimate0.8 GB estimate31.8 GB estimate23.4 GB estimateno—
Q4, longer context32,768 tokens8.8 GB estimate6.4 GB estimate0.8 GB estimate16.1 GB estimate23.4 GB estimatefull47 tok/s estimate

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

GeForce RTX 3060 12GB, used (median of sold listings), €257, dated 2026-10-16. No buy link.

This hardware

$1,370€1,224

used (median of sold listings)

price as of 16 Oct 2026

new (lowest in-stock EU): $2,483€2,218. GPU PRIX. New low €2,218, Zotac Trinity OC, France. Page last updated 16 Oct 2026.

pcprice.watch

Used median €1,224, typical €1,136–€1,312, 232 eBay sold sales over 90 days, updated 16 Oct 2026. Not an EU retail listing.

Embed this

Qwen2.5 14B on RTX 3090

[![Qwen2.5 14B Q4 on RTX 3090: fits ✓ · est. 69 tok/s (estimate)](https://localllmrig.com/badge/qwen2.5-14b/rtx-3090.svg)](https://localllmrig.com/can-i-run/qwen2.5-14b/rtx-3090?utm_source=badge)

Questions

Can I run Qwen2.5 14B on an RTX 3090?
Yes, fully in VRAM (estimate).
How much memory does Qwen2.5 14B need at Q4?
About 11.2 GB at 8,192 tokens (estimate): 8.8 GB weights, 1.6 GB KV cache, 0.8 GB overhead.
How fast is Qwen2.5 14B on RTX 3090 (estimate)?
About 69 tok/s at Q4 (estimate, not a benchmark).
Qwen2.5 14B on RTX 3090 (estimate) · localLLMrig