localLLMriglocal, on your table

estimate

Can I run Qwen2.5 72B on a Dual RTX 3090?

Only with CPU offload (slow) (estimate)

Can I run Qwen2.5 72B on a Dual RTX 3090? Only with CPU offload (slow) (estimate). About 47.1 GB at Q4_K_M (estimate).

Updated . The later of the hardware price date and the formula date.

Qwen2.5 72B on Dual RTX 3090, formula estimate
QuantContextWeightsKVOverheadTotalUsableFitEst. tok/s
Q4 Q4_K_M8,192 tokens43.6 GB estimate2.7 GB estimate0.8 GB estimate47.1 GB estimate46.8 GB estimateoffload17.3 tok/s estimate
Q5 Q5 (~0.71 bytes/param)8,192 tokens51.6 GB estimate2.7 GB estimate0.8 GB estimate55.1 GB estimate46.8 GB estimateoffload2.6 tok/s estimate
Q8 Q88,192 tokens77.8 GB estimate2.7 GB estimate0.8 GB estimate81.3 GB estimate46.8 GB estimateoffload0.7 tok/s estimate
FP16 FP168,192 tokens145.4 GB estimate2.7 GB estimate0.8 GB estimate148.9 GB estimate46.8 GB estimateoffload0.2 tok/s estimate
Q4, longer context32,768 tokens43.6 GB estimate10.7 GB estimate0.8 GB estimate55.2 GB estimate46.8 GB estimateoffload2.6 tok/s estimate

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Mac mini M4 Pro 64GB, catalog price, €1,890, dated 2026-10-16. No buy link.

This hardware

$6,054€5,408

price as of 16 Oct 2026

128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.

rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.

price unverified

GPU line is 2× the used median €1,224 (€2,448), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-3090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.

Embed this

Qwen2.5 72B on Dual RTX 3090

[![Qwen2.5 72B Q4 on Dual RTX 3090: offload · est. 17.3 tok/s (estimate)](https://localllmrig.com/badge/qwen2.5-72b/dual-rtx-3090.svg)](https://localllmrig.com/can-i-run/qwen2.5-72b/dual-rtx-3090?utm_source=badge)

Questions

Can I run Qwen2.5 72B on a Dual RTX 3090?
Only with CPU offload (slow) (estimate).
How much memory does Qwen2.5 72B need at Q4?
About 47.1 GB at 8,192 tokens (estimate): 43.6 GB weights, 2.7 GB KV cache, 0.8 GB overhead.
How fast is Qwen2.5 72B on Dual RTX 3090 (estimate)?
About 17.3 tok/s at Q4 (estimate, not a benchmark).
Qwen2.5 72B on Dual RTX 3090 (estimate) · localLLMrig