estimate
Can I run Qwen2.5 72B on a Dual RTX 4090?
Only with CPU offload (slow) (estimate)
Can I run Qwen2.5 72B on a Dual RTX 4090? Only with CPU offload (slow) (estimate). About 47.1 GB at Q4_K_M (estimate).
Updated . The later of the hardware price date and the formula date.
| Quant | Context | Weights | KV | Overhead | Total | Usable | Fit | Est. tok/s |
|---|---|---|---|---|---|---|---|---|
| Q4 Q4_K_M | 8,192 tokens | 43.6 GB estimate | 2.7 GB estimate | 0.8 GB estimate | 47.1 GB estimate | 46.8 GB estimate | offload | 18.6 tok/s estimate |
| Q5 Q5 (~0.71 bytes/param) | 8,192 tokens | 51.6 GB estimate | 2.7 GB estimate | 0.8 GB estimate | 55.1 GB estimate | 46.8 GB estimate | offload | 4.2 tok/s estimate |
| Q8 Q8 | 8,192 tokens | 77.8 GB estimate | 2.7 GB estimate | 0.8 GB estimate | 81.3 GB estimate | 46.8 GB estimate | offload | 1.1 tok/s estimate |
| FP16 FP16 | 8,192 tokens | 145.4 GB estimate | 2.7 GB estimate | 0.8 GB estimate | 148.9 GB estimate | 46.8 GB estimate | offload | 0.4 tok/s estimate |
| Q4, longer context | 32,768 tokens | 43.6 GB estimate | 10.7 GB estimate | 0.8 GB estimate | 55.2 GB estimate | 46.8 GB estimate | offload | 4.2 tok/s estimate |
Formula estimate, not a benchmark. Method →
Cheapest catalog option that fits at Q4
Mac mini M4 Pro 64GB, catalog price, €1,890, dated 2026-10-16. No buy link.
This hardware
$8,206€7,330
price as of 16 Oct 2026
128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.
rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.
price unverifiedGPU line is 2× the used median €2,185 (€4,370), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-4090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. DDR5 was not separately priced, so this total uses the sourced 128 GB DDR4 line. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.
Embed this
Qwen2.5 72B on Dual RTX 4090
[](https://localllmrig.com/can-i-run/qwen2.5-72b/dual-rtx-4090?utm_source=badge)
Questions
- Can I run Qwen2.5 72B on a Dual RTX 4090?
- Only with CPU offload (slow) (estimate).
- How much memory does Qwen2.5 72B need at Q4?
- About 47.1 GB at 8,192 tokens (estimate): 43.6 GB weights, 2.7 GB KV cache, 0.8 GB overhead.
- How fast is Qwen2.5 72B on Dual RTX 4090 (estimate)?
- About 18.6 tok/s at Q4 (estimate, not a benchmark).