How much memory does Qwen2.5 72B need at Q4?

About 47.1 GB at 8,192 tokens (estimate): 43.6 GB weights, 2.7 GB KV cache, 0.8 GB overhead.

How fast is Qwen2.5 72B on RTX 4060 Ti 16GB (estimate)?

No tokens-per-second estimate. The Q4 fit is not full and not offload, so this page leaves speed blank.

estimate

Can I run Qwen2.5 72B on an RTX 4060 Ti 16GB?

No: needs ~47.1 GB, this card has ~15.4 GB usable (estimate)

Can I run Qwen2.5 72B on an RTX 4060 Ti 16GB? No: needs ~47.1 GB, this card has ~15.4 GB usable (estimate). About 47.1 GB at Q4_K_M (estimate).

Updated 2026-10-16. The later of the hardware price date and the formula date.

Qwen2.5 72B on RTX 4060 Ti 16GB, formula estimate
Quant	Context	Weights	KV	Overhead	Total	Usable	Fit	Est. tok/s
Q4 Q4_K_M	8,192 tokens	43.6 GB estimate	2.7 GB estimate	0.8 GB estimate	47.1 GB estimate	15.4 GB estimate	no	—
Q5 Q5 (~0.71 bytes/param)	8,192 tokens	51.6 GB estimate	2.7 GB estimate	0.8 GB estimate	55.1 GB estimate	15.4 GB estimate	no	—
Q8 Q8	8,192 tokens	77.8 GB estimate	2.7 GB estimate	0.8 GB estimate	81.3 GB estimate	15.4 GB estimate	no	—
FP16 FP16	8,192 tokens	145.4 GB estimate	2.7 GB estimate	0.8 GB estimate	148.9 GB estimate	15.4 GB estimate	no	—
Q4, longer context	32,768 tokens	43.6 GB estimate	10.7 GB estimate	0.8 GB estimate	55.2 GB estimate	15.4 GB estimate	no	—

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Mac mini M4 Pro 64GB, catalog price, €1,890, dated 2026-10-16. No buy link.

This hardware

$1,006€899

new (lowest in-stock EU)

price as of 16 Oct 2026

GPU PRIX

Current low €899, MSI Gaming X Slim 16GB, Netherlands, new. Page last updated 15 Oct 2026, checked 16 Oct 2026. 12-month median €713. 3-month median €629. No pcprice.watch used median was recorded for this 16GB card. A used line at €546 on that page is a GIGABYTE 8GB board, not this card.

Embed this

Qwen2.5 72B on RTX 4060 Ti 16GB

[![Qwen2.5 72B Q4 on RTX 4060 Ti 16GB: ✗ · needs 47.1 GB (estimate)](https://localllmrig.com/badge/qwen2.5-72b/rtx-4060-ti-16gb.svg)](https://localllmrig.com/can-i-run/qwen2.5-72b/rtx-4060-ti-16gb?utm_source=badge)

Questions

Can I run Qwen2.5 72B on an RTX 4060 Ti 16GB?: No: needs ~47.1 GB, this card has ~15.4 GB usable (estimate).
How much memory does Qwen2.5 72B need at Q4?: About 47.1 GB at 8,192 tokens (estimate): 43.6 GB weights, 2.7 GB KV cache, 0.8 GB overhead.
How fast is Qwen2.5 72B on RTX 4060 Ti 16GB (estimate)?: No tokens-per-second estimate. The Q4 fit is not full and not offload, so this page leaves speed blank.