How much memory does Gemma 2 27B need at Q4?

About 19.4 GB at 8,192 tokens (estimate): 16.3 GB weights, 2.3 GB KV cache, 0.8 GB overhead.

How fast is Gemma 2 27B on RTX 3060 12GB (estimate)?

No tokens-per-second estimate. The Q4 fit is not full and not offload, so this page leaves speed blank.

estimate

Can I run Gemma 2 27B on an RTX 3060 12GB?

No: needs ~19.4 GB, this card has ~11.4 GB usable (estimate)

Can I run Gemma 2 27B on an RTX 3060 12GB? No: needs ~19.4 GB, this card has ~11.4 GB usable (estimate). About 19.4 GB at Q4_K_M (estimate).

Updated 2026-10-16. The later of the hardware price date and the formula date.

Gemma 2 27B on RTX 3060 12GB, formula estimate
Quant	Context	Weights	KV	Overhead	Total	Usable	Fit	Est. tok/s
Q4 Q4_K_M	8,192 tokens	16.3 GB estimate	2.3 GB estimate	0.8 GB estimate	19.4 GB estimate	11.4 GB estimate	no	—
Q5 Q5 (~0.71 bytes/param)	8,192 tokens	19.3 GB estimate	2.3 GB estimate	0.8 GB estimate	22.4 GB estimate	11.4 GB estimate	no	—
Q8 Q8	8,192 tokens	29.1 GB estimate	2.3 GB estimate	0.8 GB estimate	32.2 GB estimate	11.4 GB estimate	no	—
FP16 FP16	8,192 tokens	54.4 GB estimate	2.3 GB estimate	0.8 GB estimate	57.5 GB estimate	11.4 GB estimate	no	—
Q4, longer context	8,192 tokens	16.3 GB estimate	2.3 GB estimate	0.8 GB estimate	19.4 GB estimate	11.4 GB estimate	no	—

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Radeon RX 7900 XTX 24GB, new (out of stock), €1,050, dated 2026-10-16. No buy link.

This hardware

$288€257

used (median of sold listings)

price as of 16 Oct 2026

pcprice.watch

Used median €257, typical €236–€280, 1,378 sales. The buying-guide page says Updated Oct 15, 2026. Recorded here on 16 Oct 2026. Not an EU retail listing. No separate new in-stock figure is stored for this card.

Embed this

Gemma 2 27B on RTX 3060 12GB

[![Gemma 2 27B Q4 on RTX 3060 12GB: ✗ · needs 19.4 GB (estimate)](https://localllmrig.com/badge/gemma-2-27b/rtx-3060-12gb.svg)](https://localllmrig.com/can-i-run/gemma-2-27b/rtx-3060-12gb?utm_source=badge)

Questions

Can I run Gemma 2 27B on an RTX 3060 12GB?: No: needs ~19.4 GB, this card has ~11.4 GB usable (estimate).
How much memory does Gemma 2 27B need at Q4?: About 19.4 GB at 8,192 tokens (estimate): 16.3 GB weights, 2.3 GB KV cache, 0.8 GB overhead.
How fast is Gemma 2 27B on RTX 3060 12GB (estimate)?: No tokens-per-second estimate. The Q4 fit is not full and not offload, so this page leaves speed blank.