What LLMs fit in 12GB VRAM? (Oct 2026)
16 models on our list fit in 12 GB of graphics memory. The largest by parameter count is Gemma 4 31B at UD-IQ2_XXS, 10.84 GB (measured weights; total is an estimate). We keep 0.6 GB free on one graphics card, so 11.4 GB is usable. Each total adds conversation memory for 8,192 tokens (or the model's own maximum, when that is shorter) and 0.8 GB for the software. The total is an estimate.
Updated
Own a 12 GB GPU? Get a 1-line alert when a new top model fits 11.4 GB usable VRAM
16 models on our catalog fit 12 GB today. Get our weekly 1-line alert when a new open-weight LLM lands inside 11.4 GB at Q4_K_M or when 12 GB+ GPU prices drop >10% — zero spam.
Models that fit
Ranked by parameter count, largest first. The best quant is the highest-quality option that fits in 11.4 GB. A measured download is used when we have one. Otherwise the figure is Q4, Q5, Q8 or FP16 from our estimate. The gigabytes are the weights plus conversation memory for 8,192 tokens, or the model's shorter maximum, plus 0.8 GB for the software. The total is an estimate.
| Rank | AI model | Parameters | Best quant | GB | Label |
|---|---|---|---|---|---|
| 1 | Can I run Gemma 4 31B? | 31.27B (estimate) | UD-IQ2_XXS | 10.84 GB | measured weights; total is an estimate |
| 2 | Can I run Qwen3 Coder 30B A3B? | 30.53B (estimate), 3.3B active | UD-IQ1_M | 11.24 GB | measured weights; total is an estimate |
| 3 | Can I run Qwen3.8-27B? | 27.78B (estimate) | UD-IQ2_XXS | 8.61 GB | measured weights; total is an estimate |
| 4 | Can I run Gemma 3 27B? | 27.43B (estimate) | IQ2_M | 11.40 GB | measured weights; total is an estimate |
| 5 | Can I run Gemma 4 26B A4B? | 25.2B (estimate), 3.8B active | UD-IQ2_XXS | 11.10 GB | measured weights; total is an estimate |
| 6 | Can I run Mistral Small 3.2 24B? | 24.01B (estimate) | IQ2_M | 10.25 GB | measured weights; total is an estimate |
| 7 | Can I run DeepSeek R1 Distill Qwen 14B? | 14.77B | IQ4_XS | 10.53 GB | measured weights; total is an estimate |
| 8 | Can I run Phi-4 14B? | 14.7B (estimate) | Q4_K_M | 11.30 GB | estimate |
| 9 | Can I run Qwen2.5 14B? | 14.7B (estimate) | Q4_K_M | 11.23 GB | estimate |
| 10 | Can I run Gemma 2 9B? | 9.24B (estimate) | Q5 (~0.71 bytes/param) | 9.47 GB | estimate |
| 11 | Can I run Llama 3.1 8B? | 8.03B (estimate) | Q8 | 10.47 GB | estimate |
| 12 | Can I run NVIDIA Nemotron 3.5 Bolt E4B? | 8B (estimate) | UD-Q8_K_XL | 9.26 GB | measured weights; total is an estimate |
| 13 | Can I run Mistral 7B v0.3? | 7.25B (estimate) | Q8 | 9.63 GB | estimate |
| 14 | Can I run Spark-X2.6-4B? | 4.11B (estimate) | BF16 | 9.39 GB | measured weights; total is an estimate |
| 15 | Can I run Llama 3.2 3B? | 3.21B (estimate) | FP16 | 8.16 GB | estimate |
| 16 | Can I run LFM3-1.7B? | 1.73B (estimate) | BF16 | 4.38 GB | measured weights; total is an estimate |
Cards and Macs with 12 GB
The euro price is the figure we store, with the date it was written down. A Mac's gigabytes are shared memory, not graphics memory, so a Mac does not hold the same models as a 12 GB card.
| Machine | Memory | EU price | Date | Label |
|---|---|---|---|---|
| GeForce RTX 3060 12GB | 12 GB graphics memory | €261 | Used price, the typical price of second-hand cards that actually sold |
Memory totals are our estimate, including when the weight file was measured. Prices are the euro figures we store, with the date they were written down. How we calculate
Common questions
- What is the largest model that fits in 12 GB of VRAM?
- Gemma 4 31B is the largest by parameter count, at UD-IQ2_XXS, 10.84 GB (measured weights; total is an estimate). 16 models on our list fit.
- What does the best quant mean for 12 GB?
- The best quant is the highest-quality option that still fits. A measured download is used when we have one at that quality. Otherwise the figure is Q4, Q5, Q8 or FP16 from our estimate. A higher bit count wins. A file that runs only on a Mac is not counted. The gigabytes add conversation memory and the software overhead, so the total is an estimate even when the weight file was measured.
- Which cards and Macs have 12 GB, and what do they cost in the EU?
- GeForce RTX 3060 12GB (12 GB graphics memory): €261, Used price, the typical price of second-hand cards that actually sold, 24 Oct 2026.
- How much of 12 GB can a model use?
- Our estimate keeps 0.6 GB free on one graphics card, so 11.4 GB is usable. A Mac with 12 GB of shared memory does not give the graphics all of it. The model table is for one graphics card.