Hardware
Budget PC with RTX 3060 12GB
Entry point for 8B and, just barely, 14B Q4. The card is mostly second-hand.
Memory
12 GB VRAMBandwidth
360 GB/sBandwidth source is not stored.
Price
$996€890
14 Oct 2026
price unverifiedParts in the catalog
- GeForce RTX 3060 12GB
- Ryzen 5 5600 or similar
- 32 GB DDR4
- 1 TB SSD, PSU around 550W
Which models fit
Estimate at 8,192 tokens, or the model's maximum when that is shorter. full means the formula fits in usable memory. offload means GPU plus system RAM. no means it does not fit. This is not a measured file.
| Model | Q4estimate | Q5estimate | Q8estimate | FP16estimate |
|---|---|---|---|---|
| Llama 3.2 3B | full | full | full | full |
| Llama 3.1 8B | full | full | full | offload |
| Mistral 7B v0.3 | full | full | full | offload |
| Gemma 2 9B | full | full | offload | offload |
| Qwen2.5 14B | full | offload | offload | offload |
| Phi-4 14B | full | offload | offload | offload |
| Gemma 2 27B | offload | offload | offload | no |
| Qwen2.5 32B | offload | offload | no | no |
| Llama 3.3 70B | no | no | no | no |
| Qwen2.5 72B | no | no | no | no |
| DeepSeek-R1-Distill 70B | no | no | no | no |