localLLMriglocal, on your table

Hardware

Dual RTX 3090, 48 GB

The classic 70B Q4 rig. Two cards, more hassle, enough memory.

All hardware

Memory

48 GB VRAM

Bandwidth

1872 GB/s

Bandwidth source is not stored.

Price

$6,054€5,408

price as of 16 Oct 2026

128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.

rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.

price unverified

GPU line is 2× the used median €1,224 (€2,448), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-3090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.

Parts in the catalog

Which models fit

Estimate at 8,192 tokens, or the model's maximum when that is shorter. full means the formula fits in usable memory. offload means GPU plus system RAM. no means it does not fit. This is not a measured file.

ModelQ4Q4_K_MestimateQ5Q5 (~0.71 bytes/param)estimateQ8Q8estimateFP16FP16estimate
Llama 3.2 3Bfullfullfullfull
Llama 3.1 8Bfullfullfullfull
Mistral 7B v0.3fullfullfullfull
Gemma 2 9Bfullfullfullfull
Qwen2.5 14Bfullfullfullfull
Phi-4 14Bfullfullfullfull
Gemma 2 27Bfullfullfulloffload
Qwen2.5 32Bfullfullfulloffload
Llama 3.3 70Bfulloffloadoffloadoffload
Qwen2.5 72Boffloadoffloadoffloadoffload
DeepSeek-R1-Distill 70Bfulloffloadoffloadoffload

We'll match you with vetted providers

Open this in the calculator

Guides

Dual RTX 3090, 48 GB · localLLMrig