localLLMriglocal, on your table

Hardware

Dual RTX 4090, 48 GB

Same memory as two 3090s, higher bandwidth, a lot more money.

All hardware

Memory

48 GB VRAM

Bandwidth

2016 GB/s

Bandwidth source is not stored.

Price

$8,206€7,330

price as of 16 Oct 2026

128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.

rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.

price unverified

GPU line is 2× the used median €2,185 (€4,370), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-4090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. DDR5 was not separately priced, so this total uses the sourced 128 GB DDR4 line. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.

Parts in the catalog

Which models fit

Estimate at 8,192 tokens, or the model's maximum when that is shorter. full means the formula fits in usable memory. offload means GPU plus system RAM. no means it does not fit. This is not a measured file.

ModelQ4Q4_K_MestimateQ5Q5 (~0.71 bytes/param)estimateQ8Q8estimateFP16FP16estimate
Llama 3.2 3Bfullfullfullfull
Llama 3.1 8Bfullfullfullfull
Mistral 7B v0.3fullfullfullfull
Gemma 2 9Bfullfullfullfull
Qwen2.5 14Bfullfullfullfull
Phi-4 14Bfullfullfullfull
Gemma 2 27Bfullfullfulloffload
Qwen2.5 32Bfullfullfulloffload
Llama 3.3 70Bfulloffloadoffloadoffload
Qwen2.5 72Boffloadoffloadoffloadoffload
DeepSeek-R1-Distill 70Bfulloffloadoffloadoffload

We'll match you with vetted providers

Open this in the calculator

Guides

Dual RTX 4090, 48 GB · localLLMrig