localLLMriglocal, on your table

budget

Local LLM under $5,000

Under $5,000 (€4,466 incl. VAT) localLLMrig picks Qwen2.5 72B at Q4 as the largest model that fully fits somewhere. Global prices (USD), EUR available. Prices and tokens/s are estimates without a source.

This page is $5,000. The catalog compares against about €4,466 incl. VAT, an FX estimate.

Open in the calculator

Three setups

Qwen2.5 72B · Q4 · 8,192 ctx

Estimated memory

44.2 GBestimate

40.7 GB weights · 2.7 GB KV cache · 0.8 GB overhead

You didn't pick a model. Inside this budget, this is the largest model that fully fits somewhere.

  1. 01 · Fastest

    Dual RTX 3090, 48 GB

    The classic 70B Q4 rig. Two cards, more hassle, enough memory.

    $2,217€1,980

    inside budget · used

    estimate

    tok/s

    18.1

    estimate

    needed

    44.2 GB

    full fit

    usable

    45.6 GB

    VRAM

    Why this one

    • The model fits entirely in VRAM or unified memory. No CPU offload.
    • It fits, with little room left. A longer context can push it over.
    • The indicative price is inside your budget.
    • Two GPUs. Expect a heavier PSU and a llama.cpp split. Bandwidth does not fully double.
    • High memory bandwidth, so a higher tokens-per-second estimate.
    • Second-hand or a previous generation. The price moves around.
    • Highest estimated speed in this shortlist.

    Parts

    • 2× GeForce RTX 3090 24GB, used
    • Ryzen 9 5900X or similar
    • 128 GB DDR4
    • 1200W PSU, a case that can breathe

  2. 02 · Other platform

    Mac Studio M4 Max 128GB

    70B Q4 and Q5 fit, Q8 often does too. Slower than a dual 3090, much quieter.

    $3,683€3,290

    inside budget · used

    estimate

    tok/s

    5.9

    estimate

    needed

    44.2 GB

    full fit

    usable

    116.0 GB

    unified

    Why this one

    • The model fits entirely in VRAM or unified memory. No CPU offload.
    • Memory left for a longer context or a heavier quantisation.
    • The indicative price is inside your budget.
    • Unified memory: weights and KV cache share one pool.
    • Second-hand or a previous generation. The price moves around.
    • One box, little noise, no discrete GPU.
    • A different brand, so you don't see the same PC three times.

    Parts

    • Mac Studio (2025) M4 Max 16-core/40-core, 128 GB
    • 546 GB/s according to Apple Support

  3. 03 · A step up

    Dual RTX 4090, 48 GB

    Same memory as two 3090s, higher bandwidth, a lot more money.

    $6,146€5,490

    over budget

    estimate

    tok/s

    19.4

    estimate

    needed

    44.2 GB

    full fit

    usable

    45.6 GB

    VRAM

    Why this one

    • The model fits entirely in VRAM or unified memory. No CPU offload.
    • It fits, with little room left. A longer context can push it over.
    • Above your budget. Nothing fully fit inside the amount, or this is a faster step above it.
    • Two GPUs. Expect a heavier PSU and a llama.cpp split. Bandwidth does not fully double.
    • High memory bandwidth, so a higher tokens-per-second estimate.

    Parts

    • 2× GeForce RTX 4090 24GB
    • Ryzen 9 7950X or similar
    • 128 GB DDR5
    • 1600W PSU

With CPU offload, and therefore slower, this could also work: PC with RTX 4090 24GB, ~1.8 tok/s, $3,235€2,890.

Tokens per second are estimated from memory bandwidth, not from a measured benchmark. Global prices (USD), EUR available. EUR includes VAT. USD is an FX estimate. No shop source. Run llama-bench yourself before you buy.

Want a build tailored to you? Custom report

Get new builds when GPU prices move

End of results

Common questions

What is the largest model that fully fits under $5,000?
In this dataset that is Qwen2.5 72B at Q4, with an estimated memory need of 44.2 GB at 8,192 tokens. That is an estimate. sourceUrl stays null.
Is a 70B model always included?
No. Llama 70B Q4 needs about 40 GB. At the lower amounts it does not fully fit. The page then shows a smaller model that does, or a fit above the budget when nothing inside it does.
Are the prices shop prices?
No. Every amount is indicative as of 14 October 2026 and has no shop source.
Local LLM under $5,000 · localLLMrig