localLLMriglocal, on your table

estimate

Can I run Llama 3.1 8B on an RTX 4090?

Yes, fully in VRAM (estimate)

Can I run Llama 3.1 8B on an RTX 4090? Yes, fully in VRAM (estimate). About 6.7 GB at Q4_K_M (estimate).

Updated . The later of the hardware price date and the formula date.

Llama 3.1 8B on RTX 4090, formula estimate
QuantContextWeightsKVOverheadTotalUsableFitEst. tok/s
Q4 Q4_K_M8,192 tokens4.8 GB estimate1.1 GB estimate0.8 GB estimate6.7 GB estimate23.4 GB estimatefull130 tok/s estimate
Q5 Q5 (~0.71 bytes/param)8,192 tokens5.7 GB estimate1.1 GB estimate0.8 GB estimate7.6 GB estimate23.4 GB estimatefull113 tok/s estimate
Q8 Q88,192 tokens8.6 GB estimate1.1 GB estimate0.8 GB estimate10.5 GB estimate23.4 GB estimatefull80 tok/s estimate
FP16 FP168,192 tokens16.1 GB estimate1.1 GB estimate0.8 GB estimate17.9 GB estimate23.4 GB estimatefull45 tok/s estimate
Q4, longer context32,768 tokens4.8 GB estimate4.3 GB estimate0.8 GB estimate9.9 GB estimate23.4 GB estimatefull85 tok/s estimate

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

GeForce RTX 3060 12GB, used (median of sold listings), €257, dated 2026-10-16. No buy link.

This hardware

$2,446€2,185

used (median of sold listings)

price as of 16 Oct 2026

new (lowest in-stock EU): $4,243€3,790. GPU PRIX. Current low €3,790, MSI Gaming X Slim, Belgium. Page last updated 15 Oct 2026, checked 16 Oct 2026. In-stock boards in that table start at €3,990.

pcprice.watch

Used median €2,185, typical €2,074–€2,290, 111 sales, updated 16 Oct 2026. Not an EU retail listing.

Embed this

Llama 3.1 8B on RTX 4090

[![Llama 3.1 8B Q4 on RTX 4090: fits ✓ · est. 130 tok/s (estimate)](https://localllmrig.com/badge/llama-3.1-8b/rtx-4090.svg)](https://localllmrig.com/can-i-run/llama-3.1-8b/rtx-4090?utm_source=badge)

Questions

Can I run Llama 3.1 8B on an RTX 4090?
Yes, fully in VRAM (estimate).
How much memory does Llama 3.1 8B need at Q4?
About 6.7 GB at 8,192 tokens (estimate): 4.8 GB weights, 1.1 GB KV cache, 0.8 GB overhead.
How fast is Llama 3.1 8B on RTX 4090 (estimate)?
About 130 tok/s at Q4 (estimate, not a benchmark).
Llama 3.1 8B on RTX 4090 (estimate) · localLLMrig