Hardware
GeForce RTX 5080 16GB
Card only. 16 GB GDDR7. Too small for 70B Q4.
Memory
16 GB VRAMBandwidth
960 GB/swww.nvidia.com/en-us/geforce/graphics-cards/compare/Price
$1,468€1,311
new (lowest in-stock EU)
price as of 17 Oct 2026
GPU PRIXLowest in-stock board in the table on 17 Oct 2026: €1,311, ASUS Prime GeForce RTX 5080, in stock. The same page's header current low was €1,328, last updated Oct 17, 2026. 16 GB GDDR7 and 360 W total graphics power are on NVIDIA's RTX 5080 spec page (https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5080/). 960 GB/sec is the RTX 5080 column on NVIDIA's GeForce compare page (https://www.nvidia.com/en-us/geforce/graphics-cards/compare/). The product spec table that was fetched did not print a GB/s row.
Which models fit
Estimate at 8,192 tokens, or the model's maximum when that is shorter. full means the formula fits in usable memory. offload means GPU plus system RAM. no means it does not fit. This is not a measured file.
| Model | Q4Q4_K_Mestimate | Q5Q5 (~0.71 bytes/param)estimate | Q8Q8estimate | FP16FP16estimate |
|---|---|---|---|---|
| Llama 3.2 3B | full | full | full | full |
| Llama 3.1 8B | full | full | full | no |
| Mistral 7B v0.3 | full | full | full | no |
| Gemma 2 9B | full | full | full | no |
| Qwen2.5 14B | full | full | no | no |
| Phi-4 14B | full | full | no | no |
| Gemma 2 27B | no | no | no | no |
| Qwen2.5 32B | no | no | no | no |
| Llama 3.3 70B | no | no | no | no |
| Qwen2.5 72B | no | no | no | no |
| DeepSeek-R1-Distill 70B | no | no | no | no |
| NVIDIA Nemotron 3.5 Bolt 74B-A9B | no | no | no | no |
We'll match you with vetted providers