localLLMriglocal, on your table

estimate

Can I run Mistral 7B v0.3 on an RTX 5080?

Yes, fully in VRAM (estimate)

Can I run Mistral 7B v0.3 on an RTX 5080? Yes, fully in VRAM (estimate). About 6.2 GB at Q4_K_M (estimate).

Updated . The later of the hardware price date and the formula date.

Mistral 7B v0.3 on RTX 5080, formula estimate
QuantContextWeightsKVOverheadTotalUsableFitEst. tok/s
Q4 Q4_K_M8,192 tokens4.4 GB estimate1.1 GB estimate0.8 GB estimate6.2 GB estimate15.4 GB estimatefull134 tok/s estimate
Q5 Q5 (~0.71 bytes/param)8,192 tokens5.1 GB estimate1.1 GB estimate0.8 GB estimate7.0 GB estimate15.4 GB estimatefull118 tok/s estimate
Q8 Q88,192 tokens7.8 GB estimate1.1 GB estimate0.8 GB estimate9.6 GB estimate15.4 GB estimatefull83 tok/s estimate
FP16 FP168,192 tokens14.5 GB estimate1.1 GB estimate0.8 GB estimate16.4 GB estimate15.4 GB estimateno—
Q4, longer context32,768 tokens4.4 GB estimate4.3 GB estimate0.8 GB estimate9.4 GB estimate15.4 GB estimatefull85 tok/s estimate

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

GeForce RTX 3060 12GB, used (median of sold listings), €257, dated 2026-10-16. No buy link.

This hardware

$1,468€1,311

new (lowest in-stock EU)

price as of 17 Oct 2026

GPU PRIX

Lowest in-stock board in the table on 17 Oct 2026: €1,311, ASUS Prime GeForce RTX 5080, in stock. The same page's header current low was €1,328, last updated Oct 17, 2026. 16 GB GDDR7 and 360 W total graphics power are on NVIDIA's RTX 5080 spec page (https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5080/). 960 GB/sec is the RTX 5080 column on NVIDIA's GeForce compare page (https://www.nvidia.com/en-us/geforce/graphics-cards/compare/). The product spec table that was fetched did not print a GB/s row.

Embed this

Mistral 7B v0.3 on RTX 5080

[![Mistral 7B v0.3 Q4 on RTX 5080: fits ✓ · est. 134 tok/s (estimate)](https://localllmrig.com/badge/mistral-7b-v03/rtx-5080.svg)](https://localllmrig.com/can-i-run/mistral-7b-v03/rtx-5080?utm_source=badge)

Questions

Can I run Mistral 7B v0.3 on an RTX 5080?
Yes, fully in VRAM (estimate).
How much memory does Mistral 7B v0.3 need at Q4?
About 6.2 GB at 8,192 tokens (estimate): 4.4 GB weights, 1.1 GB KV cache, 0.8 GB overhead.
How fast is Mistral 7B v0.3 on RTX 5080 (estimate)?
About 134 tok/s at Q4 (estimate, not a benchmark).
Mistral 7B v0.3 on RTX 5080 (estimate) · localLLMrig