localLLMriglocal, on your table

estimate

Can I run Mistral 7B v0.3 on a Dual RTX 4090?

Yes, fully in VRAM (estimate)

Can I run Mistral 7B v0.3 on a Dual RTX 4090? Yes, fully in VRAM (estimate). About 6.2 GB at Q4_K_M (estimate).

Updated . The later of the hardware price date and the formula date.

Mistral 7B v0.3 on Dual RTX 4090, formula estimate
QuantContextWeightsKVOverheadTotalUsableFitEst. tok/s
Q4 Q4_K_M8,192 tokens4.4 GB estimate1.1 GB estimate0.8 GB estimate6.2 GB estimate46.8 GB estimatefull155 tok/s estimate
Q5 Q5 (~0.71 bytes/param)8,192 tokens5.1 GB estimate1.1 GB estimate0.8 GB estimate7.0 GB estimate46.8 GB estimatefull135 tok/s estimate
Q8 Q88,192 tokens7.8 GB estimate1.1 GB estimate0.8 GB estimate9.6 GB estimate46.8 GB estimatefull96 tok/s estimate
FP16 FP168,192 tokens14.5 GB estimate1.1 GB estimate0.8 GB estimate16.4 GB estimate46.8 GB estimatefull55 tok/s estimate
Q4, longer context32,768 tokens4.4 GB estimate4.3 GB estimate0.8 GB estimate9.4 GB estimate46.8 GB estimatefull98 tok/s estimate

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

GeForce RTX 3060 12GB, used (median of sold listings), €257, dated 2026-10-16. No buy link.

This hardware

$8,206€7,330

price as of 16 Oct 2026

128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.

rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.

price unverified

GPU line is 2× the used median €2,185 (€4,370), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-4090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. DDR5 was not separately priced, so this total uses the sourced 128 GB DDR4 line. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.

Embed this

Mistral 7B v0.3 on Dual RTX 4090

[![Mistral 7B v0.3 Q4 on Dual RTX 4090: fits ✓ · est. 155 tok/s (estimate)](https://localllmrig.com/badge/mistral-7b-v03/dual-rtx-4090.svg)](https://localllmrig.com/can-i-run/mistral-7b-v03/dual-rtx-4090?utm_source=badge)

Questions

Can I run Mistral 7B v0.3 on a Dual RTX 4090?
Yes, fully in VRAM (estimate).
How much memory does Mistral 7B v0.3 need at Q4?
About 6.2 GB at 8,192 tokens (estimate): 4.4 GB weights, 1.1 GB KV cache, 0.8 GB overhead.
How fast is Mistral 7B v0.3 on Dual RTX 4090 (estimate)?
About 155 tok/s at Q4 (estimate, not a benchmark).
Mistral 7B v0.3 on Dual RTX 4090 (estimate) · localLLMrig