Can I run Mistral Small 3.2 24B on a Dual RTX 4090?
Yes. Mistral Small 3.2 24B runs on a Dual RTX 4090, about 41 words per second.
Fast~41 words/sAnswers appear faster than you can read them.Updated · Mistral Small 3.2 24B on every card
How much memory it needs
It uses about 35% of the memory that is free on this machine.
What a Dual RTX 4090 costs
Dual RTX 4090, 64 GB RAM$5,910€5,470price unverified
Price details
$5,910€5,470
How we priced this
- Graphics cards (2×)$4,892€4,370
- Memory, 64 GB DDR4 (estimate)$555€600
- Rest of the PC: processor, board, case, power supply, storage (estimate)$463€500
The card is the GeForce RTX 4090 24GB. Used price, the typical price of second-hand cards that actually sold. Source: pcprice.watch, checked 16 Oct 2026.
The total is our estimate from these parts, not the price of a ready-made PC in a shop.
DDR5 was not separately priced, so this total uses the price we found for 64 GB DDR4 memory.
Prices excl. shipping. Euro prices incl. VAT. Dollar prices are converted from our euro prices without EU VAT, before US sales tax.
With 128 GB of normal memory (RAM) instead of 64 GB: Dual RTX 4090, 128 GB RAM, $7,631€7,330. price unverified It runs Mistral Small 3.2 24B the same way: the extra memory only helps with models too big for the cards.
The cheapest graphics card on our list that also runs it (it still needs the rest of a PC): GeForce RTX 3090 24GB, $1,370€1,224, used (median of sold listings). Fast~35 words/s
EU shops · In the US? Switch the currency to USD.US shops · In Europe? Switch the currency to EUR.
The cheapest complete machine that runs it: Mac mini M6 32GB, $1,416€1,530. price unverified Slow~3.9 words/s
Mistral Small 3.2 24B on other graphics cards
Runs well6
The whole model fits in the graphics memory.
Doesn't fit3
Not enough graphics memory: it needs about 16.5 GB.
- RTX 3060 12GBhas 12 GB
- RTX 4060 Ti 16GBhas 16 GB
- RTX 5080has 16 GB
More about the model itself, what it is good at and its licence: Mistral Small 3.2 24B.
The numbers behind this answer
A model comes in several sizes. Q4 is the standard one most people use; the bigger ones answer a little better but need more memory. Each row adds up the model file, the memory a conversation takes, and some working space, and compares the total with what is free on this machine.
Swipe the table sideways to see every column.
| Quality | Conversation | Result | Speed | Model file | Conversation memory | Working space | Total needed | Free memory |
|---|---|---|---|---|---|---|---|---|
| Q4 · standard (smallest that keeps quality) | ~12 pages8,192 tokens | Runs | Fast~41 words/s | 14.3 GBmeasured file | 1.3 GB | 0.8 GB | 16.5 GB | 46.8 GB |
| Q5 · a bit sharper, a bit bigger | ~12 pages8,192 tokens | Runs | Fast~35 words/s | 17.0 GB | 1.3 GB | 0.8 GB | 19.2 GB | 46.8 GB |
| Q8 · near full quality, almost twice Q4 | ~12 pages8,192 tokens | Runs | Fast~24 words/s | 25.7 GB | 1.3 GB | 0.8 GB | 27.8 GB | 46.8 GB |
| FP16 · full quality, over three times Q4 | ~12 pages8,192 tokens | Runs slowly | Slow~5.5 words/s | 48.0 GB | 1.3 GB | 0.8 GB | 50.2 GB | 46.8 GB |
| Q4 · standard, longer conversation | ~49 pages32,768 tokens | Runs | Fast~33 words/s | 14.3 GBmeasured file | 5.4 GB | 0.8 GB | 20.5 GB | 46.8 GB |
Questions
- Can I run Mistral Small 3.2 24B on a Dual RTX 4090?
- Yes. Mistral Small 3.2 24B runs on a Dual RTX 4090, about 41 words per second.
- How much memory does Mistral Small 3.2 24B need?
- About 16.5 GB at the standard quality (Q4) for a conversation of up to about 12 pages of text (8,192 tokens), by our estimate: 14.3 GB for the model file (measured), 1.3 GB to hold the conversation and 0.8 GB of working space.
- How fast is Mistral Small 3.2 24B on a Dual RTX 4090?
- Fast: about 41 words per second (about 55 tokens per second). Answers appear faster than you can read them. This is our estimate, not a measured test.
Speeds and memory are our estimate from the hardware specs, not a measured test. Prices are dated and may change. How we calculate