Mistral Small 3.2 24B: how much memory, and what runs it
Mistral Small 3.2 24B is a mid-size AI model you can download and run on your own computer. It needs about 16 GB of memory at standard quality.
Memory needed
About 16 GB
At standard quality, with room for a conversation of about 12 pages.
Machines that run Mistral Small 3.2 24B
Each of these holds the whole model in memory. Speed is in words per second; from about 6 it keeps up with your reading.
EU shops · In the US? Switch the currency to USD.US shops · In Europe? Switch the currency to EUR.
Mac mini M6 32GB
32 GB shared memory
Slow~3.9 words/s$1,416€1,530estimate
Machine details →Mac Studio M4 Max 36GB
36 GB shared memory · second-hand
Comfortable~9.4 words/s$2,116€1,890usedunverified
Machine details →Used PC with RTX 3090 24GB
24 GB graphics memory · second-hand
Fast~35 words/s$2,388€2,324estimateused parts
Machine details →The buttons look up the graphics card, the part of this PC worth comparing.
Mac Studio M5 Ultra 96GB
96 GB shared memory
Fast~27 words/s$6,152€6,649new
Machine details →PC with RTX 5090 32GB
32 GB graphics memory
Fast~66 words/s$7,834€8,467estimate
Machine details →The buttons look up the graphics card, the part of this PC worth comparing.
Where our price is for a used card or Mac, these shops mostly sell new ones, so their price can be higher.
About these prices
Each price is the amount we last wrote down for that machine, with its date on the machine page. "Estimate" is our own figure: for a complete PC we add our estimate for the other parts to the graphics card price, and some Mac prices are estimates, not a checked shop listing. "Used" is a second-hand price. "Unverified" means we have no checked shop listing for that exact amount. The shop buttons open a search for that machine at each shop, so you see today's price there. Prices excl. shipping. Euro prices incl. VAT. Dollar prices are converted from our euro prices without EU VAT, before US sales tax.
Speeds and memory are our estimate from the hardware specs, not a measured test. Prices are dated and may change. How we calculate
Memory at each quality level
A lower quality level makes the model smaller, so it fits on a smaller machine. Standard (Q4) is what most people run.
| Quality | Memory needed |
|---|---|
| Q4 · standard (smallest that keeps quality) | 16.5 GB |
| Q5 · a bit sharper, a bit bigger | 19.2 GB |
| Q8 · near full quality, almost twice Q4 | 27.8 GB |
| FP16 · full quality, over three times Q4 | 50.2 GB |
With a conversation of 8,192 tokens · about 12 pages of text.
How we worked this out
At standard quality: 14.3 GB for the model itself (a measured file), 1.3 GB for a conversation of 8,192 tokens, and 0.8 GB for the software.
Size source: huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506. The published size is rounded, so ours is an estimate.
Mistral's mid-size open model for chat, documents and image input, under Apache 2.0. At our default quality it needs about 16.5 GB, so it just misses a 16 GB graphics card: a slightly smaller download fits one, and a 24 GB card holds the default.
Licence
Commercial use: yes
Commercial use allowed. Keep the licence and copyright notice when you share the weights.
Licence: Apache-2.0 · checked 21 Oct 2026
Our reading of the licence, not legal advice.
Will Mistral Small 3.2 24B run on my graphics card?
Common questions
- How much memory does Mistral Small 3.2 24B need?
- About 16.5 GB at standard quality (Q4) with a conversation of 8,192 tokens: 14.3 GB for the model itself, 1.3 GB for the conversation and 0.8 GB for the software. The model size is a measured file; the conversation and software parts are our estimate.
- Does Mistral Small 3.2 24B fit on a single 24 GB graphics card?
- Yes, by our estimate. It needs about 16.5 GB, and we count 23.4 GB of a 24 GB card as usable.
- Are the speeds measured?
- No. They are our estimate from how fast each machine's memory is. Real speed also depends on the software and its settings.