Hardware
Mac Studio M5 Ultra 256GB
The machine in this list that can still hold 70B in FP16. The price is a rough estimate.
Memory
256 GB unifiedBandwidth
1200 GB/swww.apple.com/mac-studio/specs/Price
$11,744€10,490
14 Oct 2026
price unverifiedParts in the catalog
- Mac Studio M5 Ultra, 256 GB unified memory, 1.2 TB/s
Which models fit
Estimate at 8,192 tokens, or the model's maximum when that is shorter. full means the formula fits in usable memory. offload means GPU plus system RAM. no means it does not fit. This is not a measured file.
| Model | Q4estimate | Q5estimate | Q8estimate | FP16estimate |
|---|---|---|---|---|
| Llama 3.2 3B | full | full | full | full |
| Llama 3.1 8B | full | full | full | full |
| Mistral 7B v0.3 | full | full | full | full |
| Gemma 2 9B | full | full | full | full |
| Qwen2.5 14B | full | full | full | full |
| Phi-4 14B | full | full | full | full |
| Gemma 2 27B | full | full | full | full |
| Qwen2.5 32B | full | full | full | full |
| Llama 3.3 70B | full | full | full | full |
| Qwen2.5 72B | full | full | full | full |
| DeepSeek-R1-Distill 70B | full | full | full | full |