Can I run NVIDIA Nemotron 3.5 Bolt 74B-A9B on an RX 9060 XT 16GB?
Key facts
No: it needs about 45 GB and this card has 16 GB of graphics memory.
It needs about 45.3 GB at standard quality (estimate). Checked . model config.
How much memory it needs
That is about 2.9 times what this card has free.
Get a 1-line alert when a faster quant for NVIDIA Nemotron 3.5 Bolt 74B-A9B drops — or when GPUs that run it drop >10%
Get a 1-line alert when a new open-weight model fits 48 GB VRAM (45.3 GB at Q4 for NVIDIA Nemotron 3.5 Bolt 74B-A9B) or when used RTX 3090 / 4090 & Mac Studio prices drop >10% — weekly, zero spam.
What runs NVIDIA Nemotron 3.5 Bolt 74B-A9B instead
The cheapest machine on our list that holds the whole model in its graphics memory:
Mac mini M4 Pro 64GBabout $2,116€1,890
EU shops · Shown to visitors in Europe.US shops · Shown to visitors outside Europe.
We never pass off an estimate as a benchmark. Commissions never change which hardware we recommend. How we calculate
Price details
$2,116€1,890
How we priced this
Not checked against a shop listing (price unverified). Price from 16 Oct 2026.
Used-market euro amount from an earlier check of ours. Used prices cannot be checked on the Apple Store.
Prices excl. shipping unless marked. Euro prices incl. VAT where the seller charges it. Dollar prices are converted from our euro prices without the 21% EU VAT, before US sales tax.
See our picks for NVIDIA Nemotron 3.5 Bolt 74B-A9B in Find hardware. Add your budget to see cheaper machines.
For comparison, an RX 9060 XT 16GB costs $522€564, new (cheapest in-stock board on GPU PRIX's German board list). Card details
If you buy through these links we may earn a commission. It doesn't change our ranking. How shop links work
As an Amazon Associate I earn from qualifying purchases.
Als Amazon-Partner verdiene ich an qualifizierten Verkäufen.
Als Amazon-Partner verdien ik aan in aanmerking komende aankopen.
NVIDIA Nemotron 3.5 Bolt 74B-A9B on other graphics cards
Runs well2
The whole model fits in the graphics memory.
Doesn't fit8
Not enough graphics memory: it needs about 45.3 GB.
- RTX 3060 12GBhas 12 GB
- RTX 4060 Ti 16GBhas 16 GB
- RTX 3090has 24 GB
- RTX 4090has 24 GB
- RTX 5080has 16 GB
- RX 9060 XT 16GBhas 16 GB
- RTX 5090has 32 GB
- RX 7900 XTXhas 24 GB
More about the model itself, what it is good at and its licence: NVIDIA Nemotron 3.5 Bolt 74B-A9B.
The numbers behind this answer
A model comes in several sizes. Q4 is the standard one most people use; the bigger ones answer a little better but need more memory. Each row adds up the model file, the memory a conversation takes, and some working space, and compares the total with what is free on this card.
Swipe the table sideways to see every column.
| Quality | Conversation | Result | Model file | Conversation memory | Working space | Total needed | Free memory |
|---|---|---|---|---|---|---|---|
| Q4 · standard (smallest that keeps quality) | ~12 pages8,192 tokens | Doesn't fit | 44.4 GB | 0.1 GB | 0.8 GB | 45.3 GB | 15.4 GB |
| Q5 · a bit sharper, a bit bigger | ~12 pages8,192 tokens | Doesn't fit | 52.5 GB | 0.1 GB | 0.8 GB | 53.4 GB | 15.4 GB |
| Q8 · near full quality, almost twice Q4 | ~12 pages8,192 tokens | Doesn't fit | 79.2 GB | 0.1 GB | 0.8 GB | 80.0 GB | 15.4 GB |
| FP16 · full quality, over three times Q4 | ~12 pages8,192 tokens | Doesn't fit | 148.0 GB | 0.1 GB | 0.8 GB | 148.9 GB | 15.4 GB |
| Q4 · standard, longer conversation | ~49 pages32,768 tokens | Doesn't fit | 44.4 GB | 0.3 GB | 0.8 GB | 45.5 GB | 15.4 GB |
speed: not estimated for MoE yet. This model only uses part of itself for each word (a mixture of experts), and our speed estimate does not handle that yet.
Sources and method
Memory and speed on this page are our estimate, not a measured test. Checked . model config.
Hugging Face model card, cited as 10/15/2026: 74B total, 9B active, OpenMDW-1.1, context up to 256K. Our memory estimate uses the 74B total. Our Q4, Q5, Q8 and FP16 figures are not the published 2-bit pack. The config's language stack is a hybrid of 40 Mamba, 40 MoE and 8 attention blocks; our conversation-memory estimate uses only those 8 attention blocks and is not NVIDIA's cache.
Measured by others
Someone else ran NVIDIA Nemotron 3.5 Bolt 74B-A9B and published the speed (community measurement, single run). They may have used a smaller or bigger version than the standard size above, so their result can differ from our answer: "How they measured" has the details.
- RTX 3090
- RTX 4090
- RTX 5090
How they measured
Published 16 Oct 2026. NVIDIA official 2-bit GGUF, stated file size 22.0 GB. llama.cpp 0.7.0-dev build 11669, commit 620d2225c, 4K context, chat-short, one run per config, runs dated 15 Oct 2026. Headline figures are 87.8, 107.3 and 154.7 tokens per second. The table prints 87.75 for the RTX 3090 and says the quant was not reported in that column. Not a localLLMrig measurement.
Source: llm-speed, published 16 Oct 2026
Questions
- Can I run NVIDIA Nemotron 3.5 Bolt 74B-A9B on an RX 9060 XT 16GB?
- No: it needs about 45 GB and this card has 16 GB of graphics memory.
- How much memory does NVIDIA Nemotron 3.5 Bolt 74B-A9B need?
- About 45.3 GB at the standard quality (Q4) for a conversation of up to about 12 pages of text (8,192 tokens), by our estimate: 44.4 GB for the model file (estimated), 0.1 GB to hold the conversation and 0.8 GB of working space.
- How fast is NVIDIA Nemotron 3.5 Bolt 74B-A9B on an RX 9060 XT 16GB?
- We don't give a speed for this model yet. This model only uses part of itself for each word (a mixture of experts), and our speed estimate does not handle that yet.
Speeds and memory are our estimate from the hardware specs, not a measured test. Prices are dated and may change. How we calculate