How much memory does NVIDIA Nemotron 3.5 Super VL need at Q4?

About 72.7 GB at 8,192 tokens (estimate): 71.8 GB weights (measured GGUF file size), 0.1 GB KV cache, 0.8 GB overhead.

estimate

Can I run NVIDIA Nemotron 3.5 Super VL on an RTX 5090?

No: needs ~72.7 GB, this card has ~31.4 GB usable (estimate)

speed: not estimated for MoE yet

Can I run NVIDIA Nemotron 3.5 Super VL on an RTX 5090? No: needs ~72.7 GB, this card has ~31.4 GB usable (estimate). About 72.7 GB at Q4_K_M (estimate).

VRAM per quant for NVIDIA Nemotron 3.5 Super VL

Updated 2026-10-16. The later of the hardware price date and the formula date.

NVIDIA Nemotron 3.5 Super VL on RTX 5090, formula estimate
Quant	Context	Weights	KV	Overhead	Total	Usable	Fit
Q4 Q4_K_M	8,192 tokens	71.8 GB measured GGUF file size	0.1 GB estimate	0.8 GB estimate	72.7 GB estimate	31.4 GB estimate	no
Q5 Q5 (~0.71 bytes/param)	8,192 tokens	85.2 GB estimate	0.1 GB estimate	0.8 GB estimate	86.1 GB estimate	31.4 GB estimate	no
Q8 Q8	8,192 tokens	128.4 GB estimate	0.1 GB estimate	0.8 GB estimate	129.3 GB estimate	31.4 GB estimate	no
FP16 FP16	8,192 tokens	240.0 GB estimate	0.1 GB estimate	0.8 GB estimate	240.9 GB estimate	31.4 GB estimate	no
Q4, longer context	32,768 tokens	71.8 GB measured GGUF file size	0.3 GB estimate	0.8 GB estimate	72.9 GB estimate	31.4 GB estimate	no

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Mac Studio M4 Max 128GB, catalog price, €3,290, dated 2026-10-16. No buy link.

This hardware

$7,052€6,299

new (lowest in-stock EU)

price as of 16 Oct 2026

PriceSquirrel

Cheapest in-stock listing on 16 Oct 2026: €6,299, ASUS ROG Astral GeForce RTX 5090 32GB OC White at Proshop (FI). MSI Gaming Trio OC at Compumsa (BE) was €6,571 and out of stock. A 16 Oct 2026 fact-check notes BE/NL/DE about €7,900–€8,800. No used median was recorded. NVIDIA (Jeff Fisher, 16 Oct 2026) denies a production halt; supply is tight and some retailers have delisted the card.

Embed this

NVIDIA Nemotron 3.5 Super VL on RTX 5090

[![NVIDIA Nemotron 3.5 Super VL Q4 on RTX 5090: ✗ · needs 72.7 GB (estimate)](https://localllmrig.com/badge/nemotron-3.5-super-vl/rtx-5090.svg)](https://localllmrig.com/can-i-run/nemotron-3.5-super-vl/rtx-5090?utm_source=badge)

Questions

Can I run NVIDIA Nemotron 3.5 Super VL on an RTX 5090?: No: needs ~72.7 GB, this card has ~31.4 GB usable (estimate).
How much memory does NVIDIA Nemotron 3.5 Super VL need at Q4?: About 72.7 GB at 8,192 tokens (estimate): 71.8 GB weights (measured GGUF file size), 0.1 GB KV cache, 0.8 GB overhead.
How fast is NVIDIA Nemotron 3.5 Super VL on RTX 5090 (estimate)?: speed: not estimated for MoE yet