How much memory does NVIDIA Nemotron 3.5 Super VL need at Q4?

About 72.7 GB at 8,192 tokens (estimate): 71.8 GB weights (measured GGUF file size), 0.1 GB KV cache, 0.8 GB overhead.

estimate

Can I run NVIDIA Nemotron 3.5 Super VL on an RTX 3060 12GB?

No: needs ~72.7 GB, this card has ~11.4 GB usable (estimate)

speed: not estimated for MoE yet

Can I run NVIDIA Nemotron 3.5 Super VL on an RTX 3060 12GB? No: needs ~72.7 GB, this card has ~11.4 GB usable (estimate). About 72.7 GB at Q4_K_M (estimate).

VRAM per quant for NVIDIA Nemotron 3.5 Super VL

Updated 2026-10-16. The later of the hardware price date and the formula date.

NVIDIA Nemotron 3.5 Super VL on RTX 3060 12GB, formula estimate
Quant	Context	Weights	KV	Overhead	Total	Usable	Fit
Q4 Q4_K_M	8,192 tokens	71.8 GB measured GGUF file size	0.1 GB estimate	0.8 GB estimate	72.7 GB estimate	11.4 GB estimate	no
Q5 Q5 (~0.71 bytes/param)	8,192 tokens	85.2 GB estimate	0.1 GB estimate	0.8 GB estimate	86.1 GB estimate	11.4 GB estimate	no
Q8 Q8	8,192 tokens	128.4 GB estimate	0.1 GB estimate	0.8 GB estimate	129.3 GB estimate	11.4 GB estimate	no
FP16 FP16	8,192 tokens	240.0 GB estimate	0.1 GB estimate	0.8 GB estimate	240.9 GB estimate	11.4 GB estimate	no
Q4, longer context	32,768 tokens	71.8 GB measured GGUF file size	0.3 GB estimate	0.8 GB estimate	72.9 GB estimate	11.4 GB estimate	no

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Mac Studio M4 Max 128GB, catalog price, €3,290, dated 2026-10-16. No buy link.

This hardware

$288€257

used (median of sold listings)

price as of 16 Oct 2026

pcprice.watch

Used median €257, typical €236–€280, 1,378 sales. The buying-guide page says Updated Oct 15, 2026. Recorded here on 16 Oct 2026. Not an EU retail listing. No separate new in-stock figure is stored for this card.

Embed this

NVIDIA Nemotron 3.5 Super VL on RTX 3060 12GB

[![NVIDIA Nemotron 3.5 Super VL Q4 on RTX 3060 12GB: ✗ · needs 72.7 GB (estimate)](https://localllmrig.com/badge/nemotron-3.5-super-vl/rtx-3060-12gb.svg)](https://localllmrig.com/can-i-run/nemotron-3.5-super-vl/rtx-3060-12gb?utm_source=badge)

Questions

Can I run NVIDIA Nemotron 3.5 Super VL on an RTX 3060 12GB?: No: needs ~72.7 GB, this card has ~11.4 GB usable (estimate).
How much memory does NVIDIA Nemotron 3.5 Super VL need at Q4?: About 72.7 GB at 8,192 tokens (estimate): 71.8 GB weights (measured GGUF file size), 0.1 GB KV cache, 0.8 GB overhead.
How fast is NVIDIA Nemotron 3.5 Super VL on RTX 3060 12GB (estimate)?: speed: not estimated for MoE yet