How much memory does NVIDIA Nemotron 3.5 Super VL need at Q4?

About 72.7 GB at 8,192 tokens (estimate): 71.8 GB weights (measured GGUF file size), 0.1 GB KV cache, 0.8 GB overhead.

estimate

Can I run NVIDIA Nemotron 3.5 Super VL on a Dual RTX 4090?

Only with CPU offload (slow) (estimate)

speed: not estimated for MoE yet

Can I run NVIDIA Nemotron 3.5 Super VL on a Dual RTX 4090? Only with CPU offload (slow) (estimate). About 72.7 GB at Q4_K_M (estimate).

VRAM per quant for NVIDIA Nemotron 3.5 Super VL

Updated 2026-10-16. The later of the hardware price date and the formula date.

NVIDIA Nemotron 3.5 Super VL on Dual RTX 4090, formula estimate
Quant	Context	Weights	KV	Overhead	Total	Usable	Fit
Q4 Q4_K_M	8,192 tokens	71.8 GB measured GGUF file size	0.1 GB estimate	0.8 GB estimate	72.7 GB estimate	46.8 GB estimate	offload
Q5 Q5 (~0.71 bytes/param)	8,192 tokens	85.2 GB estimate	0.1 GB estimate	0.8 GB estimate	86.1 GB estimate	46.8 GB estimate	offload
Q8 Q8	8,192 tokens	128.4 GB estimate	0.1 GB estimate	0.8 GB estimate	129.3 GB estimate	46.8 GB estimate	offload
FP16 FP16	8,192 tokens	240.0 GB estimate	0.1 GB estimate	0.8 GB estimate	240.9 GB estimate	46.8 GB estimate	no
Q4, longer context	32,768 tokens	71.8 GB measured GGUF file size	0.3 GB estimate	0.8 GB estimate	72.9 GB estimate	46.8 GB estimate	offload

Formula estimate, not a benchmark. Method →

Cheapest catalog option that fits at Q4

Mac Studio M4 Max 128GB, catalog price, €3,290, dated 2026-10-16. No buy link.

This hardware

$8,206€7,330

price as of 16 Oct 2026

128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.

rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.

price unverified

GPU line is 2× the used median €2,185 (€4,370), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-4090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. DDR5 was not separately priced, so this total uses the sourced 128 GB DDR4 line. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.

Embed this

NVIDIA Nemotron 3.5 Super VL on Dual RTX 4090

[![NVIDIA Nemotron 3.5 Super VL Q4 on Dual RTX 4090: offload (estimate)](https://localllmrig.com/badge/nemotron-3.5-super-vl/dual-rtx-4090.svg)](https://localllmrig.com/can-i-run/nemotron-3.5-super-vl/dual-rtx-4090?utm_source=badge)

Questions

Can I run NVIDIA Nemotron 3.5 Super VL on a Dual RTX 4090?: Only with CPU offload (slow) (estimate).
How much memory does NVIDIA Nemotron 3.5 Super VL need at Q4?: About 72.7 GB at 8,192 tokens (estimate): 71.8 GB weights (measured GGUF file size), 0.1 GB KV cache, 0.8 GB overhead.
How fast is NVIDIA Nemotron 3.5 Super VL on Dual RTX 4090 (estimate)?: speed: not estimated for MoE yet