How much memory does Qwen3.6-35B-A3B need at Q4?

About 23.1 GB at 8,192 tokens: 22.1 GB weights, 0.2 GB KV cache, 0.8 GB overhead. That is an estimate. sourceUrl stays null.

Does Qwen3.6-35B-A3B fit on a single 24 GB GPU?

The estimate of 23.1 GB sits under the 23.4 GB we treat as usable on a 24 GB card. It is still an estimate, not a measured file.

model

Qwen3.6-35B-A3B: how much memory, and what runs it

Mixture-of-experts vision-language model, Apache-2.0. The card says 35B in total and 3B activated. Hugging Face safetensors metadata lists 35,951,822,704 parameters, all BF16. 35.95B is that count to two decimals, and 3B active is the card's round figure, so paramsEstimated stays true. VRAM math uses the total. 256 experts, 8 routed per token in the config. The card adds 1 shared expert. 40 layers: 30 linear_attention (Gated DeltaNet) and 10 full_attention (Gated Attention). 16 query heads, 2 KV heads, head dim 256. Linear-attention layers are stored with a sliding window of 0 so this formula gives them no token KV. The KV figure uses only the 10 full-attention layers and is an FP16 estimate. Config max_position_embeddings is 262,144. The card says that window is extensible to 1,010,000 tokens; this catalog uses 262,144. The card's citation is April 2026. Hugging Face lists the repo as created on 15 April 2026. Speed is not estimated: the formula streams every weight and understates sparse MoE, and no speed figure is stored. Unsloth GGUF sizes, decimal GB, checked 19 Oct 2026: UD-Q3_K_XL 16.85, UD-IQ4_XS 17.73, MXFP4_MOE 21.71, UD-Q4_K_M 22.13, UD-Q4_K_XL 22.36, Q8_0 36.90. Q8_0 is 36,903,140,320 bytes. mmproj-F16 is 0.90 GB (899,283,680 bytes) and is not a row in the memory table.

Qwen3.6-35B-A3B needs about 23.1 GB at Q4_K_M with 8K context (estimate). See which GPUs and Macs fit it, and EU prices. Speed is not estimated for this mixture-of-experts model.

Quantisation	Estimated memory
Q4	23.1 GBestimate
Q5	26.5 GBestimate
Q8	39.4 GBestimate
FP16	72.9 GBestimate

At 8,192 tokens of context. Catalog quant rates are a formula. sourceUrl on that memory stays null.

Parameter count source: huggingface.co/Qwen/Qwen3.6-35B-A3B. 35.95B total, 3B active. Memory math uses the total.

VRAM per quant and the cheapest rig for Qwen3.6-35B-A3B

Open in the calculator

Three setups

Qwen3.6-35B-A3B · Q4 · 8,192 ctx

Estimated memory

23.1 GBestimate

22.1 GB weights · 0.2 GB KV cache · 0.8 GB overhead

01 · Fastest
PC with RTX 5090 32GB
Highest bandwidth in a single card. 32 GB is plenty for 32B, still too tight for 70B Q4.
$8,283€7,399
price as of 16 Oct 2026
64 GB DDR4 (estimate): $672€600. From the 16 Oct 2026 fact-check.
rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.
price unverified
GPU line is the new in-stock floor €6,299 from PriceSquirrel at Proshop (FI) (https://www.pricesquirrel.com/gpus/rtx-5090). 64 GB DDR4 (estimate) €600, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. The parts list names 96 GB DDR5. That kit was not priced, so this total uses the sourced 64 GB DDR4 line. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.
speed
not estimated for MoE yet
speed: not estimated for MoE yet
needed
23.1 GB
full fit
usable
31.4 GB
VRAM
Why this one
- The model fits entirely in VRAM or unified memory. No CPU offload.
- High memory bandwidth, so a higher tokens-per-second estimate.
- Highest estimated speed in this shortlist.
Parts
- GeForce RTX 5090 32GB
- 96 GB DDR5 is named here and was not priced.
- 64 GB DDR4 (estimate): €600. from the 16 Oct 2026 fact-check.
- Rest of system (estimate): €500. Other parts from €500 in that fact-check. Not a shop listing.
- Ryzen 7 9700X or similar
- 1200W PSU, roomy case
EU shops
US shops are not linked yet.
02 · Best value
Used PC with RTX 3090 24GB
Best single card here for 32B Q4. 70B Q4 does not fully fit.
$2,602€2,324
price as of 16 Oct 2026
64 GB DDR4 (estimate): $672€600. From the 16 Oct 2026 fact-check.
rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.
price unverified
GPU line is the used median €1,224, labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-3090-price-used-and-specs). 64 GB DDR4 (estimate) €600, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.
used
speed
not estimated for MoE yet
speed: not estimated for MoE yet
needed
23.1 GB
full fit
usable
23.4 GB
VRAM
Why this one
- The model fits entirely in VRAM or unified memory. No CPU offload.
- It fits, with little room left. A longer context can push it over.
- High memory bandwidth, so a higher tokens-per-second estimate.
- Second-hand or a previous generation. The price moves around.
- Most estimated tokens per euro in this shortlist.
Parts
- GeForce RTX 3090 24GB, used
- 64 GB DDR4 (estimate): €600. from the 16 Oct 2026 fact-check.
- Rest of system (estimate): €500. Other parts from €500 in that fact-check. Not a shop listing.
- Ryzen 7 5700X or similar
- 850W PSU, decent airflow
EU shops
US shops are not linked yet.
03 · Other platform
Mac Studio M5 Ultra 96GB
High bandwidth and enough memory for 70B Q4/Q5. FP16 70B does not fit.
$7,444€6,649
price as of 16 Oct 2026
Belgian Apple Store
Belgian Apple Store price for this config, from the 16 Oct 2026 fact-check.
speed
not estimated for MoE yet
speed: not estimated for MoE yet
needed
23.1 GB
full fit
usable
72.0 GB
unified
Why this one
- The model fits entirely in VRAM or unified memory. No CPU offload.
- Memory left for a longer context or a heavier quantisation.
- Unified memory: weights and KV cache share one pool.
- High memory bandwidth, so a higher tokens-per-second estimate.
- One box, little noise, no discrete GPU.
- A different brand, so you don't see the same PC three times.
Parts
- Mac Studio M5 Ultra, 96 GB, 1.2 TB/s
EU shops
US shops are not linked yet.

With CPU offload, and therefore slower, this could also work: Mid-range PC with RTX 4060 Ti 16GB, speed: not estimated for MoE yet, $2,238€1,999.

Tokens per second are estimated from memory bandwidth, not from a measured benchmark. Prices incl. VAT, excl. shipping. USD = FX estimate, excl. sales tax. A price without a checked listing is marked price unverified. Run llama-bench yourself before you buy.

Want a build tailored to you? Custom report

Get new builds when GPU prices move

Embed this

Pair

[![Qwen3.6-35B-A3B Q4 on RTX 3060 12GB: ✗ · needs 23.1 GB (estimate)](https://localllmrig.com/badge/qwen3.6-35b-a3b/rtx-3060-12gb.svg)](https://localllmrig.com/can-i-run/qwen3.6-35b-a3b/rtx-3060-12gb?utm_source=badge)

Model badge

[![Qwen3.6-35B-A3B Q4: needs ~23.1 GB VRAM (estimate)](https://localllmrig.com/badge/qwen3.6-35b-a3b.svg)](https://localllmrig.com/models/qwen3.6-35b-a3b?utm_source=badge)

Common questions

How much memory does Qwen3.6-35B-A3B need at Q4?: About 23.1 GB at 8,192 tokens: 22.1 GB weights, 0.2 GB KV cache, 0.8 GB overhead. That is an estimate. sourceUrl stays null.
Does Qwen3.6-35B-A3B fit on a single 24 GB GPU?: The estimate of 23.1 GB sits under the 23.4 GB we treat as usable on a 24 GB card. It is still an estimate, not a measured file.
Are the tokens per second measured?: speed: not estimated for MoE yet