estimate
Can I run Qwen3.8-Flash-Next on a Dual RTX 3090?
Only with CPU offload (slow) (estimate)
speed: not estimated for MoE yet
KV cache not modelled for this architecture: real use needs more than the figures shown
Mixture-of-experts vision-language model. Hugging Face metadata records license: other and license_name: qwen-community-1.0. The LICENSE file is titled Qwen Community License 1.0. It requires the copyright notice. A commercial product or service with more than 100 million monthly active users, or more than US$20 million in monthly revenue, must display the model name. A Model as a Service or AI Work Assistant business needs a separate licence from Qwen before commercial use. Internal use that does not make the model or its outputs available to a third party is exempt from that separate licence. The card says 125B with 6B activated, plus 51B n-gram embedding and 4B MTP. Those round billions are why paramsEstimated stays true. Hugging Face safetensors metadata lists 179,999,981,459 parameters (BF16 179,999,981,424 and I64 35). VRAM math uses that total, stored as 180B. 6B active is the card's activated figure for the 125B portion, not a second measurement. 512 experts in the config, 10 routed per token. The card adds 1 shared expert. 48 layers: 36 linear_attention and 12 full_attention. Those 12 are Qwen Sparse Attention. The card's budget is 512 blocks or 2,048 tokens, and text_config.indexer_budget is 2048. That cache is outside this formula, so kvNotModelled is set and the KV column is not a computed cache. 2 KV heads, head dim 256, max_position_embeddings 262,144. The card says the window is extensible to 1,000,000 tokens with a RoPE change; this catalog uses 262,144. The card's citation is August 2026. Hugging Face lists the repo as created on 24 August 2026. Speed is not estimated: the formula streams every weight and understates sparse MoE, and no speed figure is stored. Unsloth GGUF sizes, shards summed, decimal GB, checked 19 Oct 2026: UD-IQ4_XS 93.68, UD-Q4_K_XL 111.33, Q8_0 188.23. MTP/mtp-Qwen3.8-Flash-Next-Q8_0.gguf is 4.14 GB (4,137,429,120 bytes) and is not included in those three totals. mmproj-F16 is 0.90 GB (904,004,000 bytes), also separate. Strata's README says the graphics card keeps the experts that are used most often and RAM holds all of them (https://github.com/Niko1221/Strata). Releases: https://github.com/Niko1221/Strata/releases. Mainline llama.cpp GPU expert-cache pull requests were still open on 19 Oct 2026: https://github.com/ggml-org/llama.cpp/pull/27861, https://github.com/ggml-org/llama.cpp/pull/30594 and https://github.com/ggml-org/llama.cpp/pull/30637.
Can I run Qwen3.8-Flash-Next on a Dual RTX 3090? Only with CPU offload (slow) (estimate). About 112.1 GB at Q4_K_M (estimate).
VRAM per quant for Qwen3.8-Flash-Next
Updated . The later of the hardware price date and the formula date.
| Quant | Context | Weights | KV | Overhead | Total | Usable | Fit |
|---|---|---|---|---|---|---|---|
| Q4 Q4_K_M | 8,192 tokens | 111.3 GB measured GGUF file size | 0.0 GB not modelled | 0.8 GB estimate | 112.1 GB estimate | 46.8 GB estimate | offload |
| Q5 Q5 (~0.71 bytes/param) | 8,192 tokens | 127.8 GB estimate | 0.0 GB not modelled | 0.8 GB estimate | 128.6 GB estimate | 46.8 GB estimate | offload |
| Q8 Q8 | 8,192 tokens | 192.6 GB estimate | 0.0 GB not modelled | 0.8 GB estimate | 193.4 GB estimate | 46.8 GB estimate | no |
| FP16 FP16 | 8,192 tokens | 360.0 GB estimate | 0.0 GB not modelled | 0.8 GB estimate | 360.8 GB estimate | 46.8 GB estimate | no |
| Q4, longer context | 32,768 tokens | 111.3 GB measured GGUF file size | 0.0 GB not modelled | 0.8 GB estimate | 112.1 GB estimate | 46.8 GB estimate | offload |
Formula estimate, not a benchmark. Method →
Cheapest catalog option that fits at Q4
Mac Studio M5 Ultra 256GB, catalog price, €12,500, dated 2026-10-16. No buy link.
This hardware
$6,054€5,408
price as of 16 Oct 2026
128 GB DDR4 (estimate): $2,754€2,460. From the 16 Oct 2026 fact-check.
rest of system (estimate): $560€500. The total is the GPU price plus the RAM line plus this estimate. It is not a checked system price.
price unverifiedGPU line is 2× the used median €1,224 (€2,448), labelled used, from pcprice.watch (https://www.pcprice.watch/gpu-buying-guide/rtx-3090-price-used-and-specs). 128 GB DDR4 (estimate) €2,460, from the 16 Oct 2026 fact-check. Rest of system (estimate) €500. Other parts from €500 in that fact-check. Not a shop listing. The total is the GPU price plus the RAM line plus that rest estimate. It is not a checked system price.
Embed this
Qwen3.8-Flash-Next on Dual RTX 3090
[](https://localllmrig.com/can-i-run/qwen3.8-flash-next/dual-rtx-3090?utm_source=badge)
Questions
- Can I run Qwen3.8-Flash-Next on a Dual RTX 3090?
- Only with CPU offload (slow) (estimate).
- How much memory does Qwen3.8-Flash-Next need at Q4?
- About 112.1 GB at 8,192 tokens (estimate): 111.3 GB weights (measured GGUF file size), 0.0 GB KV cache (not modelled; real use needs more), 0.8 GB overhead.
- How fast is Qwen3.8-Flash-Next on Dual RTX 3090 (estimate)?
- speed: not estimated for MoE yet
Rig Report waitlist
A written hardware plan for one model and budget. Planned price, not for sale yet.
Sign up with consent and download GPU Buying Cheat Sheet (EU, Oct 2026). The file is not emailed.
Read next: Building a local LLM rig in the RAMageddon.