qwen.ai2026-08-26officialauthorityHN front pageHN 704 pts · 233 comments3,581 words
Qwen3.8-Flash-Next is a 125B-parameter multimodal MoE model with 51B N-gram embeddings and 6B activated parameters per token. It natively supports 262,144 tokens of context and is extensible to 1,000,000 tokens with YaRN. The production version on QwenCloud costs 0.15 USD per million input tokens and 0.47 USD per million output tokens.written, reviewed, cited
- The model uses a Muon optimizer refined around orthogonalization accuracy and the division of labour between Muon and AdamW.
- Qwen Sparse Attention compresses the sequence into micro-blocks to estimate context importance at the block level before selecting regions.
- Gated Residual expands the original single residual stream into four parallel branches to dynamically control reads and writes.
qwen.ai2026-08-26officialauthorityHN 12 pts · 0 comments