qwenlm.github.io2025-04-28officialauthorityHN front pageabout the Qwen3 familyHN 869 pts · 388 comments2,139 words
Qwen3 introduces Hybrid Thinking Modes, allowing users to toggle between step-by-step reasoning and rapid responses via computational budget control. The open-weight MoE model Qwen3-235B-A22B achieves performance similar to dense models while using only 10% of the active parameters. Pre-training utilized approximately 36 trillion tokens across 119 languages, with deployment supported by SGLang and vLLM.written, reviewed, cited
- Qwen3-8B and Qwen3-14B models do not use tied embeddings, unlike smaller variants.
- The pre-training pipeline includes a final stage extending context length to 32K tokens.
qwen.ai2025-09-23officialauthorityHN front pageabout the Qwen3 familyHN 434 pts · 160 comments5,127 words
qwen.aiofficialauthorityabout the Qwen3 family