Smollm3: Smol, multilingual, long-context reasoner LLM
SmolLM3 is a fully open 3B parameter model trained on 11T tokens that outperforms Llama-3.2-3B and Qwen2.5-3B while staying competitive with larger 4B alternatives.
- The model removes weight decay from embedding layers to improve training stability.
- Users activate reasoning or non-reasoning modes by including the /think and /no_think flags in the system prompt.