Models › SmolLM3 family

HuggingFaceTB Apache 2.0 out 16 months ago

3.08B parameters, text in, text out, 64K tokens of context.

Verified 2026-10-25 Rank #206 in LLMs · score 88.5 method v1 Sources 3 Downloads 30d 723.6k · #138 of 619 tracked

Changed this week: 3 new quantized builds on the Hub (125 in all).2026-10-24

Can I run it?1.8GB at INT4Estimatefits a 16 GB cardmethodCommunity: SmolLM3 3B — specs, VRAM, benchmarks (3B) | BestLLMfor →
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?723.6kdownloads, 30 days#138 of 619 we track · top 22%+6 likes, downloads −4% this week1,070 likesHugging Face2026-10-24

Worth reading

Picked by rule from 5 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Latest · 16 months ago

Smollm3: Smol, multilingual, long-context reasoner LLM

SmolLM3 is a fully open 3B parameter model trained on 11T tokens that outperforms Llama-3.2-3B and Qwen2.5-3B while staying competitive with larger 4B alternatives.

  • The model removes weight decay from embedding layers to improve training stability.
  • Users activate reasoning or non-reasoning modes by including the /think and /no_think flags in the system prompt.
huggingface.co 2025-07-08 388 HN pts · 79 comments 3.2k words about the SmolLM3 family family

5 best of 5 tracked

The 2 picks above, plus these 3. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleAssessment of SmolLM3-3Baial.ie · undated
  2. ArticleSmolLM3 3B — specs, VRAM, benchmarks (3B) | BestLLMforbestllmfor.com · undated
  3. ArticleSmolLM3: smol, multilingual, long-context reasonersmollm3.org · undated

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 125 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware125quantized builds
  • Built on234169 fine-tunes · 62 adapters · 3 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: pliny-the-prompter/obliteratus ♥ 621 · OpenEvals/evaluation-guidebook ♥ 367 · HuggingFaceFW/finephrase ♥ 285 · lerobot/robot-folding ♥ 158

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 1.8 GB at INT4, 3.7 GB at FP8, 7.4 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.8 GB of weights (estimate; KV cache and activations extra)INT41.8 GBFP8: about 3.7 GB of weights (estimate; KV cache and activations extra)FP83.7 GBBF16: about 7.4 GB of weights (estimate; KV cache and activations extra)BF167.4 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.8 GB of weights (estimate; KV cache and activations extra)INT41.8 GBFP8: about 3.7 GB of weights (estimate; KV cache and activations extra)FP83.7 GBBF16: about 7.4 GB of weights (estimate; KV cache and activations extra)BF167.4 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

1 dated article and 30 repo commits so far

Teal is the weights (2025-07-08), amber triangles are 1 dated article (each links to it), grey ticks are repo commits.

AugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-09-10: 2 repo commits2025-08-14: 2 repo commits2025-07-28: 3 repo commits2025-07-25: 1 repo commit2025-07-24: 1 repo commit2025-07-18: 1 repo commit2025-07-10: 1 repo commit2025-07-09: 3 repo commits2025-07-08: 16 repo commitsSmollm3: Smol, multilingual, long-context reasoner LLM · 2025-07-08Weights 2025-07-08 · 2025-07-08Weights 2025-07-08now
AugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-09-10: 2 repo commits2025-08-14: 2 repo commits2025-07-28: 3 repo commits2025-07-25: 1 repo commit2025-07-24: 1 repo commit2025-07-18: 1 repo commit2025-07-10: 1 repo commit2025-07-09: 3 repo commits2025-07-08: 16 repo commitsSmollm3: Smol, multilingual, long-context reasoner LLM · 2025-07-08Weights 2025-07-08 · 2025-07-08Weights 2025-07-08now

What people built on it

359 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

359 derivatives on the Hub, led by 169 fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

125 quantized (Hugging Face model tree)169 fine-tunes (Hugging Face model tree)3 merges (Hugging Face model tree)62 adapters (Hugging Face model tree)125 quantized169 fine-tunes3 merges62 adapters
125 quantized (Hugging Face model tree)169 fine-tunes (Hugging Face model tree)3 merges (Hugging Face model tree)62 adapters (Hugging Face model tree)125 quantized169 fine-tunes3 merges62 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

21 rows

Benchmarks 21 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (21)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AIME 2025 · Reason through hard problems9.3Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported AIME 2025 · Reason through hard problems36.7Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported ARC Challenge · Chat and follow instructions65.61Base Pre-Trained Model, Englishmodel author2026-10-07
author-reported BFCL · Call tools and APIs92.3Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported BFCL · Call tools and APIs88.8Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions55.28Base Pre-Trained Model, Englishmodel author2026-10-07
author-reported GPQA Diamond · Reason through hard problems35.7Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported GPQA Diamond · Reason through hard problems41.7Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported GSM-Plus72.8Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported GSM-Plus83.4Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported Global-MMLU · Work across languages53.5Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported Global-MMLU · Work across languages64.1Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported HellaSwag · Chat and follow instructions76.15Base Pre-Trained Model, Englishmodel author2026-10-07
author-reported IFEval · Chat and follow instructions76.7Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported IFEval · Chat and follow instructions71.2Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported LiveCodeBench · Write code with agents15.2Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported LiveCodeBench · Write code with agents30Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported MMLU · Reason through hard problems44.13Base Pre-Trained Model, Englishmodel author2026-10-07
author-reported MixEval Hard26.9Instruction Model, No Extended Thinkingmodel author2026-10-07
author-reported MixEval Hard30.8Instruction Model, Extended Thinkingmodel author2026-10-07
author-reported Winogrande · Chat and follow instructions58.88Base Pre-Trained Model, Englishmodel author2026-10-07

What the card says

1 cited sentence

Summary generated, cited

This decoder-only transformer supports up to 128k tokens using YARN extrapolation.[1]

  1. “supports up to 128k tokens using YARN extrapolation”

Generated 2026-10-07 15:04 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesSmolLM3ForCausalLM
Model typesmollm3
Dtypebfloat16
Params by dtypeBF16: 3,075,098,624
Size bandM
MoEno
Context length65,536 (config.json max_position_embeddings)
Languagesen, fr, es, it, pt, zh, ar, ru
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · SmolLM3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for SmolLM3-3B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)7.4 GB · Single GPU (<24 GB)
FP8 (1 byte/param)3.7 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)1.8 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from HuggingFaceTB/SmolLM3-3B-Base (same organization) Family: HuggingFaceTB/SmolLM3 359 derivatives on the Hub

Base model: HuggingFaceTB/SmolLM3-3B-Base

adapter: 62quantized: 125finetune: 169merge: 3

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
webAI-Official/TwIL-LM3 adapter GGUF 3.08B M other webAI-Official 93 785.7k
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 bartowski 11 156.5k
ggml-org/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 ggml-org 80 119.5k
unsloth/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 unsloth 34 83.4k
unsloth/SmolLM3-3B-128K-GGUF quantized GGUF — — apache-2.0 unsloth 48 68.2k
mlx-community/SmolLM3-3B-4bit quantized -4bit 3.08B M apache-2.0 mlx-community 7 45.9k
unsloth/SmolLM3-3B finetune — 3.08B M apache-2.0 unsloth 9 22.8k
xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel quantized 4bpw 968M S apache-2.0 xv0y5ncu 0 18.7k
yujiepan/smollm3-tiny-random finetune — 8.28M S — yujiepan 0 16.2k
lmstudio-community/SmolLM3-3B-MLX-8bit quantized MLX 3.08B M apache-2.0 lmstudio-community 5 11.6k
RedHatAI/SmolLM3-3B-FP8-dynamic quantized -FP8 3.08B M apache-2.0 RedHatAI 2 10.9k
HuggingFaceTB/SmolLM3-3B-ONNX quantized — — — apache-2.0 HuggingFaceTB 27 7k
lmstudio-community/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 lmstudio-community 2 7.5k
litert-community/SmolLM3-3B quantized — — — apache-2.0 litert-community 3 7.2k
enacimie/SmolLM3-3B-Q4_K_M-GGUF quantized GGUF — — apache-2.0 enacimie 1 4.9k
second-state/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 second-state 0 4.7k
unsloth/SmolLM3-3B-unsloth-bnb-4bit quantized -bnb 3.16B M apache-2.0 unsloth 3 4k
Alcoft/HuggingFaceTB_SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 Alcoft 0 4.1k
mradermacher/SmolLM3-3B-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 0 4.1k
pytorch/SmolLM3-3B-INT8-INT4 quantized INT8 — — apache-2.0 pytorch 39 2k
Bastion-AI/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 Bastion-AI 1 3.6k
DevQuasar/HuggingFaceTB.SmolLM3-3B-GGUF quantized GGUF — — — DevQuasar 0 3.4k
arzaan789/smolm3-3b-uncensored quantized GGUF — — apache-2.0 arzaan789 0 3k
jc-builds/SmolLM3-3B-Instruct-GGUF quantized GGUF — — apache-2.0 jc-builds 0 2.7k
lmstudio-community/SmolLM3-3B-MLX-6bit quantized MLX 3.08B M apache-2.0 lmstudio-community 1 2.6k
xv0y5ncu/SmolLM3-3B-GLQ-3.5bpw quantized 5bpw 1.14B S apache-2.0 xv0y5ncu 0 2.5k
lmstudio-community/SmolLM3-3B-MLX-4bit quantized MLX 3.08B M apache-2.0 lmstudio-community 1 2.5k
mradermacher/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 mradermacher 1 2.5k
unsloth/SmolLM3-3B-bnb-4bit quantized -bnb 3.16B M apache-2.0 unsloth 0 2.5k
tiny-random/smollm3 finetune — 8.28M S — tiny-random 0 2.5k
mlx-community/SmolLM3-3B-8bit quantized -8bit 3.08B M apache-2.0 mlx-community 9 1.8k
notpaulmartin/SmolLM3-3B-flax adapter — — — apache-2.0 notpaulmartin 0 2.1k
taobao-mnn/SmolLM3-3B-MNN quantized — — — apache-2.0 taobao-mnn 0 2k
vinayp27/smollm3-medical finetune — 3.08B M — vinayp27 1 1.9k
Zynerji/Ektome-SmolLM3-3B-PristinelyUncensored quantized GGUF 3.08B M apache-2.0 Zynerji 1 1.8k
AnkitAI/Parable-SmolLM3-3B-Claude-Fable-5-GGUF quantized GGUF — — apache-2.0 AnkitAI 2 1.7k
gaianet/SmolLM3-3B-GGUF quantized GGUF — — apache-2.0 gaianet 0 1.8k
yasserrmd/smollm3-gguf quantized gguf — — apache-2.0 yasserrmd 1 1.6k
MInAlA/SmolLM3-3B-DPO-merged finetune — 3.08B M — MInAlA 0 1.5k
K0D3IN/SmolLM3-3B-Instruct-heretic finetune — 3.08B M apache-2.0 K0D3IN 3 1.3k

Repository changelog

30 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 30 commits

DateCommitSHA
2025-09-10 Rename model-00001-of-00003.safetensors to model-00001-of-00002.safetensors a07cc9a
2025-09-10 Rename model-00001-of-00002.safetensors to model-00001-of-00003.safetensors 1e60c88
2025-08-14 Update README.md 1c00fc7
2025-08-14 Update README.md 1bde5af
2025-07-28 Update config.json 988f1dd
2025-07-28 add intermediate checkpoints link (#31) 432810c
2025-07-28 Update README.md to include ExecuTorch (#30) 4f03542
2025-07-25 Embed and add reference to EU transparency template (#29) c861a13
2025-07-24 Fix typo 5fb986e
2025-07-18 add base model 2ab5181
2025-07-10 Update README.md 1fa6fa2
2025-07-09 Adding notebook.ipynb for showing inference using Colab (#12) 297fd63
2025-07-09 smol markup error (#11) 66fc337
2025-07-09 fix: reassign xml_tools to tools to make it work with vllm (#9) 486a602
2025-07-08 Update README.md b49c771
2025-07-08 fix todo 90486a3
2025-07-08 Update README.md f17cc5c
2025-07-08 Update README.md ce6f3a2
2025-07-08 Update README.md 78ed62d
2025-07-08 Update README.md ae6225b
2025-07-08 Update README.md (#4) 2585aa5
2025-07-08 Update chat_template.jinja a169fa4
2025-07-08 Update generation_config.json (#3) 2ea4d77
2025-07-08 Update README.md ddd1ea1
2025-07-08 Update README.md 1ca9692
2025-07-08 Update README.md bbd8497
2025-07-08 add how to use (#2) 0831828
2025-07-08 Update README.md 9d66358
2025-07-08 Update README.md 2593281
2025-07-08 Add vllm and slang commands aa9d5a1

Articles and coverage

5 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

huggingface.co2025-07-08officialauthorityHN front pageabout the SmolLM3 familyHN 388 pts · 79 comments3,203 words
SmolLM3 is a fully open 3B parameter model trained on 11T tokens that outperforms Llama-3.2-3B and Qwen2.5-3B while staying competitive with larger 4B alternatives. The model utilizes Grouped Query Attention with 4 groups and was trained on 384 H100 GPUs for 24 days using a global batch size of 2.36M tokens. It supports multilingual input for six languages and handles long contexts up to 128k tokens via NoPE and YaRN extrapolation.written, reviewed, cited
  • The model removes weight decay from embedding layers to improve training stability.
  • Users activate reasoning or non-reasoning modes by including the /think and /no_think flags in the system prompt.

Analysis4

github.comauthority858 words
An independent benchmark evaluates HuggingFace's SmolLM3-3B base model, a 3.08B dense decoder with GQA and NoPE trained on 11.2T tokens, using standardized vLLM tools on rented NVIDIA A40 hardware. The Apache-2.0 licensed model achieves 35.35% on GPQA Diamond via loglikelihood scoring, while generative tasks like MMLU-Pro show lower scores due to format penalties inherent to base checkpoints. Results match vendor figures for GSM8K and HumanEval+ within standard error margins.written, reviewed, cited
  • GPQA Diamond loglikelihood scoring avoids instruction-following penalties, yielding 35.35% close to vendor instruct figures.
  • GPQA Diamond evaluation requires enforce_eager=True to prevent out-of-memory errors on standard 48 GB GPUs.
  • AIME 2024+2025 combined score of 1.7% reflects honest base-model performance without instruction tuning.
aial.ie1,282 words
HuggingFace released SmolLM3-3B, a fine-tuned model published on 2025-07-08. Its public summary scored 82.50% for Transparency and 86.01% for Usefulness, receiving a B+ grade in both categories. The document scored particularly well on disclosing public data sources, a key requirement under Article 53(1)(d), though it lacked information about other AI models used to generate synthetic data. The model dependencies should include SmolLM3-3B-Base.written, reviewed, cited
bestllmfor.com244 words
Running SmolLM3 3B locally with Q4 quantization requires about 2 GB of VRAM. The model generates tokens at a rate where beyond 20 t/s reading is comfortable.generated, cited
smollm3.orgabout the SmolLM3 family1,745 words
SmolLM3 is a 3 billion parameter language model available in transformers v4.53.0 or later that delivers exceptional performance in reasoning, multilingual understanding, and long context processing. The model supports extended thinking modes with reasoning traces and tool calling via xml_tools or python_tools, recommending temperature=0.6 and top_p=0.95 for optimal results. It can generate outputs up to 32768 new tokens while maintaining efficiency for edge computing scenarios and resource-constrained deployments.written, reviewed, cited
  • SmolLM3 supports tool calling using xml_tools for standard functions or python_tools for Python function calls.
  • The model features an extended thinking mode controlled via system prompts with /think and /no_think flags.
  • SmolLM3 is engineered to deliver comparable performance with significantly reduced resource requirements compared to larger models.

Similar models

3 models

Similar models

  • Llama-3.2-3B-Instruct · 3.21B
    same size band (M), same task (text-generation), more providers
  • Qwen2.5-3B-Instruct · 3.09B
    same size band (M), same task (text-generation), more providers
  • Llama-3.2-3B · 3.21B
    same size band (M), same task (text-generation), more providers

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25

Follow SmolLM3-3B

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.