Models › Qwen3 family

Qwen Apache 2.0 out 18 months ago

4.02B parameters, text in, text out, 32K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #180 in LLMs · score 90.4 method v1 Sources 3 Downloads 30d 577.7k · #153 of 619 tracked

Changed this week: 1 new quantized build on the Hub (56 in all).2026-10-24

Can I run it?2.4GB at INT4Estimatefits a 16 GB cardmethodCommunity: Qwen3-4B-Base: Efficient 4B-Parameter LM →
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?577.7kdownloads, 30 days#153 of 619 we track · top 25%+4 likes, downloads +0% this week117 likesHugging Face2026-10-24

Worth reading

Picked by rule from 18 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 490 HN pts

GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2

OpenAI released gpt-oss-120b and gpt-oss-20b, their first open-weight models since GPT-2 in 2019.

  • A 2025 research paper confirms Dropout results in worse downstream performance in single-epoch regimes.
magazine.sebastianraschka.com 2025-08-10 490 HN pts · 97 comments 5.2k words about the Qwen3 family family

18 best of 18 tracked

The 2 picks above, plus these 16. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleQwen3-Coder-Nextqwen.ai · 2026-02-03 · official
  2. ArticleQwen3-Max-Thinkingqwen.ai · 2026-01-26 · official
  3. ArticleQwen3-TTS family is now open sourced: Voice design, clone, and generationqwen.ai · 2026-01-22 · official
  4. ArticleQwen3: Think deeper, act fasterqwenlm.github.io · 2025-04-28 · 869 HN pts · official
  5. ArticleQwen3-Coder: Agentic coding in the worldqwenlm.github.io · 2025-07-22 · official
  6. ArticleQwen3-Nextqwen.ai · 2025-09-12 · official
  7. ArticleQwen3-VLqwen.ai · 2025-09-23 · official
  8. CodeQwen3-Omni: Native Omni AI model for text, image and videogithub.com · 2025-09-22
  9. PaperQwen3 Technical Report - arXivarxiv.org · undated
  10. ArticleUnderstanding and Implementing Qwen3 From Scratchmagazine.sebastianraschka.com · undated
  11. ArticleQwen 3: The new open standard - by Nathan Lambertinterconnects.ai · undated
  12. ArticleQwen3 4B — 4B Dense LLM | FitMyLLMfitmyllm.com · undated
  13. Article[Literature Review] Qwen3 Technical Reportthemoonlight.io · undated
  14. ArticleQwen3-4B-Base: Efficient 4B-Parameter LMemergentmind.com · undated
  15. ArticleQwen3-4B-Base by Qwen: Open-Weight Modelsavrn.com · undated
  16. ArticleQwen3 4B — pricing, benchmarks and overview 2026 · nAIvigatenaivigate.com · undated

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; heavily run locally (56 quantized builds); a big base for builders (645 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware56quantized builds
  • Built on645513 fine-tunes · 125 adapters · 7 merges
  • In apps17Hugging Face Spaces

Top Spaces running it: dqy08/InfoLens1 ♥ 22 · fuvty/C2C_demo ♥ 3 · nics-efc/C2C_demo ♥ 2 · jaredpalmer/kev-4b-decision-demo ♥ 2

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 2.4 GB at INT4, 4.8 GB at FP8, 9.7 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.4 GB of weights (estimate; KV cache and activations extra)INT42.4 GBFP8: about 4.8 GB of weights (estimate; KV cache and activations extra)FP84.8 GBBF16: about 9.7 GB of weights (estimate; KV cache and activations extra)BF169.7 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.4 GB of weights (estimate; KV cache and activations extra)INT42.4 GBFP8: about 4.8 GB of weights (estimate; KV cache and activations extra)FP84.8 GBBF16: about 9.7 GB of weights (estimate; KV cache and activations extra)BF169.7 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

3 dated articles and 9 repo commits so far

Teal is the weights (2025-04-28), amber triangles are 3 dated articles (each links to it), grey ticks are repo commits.

MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-07-26: 1 repo commit2025-05-21: 1 repo commit2025-05-20: 1 repo commit2025-04-28: 6 repo commitsQwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers · 2026-02-28Qwen3: Think deeper, act faster · 2025-04-28GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2 · 2025-08-10Weights 2025-04-28 · 2025-04-28Weights 2025-04-28now · 1 provider
MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-07-26: 1 repo commit2025-05-21: 1 repo commit2025-05-20: 1 repo commit2025-04-28: 6 repo commitsQwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers · 2026-02-28Qwen3: Think deeper, act faster · 2025-04-28GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2 · 2025-08-10Weights 2025-04-28 · 2025-04-28Weights 2025-04-28now · 1 provider

What people built on it

701 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

701 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

56 quantized (Hugging Face model tree)513 fine-tunes (Hugging Face model tree)7 merges (Hugging Face model tree)125 adapters (Hugging Face model tree)56 quantized513 fine-tunes7 merges125 adapters
56 quantized (Hugging Face model tree)513 fine-tunes (Hugging Face model tree)7 merges (Hugging Face model tree)125 adapters (Hugging Face model tree)56 quantized513 fine-tunes7 merges125 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The model architecture uses 36 layers and supports a context length of 32,768 tokens.[1][2]

  1. “Number of Layers: 36”
  2. “Context Length: 32,768”

Generated 2026-10-07 15:03 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

5 use cases

What it is good at 5 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesQwen3ForCausalLM
Model typeqwen3
Dtypebfloat16
Params by dtypeBF16: 4,022,468,096
Size bandM
MoEno
Context length32,768 (config.json max_position_embeddings)
PapersarXiv:2505.09388
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen3ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen3-4B-Base: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)9.7 GB · Single GPU (<24 GB)
FP8 (1 byte/param)4.8 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)2.4 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: Qwen/Qwen3 701 derivatives on the Hub

finetune: 513quantized: 56adapter: 125merge: 7

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
unsloth/Qwen3-Embedding-4B finetune — 4.02B M apache-2.0 unsloth 4 941.3k
unsloth/Qwen3-4B-Base finetune — 4.02B M apache-2.0 unsloth 7 703.2k
Qwen/Qwen3-Embedding-4B-GGUF quantized GGUF — — apache-2.0 Qwen 143 472.3k
unsloth/Qwen3-4B-Base-unsloth-bnb-4bit quantized -bnb 4.12B M apache-2.0 unsloth 4 260.5k
tomaarsen/Qwen3-Reranker-4B-seq-cls finetune — 4.02B M apache-2.0 tomaarsen 11 78k
xuefengli/qwen3_4b_openthoughts_400k finetune — 4.02B M apache-2.0 xuefengli 0 51.4k
Mungert/Qwen3-Embedding-4B-GGUF quantized GGUF — — apache-2.0 Mungert 5 21.1k
unsloth/Qwen3-4B-Base-bnb-4bit quantized -bnb 4.14B M apache-2.0 unsloth 0 18.6k
QuantFactory/Qwen3-Reranker-4B-GGUF quantized GGUF — — apache-2.0 QuantFactory 6 16.6k
Mungert/Qwen3-Reranker-4B-GGUF quantized GGUF — — apache-2.0 Mungert 3 15.4k
mlx-community/Qwen3-Embedding-4B-mxfp8 finetune — 4.02B M apache-2.0 mlx-community 2 11k
PrimeIntellect/Qwen3-4B finetune — 4.02B M apache-2.0 PrimeIntellect 1 9.8k
Mungert/Qwen3-4B-GGUF quantized GGUF — — apache-2.0 Mungert 8 8.3k
thewimo/Qwen3-4B-AWQ quantized AWQ 4.02B M apache-2.0 thewimo 1 8.5k
AlphaGaO/Qwen3-4B-GPTQ quantized GPTQ 4.02B M apache-2.0 AlphaGaO 0 8k
mradermacher/Qwen3-4B-Base-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 2 7.9k
mozilla-ai/Qwen3-4B-llamafile finetune — — — apache-2.0 mozilla-ai 12 6.8k
konantech/Konan-LLM-OND finetune — 4.08B M apache-2.0 konantech 16 6.4k
winglian/qwen3-4b-math finetune — 4.02B M apache-2.0 winglian 0 7.1k
mlx-community/Qwen3-Reranker-4B-mxfp8 finetune — 4.02B M apache-2.0 mlx-community 2 6.3k
YixuanEvenXu/Qwen3-4B-Base-HIP-adapter adapter — — — apache-2.0 YixuanEvenXu 1 6.2k
QuantFactory/Qwen3-4B-GGUF quantized GGUF — — apache-2.0 QuantFactory 3 5.8k
mradermacher/Qwen3-4B-Base-GGUF quantized GGUF — — apache-2.0 mradermacher 2 5.8k
dengcao/Qwen3-Reranker-4B-GGUF quantized GGUF — — apache-2.0 dengcao 0 5k
HealthDataHub/PARTAGES-Qwen3-4B-PDAPT-SLERP finetune — 4.41B M apache-2.0 HealthDataHub 0 4.6k
FastFlowLM/Qwen3-4B-NPU2 finetune — — — apache-2.0 FastFlowLM 1 4.5k
SeaFill2025/Qwen3-4B-SFT finetune — 4.41B M apache-2.0 SeaFill2025 3 4.4k
Polygl0t/Tucano2-qwen-3.7B-Base finetune — 3.76B M apache-2.0 Polygl0t 1 4.5k
hardlyworking/Sugma4B finetune — 4.02B M apache-2.0 hardlyworking 0 4.6k
Thinking-Space/Qwen3-4B-Base-GRPO finetune — 4.41B M other Thinking-Space 3 3.9k
budecosystem/hex-1 finetune — 4.02B M apache-2.0 budecosystem 3 3.5k
Hastagaras/Qibil-4B-v0.1-RP finetune — 4.02B M apache-2.0 Hastagaras 0 3.6k
McGill-NLP/AfriqueQwen-4B finetune — 4.02B M cc-by-4.0 McGill-NLP 0 3.5k
chartreuse-verte/prose-rewriter-4b-v1.2 quantized GGUF 4.41B M agpl-3.0 chartreuse-verte 2 3.2k
edbeeching/Qwen3-4B-Base-SFT-tr5 finetune — 4.02B M — edbeeching 0 3.2k
michaelfeil/Qwen3-Embedding-4B-auto finetune — 4.02B M apache-2.0 michaelfeil 0 3k
cmu-lti/osim-4b-mid finetune — 4.41B M mit cmu-lti 0 2.9k
MagicCaster/crimeradar-event-merge-qwen3-4b-reasoning-20260629 finetune — 4.02B M apache-2.0 MagicCaster 0 2.8k
winglian/qwen3-4b-math-kd-jsd-temp1-v2 finetune — 4.02B M apache-2.0 winglian 0 2.5k
dnotitia/Qwen3-4B finetune — 4.02B M apache-2.0 dnotitia 0 2.5k

Repository changelog

9 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 9 commits

DateCommitSHA
2025-07-26 Create LICENSE 906bfd4
2025-05-21 Update README.md a81b894
2025-05-20 update tokenizer_config.json 0823829
2025-04-28 Update README.md ff84294
2025-04-28 Update tokenizer_config.json 08a151e
2025-04-28 Upload merges.txt 467dab3
2025-04-28 Update README.md b1ecb62
2025-04-28 Upload folder using huggingface_hub 2fcc0a0
2025-04-28 initial commit 73e143d

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Qwen3-4B-Base, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
Qwen/Qwen3-4B-Base — — — — — — — live 2026-10-25

Articles and coverage

18 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

qwenlm.github.io2025-04-28officialauthorityHN front pageabout the Qwen3 familyHN 869 pts · 388 comments2,139 words
Qwen3 introduces Hybrid Thinking Modes, allowing users to toggle between step-by-step reasoning and rapid responses via computational budget control. The open-weight MoE model Qwen3-235B-A22B achieves performance similar to dense models while using only 10% of the active parameters. Pre-training utilized approximately 36 trillion tokens across 119 languages, with deployment supported by SGLang and vLLM.written, reviewed, cited
  • Qwen3-8B and Qwen3-14B models do not use tied embeddings, unlike smaller variants.
  • The pre-training pipeline includes a final stage extending context length to 32K tokens.

Analysis9

venturebeat.com2026-02-28HN front pageabout the Qwen3 familyHN 461 pts · 272 comments
magazine.sebastianraschka.com2025-08-10authorityHN front pageabout the Qwen3 familyHN 490 pts · 97 comments5,195 words
OpenAI released gpt-oss-120b and gpt-oss-20b, their first open-weight models since GPT-2 in 2019. The 20B model can run on a consumer GPU with up to 16 GB of RAM, and the 120B model can run on a single H100 with 80 GB of RAM or newer hardware. The models utilize MXFP4 optimization to fit onto single GPUs.written, reviewed, cited
  • A 2025 research paper confirms Dropout results in worse downstream performance in single-epoch regimes.
arxiv.orgauthorityabout the Qwen3 family
magazine.sebastianraschka.comauthorityabout the Qwen3 family
interconnects.aiauthorityabout the Qwen3 family
fitmyllm.com
themoonlight.ioabout the Qwen3 family
emergentmind.com
savrn.com
All coverage tracked for this model (18) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Qwen3 Technical Report - arXivarxiv.org—2026-10-07exa
Understanding and Implementing Qwen3 From Scratchmagazine.sebastianraschka.com—2026-10-07exa
Qwen 3: The new open standard - by Nathan Lambertinterconnects.ai—2026-10-07exa
Qwen3 4B — 4B Dense LLM | FitMyLLMfitmyllm.com—2026-10-07exa
[Literature Review] Qwen3 Technical Reportthemoonlight.io—2026-10-07exa
Qwen3-4B-Base: Efficient 4B-Parameter LMemergentmind.com—2026-10-07exa
Qwen3-4B-Base by Qwen: Open-Weight Modelsavrn.com—2026-10-07exa
Qwen3 4B — pricing, benchmarks and overview 2026 · nAIvigatenaivigate.com—2026-10-07exa
Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computersventurebeat.com2026-02-282026-10-07hn
Qwen3-Coder-Nextqwen.ai official2026-02-032026-10-07hn
Qwen3-Max-Thinkingqwen.ai official2026-01-262026-10-07hn
Qwen3-TTS family is now open sourced: Voice design, clone, and generationqwen.ai official2026-01-222026-10-07hn
Qwen3-VLqwen.ai official2025-09-232026-10-07hn
Qwen3-Omni: Native Omni AI model for text, image and videogithub.com2025-09-222026-10-07hn
Qwen3-Nextqwen.ai official2025-09-122026-10-07hn
GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2magazine.sebastianraschka.com2025-08-102026-10-07hn
Qwen3-Coder: Agentic coding in the worldqwenlm.github.io official2025-07-222026-10-07hn
Qwen3: Think deeper, act fasterqwenlm.github.io official2025-04-282026-10-07hn, exa

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:03 UTC · Last verified 2026-10-25

Follow Qwen3-4B-Base

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.