Models › Qwen3 family

Qwen Apache 2.0 out 18 months ago

596M parameters, text in, text out, 32K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #174 in LLMs · score 90.6 method v1 Sources 3 Downloads 30d 636.7k · #145 of 619 tracked

Changed this week: 2 new quantized builds on the Hub (96 in all).2026-10-24

Can I run it?0.4GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?636.7kdownloads, 30 days#145 of 619 we track · top 23%+6 likes, downloads −10% this week217 likesHugging Face2026-10-24

Worth reading

Picked by rule from 14 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 490 HN pts

GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2

OpenAI released gpt-oss-120b and gpt-oss-20b, their first open-weight models since GPT-2 in 2019.

  • A 2025 research paper confirms Dropout results in worse downstream performance in single-epoch regimes.
magazine.sebastianraschka.com 2025-08-10 490 HN pts · 97 comments 5.2k words about the Qwen3 family family

14 best of 14 tracked

The 3 picks above, plus these 11. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleQwen3-Coder-Nextqwen.ai · 2026-02-03 · official
  2. ArticleQwen3-Max-Thinkingqwen.ai · 2026-01-26 · official
  3. ArticleQwen3-TTS family is now open sourced: Voice design, clone, and generationqwen.ai · 2026-01-22 · official
  4. ArticleQwen3: Think deeper, act fasterqwenlm.github.io · 2025-04-28 · 869 HN pts · official
  5. ArticleQwen3-Coder: Agentic coding in the worldqwenlm.github.io · 2025-07-22 · official
  6. ArticleQwen3-Nextqwen.ai · 2025-09-12 · official
  7. ArticleQwen3-VLqwen.ai · 2025-09-23 · official
  8. CodeQwen3-Omni: Native Omni AI model for text, image and videogithub.com · 2025-09-22
  9. PaperQwen3 Technical Report - arXivarxiv.org · undated
  10. ArticleUnderstanding and Implementing Qwen3 From Scratchmagazine.sebastianraschka.com · undated
  11. ArticleQwen3 Released: How Does It Stack Up?runpod.io · undated

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; heavily run locally (96 quantized builds); a big base for builders (827 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware96quantized builds
  • Built on827735 fine-tunes · 90 adapters · 2 merges
  • In apps34Hugging Face Spaces

Top Spaces running it: dqy08/InfoLens1 ♥ 22 · Jellyfish042/Compression-Lens ♥ 4 · capacit-ai/saga2-danish-asr ♥ 4 · open-ticket-ai/queues-university-classifier-demo ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.4 GB at INT4, 0.7 GB at FP8, 1.4 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.4 GB of weights (estimate; KV cache and activations extra)INT40.4 GBFP8: about 0.7 GB of weights (estimate; KV cache and activations extra)FP80.7 GBBF16: about 1.4 GB of weights (estimate; KV cache and activations extra)BF161.4 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.4 GB of weights (estimate; KV cache and activations extra)INT40.4 GBFP8: about 0.7 GB of weights (estimate; KV cache and activations extra)FP80.7 GBBF16: about 1.4 GB of weights (estimate; KV cache and activations extra)BF161.4 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

3 dated articles and 13 repo commits so far

Teal is the weights (2025-04-28), amber triangles are 3 dated articles (each links to it), grey ticks are repo commits.

MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-07-26: 1 repo commit2025-05-21: 1 repo commit2025-05-20: 1 repo commit2025-04-28: 10 repo commitsQwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers · 2026-02-28Qwen3: Think deeper, act faster · 2025-04-28GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2 · 2025-08-10Weights 2025-04-28 · 2025-04-28Weights 2025-04-28now · 1 provider
MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-07-26: 1 repo commit2025-05-21: 1 repo commit2025-05-20: 1 repo commit2025-04-28: 10 repo commitsQwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers · 2026-02-28Qwen3: Think deeper, act faster · 2025-04-28GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2 · 2025-08-10Weights 2025-04-28 · 2025-04-28Weights 2025-04-28now · 1 provider

What people built on it

923 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

923 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

96 quantized (Hugging Face model tree)735 fine-tunes (Hugging Face model tree)2 merges (Hugging Face model tree)90 adapters (Hugging Face model tree)96 quantized735 fine-tunes2 merges90 adapters
96 quantized (Hugging Face model tree)735 fine-tunes (Hugging Face model tree)2 merges (Hugging Face model tree)90 adapters (Hugging Face model tree)96 quantized735 fine-tunes2 merges90 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The model architecture features 28 layers and supports a context length of 32,768 tokens.[1][2]

  1. “Number of Layers: 28”
  2. “Context Length: 32,768”

Generated 2026-10-07 15:03 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

5 use cases

What it is good at 5 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesQwen3ForCausalLM
Model typeqwen3
Dtypebfloat16
Params by dtypeBF16: 596,049,920
Size bandS
MoEno
Context length32,768 (config.json max_position_embeddings)
PapersarXiv:2505.09388
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen3ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen3-0.6B-Base: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)1.4 GB · Edge (<4 GB)
FP8 (1 byte/param)0.7 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.4 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: Qwen/Qwen3 923 derivatives on the Hub

finetune: 735quantized: 96adapter: 90merge: 2

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
tomaarsen/Qwen3-Reranker-0.6B-seq-cls finetune — 596M S apache-2.0 tomaarsen 39 2M
jinaai/jina-embeddings-v5-text-small finetune — 596M S cc-by-nc-4.0 jinaai 205 1.9M
PrimeIntellect/Qwen3-0.6B finetune — 752M S apache-2.0 PrimeIntellect 0 1.2M
Qwen/Qwen3-Embedding-0.6B-GGUF quantized GGUF — — apache-2.0 Qwen 587 1M
unsloth/Qwen3-0.6B-Base-unsloth-bnb-4bit quantized -bnb 609M S apache-2.0 unsloth 4 197k
unsloth/Qwen3-0.6B-Base finetune — 596M S apache-2.0 unsloth 6 162.6k
unsloth/Qwen3-Embedding-0.6B finetune — 596M S apache-2.0 unsloth 11 53.7k
unsloth/Qwen3-0.6B-Base-bnb-4bit quantized -bnb 610M S apache-2.0 unsloth 0 44k
michaelfeil/Qwen3-Embedding-0.6B-auto finetune — 596M S apache-2.0 michaelfeil 0 22.9k
Qwen/Qwen3-0.6B-MLX-4bit quantized MLX 596M S apache-2.0 Qwen 30 20.1k
Mungert/Qwen3-Reranker-0.6B-GGUF quantized GGUF — — apache-2.0 Mungert 7 16.9k
Mungert/Qwen3-Embedding-0.6B-GGUF quantized GGUF — — apache-2.0 Mungert 4 15.3k
mradermacher/Qwen3-0.6B-Base-GGUF quantized GGUF — — apache-2.0 mradermacher 3 13.7k
QuantFactory/Qwen3-0.6B-GGUF quantized GGUF — — apache-2.0 QuantFactory 6 12.3k
Qwen/Qwen3-0.6B-MLX-8bit quantized MLX 596M S apache-2.0 Qwen 9 10.8k
Qwen/Qwen3-0.6B-MLX-bf16 finetune MLX 596M S apache-2.0 Qwen 13 9.3k
Aratako/MioTTS-0.6B finetune — 609M S apache-2.0 Aratako 10 9.1k
Mungert/Qwen3-0.6B-GGUF quantized GGUF — — apache-2.0 Mungert 9 7.9k
QuantFactory/Qwen3-Reranker-0.6B-GGUF quantized GGUF — — apache-2.0 QuantFactory 3 7.4k
NOSIBLE/financial-sentiment-v1.1-base finetune — 596M S apache-2.0 NOSIBLE 3 7k
mradermacher/Qwen3-0.6B-Base-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 1 6.7k
wassname/Qwen3-0.6B-sft finetune — 596M S — wassname 0 5.6k
michaelfeil/Qwen3-Reranker-0.6B-seq finetune — 596M S apache-2.0 michaelfeil 1 5.5k
saidutta69/Qwen3-0.6B-heretic quantized GGUF 596M S apache-2.0 saidutta69 1 5.3k
mlx-community/Qwen3-Embedding-0.6B-mxfp8 finetune — 596M S apache-2.0 mlx-community 3 4.6k
electroglyph/Qwen3-Embedding-0.6B-onnx-uint8 quantized — — — apache-2.0 electroglyph 15 3.9k
NOSIBLE/financial-sentiment-v1.2-base finetune — 596M S apache-2.0 NOSIBLE 1 4.6k
onnx-community/kev-0.6b-ONNX quantized — — — apache-2.0 onnx-community 4 4.4k
vllm-sr/Decision-2.0-Kai-0.6B finetune — — — apache-2.0 vllm-sr 43 2.3k
HealthDataHub/PARTAGES-Qwen3-0.6B-PDAPT-SLERP finetune — 752M S apache-2.0 HealthDataHub 0 4.2k
mlx-community/Qwen3-Reranker-0.6B-mxfp8 finetune — 596M S apache-2.0 mlx-community 2 4.1k
mozilla-ai/Qwen3-0.6B-llamafile finetune — — — apache-2.0 mozilla-ai 5 3.9k
dnotitia/Qwen3-0.6B finetune — 752M S apache-2.0 dnotitia 0 4.1k
lunahr/CeluneNorm-0.6B-v1.1 finetune — 596M S mit lunahr 0 3.5k
sophiargh/MNLP_M2_mcqa_model finetune — 596M S apache-2.0 sophiargh 0 3.5k
occ-ai/OCC-RAG-0.6B finetune — 596M S mit occ-ai 2 3.3k
woodx/Qwen3-Embedding-0.6B-SGLang finetune — 596M S apache-2.0 woodx 0 3.3k
dengcao/Qwen3-Reranker-0.6B-GGUF quantized GGUF — — apache-2.0 dengcao 0 3.3k
brivangl/qwenar-0.6b-montevideo finetune — 1.19B S apache-2.0 brivangl 2 3.1k
Qwen/Qwen3-0.6B-MLX-6bit quantized MLX 596M S apache-2.0 Qwen 11 2.6k

Repository changelog

13 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 13 commits

DateCommitSHA
2025-07-26 Create LICENSE da87bfb
2025-05-21 Update README.md 11214f7
2025-05-20 update tokenizer_config.json 311c62e
2025-04-28 Update README.md 15c1898
2025-04-28 Upload merges.txt 57ca99e
2025-04-28 Update tokenizer_config.json 527f918
2025-04-28 Update README.md fe3e458
2025-04-28 Update README.md ddc9284
2025-04-28 Delete .mv 5352dc2
2025-04-28 Delete .msc 78b4464
2025-04-28 Delete configuration.json d466799
2025-04-28 Upload folder using huggingface_hub da05741
2025-04-28 initial commit 478df38

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Qwen3-0.6B-Base, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
Qwen/Qwen3-0.6B-Base — — — — — — — live 2026-10-25

Articles and coverage

14 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

qwenlm.github.io2025-04-28officialauthorityHN front pageabout the Qwen3 familyHN 869 pts · 388 comments2,139 words
Qwen3 introduces Hybrid Thinking Modes, allowing users to toggle between step-by-step reasoning and rapid responses via computational budget control. The open-weight MoE model Qwen3-235B-A22B achieves performance similar to dense models while using only 10% of the active parameters. Pre-training utilized approximately 36 trillion tokens across 119 languages, with deployment supported by SGLang and vLLM.written, reviewed, cited
  • Qwen3-8B and Qwen3-14B models do not use tied embeddings, unlike smaller variants.
  • The pre-training pipeline includes a final stage extending context length to 32K tokens.

Analysis6

venturebeat.com2026-02-28HN front pageabout the Qwen3 familyHN 461 pts · 272 comments
magazine.sebastianraschka.com2025-08-10authorityHN front pageabout the Qwen3 familyHN 490 pts · 97 comments5,195 words
OpenAI released gpt-oss-120b and gpt-oss-20b, their first open-weight models since GPT-2 in 2019. The 20B model can run on a consumer GPU with up to 16 GB of RAM, and the 120B model can run on a single H100 with 80 GB of RAM or newer hardware. The models utilize MXFP4 optimization to fit onto single GPUs.written, reviewed, cited
  • A 2025 research paper confirms Dropout results in worse downstream performance in single-epoch regimes.
arxiv.orgauthorityabout the Qwen3 family
magazine.sebastianraschka.comauthorityabout the Qwen3 family
q4km.ai
runpod.ioabout the Qwen3 family
All coverage tracked for this model (14) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Qwen3 Technical Report - arXivarxiv.org—2026-10-07exa
Understanding and Implementing Qwen3 From Scratchmagazine.sebastianraschka.com—2026-10-07exa
Qwen3-0.6B by Qwen - Overview, Benchmarks & Hardware | Q4KM.aiq4km.ai—2026-10-07exa
Qwen3 Released: How Does It Stack Up?runpod.io—2026-10-07exa
Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computersventurebeat.com2026-02-282026-10-07hn
Qwen3-Coder-Nextqwen.ai official2026-02-032026-10-07hn
Qwen3-Max-Thinkingqwen.ai official2026-01-262026-10-07hn
Qwen3-TTS family is now open sourced: Voice design, clone, and generationqwen.ai official2026-01-222026-10-07hn
Qwen3-VLqwen.ai official2025-09-232026-10-07hn
Qwen3-Omni: Native Omni AI model for text, image and videogithub.com2025-09-222026-10-07hn
Qwen3-Nextqwen.ai official2025-09-122026-10-07hn
GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2magazine.sebastianraschka.com2025-08-102026-10-07hn
Qwen3-Coder: Agentic coding in the worldqwenlm.github.io official2025-07-222026-10-07hn
Qwen3: Think deeper, act fasterqwenlm.github.io official2025-04-282026-10-07hn, exa

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen1.5-0.5B · 620M
    same size band (S), same task (text-generation)
  • Qwen1.5-0.5B-Chat · 620M
    same size band (S), same task (text-generation)
  • bloomz-560m · 559M
    same size band (S), same task (text-generation)

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:03 UTC · Last verified 2026-10-25

Follow Qwen3-0.6B-Base

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.