Models › Qwen2.5 family

Qwen2.5-Coder-3B-Instruct

Qwen Qwen License (qwen-research) out 2 years ago

3.09B parameters, text in, text out, 32K tokens of context. 2 providers serve it from $0.010 per million input tokens.

Verified 2026-10-25 Rank #182 in LLMs · score 90.1 method v1 Sources 3 Downloads 30d 433.6k · #176 of 619 tracked

Changed this week: 1 new quantized build on the Hub (136 in all).2026-10-24 · 1 new provider: Nscale.2026-10-23

What does it cost?$0.010/1M incheapest of 1Nscale2026-10-25
Can I use it?Qwen License (qwen-research)Free below a usage thresholdlicence file2026-10-24
Do people use it?433.6kdownloads, 30 days#176 of 619 we track · top 28%+3 likes, downloads −15% this week148 likesHugging Face2026-10-24

Worth reading

Picked by rule from 29 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 164 HN pts

Qwen2.5-Coder-32B is an LLM that can code well that runs on my Mac

Alibaba released the Qwen2.5-Coder-32B-Instruct model, an Apache 2.0 licensed open-source LLM.

  • The model requires a workaround for an SSL bug when using the standard library instead of requests or httpx.
  • Running the Ollama version was too slow because the author did not have the tool compiled to use the Mac's GPU.
simonwillison.net 2024-11-13 164 HN pts · 65 comments 635 words about the Qwen2.5 family family

25 best of 29 tracked

The 4 picks above, plus these 21. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. Codekev: Jev-like model built on Qwen2.5-0.5Bgithub.com · 2026-09-19
  2. ArticleQwen2.5-VL-32B: Smarter and Lighterqwenlm.github.io · 2025-03-24 · official
  3. ArticleQwen2.5-1M: Deploy your own Qwen with context length up to 1M tokensqwenlm.github.io · 2025-01-26 · official
  4. ArticleQwen2.5: A Party of Foundation Modelsqwenlm.github.io · 2024-09-18 · 168 HN pts · official
  5. ArticleQwen2.5-Max: Exploring the intelligence of large-scale MoE modelqwenlm.github.io · 2025-01-28 · official
  6. ArticleShow HN: Fine-tuned Qwen2.5-7B on 100 films for probabilistic story graphscinegraphs.ai · 2026-02-08
  7. ArticleQwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1Msimonwillison.net · 2025-01-26
  8. ArticleQwen2.5-Coder Beats GPT-4o and Claude 3.5 Sonnet in Codingqwenlm.github.io · 2024-11-11 · 23 HN pts · official
  9. ArticleCivic-SLM is a domain-specialized fine-tune of Qwen2.5-7B for U.S. govt dataitsmeduncan.com · 2026-04-25
  10. ArticleQwen2.5-VLqwenlm.github.io · 2025-01-27 · official
  11. CodeQwen2.5-Coder-32B with coding abilities matching those of GPT-4ogithub.com · 2024-11-09 · 21 HN pts
  12. ArticleQwen2.5 Omni: See, Hear, Talk, Write, Do It Allqwenlm.github.io · 2025-03-26 · official
  13. ArticleAlibaba Qwen2.5-Omni-7B: Open Source End-to-End Multimodal AI Modelalizila.com · 2025-03-27
  14. ArticleQwen2.5-VL-32B: Smarter and Lightersimonwillison.net · 2025-03-25
  15. ArticleQwen2.5-Max: The Next Leap in AI Innovationmedium.com · 2025-01-29
  16. ArticleQwen2.5-Omni Technical Reporthuggingface.co · 2025-03-30
  17. DiscussionQwen2.5-coder on the events occurring during the Tiananmen Square protestsnews.ycombinator.com · 2024-11-20 · 7 HN pts
  18. CodeQwen2.5-VL: State-of-the-art multimodal LLMgithub.com · 2025-01-30
  19. DiscussionNew Qwen2.5-Max Outperforms DeepSeek V3 in Benchmarkstwitter.com · 2025-01-28
  20. ArticleQwen2.5-3B-Instruct Modelemergentmind.com · undated
  21. ArticleGuide how to use a local LLM Qwen2.5-coder-7B as an autocompelte in VSCodeeamag.me · 2024-10-29 · 4 HN pts

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest 2In /1MOut /1MContextQuantSeen
1 Nscale $0.010 $0.030 32K — Oct 25
2 Featherless — — — — Oct 25

All 2 providers →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 2 API providers; heavily run locally (136 quantized builds); a big base for builders (256 fine-tunes, adapters and merges).

  • As a service2Featherless, Nscale
  • On own hardware136quantized builds
  • Built on256160 fine-tunes · 90 adapters · 6 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: BoltzmannEntropy/QuantumLLMInstruct ♥ 7 · K00B404/HugChatWrap ♥ 3 · build-small-hackathon/ThreeGen ♥ 3 · build-small-hackathon/Guarden ♥ 3

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 1.9 GB at INT4, 3.7 GB at FP8, 7.4 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.9 GB of weights (estimate; KV cache and activations extra)INT41.9 GBFP8: about 3.7 GB of weights (estimate; KV cache and activations extra)FP83.7 GBBF16: about 7.4 GB of weights (estimate; KV cache and activations extra)BF167.4 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.9 GB of weights (estimate; KV cache and activations extra)INT41.9 GBFP8: about 3.7 GB of weights (estimate; KV cache and activations extra)FP83.7 GBBF16: about 7.4 GB of weights (estimate; KV cache and activations extra)BF167.4 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2024-11-06), amber triangles are 7 dated articles (each links to it), grey ticks are repo commits.

What people built on it

392 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

392 derivatives on the Hub, led by 160 fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

136 quantized (Hugging Face model tree)160 fine-tunes (Hugging Face model tree)6 merges (Hugging Face model tree)90 adapters (Hugging Face model tree)136 quantized160 fine-tunes6 merges90 adapters
136 quantized (Hugging Face model tree)160 fine-tunes (Hugging Face model tree)6 merges (Hugging Face model tree)90 adapters (Hugging Face model tree)136 quantized160 fine-tunes6 merges90 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

Qwen2.5-Coder-3B-Instruct is a 3.09B parameter causal language model designed for code-specific tasks.[1][2] It supports a context length of 32,768 tokens.[3]

  1. parameters human
  2. “Type: Causal Language Models”
  3. “Context Length: Full 32,768 tokens”

Generated 2026-10-07 15:03 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesQwen2ForCausalLM
Model typeqwen2
Dtypebfloat16
Params by dtypeBF16: 3,085,938,688
Size bandM
MoEno
Context length32,768 (config.json max_position_embeddings)
Languagesen
PapersarXiv:2409.12186, arXiv:2407.10671
LicenseQwen License (qwen-research) (other)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen2ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen2ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen2.5-Coder-3B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)7.4 GB · Single GPU (<24 GB)
FP8 (1 byte/param)3.7 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)1.9 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from Qwen/Qwen2.5-Coder-3B (same organization) Family: Qwen/Qwen2.5 392 derivatives on the Hub

Base model: Qwen/Qwen2.5-Coder-3B

quantized: 136finetune: 160adapter: 90merge: 6

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
Qwen/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other Qwen 173 798.3k
Qwen/Qwen2.5-Coder-3B-Instruct-AWQ quantized AWQ 3.40B M other Qwen 12 494.4k
unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit quantized -bnb 3.17B M apache-2.0 unsloth 8 320.4k
mlx-community/Qwen2.5-Coder-3B-Instruct-4bit quantized -4bit 3.09B M other mlx-community 6 204.8k
bartowski/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other bartowski 35 197.6k
mlc-ai/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC quantized — — — — mlc-ai 0 166.3k
unsloth/Qwen2.5-Coder-3B-Instruct finetune — 3.09B M apache-2.0 unsloth 7 72.1k
lmstudio-community/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other lmstudio-community 9 69.4k
unsloth/Qwen2.5-Coder-3B-Instruct-128K-GGUF quantized GGUF — — apache-2.0 unsloth 30 48.1k
ryzdfm/qwen2.5-coder-3b-claude_opus_4.6-distilled quantized GGUF 3.09B M apache-2.0 ryzdfm 20 41.2k
unsloth/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — apache-2.0 unsloth 21 39.7k
lmstudio-community/Qwen2.5-Coder-3B-Instruct-MLX-4bit quantized MLX 3.09B M — lmstudio-community 2 36.3k
Qwen/Qwen2.5-Coder-3B-Instruct-GPTQ-Int4 quantized GPTQ 3.09B M other Qwen 7 32.5k
katanemo/Arch-Function-3B finetune — 3.09B M other katanemo 129 22.6k
MadeAgents/Hammer2.1-3b finetune — 3.09B M other MadeAgents 22 24.1k
bocalan/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF quantized GGUF — — other bocalan 11 21.2k
4ntoine/Qwen2.5-Coder-3B-Instruct-LiteRTLM finetune — — — — 4ntoine 2 20.7k
driaforall/Tiny-Agent-a-3B quantized GGUF 3.09B M other driaforall 25 16.3k
mradermacher/Qwen2.5-Coder-3B-Instruct-i1-GGUF quantized GGUF — — other mradermacher 2 14.5k
lmstudio-community/Qwen2.5-Coder-3B-Instruct-MLX-8bit quantized MLX 3.09B M other lmstudio-community 0 14.5k
ggml-org/Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF quantized Q8_0 — — other ggml-org 4 14k
second-state/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other second-state 0 13.8k
gaianet/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other gaianet 2 12.1k
QuantFactory/Arch-Function-3B-GGUF quantized GGUF — — other QuantFactory 2 7.9k
mradermacher/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other mradermacher 1 6.8k
Elfsong/Qwen2.5-Coder-3B-Instruct-Venus-Cold-Start finetune — 3.09B M other Elfsong 0 6.7k
Qwen/Qwen2.5-Coder-3B-Instruct-GPTQ-Int8 quantized GPTQ 3.09B M other Qwen 6 5.9k
Maites/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF quantized GGUF — — other Maites 1 6k
onnx-community/Qwen2.5-Coder-3B-Instruct quantized — — — — onnx-community 6 4.9k
driaforall/Dria-Agent-a-3B finetune — 3.09B M other driaforall 54 2.4k
mlx-community/Qwen2.5-Coder-3B-Instruct-8bit quantized -8bit 3.09B M other mlx-community 3 4.5k
prithivMLmods/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — creativeml-openrail-m prithivMLmods 5 4.2k
Bojun-Feng/Qwen2.5-Coder-3B-Instruct-GGUF-llamafile finetune GGUF — — other Bojun-Feng 2 4.2k
mlc-ai/Qwen2.5-Coder-3B-Instruct-q4f32_1-MLC quantized — — — — mlc-ai 0 4.2k
exeterminal/Exe-Guard-Dynamic-GGUF quantized GGUF — — apache-2.0 exeterminal 1 4k
EchoLabs33/qwen2.5-coder-3b-hxq quantized GGUF 3.09B M apache-2.0 EchoLabs33 0 3.6k
tensorblock/Qwen2.5-Coder-3B-Instruct-GGUF quantized GGUF — — other tensorblock 1 3.3k
tthanhannguyen/qwen25-coder-3b-uncensored quantized GGUF — — apache-2.0 tthanhannguyen 3 3k
bekoozkan/godot-qwen2.5-coder-3b-instruct quantized GGUF — — apache-2.0 bekoozkan 0 3.2k
EasierAI/Qwen-2.5-Coder-3B quantized GGUF — — other EasierAI 1 2.8k

Repository changelog

16 commits
changed in the last 7 daysNew providers: 2026-10-23Other: 2026-10-24all changes

Repository changelog 16 commits

DateCommitSHA
2025-01-12 Update README.md 488639f
2024-11-18 update tokenizer_config.json,config.json,generation_config.json 89fe544
2024-11-11 update README.md 34219cc
2024-11-11 Merge branch 'main' of hf.co:Qwen/Qwen2.5-Coder-3B-Instruct d3a7bed
2024-11-11 update README.md 731372a
2024-11-11 Update README.md c1a1480
2024-11-11 update README.md 50e33ba
2024-11-11 update README.md 357ab45
2024-11-09 Update README.md 2ffd030
2024-11-09 Update generation_config.json 2038ec3
2024-11-09 Update config.json 93d7dcd
2024-11-08 Create README.md a134d81
2024-11-06 Update config.json 4083ed0
2024-11-06 Update generation_config.json fee34fb
2024-11-06 Upload folder using huggingface_hub 098f9cd
2024-11-06 initial commit b16b5ab

All providers

2 providers · 2 endpoints

Where to run 2 providers · 2 endpoints

Hosted endpoints observed for Qwen2.5-Coder-3B-Instruct, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.01/M.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Nscale
hf
Qwen/Qwen2.5-Coder-3B-Instruct 32K — $0.01 $0.03 169.3 552 ms no live 2026-10-25
Featherless
hf
Qwen/Qwen2.5-Coder-3B-Instruct — — — — — — — live 2026-10-25

Articles and coverage

29 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official2

qwenlm.github.io2024-09-18officialauthorityHN front pageabout the Qwen2.5 familyHN 168 pts · 38 comments1,744 words
Qwen2.5 introduces dense decoder-only models pretrained on up to 18 trillion tokens, available in sizes from 0.5B to 72B parameters. Most variants are licensed under Apache 2.0, excluding the 3B and 72B models, and support a 128K context window with 8K generation limits. Specialized versions for coding and mathematics offer enhanced performance on benchmarks like HumanEval and MATH.written, reviewed, cited
  • Qwen2.5-Coder-7B-Instruct outperforms many larger language models across a range of programming languages and tasks.
  • Qwen2.5-Math-72B-Instruct general performance surpasses both Qwen2-Math-72B-Instruct and GPT4-o.
qwenlm.github.io2024-11-11officialauthorityabout the Qwen2.5 familyHN 23 pts · 0 comments1,210 words

Analysis7

simonwillison.net2024-11-13authorityHN front pageabout the Qwen2.5 familyHN 164 pts · 65 comments635 words
Alibaba released the Qwen2.5-Coder-32B-Instruct model, an Apache 2.0 licensed open-source LLM. The 32B model runs on a 64GB MacBook Pro M2 via Ollama or MLX, fetching a 20GB quantized file. On MLX, it achieved 10.016 tokens-per-sec generation speed with 32.685 GB peak memory usage.written, reviewed, cited
  • The model requires a workaround for an SSL bug when using the standard library instead of requests or httpx.
  • Running the Ollama version was too slow because the author did not have the tool compiled to use the Mac's GPU.
github.com2024-11-09authorityabout the Qwen2.5 familyHN 21 pts · 6 comments1,815 words
arxiv.org2024-11-11authorityabout the Qwen2.5 familyHN 4 pts · 0 comments
emergentmind.com
emergentmind.com
llm-explorer.com
eamag.me2024-10-29about the Qwen2.5 familyHN 4 pts · 0 comments

Community1

news.ycombinator.com2024-11-20about the Qwen2.5 familyHN 7 pts · 4 comments
All coverage tracked for this model (29) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Qwen2.5-Coder-3B-Instruct: Compact Code Modelemergentmind.com—2026-10-07exa
Qwen2.5-3B-Instruct Modelemergentmind.com—2026-10-07exa
Qwen2.5 Coder 3B Instruct by Qwen — VRAM 6.2GB, 32K context | LLM Explorerllm-explorer.com—2026-10-07exa
kev: Jev-like model built on Qwen2.5-0.5Bgithub.com2026-09-192026-10-07hn
Civic-SLM is a domain-specialized fine-tune of Qwen2.5-7B for U.S. govt dataitsmeduncan.com2026-04-252026-10-07hn
Show HN: Fine-tuned Qwen2.5-7B on 100 films for probabilistic story graphscinegraphs.ai2026-02-082026-10-07hn
Qwen2.5-Omni Technical Reporthuggingface.co2025-03-302026-10-07hn
Alibaba Qwen2.5-Omni-7B: Open Source End-to-End Multimodal AI Modelalizila.com2025-03-272026-10-07hn
Qwen2.5 Omni: See, Hear, Talk, Write, Do It Allqwenlm.github.io official2025-03-262026-10-07hn
Qwen2.5-VL-32B: Smarter and Lightersimonwillison.net2025-03-252026-10-07hn
Qwen2.5-VL-32B: Smarter and Lighterqwenlm.github.io official2025-03-242026-10-07hn
Qwen2.5-Pluschat.qwenlm.ai2025-01-312026-10-07hn
Qwen2.5-VL: State-of-the-art multimodal LLMgithub.com2025-01-302026-10-07hn
Qwen2.5-Max: The Next Leap in AI Innovationmedium.com2025-01-292026-10-07hn
New Qwen2.5-Max Outperforms DeepSeek V3 in Benchmarkstwitter.com2025-01-282026-10-07hn
Qwen2.5-Max: Exploring the intelligence of large-scale MoE modelqwenlm.github.io official2025-01-282026-10-07hn
Show HN: I made a free study tool powered by Qwen2.5freeflashcardgenerator.com2025-01-282026-10-07hn
Qwen2.5-VLqwenlm.github.io official2025-01-272026-10-07hn
Qwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1Msimonwillison.net2025-01-262026-10-07hn
Qwen2.5-1M: Deploy your own Qwen with context length up to 1M tokensqwenlm.github.io official2025-01-262026-10-07hn
Qwen2.5-coder on the events occurring during the Tiananmen Square protestsnews.ycombinator.com2024-11-202026-10-07hn
Qwen2.5-Coder-32B is an LLM that can code well that runs on my Macsimonwillison.net2024-11-132026-10-07hn
Qwen2.5-Coder Technical Reportarxiv.org2024-11-112026-10-07hn
Qwen2.5 Coderollama.com2024-11-112026-10-07hn
Qwen2.5-Coder Beats GPT-4o and Claude 3.5 Sonnet in Codingqwenlm.github.io official2024-11-112026-10-07hn
Qwen2.5-Coder-32B-Instruct Review — Benchmarks, Pricing & AI Panel Verdict | TopReviewed.aitopreviewed.ai2024-11-112026-10-07exa
Qwen2.5-Coder-32B with coding abilities matching those of GPT-4ogithub.com2024-11-092026-10-07hn
Guide how to use a local LLM Qwen2.5-coder-7B as an autocompelte in VSCodeeamag.me2024-10-292026-10-07hn
Qwen2.5: A Party of Foundation Modelsqwenlm.github.io official2024-09-182026-10-07hn

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.2-3B-Instruct · 3.21B
    same size band (M), same task (text-generation), more providers
  • Llama-3.2-3B · 3.21B
    same size band (M), same task (text-generation), fewer providers
  • SmolLM3-3B · 3.08B
    same size band (M), same task (text-generation), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:03 UTC · Last verified 2026-10-25

Follow Qwen2.5-Coder-3B-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.