Models › Qwen2.5 family

Qwen2.5-32B-Instruct

Qwen Apache 2.0 out 2 years ago

32.8B parameters, text in, text out, 32K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #130 in LLMs · score 94.6 method v1 Sources 3 Downloads 30d 1.3M · #97 of 619 tracked

Changed this week: 1 new quantized build on the Hub (158 in all).2026-10-24

Can I run it?20GB at INT4Estimatefits a 24 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?1.3Mdownloads, 30 days#97 of 619 we track · top 16%+3 likes, downloads −16% this week373 likesHugging Face2026-10-24

Worth reading

Picked by rule from 33 tracked pieces: the lab's own post, the most shared, a field report, the latest.

25 best of 33 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. Codekev: Jev-like model built on Qwen2.5-0.5Bgithub.com · 2026-09-19
  2. ArticleQwen2.5-VL-32B: Smarter and Lighterqwenlm.github.io · 2025-03-24 · official
  3. ArticleQwen2.5-1M: Deploy your own Qwen with context length up to 1M tokensqwenlm.github.io · 2025-01-26 · official
  4. ArticleQwen2.5: A Party of Foundation Modelsqwenlm.github.io · 2024-09-18 · 168 HN pts · official
  5. ArticleQwen2.5-Max: Exploring the intelligence of large-scale MoE modelqwenlm.github.io · 2025-01-28 · official
  6. ArticleQwen2.5-Coder-32B is an LLM that can code well that runs on my Macsimonwillison.net · 2024-11-13
  7. ArticleShow HN: Fine-tuned Qwen2.5-7B on 100 films for probabilistic story graphscinegraphs.ai · 2026-02-08
  8. ArticleQwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1Msimonwillison.net · 2025-01-26
  9. PaperQwen2.5 Technical Reportarxiv.org · undated
  10. Paper[2409.12186] Qwen2.5-Coder Technical Report - ar5iv - arXivar5iv.labs.arxiv.org · undated
  11. ArticleQwen2.5-Coder Beats GPT-4o and Claude 3.5 Sonnet in Codingqwenlm.github.io · 2024-11-11 · official
  12. ArticleCivic-SLM is a domain-specialized fine-tune of Qwen2.5-7B for U.S. govt dataitsmeduncan.com · 2026-04-25
  13. ArticleQwen2.5-VLqwenlm.github.io · 2025-01-27 · official
  14. CodeQwen2.5-Coder-32B with coding abilities matching those of GPT-4ogithub.com · 2024-11-09
  15. ArticleQwen2.5 Omni: See, Hear, Talk, Write, Do It Allqwenlm.github.io · 2025-03-26 · official
  16. ArticleAlibaba Qwen2.5-Omni-7B: Open Source End-to-End Multimodal AI Modelalizila.com · 2025-03-27
  17. ArticleQwen2.5-VL-32B: Smarter and Lightersimonwillison.net · 2025-03-25
  18. ArticleQwen2.5-Max: The Next Leap in AI Innovationmedium.com · 2025-01-29
  19. ArticleQwen2.5-Omni Technical Reporthuggingface.co · 2025-03-30
  20. PaperQwen2.5-Coder Technical Reportarxiv.org · 2024-11-11
  21. DiscussionQwen2.5-coder on the events occurring during the Tiananmen Square protestsnews.ycombinator.com · 2024-11-20
  22. CodeQwen2.5-VL: State-of-the-art multimodal LLMgithub.com · 2025-01-30
  23. DiscussionNew Qwen2.5-Max Outperforms DeepSeek V3 in Benchmarkstwitter.com · 2025-01-28

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; heavily run locally (158 quantized builds); a big base for builders (1,480 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware158quantized builds
  • Built on1,4801,214 fine-tunes · 217 adapters · 49 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: embedl/hfviewer ♥ 181 · HuggingFaceH4/on-policy-distillation ♥ 122 · fffiloni/SkyReels-V2 ♥ 121 · Agents-MCP-Hackathon/PMCP-AgenticProjectManager ♥ 32

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 64 GB Mac (unified memory) at INT4

About 20 GB at INT4, 39 GB at FP8, 79 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 20 GB of weights (estimate; KV cache and activations extra)INT420 GBFP8: about 39 GB of weights (estimate; KV cache and activations extra)FP839 GBBF16: about 79 GB of weights (estimate; KV cache and activations extra)BF1679 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 20 GB of weights (estimate; KV cache and activations extra)INT420 GBFP8: about 39 GB of weights (estimate; KV cache and activations extra)FP839 GBBF16: about 79 GB of weights (estimate; KV cache and activations extra)BF1679 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

3 dated articles and 12 repo commits so far

Teal is the weights (2024-09-17), amber triangles are 3 dated articles (each links to it), grey ticks are repo commits.

OctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2024-09-25: 1 repo commit2024-09-19: 1 repo commit2024-09-18: 4 repo commits2024-09-17: 6 repo commitsQwen2.5: A Party of Foundation Models · 2024-09-18Show HN: IttyBittyAI – Qwen2.5:0.5B running on a 2017 Asus smartphone · 2026-09-24Show HN: I made a free study tool powered by Qwen2.5 · 2025-01-28Weights 2024-09-17 · 2024-09-17Weights 2024-09-17now · 1 provider
OctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2024-09-25: 1 repo commit2024-09-19: 1 repo commit2024-09-18: 4 repo commits2024-09-17: 6 repo commitsQwen2.5: A Party of Foundation Models · 2024-09-18Show HN: IttyBittyAI – Qwen2.5:0.5B running on a 2017 Asus smartphone · 2026-09-24Show HN: I made a free study tool powered by Qwen2.5 · 2025-01-28Weights 2024-09-17 · 2024-09-17Weights 2024-09-17now · 1 provider

What people built on it

1,638 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

1,638 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

158 quantized (Hugging Face model tree)1,214 fine-tunes (Hugging Face model tree)49 merges (Hugging Face model tree)217 adapters (Hugging Face model tree)158 quantized1,214 fine-tunes49 merges217 adapters
158 quantized (Hugging Face model tree)1,214 fine-tunes (Hugging Face model tree)49 merges (Hugging Face model tree)217 adapters (Hugging Face model tree)158 quantized1,214 fine-tunes49 merges217 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

3 cited sentences

Summary generated, cited

Qwen2.5-32B-Instruct is an instruction-tuned causal language model with 32.8B parameters.[1][2] The model architecture uses RoPE, SwiGLU, RMSNorm, and Attention QKV bias.[3] It is released under the Apache 2.0 license and supports a context length of up to 131,072 tokens.[4][5]

  1. parameters human
  2. “Type: Causal Language Models”
  3. “Architecture: transformers with RoPE, SwiGLU, RMSNorm, an…”
  4. license
  5. “Context Length: Full 131,072 tokens”

Generated 2026-10-07 15:02 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesQwen2ForCausalLM
Model typeqwen2
Dtypebfloat16
Params by dtypeBF16: 32,763,876,352
Size bandL
MoEno
Context length32,768 (config.json max_position_embeddings)
Languagesen
PapersarXiv:2309.00071, arXiv:2407.10671
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen2ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen2ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen2.5-32B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)79 GB · Single high-end GPU (<80 GB)
FP8 (1 byte/param)39 GB · Single high-end GPU (<80 GB)
INT4 (0.5 bytes/param)20 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from Qwen/Qwen2.5-32B (same organization) Family: Qwen/Qwen2.5 1,638 derivatives on the Hub

Base model: Qwen/Qwen2.5-32B

quantized: 158finetune: 1,214merge: 49adapter: 217

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
Qwen/Qwen2.5-32B-Instruct-AWQ quantized AWQ 32.8B L apache-2.0 Qwen 111 15.3M
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4 quantized GPTQ 32.8B L apache-2.0 Qwen 51 5.6M
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8 quantized GPTQ 32.8B L apache-2.0 Qwen 21 2.7M
bartowski/Qwen2.5-32B-Instruct-GGUF quantized GGUF — — apache-2.0 bartowski 90 1.6M
sugoitoolkit/Sugoi-32B-Ultra-GGUF quantized GGUF — — apache-2.0 sugoitoolkit 9 1.2M
huihui-ai/Qwen2.5-32B-Instruct-abliterated finetune — 32.8B L apache-2.0 huihui-ai 62 657.9k
unsloth/Qwen2.5-32B-Instruct-bnb-4bit quantized -bnb 33.7B L apache-2.0 unsloth 15 529.1k
Qwen/Qwen2.5-32B-Instruct-GGUF quantized GGUF — — apache-2.0 Qwen 55 164.2k
Gensyn/Qwen2.5-32B-Instruct-bnb-4bit quantized -bnb 33.7B L apache-2.0 Gensyn 0 153.6k
OpenGVLab/InternVL2_5-38B merge — 38.4B XL mit OpenGVLab 49 147.1k
unsloth/Qwen2.5-32B-Instruct finetune — 32.8B L apache-2.0 unsloth 4 141.3k
NovaSky-AI/Sky-T1-32B-Preview finetune — 32.8B L apache-2.0 NovaSky-AI 549 75.3k
simplescaling/s1.1-32B finetune — 32.8B L apache-2.0 simplescaling 99 75.4k
zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-GGUF quantized GGUF — — apache-2.0 zetasepic 21 60k
rombodawg/Rombos-LLM-V2.5-Qwen-32b finetune — 32.8B L apache-2.0 rombodawg 62 51.4k
lmstudio-community/Qwen2.5-32B-Instruct-GGUF quantized GGUF — — apache-2.0 lmstudio-community 6 49.3k
BCCard/Qwen2.5-Coder-32B-Instruct-FP8-Dynamic quantized -FP8 32.8B L apache-2.0 BCCard 0 36.4k
open-thoughts/OpenThinker2-32B finetune — 32.8B L apache-2.0 open-thoughts 56 22.4k
ThomasBaruzier/QwQ-32B-Preview-GGUF quantized GGUF — — apache-2.0 ThomasBaruzier 1 24.6k
open-thoughts/OpenThinker-32B finetune — 32.8B L apache-2.0 open-thoughts 177 14.7k
legraphista/Qwen2.5-32B-Instruct-IMat-GGUF quantized GGUF — — apache-2.0 legraphista 0 23.5k
Multiverse4FM/Multiverse-32B finetune — 32.8B L apache-2.0 Multiverse4FM 10 19.4k
AiCloser/Qwen2.5-32B-AGI finetune — 32.8B L apache-2.0 AiCloser 106 12.4k
EasierAI/Qwen-2.5-32B quantized GGUF — — apache-2.0 EasierAI 1 15.5k
lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit quantized MLX 32.8B L apache-2.0 lmstudio-community 3 14.9k
elyza/ELYZA-Thinking-1.0-Qwen-32B finetune — 32.8B L apache-2.0 elyza 11 14k
mradermacher/Qwen2.5-32B-Instruct-GGUF quantized GGUF — — apache-2.0 mradermacher 0 14.4k
abeja/ABEJA-Qwen2.5-32b-Japanese-v1.0 finetune — 32.8B L apache-2.0 abeja 6 14k
AXCXEPT/EZO-Qwen2.5-32B-Instruct finetune — 32.8B L apache-2.0 AXCXEPT 10 13.3k
zetasepic/Qwen2.5-32B-Instruct-abliterated-v2 finetune — 32.8B L apache-2.0 zetasepic 17 11.8k
nvidia/OpenCodeReasoning-Nemotron-32B finetune — 32.8B L apache-2.0 nvidia 76 8.7k
tanliboy/lambda-qwen2.5-32b-dpo-test finetune — 32.8B L apache-2.0 tanliboy 5 12.2k
qihoo360/Light-R1-32B finetune — 32.8B L apache-2.0 qihoo360 90 7.4k
second-state/Qwen2.5-32B-Instruct-GGUF quantized GGUF — — apache-2.0 second-state 0 11.8k
abeja/ABEJA-Qwen2.5-32b-Japanese-v0.1 finetune — 32.8B L apache-2.0 abeja 11 11.2k
rinna/qwen2.5-bakeneko-32b-instruct merge — 32.8B L apache-2.0 rinna 7 10.9k
gaianet/Qwen2.5-32B-Instruct-GGUF quantized GGUF — — apache-2.0 gaianet 0 10.7k
TheRains/Qwen2.5-32B-Instruct-Q4_K_M-GGUF quantized GGUF — — apache-2.0 TheRains 1 10.2k
shengjia-toronto/ssft-32B-N6 finetune — 4.10B M apache-2.0 shengjia-toronto 0 10k
lmstudio-community/Qwen2.5-32B-Instruct-MLX-8bit quantized MLX 32.8B L apache-2.0 lmstudio-community 1 9.7k

Repository changelog

12 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 12 commits

DateCommitSHA
2024-09-25 Update metadata: Add library_name to Transformers (#3) 5ede1c9
2024-09-19 Upload ./tokenizer_config.json with huggingface_hub 70e8dfb
2024-09-18 update README & LICENSE afb2829
2024-09-18 Create LICENSE 2d46b72
2024-09-18 update config.json e470900
2024-09-18 Update tokenizer_config.json a7e76d7
2024-09-17 Update README.md 7813703
2024-09-17 Update README.md b6add0f
2024-09-17 Update README.md 4dff1cc
2024-09-17 Create README.md 7af94c6
2024-09-17 Upload folder using huggingface_hub 59eaef4
2024-09-17 initial commit c316a11

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Qwen2.5-32B-Instruct, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
Qwen/Qwen2.5-32B-Instruct — — — — — — — live 2026-10-25

Articles and coverage

33 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

qwenlm.github.io2024-09-18officialauthorityHN front pageabout the Qwen2.5 familyHN 168 pts · 38 comments1,744 words
Qwen2.5 introduces dense decoder-only models pretrained on up to 18 trillion tokens, available in sizes from 0.5B to 72B parameters. Most variants are licensed under Apache 2.0, excluding the 3B and 72B models, and support a 128K context window with 8K generation limits. Specialized versions for coding and mathematics offer enhanced performance on benchmarks like HumanEval and MATH.written, reviewed, cited
  • Qwen2.5-Coder-7B-Instruct outperforms many larger language models across a range of programming languages and tasks.
  • Qwen2.5-Math-72B-Instruct general performance surpasses both Qwen2-Math-72B-Instruct and GPT4-o.

Analysis7

arxiv.orgauthorityabout the Qwen2.5 family16,080 words
topreviewed.ai
llm-stats.com
deepranking.ai
savrn.com
emergentmind.com
freeflashcardgenerator.com2025-01-28about the Qwen2.5 familyHN 3 pts · 0 comments

Community1

news.ycombinator.com2026-09-24about the Qwen2.5 familyHN 2 pts · 0 comments494 words
All coverage tracked for this model (33) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Qwen2.5 Technical Reportarxiv.org—2026-10-07exa
[2409.12186] Qwen2.5-Coder Technical Report - ar5iv - arXivar5iv.labs.arxiv.org—2026-10-07exa
Qwen2.5-32B-Instruct Review — Benchmarks, Pricing & AI Panel Verdict | TopReviewed.aitopreviewed.ai—2026-10-07exa
Qwen2.5 32B Instruct Benchmarks, Pricing & Context Windowllm-stats.com—2026-10-07exa
LLM Model: Qwen2.5 32B Instruct by Qwen | Deepranking.aideepranking.ai—2026-10-07exa
Qwen2.5-32B-Instruct by Qwen: Open-Weight Modelsavrn.com—2026-10-07exa
Qwen-2.5-32B-Instruct Model Overviewemergentmind.com—2026-10-07exa
Show HN: IttyBittyAI – Qwen2.5:0.5B running on a 2017 Asus smartphonenews.ycombinator.com2026-09-242026-10-07hn
kev: Jev-like model built on Qwen2.5-0.5Bgithub.com2026-09-192026-10-07hn
Civic-SLM is a domain-specialized fine-tune of Qwen2.5-7B for U.S. govt dataitsmeduncan.com2026-04-252026-10-07hn
Show HN: Fine-tuned Qwen2.5-7B on 100 films for probabilistic story graphscinegraphs.ai2026-02-082026-10-07hn
Qwen2.5-Omni Technical Reporthuggingface.co2025-03-302026-10-07hn
Alibaba Qwen2.5-Omni-7B: Open Source End-to-End Multimodal AI Modelalizila.com2025-03-272026-10-07hn
Qwen2.5 Omni: See, Hear, Talk, Write, Do It Allqwenlm.github.io official2025-03-262026-10-07hn
Qwen2.5-VL-32B: Smarter and Lightersimonwillison.net2025-03-252026-10-07hn
Qwen2.5-VL-32B: Smarter and Lighterqwenlm.github.io official2025-03-242026-10-07hn
Qwen2.5-Pluschat.qwenlm.ai2025-01-312026-10-07hn
Qwen2.5-VL: State-of-the-art multimodal LLMgithub.com2025-01-302026-10-07hn
Qwen2.5-Max: The Next Leap in AI Innovationmedium.com2025-01-292026-10-07hn
New Qwen2.5-Max Outperforms DeepSeek V3 in Benchmarkstwitter.com2025-01-282026-10-07hn
Qwen2.5-Max: Exploring the intelligence of large-scale MoE modelqwenlm.github.io official2025-01-282026-10-07hn
Show HN: I made a free study tool powered by Qwen2.5freeflashcardgenerator.com2025-01-282026-10-07hn
Qwen2.5-VLqwenlm.github.io official2025-01-272026-10-07hn
Qwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1Msimonwillison.net2025-01-262026-10-07hn
Qwen2.5-1M: Deploy your own Qwen with context length up to 1M tokensqwenlm.github.io official2025-01-262026-10-07hn
Qwen2.5-coder on the events occurring during the Tiananmen Square protestsnews.ycombinator.com2024-11-202026-10-07hn
Qwen2.5-Coder-32B is an LLM that can code well that runs on my Macsimonwillison.net2024-11-132026-10-07hn
Qwen2.5-Coder Technical Reportarxiv.org2024-11-112026-10-07hn
Qwen2.5 Coderollama.com2024-11-112026-10-07hn
Qwen2.5-Coder Beats GPT-4o and Claude 3.5 Sonnet in Codingqwenlm.github.io official2024-11-112026-10-07hn
Qwen2.5-Coder-32B with coding abilities matching those of GPT-4ogithub.com2024-11-092026-10-07hn
Guide how to use a local LLM Qwen2.5-coder-7B as an autocompelte in VSCodeeamag.me2024-10-292026-10-07hn
Qwen2.5: A Party of Foundation Modelsqwenlm.github.io official2024-09-182026-10-07hn

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-32B · 32.8B
    same size band (L), same task (text-generation), more providers, permissive license
  • DeepSeek-R1-Distill-Qwen-32B · 32.8B
    same size band (L), same task (text-generation), more providers, permissive license
  • QwQ-32B · 32.8B
    same size band (L), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:02 UTC · Last verified 2026-10-25

Follow Qwen2.5-32B-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.