The story so far
Weights, every dated article, and repo commits on one rail.
3 dated articles and 12 repo commits so far
Teal is the weights (2024-09-17), amber triangles are 3 dated articles (each links to it), grey ticks are repo commits.
Up to date
Qwen Apache 2.0 out 2 years ago
32.8B parameters, text in, text out, 32K tokens of context. 1 provider serves it.
Verified 2026-10-25 Rank #130 in LLMs · score 94.6 method v1 Sources 3 Downloads 30d 1.3M · #97 of 619 tracked
Changed this week: 1 new quantized build on the Hub (158 in all).2026-10-24
Picked by rule from 33 tracked pieces: the lab's own post, the most shared, a field report, the latest.
The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.
| # | Cheapest live row | In /1M | Out /1M | Context | Quant | Seen |
|---|---|---|---|---|---|---|
| 1 | Featherless | — | — | — | — | Oct 25 |
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
Served by 1 API provider; heavily run locally (158 quantized builds); a big base for builders (1,480 fine-tunes, adapters and merges).
Top Spaces running it: embedl/hfviewer ♥ 181 · HuggingFaceH4/on-policy-distillation ♥ 122 · fffiloni/SkyReels-V2 ♥ 121 · Agents-MCP-Hackathon/PMCP-AgenticProjectManager ♥ 32
Weights only, an estimate: leave room for the KV cache. Method
About 20 GB at INT4, 39 GB at FP8, 79 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2024-09-17), amber triangles are 3 dated articles (each links to it), grey ticks are repo commits.
1,638 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
Qwen2.5-32B-Instruct is an instruction-tuned causal language model with 32.8B parameters.[1][2] The model architecture uses RoPE, SwiGLU, RMSNorm, and Attention QKV bias.[3] It is released under the Apache 2.0 license and supports a context length of up to 131,072 tokens.[4][5]
Generated 2026-10-07 15:02 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | text-generation |
|---|---|
| Library | transformers |
| Architectures | Qwen2ForCausalLM |
| Model type | qwen2 |
| Dtype | bfloat16 |
| Params by dtype | BF16: 32,763,876,352 |
| Size band | L |
| MoE | no |
| Context length | 32,768 (config.json max_position_embeddings) |
| Languages | en |
| Papers | arXiv:2309.00071, arXiv:2407.10671 |
| License | Apache 2.0 (apache-2.0) |
| Hub snapshot | 2026-10-25 |
vLLM: supported · Qwen2ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen2ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for Qwen2.5-32B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 79 GB · Single high-end GPU (<80 GB) |
|---|---|
| FP8 (1 byte/param) | 39 GB · Single high-end GPU (<80 GB) |
| INT4 (0.5 bytes/param) | 20 GB · Single GPU (<24 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
Base model: Qwen/Qwen2.5-32B
quantized: 158finetune: 1,214merge: 49adapter: 217
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| Qwen/Qwen2.5-32B-Instruct-AWQ | quantized | AWQ | 32.8B | L | apache-2.0 | Qwen | 111 | 15.3M |
| Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4 | quantized | GPTQ | 32.8B | L | apache-2.0 | Qwen | 51 | 5.6M |
| Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8 | quantized | GPTQ | 32.8B | L | apache-2.0 | Qwen | 21 | 2.7M |
| bartowski/Qwen2.5-32B-Instruct-GGUF | quantized | GGUF | — | — | apache-2.0 | bartowski | 90 | 1.6M |
| sugoitoolkit/Sugoi-32B-Ultra-GGUF | quantized | GGUF | — | — | apache-2.0 | sugoitoolkit | 9 | 1.2M |
| huihui-ai/Qwen2.5-32B-Instruct-abliterated | finetune | — | 32.8B | L | apache-2.0 | huihui-ai | 62 | 657.9k |
| unsloth/Qwen2.5-32B-Instruct-bnb-4bit | quantized | -bnb | 33.7B | L | apache-2.0 | unsloth | 15 | 529.1k |
| Qwen/Qwen2.5-32B-Instruct-GGUF | quantized | GGUF | — | — | apache-2.0 | Qwen | 55 | 164.2k |
| Gensyn/Qwen2.5-32B-Instruct-bnb-4bit | quantized | -bnb | 33.7B | L | apache-2.0 | Gensyn | 0 | 153.6k |
| OpenGVLab/InternVL2_5-38B | merge | — | 38.4B | XL | mit | OpenGVLab | 49 | 147.1k |
| unsloth/Qwen2.5-32B-Instruct | finetune | — | 32.8B | L | apache-2.0 | unsloth | 4 | 141.3k |
| NovaSky-AI/Sky-T1-32B-Preview | finetune | — | 32.8B | L | apache-2.0 | NovaSky-AI | 549 | 75.3k |
| simplescaling/s1.1-32B | finetune | — | 32.8B | L | apache-2.0 | simplescaling | 99 | 75.4k |
| zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-GGUF | quantized | GGUF | — | — | apache-2.0 | zetasepic | 21 | 60k |
| rombodawg/Rombos-LLM-V2.5-Qwen-32b | finetune | — | 32.8B | L | apache-2.0 | rombodawg | 62 | 51.4k |
| lmstudio-community/Qwen2.5-32B-Instruct-GGUF | quantized | GGUF | — | — | apache-2.0 | lmstudio-community | 6 | 49.3k |
| BCCard/Qwen2.5-Coder-32B-Instruct-FP8-Dynamic | quantized | -FP8 | 32.8B | L | apache-2.0 | BCCard | 0 | 36.4k |
| open-thoughts/OpenThinker2-32B | finetune | — | 32.8B | L | apache-2.0 | open-thoughts | 56 | 22.4k |
| ThomasBaruzier/QwQ-32B-Preview-GGUF | quantized | GGUF | — | — | apache-2.0 | ThomasBaruzier | 1 | 24.6k |
| open-thoughts/OpenThinker-32B | finetune | — | 32.8B | L | apache-2.0 | open-thoughts | 177 | 14.7k |
| legraphista/Qwen2.5-32B-Instruct-IMat-GGUF | quantized | GGUF | — | — | apache-2.0 | legraphista | 0 | 23.5k |
| Multiverse4FM/Multiverse-32B | finetune | — | 32.8B | L | apache-2.0 | Multiverse4FM | 10 | 19.4k |
| AiCloser/Qwen2.5-32B-AGI | finetune | — | 32.8B | L | apache-2.0 | AiCloser | 106 | 12.4k |
| EasierAI/Qwen-2.5-32B | quantized | GGUF | — | — | apache-2.0 | EasierAI | 1 | 15.5k |
| lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit | quantized | MLX | 32.8B | L | apache-2.0 | lmstudio-community | 3 | 14.9k |
| elyza/ELYZA-Thinking-1.0-Qwen-32B | finetune | — | 32.8B | L | apache-2.0 | elyza | 11 | 14k |
| mradermacher/Qwen2.5-32B-Instruct-GGUF | quantized | GGUF | — | — | apache-2.0 | mradermacher | 0 | 14.4k |
| abeja/ABEJA-Qwen2.5-32b-Japanese-v1.0 | finetune | — | 32.8B | L | apache-2.0 | abeja | 6 | 14k |
| AXCXEPT/EZO-Qwen2.5-32B-Instruct | finetune | — | 32.8B | L | apache-2.0 | AXCXEPT | 10 | 13.3k |
| zetasepic/Qwen2.5-32B-Instruct-abliterated-v2 | finetune | — | 32.8B | L | apache-2.0 | zetasepic | 17 | 11.8k |
| nvidia/OpenCodeReasoning-Nemotron-32B | finetune | — | 32.8B | L | apache-2.0 | nvidia | 76 | 8.7k |
| tanliboy/lambda-qwen2.5-32b-dpo-test | finetune | — | 32.8B | L | apache-2.0 | tanliboy | 5 | 12.2k |
| qihoo360/Light-R1-32B | finetune | — | 32.8B | L | apache-2.0 | qihoo360 | 90 | 7.4k |
| second-state/Qwen2.5-32B-Instruct-GGUF | quantized | GGUF | — | — | apache-2.0 | second-state | 0 | 11.8k |
| abeja/ABEJA-Qwen2.5-32b-Japanese-v0.1 | finetune | — | 32.8B | L | apache-2.0 | abeja | 11 | 11.2k |
| rinna/qwen2.5-bakeneko-32b-instruct | merge | — | 32.8B | L | apache-2.0 | rinna | 7 | 10.9k |
| gaianet/Qwen2.5-32B-Instruct-GGUF | quantized | GGUF | — | — | apache-2.0 | gaianet | 0 | 10.7k |
| TheRains/Qwen2.5-32B-Instruct-Q4_K_M-GGUF | quantized | GGUF | — | — | apache-2.0 | TheRains | 1 | 10.2k |
| shengjia-toronto/ssft-32B-N6 | finetune | — | 4.10B | M | apache-2.0 | shengjia-toronto | 0 | 10k |
| lmstudio-community/Qwen2.5-32B-Instruct-MLX-8bit | quantized | MLX | 32.8B | L | apache-2.0 | lmstudio-community | 1 | 9.7k |
| Date | Commit | SHA |
|---|---|---|
| 2024-09-25 | Update metadata: Add library_name to Transformers (#3) | 5ede1c9 |
| 2024-09-19 | Upload ./tokenizer_config.json with huggingface_hub | 70e8dfb |
| 2024-09-18 | update README & LICENSE | afb2829 |
| 2024-09-18 | Create LICENSE | 2d46b72 |
| 2024-09-18 | update config.json | e470900 |
| 2024-09-18 | Update tokenizer_config.json | a7e76d7 |
| 2024-09-17 | Update README.md | 7813703 |
| 2024-09-17 | Update README.md | b6add0f |
| 2024-09-17 | Update README.md | 4dff1cc |
| 2024-09-17 | Create README.md | 7af94c6 |
| 2024-09-17 | Upload folder using huggingface_hub | 59eaef4 |
| 2024-09-17 | initial commit | c316a11 |
Hosted endpoints observed for Qwen2.5-32B-Instruct, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.
| Provider | Model ref | Context | Quant | $/M in | $/M out | tok/s | TTFT | Tools | Status | Observed |
|---|---|---|---|---|---|---|---|---|---|---|
| Featherless hf | Qwen/Qwen2.5-32B-Instruct | — | — | — | — | — | — | — | live | 2026-10-25 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:02 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.