Models › Qwen3.5 family

Qwen3.5-0.8B-Base

Qwen Apache 2.0 out 8 months ago

873M parameters, images and text in, text out, 256K tokens of context.

Verified 2026-10-25 Rank #439 in LLMs · score 78.3 method v1 Sources 3 Downloads 30d 475.1k · #167 of 619 tracked

Changed this week: 3 new quantized builds on the Hub (54 in all).2026-10-24

Can I run it?0.5GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?475.1kdownloads, 30 days#167 of 619 we track · top 27%+9 likes, downloads +0% this week132 likesHugging Face2026-10-24

Worth reading

Picked by rule from 24 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 463 HN pts

Kev: Tiny Jev-like family of decision models built on top of Qwen3.5

Kev is a family of small decision models built on Qwen3.5 and Qwen3.8 that you can train and run locally.

  • The Kev-27B model requires 96–128 GB of RAM on Macs, a requirement marked as expected but not measured.
  • An explicitly requested accelerator fails instead of falling back if the probe times out or crashes.
github.com 2026-09-21 463 HN pts · 210 comments 6.7k words about the Qwen3.5 family family
Latest · 21 days ago

Full-fabric VHDL LLM inference engine. Runs Qwen3.5-class transformer inference

llm.vhdl is a full-fabric VHDL inference engine for Qwen3.5-class models on Xilinx XCVU33P and XCVU35P FPGAs using INT4 streaming matvecs and HBM-resident weights.

  • Reconfiguring the FPGA tears the PCIe bus down and rescans it, which can hang the host if a transaction faults.
  • The inter-die link for the two-die residual hand-off cannot come up because the carrier's refclk oscillator sites are unpopulated.
github.com 2026-10-04 2 HN pts 1.6k words about the Qwen3.5 family family

24 best of 24 tracked

The 2 picks above, plus these 22. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleFixed three bugs that made Qwen3.5-122B a daily driver on Mac Studiomrzk.io · 2026-07-11
  2. CodeWe got 207 tok/s with Qwen3.5-27B on an RTX 3090github.com · 2026-04-20
  3. ArticleQwen3.5: Towards Native Multimodal Agentsqwen.ai · 2026-02-16 · 434 HN pts · official
  4. ArticleQwen3.5 Fine-Tuning Guideunsloth.ai · 2026-03-04 · 416 HN pts
  5. ArticleMacBook M5 Pro and Qwen3.5 = Local AI Security Systemsharpai.org · 2026-03-20 · 173 HN pts
  6. ArticleQwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computersventurebeat.com · 2026-02-28
  7. ArticlePewDiePie uncensors Qwen3.5-9B with Heretictomshardware.com · 2026-10-02
  8. ArticleQwen3.5-Omniqwen.ai · 2026-03-30 · official
  9. DiscussionLaguna S 2.1:118B-a9B better than Qwen3.5:122B-a10B? So far, yesnews.ycombinator.com · 2026-08-06 · 4 HN pts
  10. PaperQwen3.5-Omni Technical Reportarxiv.org · 2026-04-22
  11. ArticleShow HN: Moe Routing Atlas – which experts fire in Qwen3.5/3.6 35B-A3Bgslaller.github.io · 2026-09-29 · 2 HN pts
  12. DiscussionQwen3.5 50% expert reduction successnews.ycombinator.com · 2026-04-16 · 7 HN pts
  13. ArticleQwen3.5 GGUF Benchmarksunsloth.ai · 2026-02-28 · 5 HN pts
  14. ArticleAsking Qwen3.5-9B, running on 16GB VRAM, to exploit old Windows machinesthepatrickfisher.com · 2026-04-25
  15. CodeQwen3.5-35B – 16GB GPU – 100T/s with 120K context AND vision enabledgithub.com · 2026-03-06
  16. DiscussionShow HN: I ran Qwen3.5 35B on my iPhone at 5.6 tok/SECtwitter.com · 2026-03-21
  17. CodeQwen3.5github.com · 2026-02-16 · 5 HN pts
  18. ArticleShow HN: llamafile 0.10.0 rebuilt, Qwen3.5, lfm2, Anthropic APIblog.mozilla.ai · 2026-03-19
  19. CodeAdding Support for Qwen3.5github.com · 2026-02-09
  20. ArticleAI on a Budget: Recompiling Llama.cpp for Qwen3.5 Inference on an HP Z440jeanbaptistefleury.neocities.org · 2026-03-10
  21. ArticleAre Local LLMs Good Enough for Vibe Coding? Gemma4-26B-A4B vs. Qwen3.5-35B-A3Bgrigio.org · 2026-04-07
  22. ArticleUnlocking LoRA Moe RL for Qwen3.5osmosis.ai · 2026-04-03

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 54 quantized builds and 20 Spaces.

  • As a service0no API provider listed
  • On own hardware54quantized builds
  • Built on208148 fine-tunes · 59 adapters · 1 merges
  • In apps20Hugging Face Spaces

Top Spaces running it: jaredpalmer/kev ♥ 93 · dqy08/InfoLens1 ♥ 22 · Girlz/TokenTrace ♥ 1 · MahmoudGhraibeh/kev-decisions ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.5 GB at INT4, 1.0 GB at FP8, 2.1 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.5 GB of weights (estimate; KV cache and activations extra)INT40.5 GBFP8: about 1.0 GB of weights (estimate; KV cache and activations extra)FP81.0 GBBF16: about 2.1 GB of weights (estimate; KV cache and activations extra)BF162.1 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.5 GB of weights (estimate; KV cache and activations extra)INT40.5 GBFP8: about 1.0 GB of weights (estimate; KV cache and activations extra)FP81.0 GBBF16: about 2.1 GB of weights (estimate; KV cache and activations extra)BF162.1 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 9 repo commits so far

Teal is the weights (2026-02-28), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

262 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

262 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

54 quantized (Hugging Face model tree)148 fine-tunes (Hugging Face model tree)1 merge (Hugging Face model tree)59 adapters (Hugging Face model tree)54 quantized148 fine-tunes1 merge59 adapters
54 quantized (Hugging Face model tree)148 fine-tunes (Hugging Face model tree)1 merge (Hugging Face model tree)59 adapters (Hugging Face model tree)54 quantized148 fine-tunes1 merge59 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

Qwen3.5-0.8B-Base is an 873M parameter image-text-to-text model designed for fine-tuning and research purposes.[1][2][3] The architecture is a causal language model with a vision encoder released under the Apache 2.0 license.[4][5]

  1. parameters human
  2. pipeline tag
  3. “intended use cases are fine-tuning, in-context learning e…”
  4. “Type: Causal Language Model with Vision Encoder”
  5. license

Generated 2026-10-07 15:11 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesQwen3_5ForConditionalGeneration
Model typeqwen3_5
Dtypebfloat16
Params by dtypeBF16: 873,436,192 · F32: 2,592
Size bandS
MoEno
Context length262,144 (config.json max_position_embeddings)
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen3_5ForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen3_5ForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen3.5-0.8B-Base: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)2.1 GB · Edge (<4 GB)
FP8 (1 byte/param)1.0 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.5 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: Qwen/Qwen3.5 262 derivatives on the Hub

quantized: 54finetune: 148adapter: 59merge: 1

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
mlx-community/Qwen3.5-0.8B-8bit quantized -8bit 853M S apache-2.0 mlx-community 2 79.4k
unsloth/Qwen3.5-0.8B-Base finetune — 853M S apache-2.0 unsloth 3 58.7k
mlx-community/Qwen3.5-0.8B-4bit quantized -4bit 853M S apache-2.0 mlx-community 4 34.4k
Mapika/decider-0.8b finetune — 752M S apache-2.0 Mapika 8 16.7k
iapp/OpenThai-SystemOne finetune — 753M S apache-2.0 iapp 37 12.2k
nineninesix/qwen3_5-full-attn-only-14 finetune — 511M S apache-2.0 nineninesix 0 13.9k
SeerRay-Lab/Xiaomi-OCR-0 finetune — 873M S apache-2.0 SeerRay-Lab 52 10.6k
mlx-community/Qwen3.5-0.8B-6bit quantized — 853M S apache-2.0 mlx-community 0 8.9k
voodooquant/Qwen3.5-0.8B-MTP-Voodoo quantized GGUF — — apache-2.0 voodooquant 2 8.8k
mradermacher/Qwen3.5-0.8B-Base-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 0 8.1k
surogate/Qwen3.5-0.8B-FP8 quantized -FP8 853M S apache-2.0 surogate 1 7.9k
titan0115/Qwen3.5-0.8B-Base quantized GGUF — — — titan0115 0 7.7k
Mungert/Qwen3.5-0.8B-GGUF quantized GGUF — — apache-2.0 Mungert 0 6.8k
ggml-org/Qwen3.5-0.8B-Base-GGUF quantized GGUF — — apache-2.0 ggml-org 6 4.9k
mlx-community/Qwen3.5-0.8B-bf16 finetune -bf16 853M S apache-2.0 mlx-community 0 5k
ZuzeTt/Qwen3.5-0.8B-imatrix-GGUF quantized imatrix — — apache-2.0 ZuzeTt 0 3.7k
FastFlowLM/Qwen3.5-0.8B-NPU2 finetune — — — apache-2.0 FastFlowLM 1 3.4k
mradermacher/Qwen3.5-0.8B-Base-GGUF quantized GGUF — — apache-2.0 mradermacher 0 3.1k
mithulaartigala/reasoning-summarizer-qwen3.5-0.8b-preview finetune — 752M S apache-2.0 mithulaartigala 13 2.2k
cooperdk/BooruNL-0.8B-GGUF quantized GGUF — — apache-2.0 cooperdk 0 2.5k
kaptaan45/QaptaanLM-0.75B finetune — 752M S apache-2.0 kaptaan45 0 2.4k
huggingworld/Qwen3.5-0.8B-ONNX quantized — — — apache-2.0 huggingworld 2 2.1k
cooperdk/BooruNL-0.8B finetune — 853M S apache-2.0 cooperdk 1 2k
OmniJev/PlayJev-0.8B finetune — 1.11B S apache-2.0 OmniJev 2 1.7k
NamanAgnih0tri/AlphaRoute-0.8B-v1.0 finetune — 752M S apache-2.0 NamanAgnih0tri 2 1.7k
mlx-community/Qwen3.5-0.8B-5bit quantized — 853M S apache-2.0 mlx-community 0 1.6k
jaweed123/Qwen3.5-0.8B-Python-SFT quantized GGUF 752M S apache-2.0 jaweed123 0 1.6k
harshitsiwach/qwen-3.5-0.8B-makeup-botox-specialist quantized GGUF 752M S apache-2.0 harshitsiwach 1 1.3k
wxsys/qwen-servitor quantized GGUF 752M S apache-2.0 wxsys 1 1.2k
apexlearn/BECoach-Qwen3.5-0.8B-4bit-vlm-mlx quantized -4bit 853M S apache-2.0 apexlearn 0 1.2k
McGill-NLP/AfriqueQwen3.5-0.8B-50Langs finetune — 1.11B S cc-by-4.0 McGill-NLP 2 1.1k
igorktech/Qwen3.5-0.8B-Base-LM finetune — 752M S — igorktech 0 1.1k
djinn-san/QSIV finetune — 752M S apache-2.0 djinn-san 3 867
junma/MedJev-Qwen3.5-0.8B adapter — — — apache-2.0 junma 17 122
sh0ck0r/Qwen3.5-0.8B-heretic finetune — 853M S apache-2.0 sh0ck0r 0 960
labqoat/qev-0.8b finetune — 853M S apache-2.0 labqoat 13 289
XingChina/ChunMengDie-0.8B-Qwen3.5-v1.2 quantized GGUF 873M S bsd-3-clause XingChina 0 876
qikp/Qwen3.5-0.8B-Base-mmproj-GGUF quantized GGUF — — — qikp 0 821
BananaMind/BananaMind-2-AI-Detect finetune — 752M S apache-2.0 BananaMind 4 613
Axiom-AI/Quasar-1-0.8B finetune — 752M S apache-2.0 Axiom-AI 1 734

Repository changelog

9 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 9 commits

DateCommitSHA
2026-04-23 Upload LICENSE dc7cdfe
2026-03-02 Update video_preprocessor_config.json a9a407b
2026-03-02 Update tokenizer_config.json 5c8a1b9
2026-03-01 Update tokenizer_config.json cf61105
2026-03-01 Delete chat_template.json 8b2d89c
2026-03-01 Update README.md f753615
2026-03-01 Update README.md (#1) 4dac375
2026-03-01 Upload folder using huggingface_hub a5fba42
2026-02-28 initial commit 0abaa91

Articles and coverage

24 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official2

qwen.ai2026-02-16officialauthorityHN front pageabout the Qwen3.5 familyHN 434 pts · 214 comments17,678 words
Qwen3.5-397B-A17B is the first open-weight native vision-language model in the Qwen3.5 series, released on 2026/02/15. Built on a hybrid architecture fusing linear attention via Gated Delta Networks with a sparse mixture-of-experts, it activates just 17 billion parameters per forward pass despite comprising 397 billion total parameters. The model expanded language support from 119 to 201 languages while matching the >1T-parameter Qwen3-Max-Base capability.written, reviewed, cited
  • The hosted Qwen3.5-Plus model defaults to a 1M context window and includes official built-in tools with adaptive tool use.
  • For the BrowseComp benchmark, the model achieved a score of 69.0 using simple context-folding, while the discard-all strategy reached 78.6.
unsloth.ai2026-03-04authorityHN front pageabout the Qwen3.5 familyHN 416 pts · 107 comments729 words
Engineers can fine-tune the Qwen3.5 model family (0.8B, 2B, 4B, 9B, 27B, 35B-A3B, 122B-A10B) with Unsloth, which trains models 1.5 times faster using 50% less VRAM than FA2 setups. VRAM requirements for bf16 LoRA range from 3GB for the 0.8B model to 56GB for the 27B model, while the 35B-A3B variant operates on 74GB VRAM and the 122B-A10B on 256GB VRAM. MoE fine-tuning leverages a recent update delivering over 35% less VRAM usage and approximately 6x longer context support.written, reviewed, cited
  • To preserve reasoning ability, mix reasoning-style examples with direct answers while keeping a minimum of 75% reasoning.
  • Router-layer fine-tuning is disabled by default for stability on MoE models like Qwen3.5‑35B‑A3B.
  • You can run Qwen3.5 RL with Unsloth even though it is not supported by vLLM by setting fast_inference=False.

Analysis6

github.com2026-09-21authorityHN front pageabout the Qwen3.5 familyHN 463 pts · 210 comments6,746 words
Kev is a family of small decision models built on Qwen3.5 and Qwen3.8 that you can train and run locally. The API matches TypeSafe's System One, so you can point their Python SDK at your local server. Models use a small adapter on a frozen base, except Kev-27B which ships as 51 GB of full weights. The 27B model achieves 0.851 accuracy on new sources.written, reviewed, cited
  • The Kev-27B model requires 96–128 GB of RAM on Macs, a requirement marked as expected but not measured.
  • An explicitly requested accelerator fails instead of falling back if the probe times out or crashes.
github.com2026-10-04authorityabout the Qwen3.5 familyHN 2 pts · 0 comments1,558 words
llm.vhdl is a full-fabric VHDL inference engine for Qwen3.5-class models on Xilinx XCVU33P and XCVU35P FPGAs using INT4 streaming matvecs and HBM-resident weights. It supports single-card 9B or two-card 27B configurations, achieving about 2.5 tokens/s on silicon at 75 MHz. The 27B target fits a VU35P at about 46% LUT but requires the Jungle Cat board, which lacks PCIe and relies on slow Ethernet or JTAG for weight loading.written, reviewed, cited
  • Reconfiguring the FPGA tears the PCIe bus down and rescans it, which can hang the host if a transaction faults.
  • The inter-die link for the two-die residual hand-off cannot come up because the carrier's refclk oscillator sites are unpopulated.
  • The Jungle Cat board lacks PCIe, forcing weight loading over a CoE/JTAG bridge that operates at roughly 1 MB/s.
sharpai.org2026-03-20HN front pageabout the Qwen3.5 familyHN 173 pts · 152 comments1,458 words
gslaller.github.io2026-09-29about the Qwen3.5 familyHN 2 pts · 0 comments
unsloth.ai2026-02-28authorityabout the Qwen3.5 familyHN 5 pts · 0 comments
github.com2026-02-16authorityabout the Qwen3.5 familyHN 5 pts · 0 comments

Community2

news.ycombinator.com2026-08-06about the Qwen3.5 familyHN 4 pts · 2 comments157 words
This American (San Francisco) model, Laguna S 2.1:118B-a9B, outperforms Qwen3.5:122B-a10B and Sonnet in current benchmarking tests. It demonstrates better personality and natural creativity when designing UIs. Benchmarks need to include a minimum of hardware requirements, which are currently missing.written, reviewed, cited
news.ycombinator.com2026-04-16about the Qwen3.5 familyHN 7 pts · 2 comments
All coverage tracked for this model (24) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Full-fabric VHDL LLM inference engine. Runs Qwen3.5-class transformer inferencegithub.com2026-10-042026-10-07hn
PewDiePie uncensors Qwen3.5-9B with Heretictomshardware.com2026-10-022026-10-07hn
Show HN: Moe Routing Atlas – which experts fire in Qwen3.5/3.6 35B-A3Bgslaller.github.io2026-09-292026-10-07hn
Kev: Tiny Jev-like family of decision models built on top of Qwen3.5github.com2026-09-212026-10-07hn
Laguna S 2.1:118B-a9B better than Qwen3.5:122B-a10B? So far, yesnews.ycombinator.com2026-08-062026-10-07hn
Fixed three bugs that made Qwen3.5-122B a daily driver on Mac Studiomrzk.io2026-07-112026-10-07hn
Asking Qwen3.5-9B, running on 16GB VRAM, to exploit old Windows machinesthepatrickfisher.com2026-04-252026-10-07hn
Qwen3.5-Omni Technical Reportarxiv.org2026-04-222026-10-07hn
We got 207 tok/s with Qwen3.5-27B on an RTX 3090github.com2026-04-202026-10-07hn
Qwen3.5 50% expert reduction successnews.ycombinator.com2026-04-162026-10-07hn
Are Local LLMs Good Enough for Vibe Coding? Gemma4-26B-A4B vs. Qwen3.5-35B-A3Bgrigio.org2026-04-072026-10-07hn
Unlocking LoRA Moe RL for Qwen3.5osmosis.ai2026-04-032026-10-07hn
Qwen3.5-Omniqwen.ai official2026-03-302026-10-07hn
Show HN: I ran Qwen3.5 35B on my iPhone at 5.6 tok/SECtwitter.com2026-03-212026-10-07hn
MacBook M5 Pro and Qwen3.5 = Local AI Security Systemsharpai.org2026-03-202026-10-07hn
Show HN: llamafile 0.10.0 rebuilt, Qwen3.5, lfm2, Anthropic APIblog.mozilla.ai2026-03-192026-10-07hn
AI on a Budget: Recompiling Llama.cpp for Qwen3.5 Inference on an HP Z440jeanbaptistefleury.neocities.org2026-03-102026-10-07hn
Qwen3.5-35B – 16GB GPU – 100T/s with 120K context AND vision enabledgithub.com2026-03-062026-10-07hn
Qwen3.5 Fine-Tuning Guideunsloth.ai2026-03-042026-10-07hn
Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computersventurebeat.com2026-02-282026-10-07hn
Qwen3.5 GGUF Benchmarksunsloth.ai2026-02-282026-10-07hn
Qwen3.5github.com2026-02-162026-10-07hn
Qwen3.5: Towards Native Multimodal Agentsqwen.ai official2026-02-162026-10-07hn
Adding Support for Qwen3.5github.com2026-02-092026-10-07hn

Similar models

3 models

Similar models

  • OvisOCR2 · 853M
    same size band (S), same task (image-text-to-text), more providers, permissive license
  • Florence-2-large · 777M
    same size band (S), same task (image-text-to-text), permissive license
  • LightOnOCR-2-1B · 1.01B
    same size band (S), same task (image-text-to-text), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:40 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:11 UTC · Last verified 2026-10-25

Follow Qwen3.5-0.8B-Base

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.