Models › Qwen3Guard family

Qwen3Guard-Gen-0.6B

Qwen Apache 2.0 out 13 months ago

752M parameters, text in, text out, 32K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #266 in LLMs · score 85.1 method v1 Sources 3 Downloads 30d 213.2k · #245 of 619 tracked

Changed this week: 1 new quantized build on the Hub (17 in all).2026-10-24

Can I run it?0.5GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?213.2kdownloads, 30 days#245 of 619 we track · top 40%+3 likes, downloads −2% this week95 likesHugging Face2026-10-24

Worth reading

Picked by rule from 10 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Latest · 3 months ago

Qwen3Guard Technical Report: LLM Safety Guardrail Model

Qwen3Guard is a multilingual safety guardrail model released under the Apache 2.0 license for public use.

  • Stream Qwen3Guard introduces a token-level classification head for real-time safety monitoring during incremental text generation.
  • Existing guard models require complete model outputs before performing safety checks, making them incompatible with streaming LLM inference.
studylib.net 2026-08-01 14.2k words about the Qwen3Guard family family

10 best of 10 tracked

The 1 pick above, plus these 9. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleQwen3Guard Technical Reporthuggingface.co · 2025-10-17 · 1 HN pts
  2. ArticleArchitecture graph for Qwen/Qwen3Guard-Gen-0.6B | hfviewerhfviewer.com · undated
  3. ArticleQwen3Guard-Stream: a safety verdict on every tokenai.thesatyajit.com · undated
  4. ArticleQwen3Guard Review: Score, Pros and Consfaun.dev · undated
  5. ArticleQwen3Guard Gen 0.6B: Can I Run It on My Mac? | ModelPipermodelpiper.com · undated
  6. ArticleQwen3Guard-Gen-0.6B: Open-Source Multilingual Safetydev.co · undated
  7. ArticleQwen3Guard Technical Report | arXiv Sciencearxiv.science · 2025-10-16
  8. ArticleQwen3Guard Technical Report: Analysis, Review & Summary | Paperiumpaperium.net · 2025-10-16
  9. ArticleAn Introduction to Real-Time Guardrails using Qwen3Guard – Aman Arora’s Blogamaarora.github.io · 2025-09-29

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 17 quantized builds for local use.

  • As a service1Featherless
  • On own hardware17quantized builds
  • Built on3732 fine-tunes · 5 adapters · 0 merges
  • In apps9Hugging Face Spaces

Top Spaces running it: nvidia/Cosmos3-Action-Viewer ♥ 46 · build-small-hackathon/quantsafe-certifier ♥ 2 · nvidia/Cosmos3-Action-Viewer-Prerelease ♥ 1 · Dipl0/brain_rot_demo ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.5 GB at INT4, 0.9 GB at FP8, 1.8 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.5 GB of weights (estimate; KV cache and activations extra)INT40.5 GBFP8: about 0.9 GB of weights (estimate; KV cache and activations extra)FP80.9 GBBF16: about 1.8 GB of weights (estimate; KV cache and activations extra)BF161.8 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.5 GB of weights (estimate; KV cache and activations extra)INT40.5 GBFP8: about 0.9 GB of weights (estimate; KV cache and activations extra)FP80.9 GBBF16: about 1.8 GB of weights (estimate; KV cache and activations extra)BF161.8 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

5 dated articles and 8 repo commits so far

Teal is the weights (2025-09-23), amber triangles are 5 dated articles (each links to it), grey ticks are repo commits.

What people built on it

54 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

54 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

17 quantized (Hugging Face model tree)32 fine-tunes (Hugging Face model tree)5 adapters (Hugging Face model tree)17 quantized32 fine-tunes5 adapters
17 quantized (Hugging Face model tree)32 fine-tunes (Hugging Face model tree)5 adapters (Hugging Face model tree)17 quantized32 fine-tunes5 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The model frames safety classification as an instruction-following task and is released under the Apache 2.0 license.[1][2]

  1. “frames safety classification as an instruction-following …”
  2. license

Generated 2026-10-07 15:08 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

6 use cases

What it is good at 6 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesQwen3ForCausalLM
Model typeqwen3
Dtypebfloat16
Params by dtypeBF16: 751,632,384
Size bandS
MoEno
Context length32,768 (config.json max_position_embeddings)
PapersarXiv:2510.14276
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen3ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen3Guard-Gen-0.6B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)1.8 GB · Edge (<4 GB)
FP8 (1 byte/param)0.9 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.5 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from Qwen/Qwen3-0.6B (same organization) Family: Qwen/Qwen3Guard 54 derivatives on the Hub

Base model: Qwen/Qwen3-0.6B

quantized: 17finetune: 32adapter: 5

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
mradermacher/Qwen3Guard-Gen-0.6B-GGUF quantized GGUF — — apache-2.0 mradermacher 2 6.1k
i1see1you/VirbiusGuard quantized GGUF 752M S apache-2.0 i1see1you 3 1.9k
geoffmunn/Qwen3Guard-Gen-0.6B quantized GGUF — — apache-2.0 geoffmunn 0 1.7k
DevQuasar/Qwen.Qwen3Guard-Gen-0.6B-GGUF quantized GGUF — — — DevQuasar 0 1.5k
rogerdeng/Qwen3Guard-0.6B-ONNX-Quantized quantized -Quant — — other rogerdeng 0 1.2k
jsl5710/Shield-Qwen3Guard-Gen-0.6B-Full-FT-CE finetune — 596M S apache-2.0 jsl5710 0 785
pvelab/Qwen3Guard-Gen-0.6B-openvino finetune — — — apache-2.0 pvelab 0 641
nova-shadowtail/Qwen3Guard-0.6B-Q4_1-NPU2 quantized Q4_1 — — apache-2.0 nova-shadowtail 1 526
mlx-community/Qwen3Guard-Gen-0.6B-MLX finetune MLX 596M S apache-2.0 mlx-community 0 516
Yunhao-Feng/AdaGuard-0.6B finetune — 752M S apache-2.0 Yunhao-Feng 0 487
Mitroshenkov87/voxprint-mirror-qwen3guard-gen-0.6b finetune — 752M S apache-2.0 Mitroshenkov87 1 266
nxp/Qwen3Guard-Gen-0.6B-ONNX quantized — — — apache-2.0 nxp 0 190
Hayanie/Qwen3Guard-Gen-0.6B-GGUF quantized GGUF — — apache-2.0 Hayanie 0 184
BRlkl/BingoGuard-qwen3-0.6B-pt finetune — 752M S apache-2.0 BRlkl 0 175
mistralrs-community/Qwen3Guard-Gen-0.6B-UQFF quantized — — — — mistralrs-community 0 171
beyond-logic-labs/Qwen3Guard-Gen-0.6B-gguf quantized gguf — — apache-2.0 beyond-logic-labs 0 143
chenhaodev/med-guard-0.6b adapter GGUF — — apache-2.0 chenhaodev 0 131
thulpar/qwen3guard-0.6b-gguf quantized gguf — — apache-2.0 thulpar 0 128
abnormalmapstudio/Qwen3Guard-Gen-0.6B-mxfp4-mlx quantized mxfp4 596M S apache-2.0 abnormalmapstudio 0 113
jsl5710/Shield-Qwen3Guard-Gen-0.6B-PEFT-CE adapter — — — apache-2.0 jsl5710 0 103
Cwkisgo/Qwen3Guard-Gen-0.6B-GGUF quantized GGUF — — apache-2.0 Cwkisgo 0 100
louivis/xguard-0.6b-2t-ollama quantized GGUF — — apache-2.0 louivis 0 78
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-GKD-Qwen3-4B-SafeRL-OOB finetune — 596M S apache-2.0 jsl5710 0 57
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3-4B-SafeRL-OOB finetune — 596M S apache-2.0 jsl5710 0 55
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-MINILLM-Qwen3-4B-SafeRL-OOB finetune — 596M S apache-2.0 jsl5710 0 50
peonist-ai/halogen-npu-qwen3guard-gen-0.6b quantized — — — apache-2.0 peonist-ai 1 0
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3Guard-Gen-8B-OOB finetune — 596M S apache-2.0 jsl5710 0 49
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3Guard-Gen-8B-FT-S2-QG-PEFT finetune — 596M S apache-2.0 jsl5710 0 48
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3Guard-Gen-8B-FT-aliwister-S2-QG-PEFT finetune — 596M S apache-2.0 jsl5710 0 46
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-MINILLM-Qwen3-4B-SafeRL-FT-S2-QG-BASE finetune — 596M S apache-2.0 jsl5710 0 44
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3-4B-SafeRL-FT-S2-QG-FULL finetune — 596M S apache-2.0 jsl5710 0 44
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3-4B-SafeRL-FT-S2-QG-BASE finetune — 596M S apache-2.0 jsl5710 0 43
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-MINILLM-Qwen3Guard-Gen-8B-OOB finetune — 596M S apache-2.0 jsl5710 0 42
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-GKD-Qwen3-4B-SafeRL-FT-S2-QG-PEFT finetune — 596M S apache-2.0 jsl5710 0 42
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-GKD-Qwen3Guard-Gen-8B-OOB finetune — 596M S apache-2.0 jsl5710 0 41
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-MINILLM-Qwen3Guard-Gen-8B-FT-S2-QG-BASE finetune — 596M S apache-2.0 jsl5710 0 41
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3-4B-SafeRL-FT-S2-QG-PEFT finetune — 596M S apache-2.0 jsl5710 0 41
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-TED-Qwen3Guard-Gen-8B-FT-S2-QG-BASE finetune — 596M S apache-2.0 jsl5710 0 41
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-MINILLM-Qwen3Guard-Gen-8B-FT-S2-QG-PEFT finetune — 596M S apache-2.0 jsl5710 0 40
jsl5710/Shield-Qwen3Guard-Gen-0.6B-KD-GKD-Qwen3Guard-Gen-8B-FT-S2-QG-PEFT finetune — 596M S apache-2.0 jsl5710 0 39

Repository changelog

8 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 8 commits

DateCommitSHA
2025-11-07 Update README.md fada3b2
2025-10-17 Update README.md 5ea3961
2025-09-24 Update README.md 0a0af2c
2025-09-24 Update README.md 5e11206
2025-09-23 Update README.md 638f45f
2025-09-23 Update README.md 92a3d3c
2025-09-23 Upload folder using huggingface_hub 3706d23
2025-09-23 initial commit d97d7ee

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Qwen3Guard-Gen-0.6B, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
Qwen/Qwen3Guard-Gen-0.6B — — — — — — — live 2026-10-25

Articles and coverage

10 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis10

studylib.net2026-08-01about the Qwen3Guard family14,222 words
Qwen3Guard is a multilingual safety guardrail model released under the Apache 2.0 license for public use. Generative Qwen3Guard casts safety classification as an instruction-following task to enable fine-grained tri-class judgments. The system provides two variants available in 0.6B, 4B, and 8B parameters to support diverse resource constraints across 119 languages and dialects.written, reviewed, cited
  • Stream Qwen3Guard introduces a token-level classification head for real-time safety monitoring during incremental text generation.
  • Existing guard models require complete model outputs before performing safety checks, making them incompatible with streaming LLM inference.
huggingface.co2025-10-17authorityabout the Qwen3Guard familyHN 1 pts · 0 comments530 words
Qwen3Guard introduces multilingual safety guardrail models featuring fine-grained tri-class judgments and real-time token-level monitoring for large language models. The system offers two variants, Generative Qwen3Guard and Stream Qwen3Guard, available in three sizes (0.6B, 4B, and 8B parameters) and supporting up to 119 languages and dialects. All models are released under the Apache 2.0 license for public use.written, reviewed, cited
hfviewer.com3,279 words
hfviewer renders an interactive architecture graph for the Hugging Face model Qwen/Qwen3Guard-Gen-0.6B. The model uses 28 transformer layers with a hidden size of 1,024 and a vocabulary of 151,936 tokens. Checkpoint weights are stored in BF16 and the context window supports up to 32,768 tokens.written, reviewed, cited
  • The graph is trace-backed where executable or derived from reviewed configuration and source code otherwise.
  • Qwen/Qwen3Guard-Gen-0.6B is a fine-tune of Qwen/Qwen3-0.6B using the qwen3 architecture.
  • The feed-forward layers use an intermediate size of 3,072 with 16 query heads and 8 key/value heads.
ai.thesatyajit.comabout the Qwen3Guard family3,376 words
Qwen3Guard-Stream is a per-token safety guard for Qwen3 models that emits a verdict after every generated token instead of waiting for a full response. The 0.6B guard model uses 1.06M head params and avoids quadratic costs by processing tokens sequentially rather than re-submitting 32-token chunks. It requires a two-token debounce to prevent false alarms and is tied to Qwen3's 151,936-entry vocabulary, necessitating re-tokenization for other models.written, reviewed, cited
  • The guard adds 1,061,376 parameters to the 0.6B model, representing 0.18% of the total checkpoint size.
  • Training requires rolling out continuations for unsafe prefixes and judging them with Qwen3-235B-A22B to find the boundary token.
  • The reference implementation scans the whole sequence for an Unsafe pair before looking for a Controversial pair.
faun.devabout the Qwen3Guard family
modelpiper.com514 words
dev.co814 words
amaarora.github.io2025-09-29about the Qwen3Guard family1,935 words
arxiv.science2025-10-16about the Qwen3Guard family334 words
paperium.net2025-10-16about the Qwen3Guard family872 words

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-0.6B · 752M
    same size band (S), same task (text-generation), permissive license
  • gpt2-large · 812M
    same size band (S), same task (text-generation), permissive license
  • bitnet-b1.58-2B-4T · 850M
    same size band (S), same task (text-generation), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:38 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:08 UTC · Last verified 2026-10-25

Follow Qwen3Guard-Gen-0.6B

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.