Models › Qwen3Guard family

Qwen3Guard-Gen-4B

Qwen Apache 2.0 out 13 months ago

4.41B parameters, text in, text out, 32K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #609 in LLMs · score 73.9 method v1 Sources 3 Downloads 30d 19.3k · #460 of 619 tracked

Can I run it?2.6GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?19.3kdownloads, 30 days#460 of 619 we track · below the median+2 likes, downloads +3% this week65 likesHugging Face2026-10-24

Worth reading

Picked by rule from 1 tracked piece: the lab's own post, the most shared, a field report, the latest.

Latest · 12 months ago

Qwen3Guard Technical Report

Qwen3Guard introduces multilingual safety guardrail models featuring fine-grained tri-class judgments and real-time token-level monitoring for large language models.

huggingface.co 2025-10-17 1 HN pts 530 words about the Qwen3Guard family family

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 11 quantized builds for local use.

  • As a service1Featherless
  • On own hardware11quantized builds
  • Built on179 fine-tunes · 8 adapters · 0 merges
  • In apps1Hugging Face Spaces

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 2.6 GB at INT4, 5.3 GB at FP8, 11 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.6 GB of weights (estimate; KV cache and activations extra)INT42.6 GBFP8: about 5.3 GB of weights (estimate; KV cache and activations extra)FP85.3 GBBF16: about 11 GB of weights (estimate; KV cache and activations extra)BF1611 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.6 GB of weights (estimate; KV cache and activations extra)INT42.6 GBFP8: about 5.3 GB of weights (estimate; KV cache and activations extra)FP85.3 GBBF16: about 11 GB of weights (estimate; KV cache and activations extra)BF1611 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

1 dated article and 7 repo commits so far

Teal is the weights (2025-09-23), amber triangles are 1 dated article (each links to it), grey ticks are repo commits.

OctNovDecJanFebMarAprMayJunJulAugSepOct2025-11-07: 1 repo commit2025-10-17: 1 repo commit2025-09-24: 2 repo commits2025-09-23: 3 repo commitsQwen3Guard Technical Report · 2025-10-17Weights 2025-09-23 · 2025-09-23Weights 2025-09-23now · 1 provider
OctNovDecJanFebMarAprMayJunJulAugSepOct2025-11-07: 1 repo commit2025-10-17: 1 repo commit2025-09-24: 2 repo commits2025-09-23: 3 repo commitsQwen3Guard Technical Report · 2025-10-17Weights 2025-09-23 · 2025-09-23Weights 2025-09-23now · 1 provider

What people built on it

28 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

28 derivatives on the Hub, led by 11 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

11 quantized (Hugging Face model tree)9 fine-tunes (Hugging Face model tree)8 adapters (Hugging Face model tree)11 quantized9 fine-tunes8 adapters
11 quantized (Hugging Face model tree)9 fine-tunes (Hugging Face model tree)8 adapters (Hugging Face model tree)11 quantized9 fine-tunes8 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

Qwen3Guard-Gen-4B is a 4.41B parameter generative safety moderation model based on the Qwen3 architecture.[1][2] The model is released under the Apache 2.0 license and supports 119 languages and dialects.[3][4]

  1. parameters human
  2. “Qwen3Guard-Gen, a generative model that frames safety cla…”
  3. license
  4. “Qwen3Guard-Gen supports 119 languages and dialects”

Generated 2026-10-07 15:13 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

6 use cases

What it is good at 6 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesQwen3ForCausalLM
Model typeqwen3
Dtypebfloat16
Params by dtypeBF16: 4,411,424,256
Size bandM
MoEno
Context length32,768 (config.json max_position_embeddings)
PapersarXiv:2510.14276
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen3ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen3Guard-Gen-4B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)11 GB · Single GPU (<24 GB)
FP8 (1 byte/param)5.3 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)2.6 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

28 variants

Lineage

Fine-tuned from Qwen/Qwen3-4B (same organization) Family: Qwen/Qwen3Guard 28 derivatives on the Hub

Base model: Qwen/Qwen3-4B

quantized: 11finetune: 9adapter: 8

Top variants (28 shown, ranked by downloads)

Relation
Quant
28 rows
Variant Relation Quant Params Band License Author Likes Downloads
mradermacher/Qwen3Guard-Gen-4B-GGUF quantized GGUF — — apache-2.0 mradermacher 3 6.7k
DevQuasar/Qwen.Qwen3Guard-Gen-4B-GGUF quantized GGUF — — — DevQuasar 0 1.6k
geoffmunn/Qwen3Guard-Gen-4B-GGUF quantized GGUF — — apache-2.0 geoffmunn 0 1.2k
mediterranean1973/Qwen3Guard-Gen-4B-awq-int4 quantized awq 4.44B M apache-2.0 mediterranean1973 0 952
EddyLuo/FoodGuard-4B finetune — 4.02B M apache-2.0 EddyLuo 2 555
PLJIANGG05/qwen3guard-gen-4b-danger-intent-opendata-qwensynth-supplement-sampled4000-v9 finetune — 4.02B M cc-by-nc-4.0 PLJIANGG05 0 627
i1see1you/VirbiusGuard-4B quantized GGUF 4.02B M apache-2.0 i1see1you 1 497
Yunhao-Feng/AdaGuard-4B finetune — 4.41B M apache-2.0 Yunhao-Feng 0 477
amalia-llm/amaliaguard-4b finetune — 4.02B M — amalia-llm 0 456
liodon-ai/Qwen3Guard-Gen-4B-imatrix-GGUF quantized imatrix — — other liodon-ai 0 449
zenlm/zen-guard finetune — 4.41B M apache-2.0 zenlm 0 364
JeremyLiShuhao/UD_model_v1 finetune — 4.02B M apache-2.0 JeremyLiShuhao 0 275
burrowswang/Qwen3Guard-Gen-4B-Q4_K_M-GGUF quantized GGUF — — apache-2.0 burrowswang 0 256
HikmaAI/HikmaGuard finetune — 4.02B M apache-2.0 HikmaAI 3 54
mistralrs-community/Qwen3Guard-Gen-4B-UQFF quantized — — — — mistralrs-community 0 166
AhmedxSaad/Qwen3Guard-Gen-4B-Q4_K_M-GGUF quantized GGUF — — apache-2.0 AhmedxSaad 0 139
abnormalmapstudio/Qwen3Guard-Gen-4B-mxfp4-mlx quantized mxfp4 4.02B M apache-2.0 abnormalmapstudio 0 129
Otilde/Qwen3Guard-Gen-4B-MLX-Q8 quantized MLX 4.02B M apache-2.0 Otilde 0 129
Otilde/Qwen3Guard-Gen-4B-Heretic finetune — 4.02B M apache-2.0 Otilde 0 85
psssd-cat/HaloGuard1.2-4B adapter — — — — psssd-cat 0 44
psssd-cat/HaloGuard1.3-4B adapter — — — — psssd-cat 0 43
psssd-cat/HaloGuard1.5-4B adapter — — — — psssd-cat 0 35
psssd-cat/HaloGuard1.6-4B adapter — — — — psssd-cat 0 34
psssd-cat/HaloGuard1.1-4B adapter — — — — psssd-cat 0 33
psssd-cat/HaloGuard1.7-4B adapter — — — — psssd-cat 0 33
psssd-cat/HaloGuard1.4-4B adapter — — — — psssd-cat 0 31
PinoCookie/Qwen3Guard-Gen-4B-Abliterated finetune — — — apache-2.0 PinoCookie 0 19
TuanAnhHoangBui/qwen3guard-gen-4b-vi-en-p-pr-lora adapter — — — apache-2.0 TuanAnhHoangBui 0 13

Repository changelog

7 commits

Repository changelog 7 commits

DateCommitSHA
2025-11-07 Update README.md 6ec4282
2025-10-17 Update README.md 57f3ce6
2025-09-24 Update README.md ec9748a
2025-09-24 Update README.md 9b921af
2025-09-23 Update README.md 9e39030
2025-09-23 Upload folder using huggingface_hub 173cf65
2025-09-23 initial commit d59b2e4

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Qwen3Guard-Gen-4B, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
Qwen/Qwen3Guard-Gen-4B — — — — — — — live 2026-10-25

Articles and coverage

1 piece

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis1

huggingface.co2025-10-17authorityabout the Qwen3Guard familyHN 1 pts · 0 comments530 words
Qwen3Guard introduces multilingual safety guardrail models featuring fine-grained tri-class judgments and real-time token-level monitoring for large language models. The system offers two variants, Generative Qwen3Guard and Stream Qwen3Guard, available in three sizes (0.6B, 4B, and 8B parameters) and supporting up to 119 languages and dialects. All models are released under the Apache 2.0 license for public use.written, reviewed, cited

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-4B · 4.02B
    same size band (M), same task (text-generation), permissive license
  • Qwen3-4B-Instruct-2507 · 4.02B
    same size band (M), same task (text-generation), permissive license
  • Qwen3-4B-Thinking-2507 · 4.02B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:41 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:13 UTC · Last verified 2026-10-25

Follow Qwen3Guard-Gen-4B

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.