Models › gemma-3 family

google Gemma Terms of Use out 20 months ago

4.30B parameters, images and text in, text out. 1 provider serves it.

Verified 2026-10-25 Rank #330 in LLMs · score 82.1 method v1 Sources 3 Downloads 30d 250.6k · #232 of 619 tracked

Can I run it?2.6GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-24
Do people use it?250.6kdownloads, 30 days#232 of 619 we track · top 37%+0 likes, downloads +93% this week172 likesHugging Face2026-10-24

Worth reading

Picked by rule from 26 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 488 HN pts
storage.googleapis.com 2025-03-12 488 HN pts · 245 comments about the gemma 3 family family
Latest · 38 days ago

Open-jev: One-pass option scoring with Gemma 3 4B, similar to jev

An open-source implementation of Jev option scoring runs on local Gemma 3 4B models using MLX on Apple silicon or PyTorch on other platforms.

  • Frozen-feature extraction and head training workflows currently require MLX on Apple silicon.
  • PMI normalization requires an extra batched pass to subtract the option's unconditional log-prob.
github.com 2026-09-17 7 HN pts · 1 comments 2.1k words

25 best of 26 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com · 2026-07-04 · 6 HN pts
  2. ArticleGemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com · 2025-08-14 · official
  3. ArticleGemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com · 2025-04-18 · 602 HN pts · official
  4. ArticleIntroducing Gemma 3ndevelopers.googleblog.com · 2025-06-26 · 405 HN pts · official
  5. ArticleGemma 3n preview: Mobile-first AIdevelopers.googleblog.com · 2025-05-20 · 441 HN pts · official
  6. ArticleGemma3 Function Callingai.google.dev · 2025-03-23 · 202 HN pts · official
  7. ArticleFine-tune Google's Gemma 3unsloth.ai · 2025-03-19 · 226 HN pts
  8. CodeGemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com · 2025-08-20
  9. CodeI have written gemma3 inference in pure Cgithub.com · 2026-01-26 · 65 HN pts
  10. ArticleGemma3 – The current strongest model that fits on a single GPUollama.com · 2025-03-12 · 252 HN pts
  11. ArticleGoogle calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com · 2025-03-20
  12. ArticleGemma 3: Google's new multimodal modelsai.google.dev · 2025-03-12 · official
  13. ArticleGemma 3: The most capable model you can run on a single GPU or TPUblog.google · 2025-03-12 · official
  14. ArticleOwn your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com · 2025-10-10 · official
  15. ArticleGemma 3 QAT Modelssimonwillison.net · 2025-04-19
  16. DiscussionGemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com · 2025-05-25
  17. ArticleGemma 3n available in the open-source ecosystemhuggingface.co · 2025-06-26
  18. ArticleGemma 3n: The Developer Guidesimonwillison.net · 2025-06-27
  19. ArticleLandrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us · 2025-08-20
  20. CodeA C++ library to efficiently run Gemma-3N across various platformgithub.com · 2025-06-11
  21. ArticleSelectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com · 2026-03-12
  22. ArticleI Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com · 2025-08-11
  23. ArticleGoogle's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com · 2025-03-13

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 26 quantized builds for local use; a big base for builders (368 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware26quantized builds
  • Built on368348 fine-tunes · 19 adapters · 1 merges
  • In apps13Hugging Face Spaces

Top Spaces running it: stats-powered-ai/StatDetectLLM ♥ 9 · ariG23498/gemma3-license-plate-detection ♥ 4 · Jasmineame/detect-LLM-tokens ♥ 4 · Lunamos/flas-demo ♥ 2

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 2.6 GB at INT4, 5.2 GB at FP8, 10 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.6 GB of weights (estimate; KV cache and activations extra)INT42.6 GBFP8: about 5.2 GB of weights (estimate; KV cache and activations extra)FP85.2 GBBF16: about 10 GB of weights (estimate; KV cache and activations extra)BF1610 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.6 GB of weights (estimate; KV cache and activations extra)INT42.6 GBFP8: about 5.2 GB of weights (estimate; KV cache and activations extra)FP85.2 GBBF16: about 10 GB of weights (estimate; KV cache and activations extra)BF1610 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 4 repo commits so far

Teal is the weights (2025-02-20), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

394 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

394 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

26 quantized (Hugging Face model tree)348 fine-tunes (Hugging Face model tree)1 merge (Hugging Face model tree)19 adapters (Hugging Face model tree)26 quantized348 fine-tunes1 merge19 adapters
26 quantized (Hugging Face model tree)348 fine-tunes (Hugging Face model tree)1 merge (Hugging Face model tree)19 adapters (Hugging Face model tree)26 quantized348 fine-tunes1 merge19 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

21 rows

Benchmarks 21 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (21)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AGIEval42.1Gemma 3 PT 4Bmodel author2026-10-07
author-reported ARC Challenge · Chat and follow instructions56.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported BBH · Reason through hard problems50.9Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions72.3Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions79.6Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions51.9Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions65.8Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions20Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions82.4Gemma 3 PT 4Bmodel author2026-10-07
author-reported DROP60.1Gemma 3 PT 4Bmodel author2026-10-07
author-reported GPQA Diamond · Reason through hard problems15Gemma 3 PT 4Bmodel author2026-10-07
author-reported GSM8K · Reason through hard problems38.4Gemma 3 PT 4Bmodel author2026-10-07
author-reported Global-MMLU · Work across languages57Gemma 3 PT 4Bmodel author2026-10-07
author-reported HellaSwag · Chat and follow instructions77.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported HumanEval · Write code with agents36Gemma 3 PT 4Bmodel author2026-10-07
author-reported MATH-500 · Reason through hard problems24.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported MBPP · Write code with agents46Gemma 3 PT 4Bmodel author2026-10-07
author-reported MGSM · Work across languages34.7Gemma 3 PT 4Bmodel author2026-10-07
author-reported MMLU · Reason through hard problems59.6Gemma 3 PT 4Bmodel author2026-10-07
author-reported MMLU-Pro · Reason through hard problems29.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported Winogrande · Chat and follow instructions64.7Gemma 3 PT 4Bmodel author2026-10-07

Use-case evidence

7 use cases

Facts

18 fields

Listed in LLMs

Facts

Servability

vLLM · SGLang

Servability

vLLM: supported · Gemma3ForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Gemma3ForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for gemma-3-4b-pt: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)10 GB · Single GPU (<24 GB)
FP8 (1 byte/param)5.2 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)2.6 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: google/gemma-3 394 derivatives on the Hub

finetune: 348quantized: 26adapter: 19merge: 1

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
google/shieldgemma-2-4b-it finetune — 4.30B M gemma google 182 293.8k
unsloth/gemma-3-4b-pt-unsloth-bnb-4bit quantized -bnb 4.39B M gemma unsloth 4 184.6k
mlx-community/gemma-3-4b-it-8bit finetune -8bit 4.97B M gemma mlx-community 6 150.8k
unsloth/gemma-3-4b-pt finetune — 4.30B M gemma unsloth 6 150.3k
twinkle-ai/gemma-3-4B-T1-it finetune — 3.88B M gemma twinkle-ai 41 91.7k
hi-wesley/gemma3-vision-encoder finetune — 417M S gemma hi-wesley 1 85.5k
CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it finetune — 4.30B M gemma CEIA-UFG 159 69k
google/medgemma-4b-pt finetune — 4.30B M other google 164 58.4k
mlx-community/gemma-3-4b-it-4bit quantized -4bit 4.97B M gemma mlx-community 8 54.6k
KISTI-KONI/KONI-4B-instruct-20250901 finetune — 3.88B M gemma KISTI-KONI 3 50.3k
unsloth/gemma-3-4b-pt-bnb-4bit quantized -bnb 4.41B M gemma unsloth 1 25.6k
MBZUAI-Paris/Nile-Chat-4B finetune — 3.88B M gemma MBZUAI-Paris 20 18.1k
VIDraft/Gemma-3-R1984-4B finetune — 4.30B M gemma VIDraft 133 8.5k
mozilla-ai/gemma-3-4b-it-llamafile finetune — — — gemma mozilla-ai 7 11.7k
mlx-community/gemma-3-4b-it-bf16 finetune -bf16 4.97B M gemma mlx-community 2 11.3k
DevQuasar-5/google.gemma-3-4b-pt-GGUF quantized GGUF — — — DevQuasar-5 2 10.8k
mradermacher/gemma-3-4b-pt-i1-GGUF quantized GGUF — — gemma mradermacher 1 10.3k
Mungert/Gemma-3-Gaia-PT-BR-4b-it-GGUF quantized GGUF — — gemma Mungert 0 8.1k
Mungert/medgemma-4b-pt-GGUF quantized GGUF — — other Mungert 0 7.1k
McGill-NLP/AfriqueGemma-4B finetune — 4.30B M cc-by-4.0 McGill-NLP 0 6.5k
mradermacher/gemma-3-4b-pt-GGUF quantized GGUF — — gemma mradermacher 0 5.9k
KISTI-KONI/KONI-4B-base-20250819 finetune — 3.88B M gemma KISTI-KONI 3 5.7k
ginipick/Gemma-3-R1984-4B finetune — 4.30B M gemma ginipick 52 2.8k
google/gemma-3-4b-pt-qat-q4_0-gguf quantized q4_0 — — gemma google 29 3.6k
ariG23498/gemma-3-4b-pt-object-detection finetune — 4.30B M apache-2.0 ariG23498 6 3.3k
llmvision/glimpse-v1 quantized GGUF 4.30B M gemma llmvision 9 3k
luel/gemma-3-4b-tigrinya finetune — 3.88B M gemma luel 1 3k
tbmod/gemma-3-4b-it finetune — 4.30B M gemma tbmod 1 1.5k
DrRiceIO7/gemma-3-4b-it-heretic-creative finetune — 4.30B M gemma DrRiceIO7 2 1.4k
Abdusin/gemma-3-4b-est-v1 quantized GGUF 4.30B M gemma Abdusin 1 1.3k
professorf/gemma-3-4b-it-gguf quantized gguf — — gemma professorf 1 1.1k
manthilaffs/Gamunu-4B-Instruct-Alpha finetune — 4.30B M apache-2.0 manthilaffs 0 810
zeromodels/gemma-3-4b-pt finetune — — — gemma zeromodels 0 777
thaitung/gemma-3-4b-pt-Q4_K_M-GGUF quantized GGUF — — gemma thaitung 0 766
ngxson/gemma-3-4b-pt-Q4_0-GGUF quantized Q4_0 — — gemma ngxson 1 669
MBZUAI-Paris/Nile-Chat-3x4B-A6B finetune — 9.23B L gemma MBZUAI-Paris 3 560
mlx-community/gemma-3-4b-it-6bit finetune — 4.97B M gemma mlx-community 0 591
coder3101/gemma-3-4b-it-heretic finetune — 4.30B M gemma coder3101 3 424
munkhbayar-batkhuu/gemma-3-4b-mongolian finetune — 4.55B M gemma munkhbayar-batkhuu 0 569
GoYM/gemma-ft adapter — — — — GoYM 0 506

Repository changelog

4 commits

Repository changelog 4 commits

DateCommitSHA
2025-03-21 Update README.md cc012e0
2025-03-19 Adding top_k and top_p to generation_config.json 2166bd1
2025-03-12 Update README.md 158684e
2025-03-12 Super-squash branch 'main' using huggingface_hub 302f3cd

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for gemma-3-4b-pt, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
google/gemma-3-4b-pt — — — — — — — live 2026-10-25

Articles and coverage

26 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official4

developers.googleblog.com2025-04-18officialauthorityHN front pageabout the gemma 3 familyHN 602 pts · 276 comments1,077 words
Google released Gemma 3 Quantization-Aware Training (QAT) models that incorporate quantization during training to reduce memory usage while maintaining accuracy. Applying QAT on ~5,000 steps reduces the perplexity drop by 54% when quantizing down to Q4_0, allowing the 27B variant to fit in 14.1 GB of VRAM instead of 54 GB. These int4 models run efficiently on consumer hardware like the NVIDIA RTX 3090 and are available via Ollama, llama.cpp, and MLX.written, reviewed, cited
  • Deploying the largest models often requires lower-precision formats like FP8, potentially accepting a performance trade-off for feasibility.
  • The Gemmaverse offers many alternatives using Post-Training Quantization (PTQ) with contributions from members such as Bartowski, Unsloth, and GGML.
developers.googleblog.com2025-06-26officialauthorityHN front pageabout the gemma 3 familyHN 405 pts · 191 comments1,690 words
Gemma 3n is a mobile-first AI model family designed for on-device use with multimodal capabilities. The E2B and E4B versions have raw parameters of 5B and 8B but operate with as little as 2GB and 3GB of memory respectively. It supports 140 languages for text and includes a MobileNet-V5-300M vision encoder that delivers a 13x speedup with quantization, requires 46% fewer parameters, and has a 4x smaller memory footprint.written, reviewed, cited
  • Developers can create custom-sized models between E2B and E4B by adjusting feed forward network hidden dimensions from 8192 to 16384.
  • The Gemma 3n audio encoder processes clips up to 30 seconds at launch but supports arbitrarily long audios with additional training.
developers.googleblog.com2025-05-20officialauthorityHN front pageabout the gemma 3 familyHN 441 pts · 163 comments904 words
ai.google.dev2025-03-23officialauthorityHN front pageabout the gemma 3 familyHN 202 pts · 32 comments2,144 words

Analysis6

github.com2026-09-17authorityHN 7 pts · 1 comments2,103 words
An open-source implementation of Jev option scoring runs on local Gemma 3 4B models using MLX on Apple silicon or PyTorch on other platforms. The model achieves efficient option scoring by prefilling the context once and expanding the KV cache across a batch of options in a single forward pass without decoding. The score is the log-probability of the option tokens given the context; a softmax over the option scores gives a probability per option, like jevlike-predict.written, reviewed, cited
  • Frozen-feature extraction and head training workflows currently require MLX on Apple silicon.
  • PMI normalization requires an extra batched pass to subtract the option's unconditional log-prob.
github.com2026-07-04authorityabout the gemma 3 familyHN 6 pts · 2 comments193 words
MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models. The library API and CLI are under active development, therefore they may change without any deprecation notice. The framework is distributed under GPLv3 license and can be installed using Homebrew package manager with brew tap ybubnov/metalchat.written, reviewed, cited
unsloth.ai2025-03-19authorityHN front pageabout the gemma 3 familyHN 226 pts · 78 comments
storage.googleapis.com2025-03-12HN front pageabout the gemma 3 familyHN 488 pts · 245 comments
github.com2026-01-26authorityabout the gemma 3 familyHN 65 pts · 23 comments2,207 words
ollama.com2025-03-12HN front pageabout the gemma 3 familyHN 252 pts · 138 comments
All coverage tracked for this model (26) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Open-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com2026-09-172026-10-07hn
Show HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com2026-07-042026-10-07hn
Selectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com2026-03-122026-10-07hn
I have written gemma3 inference in pure Cgithub.com2026-01-262026-10-07hn
Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com official2025-10-102026-10-07hn
Gemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com2025-08-202026-10-07hn
Landrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us2025-08-202026-10-07hn
Gemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com official2025-08-142026-10-07hn
I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com2025-08-112026-10-07hn
Gemma 3n: The Developer Guidesimonwillison.net2025-06-272026-10-07hn
Gemma 3n available in the open-source ecosystemhuggingface.co2025-06-262026-10-07hn
Introducing Gemma 3ndevelopers.googleblog.com official2025-06-262026-10-07hn
A C++ library to efficiently run Gemma-3N across various platformgithub.com2025-06-112026-10-07hn
Gemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com2025-05-252026-10-07hn
Gemma 3n preview: Mobile-first AIdevelopers.googleblog.com official2025-05-202026-10-07hn
Gemma 3 QAT Modelssimonwillison.net2025-04-192026-10-07hn
QAT optimized Gemma 3 slash VRAM needs 54GB –> 14.1GB while maintaining qualityold.reddit.com2025-04-192026-10-07hn
Gemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com official2025-04-182026-10-07hn
Gemma3 Function Callingai.google.dev official2025-03-232026-10-07hn
Google calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com2025-03-202026-10-07hn
Fine-tune Google's Gemma 3unsloth.ai2025-03-192026-10-07hn
Google's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com2025-03-132026-10-07hn
Gemma3 – The current strongest model that fits on a single GPUollama.com2025-03-122026-10-07hn
Gemma 3: The most capable model you can run on a single GPU or TPUblog.google official2025-03-122026-10-07hn
Gemma 3: Google's new multimodal modelsai.google.dev official2025-03-122026-10-07hn
Gemma 3 Technical Report [pdf]storage.googleapis.com2025-03-122026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-VL-4B-Instruct · 4.44B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • medgemma-4b-it · 4.30B
    same size band (M), same task (image-text-to-text)
  • Qwen3.5-4B · 4.66B
    same size band (M), same task (image-text-to-text), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:38 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:09 UTC · Last verified 2026-10-25

Follow gemma-3-4b-pt

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.