Models › gemma-3 family

google Gemma Terms of Use out 20 months ago

12.2B parameters, images and text in, text out. 1 provider serves it.

Verified 2026-10-25 Rank #515 in LLMs · score 76 method v1 Sources 3 Downloads 30d 49.7k · #383 of 619 tracked

Can I run it?7.3GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-24
Do people use it?49.7kdownloads, 30 days#383 of 619 we track · below the median+1 likes, downloads +11% this week97 likesHugging Face2026-10-24

Worth reading

Picked by rule from 26 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 488 HN pts
storage.googleapis.com 2025-03-12 488 HN pts · 245 comments about the gemma 3 family family
Latest · 4 months ago

Show HN: Gemma 3 inference in pure C++ with Metal acceleration

MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models.

github.com 2026-07-04 6 HN pts · 2 comments 193 words about the gemma 3 family family

25 best of 26 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeOpen-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com · 2026-09-17
  2. ArticleGemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com · 2025-08-14 · official
  3. ArticleGemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com · 2025-04-18 · 602 HN pts · official
  4. ArticleIntroducing Gemma 3ndevelopers.googleblog.com · 2025-06-26 · 405 HN pts · official
  5. ArticleGemma 3n preview: Mobile-first AIdevelopers.googleblog.com · 2025-05-20 · 441 HN pts · official
  6. ArticleGemma3 Function Callingai.google.dev · 2025-03-23 · 202 HN pts · official
  7. ArticleFine-tune Google's Gemma 3unsloth.ai · 2025-03-19 · 226 HN pts
  8. CodeGemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com · 2025-08-20
  9. CodeI have written gemma3 inference in pure Cgithub.com · 2026-01-26 · 65 HN pts
  10. ArticleGemma3 – The current strongest model that fits on a single GPUollama.com · 2025-03-12 · 252 HN pts
  11. ArticleGoogle calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com · 2025-03-20 · 127 HN pts
  12. ArticleGemma 3: Google's new multimodal modelsai.google.dev · 2025-03-12 · official
  13. ArticleGemma 3: The most capable model you can run on a single GPU or TPUblog.google · 2025-03-12 · official
  14. ArticleOwn your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com · 2025-10-10 · official
  15. ArticleGemma 3 QAT Modelssimonwillison.net · 2025-04-19
  16. DiscussionGemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com · 2025-05-25
  17. ArticleGemma 3n available in the open-source ecosystemhuggingface.co · 2025-06-26
  18. ArticleGemma 3n: The Developer Guidesimonwillison.net · 2025-06-27
  19. ArticleLandrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us · 2025-08-20
  20. CodeA C++ library to efficiently run Gemma-3N across various platformgithub.com · 2025-06-11
  21. ArticleSelectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com · 2026-03-12
  22. ArticleI Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com · 2025-08-11
  23. ArticleGoogle's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com · 2025-03-13

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 18 quantized builds for local use; a big base for builders (196 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware18quantized builds
  • Built on196116 fine-tunes · 76 adapters · 4 merges
  • In apps8Hugging Face Spaces

Top Spaces running it: feel-fl/open-human-feedback-chat ♥ 14 · Jasmineame/detect-LLM-tokens ♥ 4 · mohitkumarrajbadi/Finetune_Gemma_Model ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 7.3 GB at INT4, 15 GB at FP8, 29 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 7.3 GB of weights (estimate; KV cache and activations extra)INT47.3 GBFP8: about 15 GB of weights (estimate; KV cache and activations extra)FP815 GBBF16: about 29 GB of weights (estimate; KV cache and activations extra)BF1629 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 7.3 GB of weights (estimate; KV cache and activations extra)INT47.3 GBFP8: about 15 GB of weights (estimate; KV cache and activations extra)FP815 GBBF16: about 29 GB of weights (estimate; KV cache and activations extra)BF1629 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 4 repo commits so far

Teal is the weights (2025-03-01), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

214 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

214 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

18 quantized (Hugging Face model tree)116 fine-tunes (Hugging Face model tree)4 merges (Hugging Face model tree)76 adapters (Hugging Face model tree)18 quantized116 fine-tunes4 merges76 adapters
18 quantized (Hugging Face model tree)116 fine-tunes (Hugging Face model tree)4 merges (Hugging Face model tree)76 adapters (Hugging Face model tree)18 quantized116 fine-tunes4 merges76 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

21 rows

Benchmarks 21 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (21)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AGIEval57.4Gemma 3 PT 12Bmodel author2026-10-07
author-reported ARC Challenge · Chat and follow instructions68.9Gemma 3 PT 12Bmodel author2026-10-07
author-reported BBH · Reason through hard problems72.6Gemma 3 PT 12Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions78.8Gemma 3 PT 12Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions81.8Gemma 3 PT 12Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions53.4Gemma 3 PT 12Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions78.2Gemma 3 PT 12Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions31.4Gemma 3 PT 12Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions88.3Gemma 3 PT 12Bmodel author2026-10-07
author-reported DROP72.2Gemma 3 PT 12Bmodel author2026-10-07
author-reported GPQA Diamond · Reason through hard problems25.4Gemma 3 PT 12Bmodel author2026-10-07
author-reported GSM8K · Reason through hard problems71Gemma 3 PT 12Bmodel author2026-10-07
author-reported Global-MMLU · Work across languages69.4Gemma 3 PT 12Bmodel author2026-10-07
author-reported HellaSwag · Chat and follow instructions84.2Gemma 3 PT 12Bmodel author2026-10-07
author-reported HumanEval · Write code with agents45.7Gemma 3 PT 12Bmodel author2026-10-07
author-reported MATH-500 · Reason through hard problems43.3Gemma 3 PT 12Bmodel author2026-10-07
author-reported MBPP · Write code with agents60.4Gemma 3 PT 12Bmodel author2026-10-07
author-reported MGSM · Work across languages64.3Gemma 3 PT 12Bmodel author2026-10-07
author-reported MMLU · Reason through hard problems74.5Gemma 3 PT 12Bmodel author2026-10-07
author-reported MMLU-Pro · Reason through hard problems45.3Gemma 3 PT 12Bmodel author2026-10-07
author-reported Winogrande · Chat and follow instructions74.3Gemma 3 PT 12Bmodel author2026-10-07

What the card says

1 cited sentence

Summary generated, cited

It supports a 128K context window for text and image inputs.[1]

  1. “Total input context of 128K tokens for the 4B, 12B, and 2…”

Generated 2026-10-07 15:12 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

Facts

18 fields

Listed in LLMs

Facts

Servability

vLLM · SGLang

Servability

vLLM: supported · Gemma3ForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Gemma3ForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for gemma-3-12b-pt: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)29 GB · Single high-end GPU (<80 GB)
FP8 (1 byte/param)15 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)7.3 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: google/gemma-3 214 derivatives on the Hub

finetune: 116quantized: 18merge: 4adapter: 76

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
mlx-community/gemma-3-12b-it-4bit finetune -4bit — — gemma mlx-community 6 516.6k
unsloth/gemma-3-12b-it finetune — 12.2B L gemma unsloth 17 389.3k
tencent/KaLM-Embedding-Gemma3-12B-2511 finetune — 11.8B L other tencent 105 340k
m8than/gemma-3-12b-it-lenientchatfix finetune — 12.2B L gemma m8than 1 205.1k
cjvt/GaMS3-12B-Instruct finetune — 11.8B L gemma cjvt 8 128.9k
unsloth/gemma-3-12b-pt finetune — 12.2B L gemma unsloth 5 69.4k
unsloth/gemma-3-12b-pt-unsloth-bnb-4bit quantized -bnb 12.4B L gemma unsloth 2 32.5k
DevQuasar-10/google.gemma-3-12b-pt-GGUF quantized GGUF — — — DevQuasar-10 0 27.4k
mlx-community/gemma-3-12b-it-bf16 finetune -bf16 13.2B L gemma mlx-community 2 24k
VIDraft/Gemma-3-R1984-12B finetune — 12.2B L gemma VIDraft 224 9.8k
p-e-w/gemma-3-12b-it-heretic finetune — 12.2B L gemma p-e-w 123 12.1k
mlx-community/gemma-3-12b-it-8bit finetune -8bit — — gemma mlx-community 2 12.8k
lapa-llm/lapa-12b-pt finetune — 12.2B L gemma lapa-llm 15 11.8k
MBZUAI-Paris/Nile-Chat-12B finetune — 11.8B L gemma MBZUAI-Paris 15 11.8k
unsloth/gemma-3-12b-pt-bnb-4bit quantized -bnb 12.5B L gemma unsloth 3 9.5k
mradermacher/gemma-3-12b-pt-i1-GGUF quantized GGUF — — gemma mradermacher 1 7.7k
ToastyPigeon/Gemma-3-Starshine-12B merge — 12.2B L — ToastyPigeon 24 6.3k
mozilla-ai/gemma-3-12b-it-llamafile finetune — — — gemma mozilla-ai 2 6.4k
unsloth/gemma-3-12b-it-FP8-Dynamic quantized -FP8 12.2B L gemma unsloth 3 5.6k
McGill-NLP/AfriqueGemma-12B finetune — 12.2B L cc-by-4.0 McGill-NLP 1 5.7k
mradermacher/gemma-3-12b-pt-GGUF quantized GGUF — — gemma mradermacher 1 5.2k
cjvt/GaMS3-12B finetune — 11.8B L gemma cjvt 0 5.1k
RedHatAI/gemma-3-12b-it finetune — 12.2B L gemma RedHatAI 1 4.3k
google/gemma-3-12b-pt-qat-q4_0-gguf quantized q4_0 — — gemma google 24 2.7k
RoseG/MiniMiP finetune — 11.8B L gemma RoseG 2 1.7k
p-e-w/gemma-3-12b-it-heretic-v2 finetune — 12.2B L gemma p-e-w 10 1k
espressovi/BODHI-gemma-3-12b-distil finetune — 12.2B L gemma espressovi 0 1k
mlx-community/gemma-3-12b-it-6bit finetune — — — gemma mlx-community 0 1k
iqbalamo93/gemma-3-12b-it-GGUF-q8_0 quantized GGUF — — gemma iqbalamo93 0 875
ToastyPigeon/Gemma-3-Starshine-12B-Alt merge — 11.8B L — ToastyPigeon 8 474
mlx-community/gemma-3-12b-pt-4bit-text quantized -4bit 11.8B L gemma mlx-community 0 806
bharathkumarK/Gemma3-12b-Indic finetune — 13.2B L apache-2.0 bharathkumarK 9 21
aifeifei798/DarkIdol-Aria-12B finetune — 12.2B L gemma aifeifei798 4 212
rahul7star/gemma-3-12b-it-heretic finetune — 12.2B L gemma rahul7star 0 408
ai-for-good-lab/byol-mri-12b-merged finetune — 12.2B L gemma ai-for-good-lab 0 344
patrickliu28/Nile-Chat-12B finetune — 11.8B L gemma patrickliu28 0 341
ai-for-good-lab/byol-mri-12b-it finetune — 12.2B L gemma ai-for-good-lab 0 324
ai-for-good-lab/byol-nya-12b-cpt finetune — 12.2B L gemma ai-for-good-lab 0 322
ai-for-good-lab/byol-nya-12b-it finetune — 12.2B L gemma ai-for-good-lab 0 320
ai-for-good-lab/byol-nya-12b-merged finetune — 12.2B L gemma ai-for-good-lab 0 317

Repository changelog

4 commits

Repository changelog 4 commits

DateCommitSHA
2025-03-21 Update README.md 295efb6
2025-03-19 Adding top_k and top_p to generation_config.json 4b0466f
2025-03-12 Update README.md 09e1051
2025-03-12 Super-squash branch 'main' using huggingface_hub 3c66fb5

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for gemma-3-12b-pt, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
google/gemma-3-12b-pt — — — — — — — live 2026-10-25

Articles and coverage

26 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official4

developers.googleblog.com2025-04-18officialauthorityHN front pageabout the gemma 3 familyHN 602 pts · 276 comments1,077 words
Google released Gemma 3 Quantization-Aware Training (QAT) models that incorporate quantization during training to reduce memory usage while maintaining accuracy. Applying QAT on ~5,000 steps reduces the perplexity drop by 54% when quantizing down to Q4_0, allowing the 27B variant to fit in 14.1 GB of VRAM instead of 54 GB. These int4 models run efficiently on consumer hardware like the NVIDIA RTX 3090 and are available via Ollama, llama.cpp, and MLX.written, reviewed, cited
  • Deploying the largest models often requires lower-precision formats like FP8, potentially accepting a performance trade-off for feasibility.
  • The Gemmaverse offers many alternatives using Post-Training Quantization (PTQ) with contributions from members such as Bartowski, Unsloth, and GGML.
developers.googleblog.com2025-06-26officialauthorityHN front pageabout the gemma 3 familyHN 405 pts · 191 comments1,690 words
Gemma 3n is a mobile-first AI model family designed for on-device use with multimodal capabilities. The E2B and E4B versions have raw parameters of 5B and 8B but operate with as little as 2GB and 3GB of memory respectively. It supports 140 languages for text and includes a MobileNet-V5-300M vision encoder that delivers a 13x speedup with quantization, requires 46% fewer parameters, and has a 4x smaller memory footprint.written, reviewed, cited
  • Developers can create custom-sized models between E2B and E4B by adjusting feed forward network hidden dimensions from 8192 to 16384.
  • The Gemma 3n audio encoder processes clips up to 30 seconds at launch but supports arbitrarily long audios with additional training.
developers.googleblog.com2025-05-20officialauthorityHN front pageabout the gemma 3 familyHN 441 pts · 163 comments904 words
ai.google.dev2025-03-23officialauthorityHN front pageabout the gemma 3 familyHN 202 pts · 32 comments2,144 words

Analysis6

github.com2026-07-04authorityabout the gemma 3 familyHN 6 pts · 2 comments193 words
MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models. The library API and CLI are under active development, therefore they may change without any deprecation notice. The framework is distributed under GPLv3 license and can be installed using Homebrew package manager with brew tap ybubnov/metalchat.written, reviewed, cited
unsloth.ai2025-03-19authorityHN front pageabout the gemma 3 familyHN 226 pts · 78 comments
storage.googleapis.com2025-03-12HN front pageabout the gemma 3 familyHN 488 pts · 245 comments
github.com2026-01-26authorityabout the gemma 3 familyHN 65 pts · 23 comments2,207 words
ollama.com2025-03-12HN front pageabout the gemma 3 familyHN 252 pts · 138 comments
theverge.com2025-03-20HN front pageabout the gemma 3 familyHN 127 pts · 100 comments
All coverage tracked for this model (26) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Open-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com2026-09-172026-10-07hn
Show HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com2026-07-042026-10-07hn
Selectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com2026-03-122026-10-07hn
I have written gemma3 inference in pure Cgithub.com2026-01-262026-10-07hn
Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com official2025-10-102026-10-07hn
Gemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com2025-08-202026-10-07hn
Landrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us2025-08-202026-10-07hn
Gemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com official2025-08-142026-10-07hn
I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com2025-08-112026-10-07hn
Gemma 3n: The Developer Guidesimonwillison.net2025-06-272026-10-07hn
Gemma 3n available in the open-source ecosystemhuggingface.co2025-06-262026-10-07hn
Introducing Gemma 3ndevelopers.googleblog.com official2025-06-262026-10-07hn
A C++ library to efficiently run Gemma-3N across various platformgithub.com2025-06-112026-10-07hn
Gemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com2025-05-252026-10-07hn
Gemma 3n preview: Mobile-first AIdevelopers.googleblog.com official2025-05-202026-10-07hn
Gemma 3 QAT Modelssimonwillison.net2025-04-192026-10-07hn
QAT optimized Gemma 3 slash VRAM needs 54GB –> 14.1GB while maintaining qualityold.reddit.com2025-04-192026-10-07hn
Gemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com official2025-04-182026-10-07hn
Gemma3 Function Callingai.google.dev official2025-03-232026-10-07hn
Google calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com2025-03-202026-10-07hn
Fine-tune Google's Gemma 3unsloth.ai2025-03-192026-10-07hn
Google's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com2025-03-132026-10-07hn
Gemma3 – The current strongest model that fits on a single GPUollama.com2025-03-122026-10-07hn
Gemma 3: The most capable model you can run on a single GPU or TPUblog.google official2025-03-122026-10-07hn
Gemma 3: Google's new multimodal modelsai.google.dev official2025-03-122026-10-07hn
Gemma 3 Technical Report [pdf]storage.googleapis.com2025-03-122026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3.5-9B · 9.65B
    same size band (L), same task (image-text-to-text), more providers, permissive license
  • Llama-Guard-4-12B · 12.0B
    same size band (L), same task (image-text-to-text), more providers
  • translategemma-12b-it · 12.2B
    same size band (L), same task (image-text-to-text)

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:40 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:12 UTC · Last verified 2026-10-25

Follow gemma-3-12b-pt

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.