Models › gemma-3 family

google Gemma Terms of Use out 15 months ago

268M parameters, text in, text out, 32K tokens of context.

Verified 2026-10-25 Rank #167 in LLMs · score 91.3 method v1 Sources 3 Downloads 30d 68.6k · #360 of 619 tracked

Changed this week: 3 new quantized builds on the Hub (54 in all).2026-10-24 · 2 new quantized builds on the Hub (53 in all).2026-10-24

Can I run it?0.2GB at INT4Estimatefits a 16 GB cardmethodCommunity: Run gemma-3-270m Locally | Atomic Chat →
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-24
Do people use it?68.6kdownloads, 30 days#360 of 619 we track · below the median+5 likes, downloads +7% this week1,128 likesHugging Face2026-10-24

Worth reading

Picked by rule from 38 tracked pieces: the lab's own post, the most shared, a field report, the latest.

The lab's own post

Gemma 3 270M: Compact model for hyper-efficient AI

Google released Gemma 3 270M, a compact model with 270 million parameters designed for task-specific fine-tuning.

  • The model includes 170 million embedding parameters due to a large vocabulary size and 100 million for transformer blocks.
  • An instruction-tuned model is released alongside a pre-trained checkpoint for developers needing different training starting points.
developers.googleblog.com 2025-08-14 824 HN pts · 317 comments 1k words
Most discussed · 488 HN pts
storage.googleapis.com 2025-03-12 488 HN pts · 245 comments about the gemma 3 family family
Latest · 4 months ago

Show HN: Gemma 3 inference in pure C++ with Metal acceleration

MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models.

github.com 2026-07-04 6 HN pts · 2 comments 193 words about the gemma 3 family family

25 best of 38 tracked

The 4 picks above, plus these 21. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeOpen-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com · 2026-09-17
  2. ArticleGemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com · 2025-04-18 · 602 HN pts · official
  3. ArticleIntroducing Gemma 3ndevelopers.googleblog.com · 2025-06-26 · 405 HN pts · official
  4. ArticleGemma 3n preview: Mobile-first AIdevelopers.googleblog.com · 2025-05-20 · 441 HN pts · official
  5. ArticleGemma3 Function Callingai.google.dev · 2025-03-23 · 202 HN pts · official
  6. ArticleFine-tune Google's Gemma 3unsloth.ai · 2025-03-19 · 226 HN pts
  7. CodeI have written gemma3 inference in pure Cgithub.com · 2026-01-26 · 65 HN pts
  8. ArticleGemma3 – The current strongest model that fits on a single GPUollama.com · 2025-03-12
  9. ArticleGoogle calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com · 2025-03-20
  10. Paper[2503.19786] Gemma 3 Technical Reportar5iv.labs.arxiv.org · undated
  11. ArticleGemma 3 270M - Intelligence, Performance & Price Analysisartificialanalysis.ai · undated
  12. ArticleGemma 3: Google's new multimodal modelsai.google.dev · 2025-03-12 · official
  13. ArticleGemma 3: The most capable model you can run on a single GPU or TPUblog.google · 2025-03-12 · official
  14. ArticleOwn your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com · 2025-10-10 · official
  15. ArticleGemma 3 QAT Modelssimonwillison.net · 2025-04-19
  16. DiscussionGemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com · 2025-05-25
  17. ArticleGemma 3n available in the open-source ecosystemhuggingface.co · 2025-06-26
  18. ArticleIntroducing Gemma 3 270M: The compact model for hyper-efficient AI - Google Developers Blogdevelopers.googleblog.com · 2025-08-14 · official
  19. ArticleGemma 3n: The Developer Guidesimonwillison.net · 2025-06-27
  20. ArticleLandrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us · 2025-08-20
  21. CodeA C++ library to efficiently run Gemma-3N across various platformgithub.com · 2025-06-11

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 54 quantized builds and 54 Spaces.

  • As a service0no API provider listed
  • On own hardware54quantized builds
  • Built on225165 fine-tunes · 51 adapters · 9 merges
  • In apps54Hugging Face Spaces

Top Spaces running it: jairwaal/image ♥ 16 · umint/gemma-3-270m ♥ 15 · hadadxyz/google-gemma-3-270m ♥ 15 · UniversalComputingResearch/clmi ♥ 8

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.2 GB at INT4, 0.3 GB at FP8, 0.6 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.2 GB of weights (estimate; KV cache and activations extra)INT40.2 GBFP8: about 0.3 GB of weights (estimate; KV cache and activations extra)FP80.3 GBBF16: about 0.6 GB of weights (estimate; KV cache and activations extra)BF160.6 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.2 GB of weights (estimate; KV cache and activations extra)INT40.2 GBFP8: about 0.3 GB of weights (estimate; KV cache and activations extra)FP80.3 GBBF16: about 0.6 GB of weights (estimate; KV cache and activations extra)BF160.6 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-08-05), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

279 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

279 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

54 quantized (Hugging Face model tree)165 fine-tunes (Hugging Face model tree)9 merges (Hugging Face model tree)51 adapters (Hugging Face model tree)54 quantized165 fine-tunes9 merges51 adapters
54 quantized (Hugging Face model tree)165 fine-tunes (Hugging Face model tree)9 merges (Hugging Face model tree)51 adapters (Hugging Face model tree)54 quantized165 fine-tunes9 merges51 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

13 rows

Benchmarks 13 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (13)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported ARC Challenge · Chat and follow instructions29Gemma 3 PT 270M (25-shot)model author2026-10-07
author-reported ARC Challenge · Chat and follow instructions28.2Gemma 3 IT 270m (0-shot)model author2026-10-07
author-reported BBH · Reason through hard problems26.7Gemma 3 IT 270m (few-shot)model author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions61.4Gemma 3 PT 270M (0-shot)model author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions67.7Gemma 3 PT 270M (0-shot)model author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions15.4Gemma 3 PT 270M (5-shot)model author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions57.7Gemma 3 PT 270M (0-shot)model author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions66.2Gemma 3 IT 270m (0-shot)model author2026-10-07
author-reported HellaSwag · Chat and follow instructions40.9Gemma 3 PT 270M (10-shot)model author2026-10-07
author-reported HellaSwag · Chat and follow instructions37.7Gemma 3 IT 270m (0-shot)model author2026-10-07
author-reported IFEval · Chat and follow instructions51.2Gemma 3 IT 270m (0-shot)model author2026-10-07
author-reported Winogrande · Chat and follow instructions52Gemma 3 PT 270M (5-shot)model author2026-10-07
author-reported Winogrande · Chat and follow instructions52.3Gemma 3 IT 270m (0-shot)model author2026-10-07

What the card says

2 cited sentences

Summary generated, cited

Gemma 3 270M is a multimodal text-generation model with 268M parameters.[1][2] The model supports a 32K token input context and was trained on 6 trillion tokens.[3][4]

  1. parameters human
  2. “text-generation”
  3. “32K tokens for the 1B and 270M sizes”
  4. “the 270M with 6 trillion tokens”

Generated 2026-10-07 15:03 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

5 use cases

What it is good at 5 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Servability

vLLM · SGLang

Servability

vLLM: supported · Gemma3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Gemma3ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for gemma-3-270m: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)0.6 GB · Edge (<4 GB)
FP8 (1 byte/param)0.3 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.2 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: google/gemma-3 279 derivatives on the Hub

finetune: 165quantized: 54adapter: 51merge: 9

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
unsloth/gemma-3-270m finetune — 268M S gemma unsloth 5 77.6k
gguf-org/gemma-3-270m-gguf quantized gguf — — gemma gguf-org 5 35.5k
pixasocial/survival-uncensored-gemma-270m quantized GGUF 268M S mit pixasocial 17 31k
ggml-org/gemma-3-270m-GGUF quantized GGUF — — — ggml-org 22 26.1k
ai4bharat/Cadence-Fast finetune — 268M S mit ai4bharat 6 16k
reaperdoesntknow/Gemma-3-270m-Opus-Distil finetune — 268M S gemma reaperdoesntknow 1 11.8k
QuantFactory/gemma-3-270m-it-GGUF quantized GGUF — — gemma QuantFactory 4 8.5k
arkanathp/llmae-gemma-270m-s2 adapter — — — gemma arkanathp 0 8.5k
unsloth/gemma-3-270m-bnb-4bit quantized -bnb 271M S gemma unsloth 0 8.4k
Papuguinho/gemmuguinho-636m finetune — 637M S gemma Papuguinho 1 8.4k
pthinc/Cicikus_v4_0.3B_Pitircik quantized GGUF 268M S other pthinc 2 7.1k
Kashif786/gemma-3-270m-sindhi finetune — 280M S gemma Kashif786 0 7k
tardellirs/gemma3moe-16x4-270m-starter finetune — 1.33B S gemma tardellirs 0 7k
DevQuasar/google.gemma-3-270m-GGUF quantized GGUF — — — DevQuasar 1 6.2k
reaperdoesntknow/gemma-270m-math-reasoner finetune — 268M S apache-2.0 reaperdoesntknow 0 5.4k
Mungert/gemma-3-270m-it-GGUF quantized GGUF — — gemma Mungert 1 5.3k
daniloreddy/gemma-3-270m-it_GGUF quantized GGUF — — apache-2.0 daniloreddy 1 5.2k
ZuzeTt/gemma-3-270m-it-heretic-GGUF quantized GGUF — — gemma ZuzeTt 2 5k
TuwaiqAcademy/AISA-AR-FunctionCall-Think finetune — 268M S gemma TuwaiqAcademy 3 4k
p-e-w/gemma-3-270m-it-heretic finetune — 268M S gemma p-e-w 15 2.6k
google/gemma-3-270m-qat-q4_0-unquantized finetune q4_0 268M S gemma google 9 2.8k
mlx-community/gemma-3-270m-4bit quantized -4bit 436M S gemma mlx-community 0 3.2k
Gramscii-IT/SemanticRepair-270M quantized GGUF 268M S gemma Gramscii-IT 2 2.8k
Dminimax/gemma-3-270m-gguf quantized gguf — — gemma Dminimax 0 2.5k
NikolayKozloff/gemma-3-270m-Q8_0-GGUF quantized Q8_0 — — gemma NikolayKozloff 2 1.3k
sappho192/gemma3-multilingual-translator-270m finetune — 268M S apache-2.0 sappho192 5 1.1k
leochen085/SLIP finetune — 569M S mit leochen085 2 1k
hugginllam/gemma-3-270m-Q4_K_M-GGUF quantized GGUF — — gemma hugginllam 1 1.1k
keke0130/gemma-3-270m-chinese-title-generator-gguf quantized gguf — — gemma keke0130 0 1.1k
bourn23/google-gemma-3-270m-mlx finetune mlx 268M S gemma bourn23 0 1k
SandLogicTechnologies/Gemma-3-270m-GGUF quantized GGUF — — gemma SandLogicTechnologies 2 890
Skshackster/gemma3-270m-mental-health-fine-tuned-gguf adapter gguf — — mit Skshackster 2 884
oopere/gemma-3-270m-14L-distilled finetune — 246M S apache-2.0 oopere 3 786
sr5434/sft_model finetune — 268M S — sr5434 0 930
mlx-community/gemma-3-270m-bf16 finetune -bf16 436M S gemma mlx-community 0 885
QLNI/embeddings-are-overpriced quantized GGUF — — other QLNI 4 637
1kxia/gemma-3-270m-modelopt-fp8 finetune -fp8 268M S gemma 1kxia 0 784
gghfez/openwebui-title-generator-270m finetune — 268M S gemma gghfez 8 376
davron04/gemma-3-270m-dueta finetune — 268M S mit davron04 1 710
Atomic-Germ/Gemma3-270M-NPU2 finetune — — — gemma Atomic-Germ 0 719

Repository changelog

7 commits
changed in the last 7 daysOther: 2026-10-24, 2026-10-24all changes

Repository changelog 7 commits

DateCommitSHA
2025-08-14 Update README.md 9b0cfec
2025-08-13 Update README.md 5e2bf23
2025-08-13 Update README.md 66318b1
2025-08-13 Removing chat template 73d69fa
2025-08-11 Update README.md 7a52caa
2025-08-05 uploading the PT weights for Gemma 3 270m 603ad58
2025-08-05 initial commit 7b6d9f0

Articles and coverage

38 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official5

developers.googleblog.com2025-08-14officialauthorityHN front pageHN 824 pts · 317 comments1,027 words
Google released Gemma 3 270M, a compact model with 270 million parameters designed for task-specific fine-tuning. The model features a vocabulary of 256k tokens and achieved 0.75% battery usage on a Pixel 9 Pro SoC during INT4-quantized testing. It provides production-ready quantization for INT4 precision with minimal performance degradation.written, reviewed, cited
  • The model includes 170 million embedding parameters due to a large vocabulary size and 100 million for transformer blocks.
  • An instruction-tuned model is released alongside a pre-trained checkpoint for developers needing different training starting points.
developers.googleblog.com2025-04-18officialauthorityHN front pageabout the gemma 3 familyHN 602 pts · 276 comments1,077 words
Google released Gemma 3 Quantization-Aware Training (QAT) models that incorporate quantization during training to reduce memory usage while maintaining accuracy. Applying QAT on ~5,000 steps reduces the perplexity drop by 54% when quantizing down to Q4_0, allowing the 27B variant to fit in 14.1 GB of VRAM instead of 54 GB. These int4 models run efficiently on consumer hardware like the NVIDIA RTX 3090 and are available via Ollama, llama.cpp, and MLX.written, reviewed, cited
  • Deploying the largest models often requires lower-precision formats like FP8, potentially accepting a performance trade-off for feasibility.
  • The Gemmaverse offers many alternatives using Post-Training Quantization (PTQ) with contributions from members such as Bartowski, Unsloth, and GGML.
developers.googleblog.com2025-06-26officialauthorityHN front pageabout the gemma 3 familyHN 405 pts · 191 comments1,690 words
Gemma 3n is a mobile-first AI model family designed for on-device use with multimodal capabilities. The E2B and E4B versions have raw parameters of 5B and 8B but operate with as little as 2GB and 3GB of memory respectively. It supports 140 languages for text and includes a MobileNet-V5-300M vision encoder that delivers a 13x speedup with quantization, requires 46% fewer parameters, and has a 4x smaller memory footprint.written, reviewed, cited
  • Developers can create custom-sized models between E2B and E4B by adjusting feed forward network hidden dimensions from 8192 to 16384.
  • The Gemma 3n audio encoder processes clips up to 30 seconds at launch but supports arbitrarily long audios with additional training.
developers.googleblog.com2025-05-20officialauthorityHN front pageabout the gemma 3 familyHN 441 pts · 163 comments904 words
ai.google.dev2025-03-23officialauthorityHN front pageabout the gemma 3 familyHN 202 pts · 32 comments2,144 words

Analysis5

github.com2026-07-04authorityabout the gemma 3 familyHN 6 pts · 2 comments193 words
MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models. The library API and CLI are under active development, therefore they may change without any deprecation notice. The framework is distributed under GPLv3 license and can be installed using Homebrew package manager with brew tap ybubnov/metalchat.written, reviewed, cited
unsloth.ai2025-03-19authorityHN front pageabout the gemma 3 familyHN 226 pts · 78 comments
storage.googleapis.com2025-03-12HN front pageabout the gemma 3 familyHN 488 pts · 245 comments
github.com2025-08-20authorityHN front pageHN 417 pts · 57 comments327 words
github.com2026-01-26authorityabout the gemma 3 familyHN 65 pts · 23 comments2,207 words
All coverage tracked for this model (38) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
[2503.19786] Gemma 3 Technical Reportar5iv.labs.arxiv.org—2026-10-07exa
Gemma 3 270M - Intelligence, Performance & Price Analysisartificialanalysis.ai—2026-10-07exa
Gemma 3 270M, line by line · Ali Janatialijanati.com—2026-10-07exa
Run gemma-3-270m Locally | Atomic Chatatomic.chat—2026-10-07exa
Build Gemma-3-270M from Scratch in Pytorch - AI Engineeringaiengineering.beehiiv.com—2026-10-07exa
Open-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com2026-09-172026-10-07hn
Show HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com2026-07-042026-10-07hn
Selectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com2026-03-122026-10-07hn
I have written gemma3 inference in pure Cgithub.com2026-01-262026-10-07hn
Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com official2025-10-102026-10-07hn
Tiny gemma3 270M implementation in Rgithub.com2025-08-252026-10-07hn
You can fine-tune Gemma3-270M and prepare for secure deployment within minutesyoutube.com2025-08-242026-10-07hn
Gemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com2025-08-202026-10-07hn
Landrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us2025-08-202026-10-07hn
Why Google’s Gemma 3 270M can signal a new direction for AI - TechTalksbdtechtalks.com2025-08-182026-10-07exa
The Sequence Radar #704: Tiny Titan: Inside Google's Gemma 3 270Mthesequence.substack.com2025-08-172026-10-07exa
Gemma 3 270M – Google's NEW AI – How to Fin-tune Gemma3 [video]youtube.com2025-08-162026-10-07hn
Gemma 3 270Mtwitter.com2025-08-142026-10-07hn
Gemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com official2025-08-142026-10-07hn
Introducing Gemma 3 270M: The compact model for hyper-efficient AI - Google Developers Blogdevelopers.googleblog.com official2025-08-142026-10-07exa
I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com2025-08-112026-10-07hn
Gemma 3n: The Developer Guidesimonwillison.net2025-06-272026-10-07hn
Gemma 3n available in the open-source ecosystemhuggingface.co2025-06-262026-10-07hn
Introducing Gemma 3ndevelopers.googleblog.com official2025-06-262026-10-07hn
A C++ library to efficiently run Gemma-3N across various platformgithub.com2025-06-112026-10-07hn
Gemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com2025-05-252026-10-07hn
Gemma 3n preview: Mobile-first AIdevelopers.googleblog.com official2025-05-202026-10-07hn
Gemma 3 QAT Modelssimonwillison.net2025-04-192026-10-07hn
QAT optimized Gemma 3 slash VRAM needs 54GB –> 14.1GB while maintaining qualityold.reddit.com2025-04-192026-10-07hn
Gemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com official2025-04-182026-10-07hn
Gemma3 Function Callingai.google.dev official2025-03-232026-10-07hn
Google calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com2025-03-202026-10-07hn
Fine-tune Google's Gemma 3unsloth.ai2025-03-192026-10-07hn
Google's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com2025-03-132026-10-07hn
Gemma3 – The current strongest model that fits on a single GPUollama.com2025-03-122026-10-07hn
Gemma 3: The most capable model you can run on a single GPU or TPUblog.google official2025-03-122026-10-07hn
Gemma 3: Google's new multimodal modelsai.google.dev official2025-03-122026-10-07hn
Gemma 3 Technical Report [pdf]storage.googleapis.com2025-03-122026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • functiongemma-270m-it · 268M
    same size band (S), same task (text-generation)
  • LFM2.5-230M · 230M
    same size band (S), same task (text-generation)
  • pythia-160m · 213M
    same size band (S), same task (text-generation), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:03 UTC · Last verified 2026-10-25

Follow gemma-3-270m

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.