Models › gemma-3 family

google Gemma Terms of Use out 20 months ago

4.30B parameters, images and text in, text out, 128K tokens of context. 3 providers serve it from $0.040 per million input tokens.

Verified 2026-10-25 Rank #29 in LLMs · score 113.7 method v1 Sources 5 Downloads 30d 988.1k · #111 of 619 tracked

Changed this week: Cheapest input price fell 20%: $0.050 → $0.040 per 1M (OpenRouter).2026-10-24 · 1 new quantized build on the Hub (492 in all).2026-10-24

Can I run it?2.6GB at INT4Estimatefits a 16 GB cardmethod
What does it cost?$0.040/1M incheapest of 2Parasailbf162026-10-24
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-24
Does it work?19.62on BFCL#27 of 28 measuredleaderboard2026-10-25
Do people use it?988.1kdownloads, 30 days#111 of 619 we track · top 18%+13 likes, downloads −10% this week1,596 likesHugging Face2026-10-24

Worth reading

Picked by rule from 35 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 488 HN pts
storage.googleapis.com 2025-03-12 488 HN pts · 245 comments about the gemma 3 family family
Latest · 38 days ago

Open-jev: One-pass option scoring with Gemma 3 4B, similar to jev

An open-source implementation of Jev option scoring runs on local Gemma 3 4B models using MLX on Apple silicon or PyTorch on other platforms.

  • Frozen-feature extraction and head training workflows currently require MLX on Apple silicon.
  • PMI normalization requires an extra batched pass to subtract the option's unconditional log-prob.
github.com 2026-09-17 7 HN pts · 1 comments 2.1k words

25 best of 35 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com · 2026-07-04 · 6 HN pts
  2. ArticleGemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com · 2025-08-14 · official
  3. ArticleGemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com · 2025-04-18 · 602 HN pts · official
  4. ArticleIntroducing Gemma 3ndevelopers.googleblog.com · 2025-06-26 · 405 HN pts · official
  5. ArticleGemma 3n preview: Mobile-first AIdevelopers.googleblog.com · 2025-05-20 · 441 HN pts · official
  6. ArticleGemma3 Function Callingai.google.dev · 2025-03-23 · 202 HN pts · official
  7. ArticleFine-tune Google's Gemma 3unsloth.ai · 2025-03-19 · 226 HN pts
  8. ArticleGemma explained: What's new in Gemma 3developers.googleblog.com · undated · official
  9. CodeGemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com · 2025-08-20
  10. CodeI have written gemma3 inference in pure Cgithub.com · 2026-01-26 · 65 HN pts
  11. ArticleGemma3 – The current strongest model that fits on a single GPUollama.com · 2025-03-12
  12. ArticleGoogle calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com · 2025-03-20
  13. ArticleGemma 3 4B Instruct Intelligence, Performance & Price Analysisartificialanalysis.ai · undated
  14. ArticleGemma 3: Google's new multimodal modelsai.google.dev · 2025-03-12 · official
  15. ArticleGemma 3: The most capable model you can run on a single GPU or TPUblog.google · 2025-03-12 · official
  16. ArticleOwn your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com · 2025-10-10 · official
  17. ArticleGemma 3 QAT Modelssimonwillison.net · 2025-04-19
  18. DiscussionGemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com · 2025-05-25
  19. ArticleGemma 3n available in the open-source ecosystemhuggingface.co · 2025-06-26
  20. ArticleGemma 3n: The Developer Guidesimonwillison.net · 2025-06-27
  21. ArticleLandrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us · 2025-08-20
  22. CodeA C++ library to efficiently run Gemma-3N across various platformgithub.com · 2025-06-11
  23. ArticleSelectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com · 2026-03-12

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

2 providers from $0.040

2 providers with a live price, from $0.040 to $0.050 per million input tokens; the median is $0.045. One dot per provider, cheapest in teal.

$0.010$0.10$1.00$10.00Parasail: $0.040 in / $0.050 out per 1M · observed 2026-10-24 · https://api.parasail.io/v1/modelsDeepInfra: $0.050 in / $0.10 out per 1M · observed 2026-10-25 · https://huggingface.co/api/models/google/gemma-3-4b-it?expand[]=inferenceProviderMappingcheapest $0.040median $0.045
$0.010$0.10$1.00$10.00Parasail: $0.040 in / $0.050 out per 1M · observed 2026-10-24 · https://api.parasail.io/v1/modelsDeepInfra: $0.050 in / $0.10 out per 1M · observed 2026-10-25 · https://huggingface.co/api/models/google/gemma-3-4b-it?expand[]=inferenceProviderMappingcheapest $0.040 · median $0.045 (white tick)
#Cheapest 3In /1MOut /1MContextQuantSeen
1 Parasail $0.040 $0.050 128K bf16 Oct 24
2 DeepInfra $0.050 $0.10 128K bfloat16 Oct 25
3 Featherless — — — — Oct 25

All 3 providers →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 3 API providers; heavily run locally (492 quantized builds); a big base for builders (1,354 fine-tunes, adapters and merges).

  • As a service3DeepInfra, Featherless, Parasail
  • On own hardware492quantized builds
  • Built on1,354848 fine-tunes · 503 adapters · 3 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: ginigen/VEO3-Free ♥ 461 · ginigen/VEO3-Directors ♥ 92 · hadadrjt/ai ♥ 86 · TIGER-Lab/MEGA-Bench ♥ 51

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 2.6 GB at INT4, 5.2 GB at FP8, 10 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.6 GB of weights (estimate; KV cache and activations extra)INT42.6 GBFP8: about 5.2 GB of weights (estimate; KV cache and activations extra)FP85.2 GBBF16: about 10 GB of weights (estimate; KV cache and activations extra)BF1610 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.6 GB of weights (estimate; KV cache and activations extra)INT42.6 GBFP8: about 5.2 GB of weights (estimate; KV cache and activations extra)FP85.2 GBBF16: about 10 GB of weights (estimate; KV cache and activations extra)BF1610 GB

Estimate params × bytes per param × 1.2 · how we estimate

How it scores

Third-party measurements only; author-reported numbers stay in Reference, marked as such.

#27 of 28 on BFCL so far

19.62. Each tick is a model on this site with a measured BFCL row; author-reported numbers stay in Reference. Percent (overall accuracy). Prompt

zai-org/GLM-4.6: 72.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmoonshotai/Kimi-K2-Instruct: 59.06 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmldeepseek-ai/DeepSeek-V3.2-Exp: 54.12 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 52.15 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 48.71 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 47.99 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 46.78 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlSalesforce/Llama-xLAM-2-8b-fc-r: 46.68 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 42.57 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 41.39 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 41.03 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 40.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 37.77 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 36.7 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.68 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.52 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.3-70B-Instruct: 31.9 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-12b-it: 30.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-27b-it: 29.47 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmicrosoft/phi-4: 28.79 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-1.7B: 28.41 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-4-Scout-17B-16E-Instruct: 28.13 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.1-8B-Instruct: 25.83 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 23.93 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 22.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.2-3B-Instruct: 21.95 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-1b-it: 7.17 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.html010019.62 · #27 of 28
zai-org/GLM-4.6: 72.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmoonshotai/Kimi-K2-Instruct: 59.06 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmldeepseek-ai/DeepSeek-V3.2-Exp: 54.12 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 52.15 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 48.71 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 47.99 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 46.78 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlSalesforce/Llama-xLAM-2-8b-fc-r: 46.68 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 42.57 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 41.39 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 41.03 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 40.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 37.77 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 36.7 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.68 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.52 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.3-70B-Instruct: 31.9 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-12b-it: 30.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-27b-it: 29.47 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmicrosoft/phi-4: 28.79 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-1.7B: 28.41 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-4-Scout-17B-16E-Instruct: 28.13 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.1-8B-Instruct: 25.83 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 23.93 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 22.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.2-3B-Instruct: 21.95 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-1b-it: 7.17 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.html010019.62 · #27 of 28

Source · leaderboard · 2026-10-25

Day-one receipts

Claim-matched tests, graded by code. Receipts, not a score.

Speed run● pass
{
  "providers": [
    {
      "provider": "parasail",
      "endpoint_model": "parasail-googlegemma-3-4b-it",
      "source_url": "https://api.parasail.io/v1/chat/completions",
      "ttft_ms_median": 460,
      "ttft_any_ms_median": 460,
      "tokens_per_s_median": 108.5,
      "runs": [
        {
          "ttft_s": 0.516,
          "ttft_any_s": 0.516,
          "tokens_per_s": 106.5,
          "latency_s": 1.65,
          "tokens_out": 176,
          "reasoning_chars": 0,
          "finish": "stop"
        },
        {
          "ttft_s": 0.454,
          "ttft_any_s": 0.454,
          "tokens_per_s": 116.6,
          "latency_s": 1.51,
          "tokens_out": 176,
          "reasoning_chars": 0,
          "finish": "stop"
        },
        {
          "ttft_s": 0.46,
          "ttft_any_s": 0.46,
          "tokens_per_s": 108.5,
          "latency_s": 1.62,
          "tokens_out": 176,
          "reasoning_chars": 0,
          "finish": "stop"
        }
      ]
    }
  ],
  "note": "Single client, wall clock; tok/s counts every output token including hidden reasoning."
}
Messy addresses to JSON✕ fail
{
  "fields_matched": 59,
  "fields_total": 80,
  "cost_per_1000_usd": 0.443,
  "parsed": true,
  "per_item": [
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": false,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": false,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": false
    }
  ],
  "sample": [
    {
      "street": "1600 Amphitheatre Parkway",
      "unit": null,
      "city": "Mountain View",
      "region": "CA",
      "postcode": "94043",
      "country": "USA"
    },
    {
      "street": "10 Downing Street",
      "unit": null,
      "city": "London",
      "region": null,
      "postcode": "SW1A 2AA",
      "country": "GBR"
    },
    {
      "street": "Rua Augusta 274",
      "unit": null,
      "city": "Lisbon",
      "region": null,
      "postcode": "1100-053",
      "country": "PT"
    }
  ],
  "fixture": "receipts.addresses.v1"
}
59/80 fields · $0.443 per 1,000 · 2026-10-096.8 s

The story so far

Weights, every dated article, and repo commits on one rail.

9 dated articles and 6 repo commits so far

Teal is the weights (2025-02-20), amber triangles are 9 dated articles (each links to it), grey ticks are repo commits.

What people built on it

1,846 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

1,846 derivatives on the Hub, led by 848 fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

492 quantized (Hugging Face model tree)848 fine-tunes (Hugging Face model tree)3 merges (Hugging Face model tree)503 adapters (Hugging Face model tree)492 quantized848 fine-tunes3 merges503 adapters
492 quantized (Hugging Face model tree)848 fine-tunes (Hugging Face model tree)3 merges (Hugging Face model tree)503 adapters (Hugging Face model tree)492 quantized848 fine-tunes3 merges503 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

17 rows

Benchmarks 17 rows

measured third-party leaderboard row (1)author-reported number from the model card or eval files (16)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
measured BFCL · Call tools and APIs19.62 percent (overall accuracy)Prompt
5 sub-scores
  • Non-Live AST Acc: 61.12
  • Live Acc: 60.84
  • Multi Turn Acc: 0.38
  • Web Search Acc: 1
  • Memory Acc: 8.6
leaderboard2026-10-25
author-reported AGIEval42.1Gemma 3 PT 4Bmodel author2026-10-07
author-reported ARC Challenge · Chat and follow instructions56.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported BBH · Reason through hard problems50.9Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions72.3Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions79.6Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions51.9Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions65.8Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions20Gemma 3 PT 4Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions82.4Gemma 3 PT 4Bmodel author2026-10-07
author-reported DROP60.1Gemma 3 PT 4Bmodel author2026-10-07
author-reported GSM8K · Reason through hard problems38.4Gemma 3 PT 4Bmodel author2026-10-07
author-reported HellaSwag · Chat and follow instructions77.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported MATH-500 · Reason through hard problems24.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported MMLU · Reason through hard problems59.6Gemma 3 PT 4Bmodel author2026-10-07
author-reported MMLU-Pro · Reason through hard problems29.2Gemma 3 PT 4Bmodel author2026-10-07
author-reported Winogrande · Chat and follow instructions64.7Gemma 3 PT 4Bmodel author2026-10-07

What the card says

2 cited sentences

Summary generated, cited

Gemma 3 4B IT is an instruction-tuned multimodal model with 4.30B parameters.[1][2] It is released under the Gemma Terms of Use and supports a 128K context window.[3][4]

  1. parameters human
  2. “instruction-tuned”
  3. license
  4. “128K context window”

Generated 2026-10-07 14:59 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesGemma3ForConditionalGeneration
Model typegemma3
Dtypebfloat16
Params by dtypeBF16: 4,300,079,472
Size bandM
MoEno
Context length131,072 (provider listing)
Gatedmanual
PapersarXiv:1905.07830, arXiv:1905.10044, arXiv:1911.11641, arXiv:1904.09728, arXiv:1705.03551, arXiv:1911.01547, arXiv:1907.10641, arXiv:1903.00161, arXiv:2009.03300, arXiv:2304.06364, arXiv:2103.03874, arXiv:2110.14168, arXiv:2311.12022, arXiv:2108.07732, arXiv:2107.03374, arXiv:2210.03057, arXiv:2106.03193, arXiv:1910.11856, arXiv:2502.12404, arXiv:2502.21228, arXiv:2404.16816, arXiv:2104.12756, arXiv:2311.16502, arXiv:2203.10244, arXiv:2404.12390, arXiv:1810.12440, arXiv:1908.02660, arXiv:2312.11805
LicenseGemma Terms of Use (gemma)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Gemma3ForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Gemma3ForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for gemma-3-4b-it: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)10 GB · Single GPU (<24 GB)
FP8 (1 byte/param)5.2 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)2.6 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from google/gemma-3-4b-pt (same organization) Family: google/gemma-3 1,846 derivatives on the Hub

Base model: google/gemma-3-4b-pt

quantized: 492finetune: 848adapter: 503merge: 3

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
MaziyarPanahi/gemma-3-4b-it-GGUF quantized GGUF — — — MaziyarPanahi 20 3.6M
lmstudio-community/gemma-3-4b-it-GGUF quantized GGUF — — gemma lmstudio-community 31 1.8M
unsloth/gemma-3-4b-it-unsloth-bnb-4bit quantized -bnb 4.39B M gemma unsloth 25 1.7M
unsloth/gemma-3-4b-it finetune — 4.30B M gemma unsloth 28 1.6M
unsloth/gemma-3-4b-it-GGUF quantized GGUF — — gemma unsloth 208 1.4M
ggml-org/gemma-3-4b-it-GGUF quantized GGUF — — gemma ggml-org 62 666.3k
bartowski/google_gemma-3-4b-it-GGUF quantized GGUF — — — bartowski 39 571.9k
unsloth/gemma-3-4b-it-bnb-4bit quantized -bnb 4.41B M gemma unsloth 12 434.3k
sarvamai/sarvam-translate finetune — 4.30B M gpl-3.0 sarvamai 163 412k
farbodtavakkoli/OTel-LLM-4B-IT finetune — 4.30B M apache-2.0 farbodtavakkoli 1 325.6k
gaunernst/gemma-3-4b-it-int4-awq quantized int4 4.30B M gemma gaunernst 8 253.1k
soob3123/amoral-gemma3-4B-v1 quantized GGUF 4.30B M apache-2.0 soob3123 23 190.7k
google/gemma-3-4b-it-qat-q4_0-gguf quantized q4_0 — — gemma google 313 156.4k
lmstudio-community/gemma-3-4B-it-qat-GGUF quantized GGUF — — gemma lmstudio-community 18 152k
gaunernst/gemma-3-4b-it-qat-compressed-tensors quantized compressed-tensors 4.40B M gemma gaunernst 3 123k
ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g quantized GPTQ 4.33B M gemma ISTA-DASLab 7 102.4k
RedHatAI/gemma-3-4b-it-quantized.w4a16 quantized -quant 5.00B M gemma RedHatAI 5 91.8k
gghfez/gemma-3-4b-novision finetune — 3.88B M gemma gghfez 7 75.7k
nvidia/Nemotron-Content-Safety-Reasoning-4B finetune — 4.30B M other nvidia 35 53.2k
google/gemma-3-4b-it-qat-int4-unquantized finetune int4 4.30B M gemma google 10 47.3k
nvidia/Nemotron-3-Content-Safety finetune — 4.30B M other nvidia 22 45.3k
mlabonne/gemma-3-4b-it-abliterated-GGUF quantized GGUF — — gemma mlabonne 36 37.6k
RedHatAI/gemma-3-4b-it-FP8-dynamic quantized -FP8 4.30B M apache-2.0 RedHatAI 3 39.2k
DavidAU/gemma-3-4b-it-heretic-uncensored-abliterated-Extreme finetune — 4.30B M — DavidAU 13 37.6k
neo4j/text-to-cypher-Gemma-3-4B-Instruct-2025.04.0 finetune — 4.30B M gemma neo4j 27 35.9k
google/gemma-3-4b-it-qat-q4_0-unquantized finetune q4_0 4.30B M gemma google 13 35.3k
mlabonne/gemma-3-4b-it-abliterated finetune — 4.30B M gemma mlabonne 31 26.1k
qiaw99/Gemma3-4b-it-LogiQA-DPO-D adapter — — — — qiaw99 0 26.7k
DavidAU/Gemma-3-4b-it-MAX-NEO-Imatrix-GGUF quantized Imatrix — — apache-2.0 DavidAU 13 24.3k
DavidAU/Gemma-3-4b-it-MAX-HORROR-Imatrix-GGUF quantized Imatrix — — apache-2.0 DavidAU 8 23.5k
mshojaei77/gemma-3-4b-persian-v0 quantized GGUF 4.30B M apache-2.0 mshojaei77 20 21.4k
aisingapore/Gemma-SEA-LION-v4-4B-VL-GGUF finetune GGUF — — gemma aisingapore 0 21.2k
second-state/gemma-3-4b-it-GGUF quantized GGUF — — gemma second-state 0 17.6k
INSAIT-Institute/MamayLM-Gemma-3-4B-IT-v1.0 finetune — 4.30B M gemma INSAIT-Institute 16 16.8k
Mungert/X-Ray_Alpha-GGUF quantized GGUF — — gemma Mungert 6 17k
qiaw99/Gemma3-4b-it-OpenbookQA-DPO-G-v1 adapter — — — — qiaw99 0 16.8k
gaunernst/gemma-3-4b-it-qat-autoawq quantized awq 4.30B M gemma gaunernst 2 16.1k
qiaw99/Gemma3-4b-it-OpenbookQA-DPO-F-v1 adapter — — — — qiaw99 0 16.2k
mlabonne/gemma-3-4b-it-abliterated-v2 finetune — 3.88B M gemma mlabonne 11 14.8k
qiaw99/Gemma3-4b-it-LogiQA-DPO-F adapter — — — — qiaw99 0 15.1k

Repository changelog

6 commits
changed in the last 7 daysPrice moves: 2026-10-24Other: 2026-10-24all changes

Repository changelog 6 commits

DateCommitSHA
2025-03-21 Update README (#25) 093f9f3
2025-03-21 Update README.md (#24) 31fa622
2025-03-19 Adding top_k and top_p to generation_config.json b11f99a
2025-03-12 Update README.md dbd91bb
2025-03-12 Update chat_template (#6) 34b1dc0
2025-03-12 Super-squash branch 'main' using huggingface_hub cf8f852

All providers

3 providers · 3 endpoints

Where to run 3 providers · 3 endpoints

Hosted endpoints observed for gemma-3-4b-it, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.04/M.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Parasail
parasail, openrouter
parasail-googlegemma-3-4b-it 128K bf16 $0.04 $0.05 — — — serverless 2026-10-24
DeepInfra
hf, deepinfra, openrouter
google/gemma-3-4b-it 128K bfloat16 $0.05 $0.10 90.9 327 ms yes live 2026-10-25
Featherless
hf
google/gemma-3-4b-it — — — — — — — live 2026-10-25

Articles and coverage

35 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official5

developers.googleblog.com2025-04-18officialauthorityHN front pageabout the gemma 3 familyHN 602 pts · 276 comments1,077 words
Google released Gemma 3 Quantization-Aware Training (QAT) models that incorporate quantization during training to reduce memory usage while maintaining accuracy. Applying QAT on ~5,000 steps reduces the perplexity drop by 54% when quantizing down to Q4_0, allowing the 27B variant to fit in 14.1 GB of VRAM instead of 54 GB. These int4 models run efficiently on consumer hardware like the NVIDIA RTX 3090 and are available via Ollama, llama.cpp, and MLX.written, reviewed, cited
  • Deploying the largest models often requires lower-precision formats like FP8, potentially accepting a performance trade-off for feasibility.
  • The Gemmaverse offers many alternatives using Post-Training Quantization (PTQ) with contributions from members such as Bartowski, Unsloth, and GGML.
developers.googleblog.com2025-06-26officialauthorityHN front pageabout the gemma 3 familyHN 405 pts · 191 comments1,690 words
Gemma 3n is a mobile-first AI model family designed for on-device use with multimodal capabilities. The E2B and E4B versions have raw parameters of 5B and 8B but operate with as little as 2GB and 3GB of memory respectively. It supports 140 languages for text and includes a MobileNet-V5-300M vision encoder that delivers a 13x speedup with quantization, requires 46% fewer parameters, and has a 4x smaller memory footprint.written, reviewed, cited
  • Developers can create custom-sized models between E2B and E4B by adjusting feed forward network hidden dimensions from 8192 to 16384.
  • The Gemma 3n audio encoder processes clips up to 30 seconds at launch but supports arbitrarily long audios with additional training.
developers.googleblog.com2025-05-20officialauthorityHN front pageabout the gemma 3 familyHN 441 pts · 163 comments904 words
ai.google.dev2025-03-23officialauthorityHN front pageabout the gemma 3 familyHN 202 pts · 32 comments2,144 words
developers.googleblog.comofficialauthorityabout the gemma 3 family1,645 words

Analysis5

github.com2026-09-17authorityHN 7 pts · 1 comments2,103 words
An open-source implementation of Jev option scoring runs on local Gemma 3 4B models using MLX on Apple silicon or PyTorch on other platforms. The model achieves efficient option scoring by prefilling the context once and expanding the KV cache across a batch of options in a single forward pass without decoding. The score is the log-probability of the option tokens given the context; a softmax over the option scores gives a probability per option, like jevlike-predict.written, reviewed, cited
  • Frozen-feature extraction and head training workflows currently require MLX on Apple silicon.
  • PMI normalization requires an extra batched pass to subtract the option's unconditional log-prob.
github.com2026-07-04authorityabout the gemma 3 familyHN 6 pts · 2 comments193 words
MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models. The library API and CLI are under active development, therefore they may change without any deprecation notice. The framework is distributed under GPLv3 license and can be installed using Homebrew package manager with brew tap ybubnov/metalchat.written, reviewed, cited
unsloth.ai2025-03-19authorityHN front pageabout the gemma 3 familyHN 226 pts · 78 comments
storage.googleapis.com2025-03-12HN front pageabout the gemma 3 familyHN 488 pts · 245 comments
github.com2026-01-26authorityabout the gemma 3 familyHN 65 pts · 23 comments2,207 words
All coverage tracked for this model (35) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Gemma explained: What's new in Gemma 3developers.googleblog.com official—2026-10-07exa
Gemma 3 4B Instruct Intelligence, Performance & Price Analysisartificialanalysis.ai—2026-10-07exa
Gemma 3 Technical Deep Dive - Architecture, Performance ...namangoyal.com—2026-10-07exa
Gemma 3 4B | Open Laboratoryopenlaboratory.com—2026-10-07exa
Technical Deep-dive into Gemma3 : Next generation models ...vizuara.substack.com—2026-10-07exa
Gemma-3: Lightweight Multimodal Open Modelsemergentmind.com—2026-10-07exa
Gemma 3: A Comprehensive Introductionlearnopencv.com—2026-10-07exa
Gemma 3 Architecture Overview - Emergent Mindemergentmind.com—2026-10-07exa
Open-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com2026-09-172026-10-07hn
Show HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com2026-07-042026-10-07hn
Selectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com2026-03-122026-10-07hn
I have written gemma3 inference in pure Cgithub.com2026-01-262026-10-07hn
Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com official2025-10-102026-10-07hn
Gemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com2025-08-202026-10-07hn
Landrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us2025-08-202026-10-07hn
Gemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com official2025-08-142026-10-07hn
I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com2025-08-112026-10-07hn
Gemma 3n: The Developer Guidesimonwillison.net2025-06-272026-10-07hn
Gemma 3n available in the open-source ecosystemhuggingface.co2025-06-262026-10-07hn
Introducing Gemma 3ndevelopers.googleblog.com official2025-06-262026-10-07hn
A C++ library to efficiently run Gemma-3N across various platformgithub.com2025-06-112026-10-07hn
Gemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com2025-05-252026-10-07hn
Gemma 3 vs Gemma 3n vs Gemma 4: Full Comparison (2026)codersera.com2025-05-212026-10-07exa
Gemma 3n preview: Mobile-first AIdevelopers.googleblog.com official2025-05-202026-10-07hn
Gemma 3 QAT Modelssimonwillison.net2025-04-192026-10-07hn
QAT optimized Gemma 3 slash VRAM needs 54GB –> 14.1GB while maintaining qualityold.reddit.com2025-04-192026-10-07hn
Gemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com official2025-04-182026-10-07hn
Gemma3 Function Callingai.google.dev official2025-03-232026-10-07hn
Google calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com2025-03-202026-10-07hn
Fine-tune Google's Gemma 3unsloth.ai2025-03-192026-10-07hn
Google's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com2025-03-132026-10-07hn
Gemma3 – The current strongest model that fits on a single GPUollama.com2025-03-122026-10-07hn
Gemma 3: The most capable model you can run on a single GPU or TPUblog.google official2025-03-122026-10-07hn
Gemma 3: Google's new multimodal modelsai.google.dev official2025-03-122026-10-07hn
Gemma 3 Technical Report [pdf]storage.googleapis.com2025-03-122026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-VL-4B-Instruct · 4.44B
    same size band (M), same task (image-text-to-text), fewer providers, permissive license
  • medgemma-4b-it · 4.30B
    same size band (M), same task (image-text-to-text)
  • Qwen3.5-4B · 4.66B
    same size band (M), same task (image-text-to-text), fewer providers, permissive license

Sources

5 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:32 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 14:59 UTC · Last verified 2026-10-25

Follow gemma-3-4b-it

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.