Models › gemma-3 family

google Gemma Terms of Use out 20 months ago

27.4B parameters, images and text in, text out, 128K tokens of context. 6 providers serve it from $0.080 per million input tokens.

Verified 2026-10-26 07:27 UTC Rank #39 in LLMs · score 111.1 method v1 Sources 5 Downloads 30d 341.8k · #202 of 619 tracked

Changed this week: 2 new quantized builds on the Hub (148 in all).2026-10-24

Can I run it?17GB at INT4Estimatefits a 24 GB cardmethod
What does it cost?$0.080/1M incheapest of 5DeepInfrafp82026-10-26
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-26
Does it work?29.47on BFCL#19 of 28 measuredleaderboard2026-10-26
Do people use it?341.8kdownloads, 30 days#202 of 619 we track · top 33%+8 likes, downloads −14% this week2,058 likesHugging Face2026-10-26

Worth reading

Picked by rule from 35 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 488 HN pts
storage.googleapis.com 2025-03-12 488 HN pts · 245 comments about the gemma 3 family family
Latest · 4 months ago

Show HN: Gemma 3 inference in pure C++ with Metal acceleration

MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models.

github.com 2026-07-04 6 HN pts · 2 comments 193 words about the gemma 3 family family

25 best of 35 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeOpen-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com · 2026-09-17
  2. ArticleGemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com · 2025-08-14 · official
  3. ArticleGemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com · 2025-04-18 · 602 HN pts · official
  4. ArticleIntroducing Gemma 3ndevelopers.googleblog.com · 2025-06-26 · 405 HN pts · official
  5. ArticleGemma 3n preview: Mobile-first AIdevelopers.googleblog.com · 2025-05-20 · 441 HN pts · official
  6. ArticleGemma3 Function Callingai.google.dev · 2025-03-23 · 202 HN pts · official
  7. ArticleFine-tune Google's Gemma 3unsloth.ai · 2025-03-19 · 226 HN pts
  8. ArticleGemma explained: What's new in Gemma 3developers.googleblog.com · undated · official
  9. ArticleGemma 3 - Google DeepMinddeepmind.google · undated · official
  10. CodeGemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com · 2025-08-20
  11. CodeI have written gemma3 inference in pure Cgithub.com · 2026-01-26 · 65 HN pts
  12. ArticleGemma3 – The current strongest model that fits on a single GPUollama.com · 2025-03-12
  13. ArticleGoogle calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com · 2025-03-20
  14. PaperGemma 3 Technical Report - arXivarxiv.org · undated
  15. Paper[2503.19786] Gemma 3 Technical Reportar5iv.labs.arxiv.org · undated
  16. ArticleGemma 3: Google's new multimodal modelsai.google.dev · 2025-03-12 · official
  17. ArticleGemma 3: The most capable model you can run on a single GPU or TPUblog.google · 2025-03-12 · official
  18. ArticleOwn your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com · 2025-10-10 · official
  19. ArticleGemma 3 QAT Modelssimonwillison.net · 2025-04-19
  20. DiscussionGemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com · 2025-05-25
  21. ArticleGemma 3n available in the open-source ecosystemhuggingface.co · 2025-06-26
  22. ArticleGemma 3n: The Developer Guidesimonwillison.net · 2025-06-27
  23. ArticleLandrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us · 2025-08-20

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

5 providers from $0.080

5 providers with a live price, from $0.080 to $0.12 per million input tokens; the median is $0.080. One dot per provider, cheapest in teal.

$0.010$0.10$1.00$10.00DeepInfra: $0.080 in / $0.16 out per 1M · observed 2026-10-26 · https://huggingface.co/api/models/google/gemma-3-27b-it?expand[]=inferenceProviderMappingParasail: $0.080 in / $0.45 out per 1M · observed 2026-10-26 · https://docs.parasail.io/parasail-docs/billing/pricingNextBit: $0.080 in / $0.35 out per 1M · observed 2026-10-26 · https://openrouter.ai/google/gemma-3-27b-itNebius: $0.10 in / $0.30 out per 1M · observed 2026-10-26 · https://openrouter.ai/google/gemma-3-27b-itNovita: $0.12 in / $0.20 out per 1M · observed 2026-10-26 · https://openrouter.ai/google/gemma-3-27b-itcheapest $0.080median $0.080
$0.010$0.10$1.00$10.00DeepInfra: $0.080 in / $0.16 out per 1M · observed 2026-10-26 · https://huggingface.co/api/models/google/gemma-3-27b-it?expand[]=inferenceProviderMappingParasail: $0.080 in / $0.45 out per 1M · observed 2026-10-26 · https://docs.parasail.io/parasail-docs/billing/pricingNextBit: $0.080 in / $0.35 out per 1M · observed 2026-10-26 · https://openrouter.ai/google/gemma-3-27b-itNebius: $0.10 in / $0.30 out per 1M · observed 2026-10-26 · https://openrouter.ai/google/gemma-3-27b-itNovita: $0.12 in / $0.20 out per 1M · observed 2026-10-26 · https://openrouter.ai/google/gemma-3-27b-itcheapest $0.080 · median $0.080 (white tick)
#Cheapest 5In /1MOut /1MContextQuantSeen
1 DeepInfra $0.080 $0.16 128K fp8 Oct 26
2 NextBit $0.080 $0.35 128K fp8 Oct 26
3 Parasail $0.080 $0.45 128K fp8 Oct 26
4 Nebius $0.10 $0.30 107K fp8 Oct 26
5 Novita $0.12 $0.20 96K bf16 Oct 26

All 6 providers →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Widely served (6 API providers); heavily run locally (148 quantized builds); a big base for builders (742 fine-tunes, adapters and merges).

  • As a service6DeepInfra, Featherless, Nebius, NextBit +2
  • On own hardware148quantized builds
  • Built on742454 fine-tunes · 283 adapters · 5 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: pliny-the-prompter/obliteratus ♥ 621 · hadadrjt/ai ♥ 86 · TIGER-Lab/MEGA-Bench ♥ 51 · yourbench/advanced ♥ 45

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 64 GB Mac (unified memory) at INT4

About 17 GB at INT4, 33 GB at FP8, 66 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 17 GB of weights (estimate; KV cache and activations extra)INT417 GBFP8: about 33 GB of weights (estimate; KV cache and activations extra)FP833 GBBF16: about 66 GB of weights (estimate; KV cache and activations extra)BF1666 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 17 GB of weights (estimate; KV cache and activations extra)INT417 GBFP8: about 33 GB of weights (estimate; KV cache and activations extra)FP833 GBBF16: about 66 GB of weights (estimate; KV cache and activations extra)BF1666 GB

Estimate params × bytes per param × 1.2 · how we estimate

How it scores

Third-party measurements only; author-reported numbers stay in Reference, marked as such.

#19 of 28 on BFCL so far

29.47. Each tick is a model on this site with a measured BFCL row; author-reported numbers stay in Reference. Percent (overall accuracy). Prompt

zai-org/GLM-4.6: 72.38 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmoonshotai/Kimi-K2-Instruct: 59.06 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmldeepseek-ai/DeepSeek-V3.2-Exp: 54.12 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 52.15 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 48.71 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 47.99 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 46.78 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlSalesforce/Llama-xLAM-2-8b-fc-r: 46.68 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 42.57 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 41.39 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 41.03 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 40.43 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 37.77 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 36.7 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.68 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.52 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.3-70B-Instruct: 31.9 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-12b-it: 30.43 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmicrosoft/phi-4: 28.79 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-1.7B: 28.41 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-4-Scout-17B-16E-Instruct: 28.13 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.1-8B-Instruct: 25.83 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 23.93 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 22.38 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.2-3B-Instruct: 21.95 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-4b-it: 19.62 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-1b-it: 7.17 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.html010029.47 · #19 of 28
zai-org/GLM-4.6: 72.38 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmoonshotai/Kimi-K2-Instruct: 59.06 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmldeepseek-ai/DeepSeek-V3.2-Exp: 54.12 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 52.15 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 48.71 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 47.99 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 46.78 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlSalesforce/Llama-xLAM-2-8b-fc-r: 46.68 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 42.57 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 41.39 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 41.03 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 40.43 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 37.77 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 36.7 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.68 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.52 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.3-70B-Instruct: 31.9 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-12b-it: 30.43 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmicrosoft/phi-4: 28.79 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-1.7B: 28.41 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-4-Scout-17B-16E-Instruct: 28.13 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.1-8B-Instruct: 25.83 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 23.93 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 22.38 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.2-3B-Instruct: 21.95 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-4b-it: 19.62 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-1b-it: 7.17 · observed 2026-10-26 · https://gorilla.cs.berkeley.edu/leaderboard.html010029.47 · #19 of 28

Source · leaderboard · 2026-10-26

Day-one receipts

Claim-matched tests, graded by code. Receipts, not a score.

Speed run● pass
{
  "providers": [
    {
      "provider": "parasail",
      "endpoint_model": "parasail-gemma3-27b-it",
      "source_url": "https://api.parasail.io/v1/chat/completions",
      "ttft_ms_median": 613,
      "ttft_any_ms_median": 613,
      "tokens_per_s_median": 47.8,
      "runs": [
        {
          "ttft_s": 0.613,
          "ttft_any_s": 0.613,
          "tokens_per_s": 28.4,
          "latency_s": 5.92,
          "tokens_out": 168,
          "reasoning_chars": 0,
          "finish": "stop"
        },
        {
          "ttft_s": 0.647,
          "ttft_any_s": 0.647,
          "tokens_per_s": 66.1,
          "latency_s": 2.81,
          "tokens_out": 186,
          "reasoning_chars": 0,
          "finish": "stop"
        },
        {
          "ttft_s": 0.572,
          "ttft_any_s": 0.572,
          "tokens_per_s": 47.8,
          "latency_s": 3.58,
          "tokens_out": 171,
          "reasoning_chars": 0,
          "finish": "stop"
        }
      ]
    }
  ],
  "note": "Single client, wall clock; tok/s counts every output token including hidden reasoning."
}
Messy addresses to JSON● pass
{
  "fields_matched": 80,
  "fields_total": 80,
  "cost_per_1000_usd": 0.0309,
  "parsed": true,
  "per_item": [
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    },
    {
      "street": true,
      "city": true,
      "postcode": true,
      "country": true
    }
  ],
  "sample": [
    {
      "street": "1600 Amphitheatre Parkway",
      "unit": null,
      "city": "Mountain View",
      "region": "CA",
      "postcode": "94043",
      "country": "US"
    },
    {
      "street": "10 Downing Street",
      "unit": null,
      "city": "London",
      "region": null,
      "postcode": "SW1A 2AA",
      "country": "GB"
    },
    {
      "street": "Rua Augusta 274",
      "unit": null,
      "city": "Lisboa",
      "region": null,
      "postcode": "1100-053",
      "country": "PT"
    }
  ],
  "fixture": "receipts.addresses.v1"
}
80/80 fields · $0.0309 per 1,000 · 2026-10-0951.4 s

The story so far

Weights, every dated article, and repo commits on one rail.

8 dated articles and 6 repo commits so far

Teal is the weights (2025-03-01), amber triangles are 8 dated articles (each links to it), grey ticks are repo commits.

What people built on it

890 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

890 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

148 quantized (Hugging Face model tree)454 fine-tunes (Hugging Face model tree)5 merges (Hugging Face model tree)283 adapters (Hugging Face model tree)148 quantized454 fine-tunes5 merges283 adapters
148 quantized (Hugging Face model tree)454 fine-tunes (Hugging Face model tree)5 merges (Hugging Face model tree)283 adapters (Hugging Face model tree)148 quantized454 fine-tunes5 merges283 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

18 rows

Benchmarks 18 rows

measured third-party leaderboard row (2)author-reported number from the model card or eval files (16)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
measured Aider Polyglot · Write code with agents4.9 percent (pass_rate_2)edit_format=wholeleaderboard2025-03-15
measured BFCL · Call tools and APIs29.47 percent (overall accuracy)Prompt
5 sub-scores
  • Non-Live AST Acc: 87.17
  • Live Acc: 74.54
  • Multi Turn Acc: 10.75
  • Web Search Acc: 0
  • Memory Acc: 13.55
leaderboard2026-10-26
author-reported AGIEval66.2Gemma 3 PT 27Bmodel author2026-10-07
author-reported ARC Challenge · Chat and follow instructions70.6Gemma 3 PT 27Bmodel author2026-10-07
author-reported BBH · Reason through hard problems77.7Gemma 3 PT 27Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions82.4Gemma 3 PT 27Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions83.3Gemma 3 PT 27Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions54.9Gemma 3 PT 27Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions85.5Gemma 3 PT 27Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions36.1Gemma 3 PT 27Bmodel author2026-10-07
author-reported Commonsense QA sets · Chat and follow instructions89Gemma 3 PT 27Bmodel author2026-10-07
author-reported DROP77.2Gemma 3 PT 27Bmodel author2026-10-07
author-reported GSM8K · Reason through hard problems82.6Gemma 3 PT 27Bmodel author2026-10-07
author-reported HellaSwag · Chat and follow instructions85.6Gemma 3 PT 27Bmodel author2026-10-07
author-reported MATH-500 · Reason through hard problems50Gemma 3 PT 27Bmodel author2026-10-07
author-reported MMLU · Reason through hard problems78.6Gemma 3 PT 27Bmodel author2026-10-07
author-reported MMLU-Pro · Reason through hard problems52.2Gemma 3 PT 27Bmodel author2026-10-07
author-reported Winogrande · Chat and follow instructions78.8Gemma 3 PT 27Bmodel author2026-10-07

What the card says

2 cited sentences

Summary generated, cited

The model handles image and text inputs to generate text outputs.[1] It is released under the Gemma Terms of Use and supports a 128K context window.[2][3]

  1. “handling text and image input and generating text output”
  2. license
  3. “large, 128K context window”

Generated 2026-10-07 14:59 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesGemma3ForConditionalGeneration
Model typegemma3
Dtypebfloat16
Params by dtypeBF16: 27,432,406,640
Size bandL
MoEno
Context length131,072 (provider listing)
Gatedmanual
PapersarXiv:1905.07830, arXiv:1905.10044, arXiv:1911.11641, arXiv:1904.09728, arXiv:1705.03551, arXiv:1911.01547, arXiv:1907.10641, arXiv:1903.00161, arXiv:2009.03300, arXiv:2304.06364, arXiv:2103.03874, arXiv:2110.14168, arXiv:2311.12022, arXiv:2108.07732, arXiv:2107.03374, arXiv:2210.03057, arXiv:2106.03193, arXiv:1910.11856, arXiv:2502.12404, arXiv:2502.21228, arXiv:2404.16816, arXiv:2104.12756, arXiv:2311.16502, arXiv:2203.10244, arXiv:2404.12390, arXiv:1810.12440, arXiv:1908.02660, arXiv:2312.11805
LicenseGemma Terms of Use (gemma)
Hub snapshot2026-10-26

Servability

vLLM · SGLang

Servability

vLLM: supported · Gemma3ForConditionalGeneration · 4b1c04e76fe9ac3ca8b7e541dd423e7d5f38dc60SGLang: supported · Gemma3ForConditionalGeneration · 60d941293e3af27a12c6eb64e2c3e2e1a17f100f

vLLM registry (4b1c04e76fe9ac3ca8b7e541dd423e7d5f38dc60) · SGLang registry (60d941293e3af27a12c6eb64e2c3e2e1a17f100f) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for gemma-3-27b-it: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)66 GB · Single high-end GPU (<80 GB)
FP8 (1 byte/param)33 GB · Single high-end GPU (<80 GB)
INT4 (0.5 bytes/param)17 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from google/gemma-3-27b-pt (same organization) Family: google/gemma-3 890 derivatives on the Hub

Base model: google/gemma-3-27b-pt

quantized: 148finetune: 454merge: 5adapter: 283

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
gaunernst/gemma-3-27b-it-int4-awq quantized int4 27.4B L gemma gaunernst 50 5.2M
ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g quantized GPTQ 27.6B L gemma ISTA-DASLab 44 3.5M
MaziyarPanahi/gemma-3-27b-it-GGUF quantized GGUF — — — MaziyarPanahi 8 3M
pytorch/gemma-3-27b-it-AWQ-INT4 quantized AWQ — — apache-2.0 pytorch 7 2.3M
farbodtavakkoli/OTel-LLM-27B-IT finetune — — — apache-2.0 farbodtavakkoli 0 2.2M
RedHatAI/gemma-3-27b-it-quantized.w4a16 quantized -quant 28.8B L gemma RedHatAI 13 2M
unsloth/gemma-3-27b-it-GGUF quantized GGUF — — gemma unsloth 208 1.3M
RedHatAI/gemma-3-27b-it-FP8-dynamic quantized -FP8 27.4B L apache-2.0 RedHatAI 13 1.2M
mlabonne/gemma-3-27b-it-abliterated finetune — 27.4B L gemma mlabonne 345 733.6k
unsloth/gemma-3-27b-it-bnb-4bit quantized -bnb 28.2B L gemma unsloth 19 621.5k
unsloth/gemma-3-27b-it finetune — 27.4B L gemma unsloth 16 594.8k
lmstudio-community/gemma-3-27B-it-qat-GGUF quantized GGUF — — gemma lmstudio-community 19 549.9k
mlabonne/gemma-3-27b-it-abliterated-GGUF quantized GGUF — — gemma mlabonne 252 455.5k
lmstudio-community/gemma-3-27b-it-GGUF quantized GGUF — — gemma lmstudio-community 51 444.7k
google/gemma-3-27b-it-qat-q4_0-gguf quantized q4_0 — — gemma google 407 419.2k
m8than/gemma-3-27b-lenientchatfix finetune — 27.4B L gemma m8than 0 298.5k
leon-se/gemma-3-27b-it-FP8-Dynamic quantized -FP8 27.4B L gemma leon-se 20 294.1k
bartowski/google_gemma-3-27b-it-GGUF quantized GGUF — — gemma bartowski 66 284.6k
unsloth/gemma-3-27b-it-unsloth-bnb-4bit quantized -bnb 28.2B L gemma unsloth 19 281.9k
google/gemma-3-27b-it-qat-q4_0-unquantized finetune q4_0 27.4B L gemma google 42 267.3k
gaunernst/gemma-3-27b-it-qat-compressed-tensors quantized compressed-tensors 28.2B L gemma gaunernst 13 87.7k
ggml-org/gemma-3-27b-it-GGUF quantized GGUF — — gemma ggml-org 24 74.4k
gaunernst/gemma-3-27b-it-qat-autoawq quantized awq 27.4B L gemma gaunernst 12 62.4k
abhishekchohan/gemma-3-27b-it-quantized-W4A16 quantized -quant 27.6B L gemma abhishekchohan 5 51.2k
pytorch/gemma-3-27b-it-FP8 quantized -FP8 — — apache-2.0 pytorch 3 45.4k
pytorch/gemma-3-27b-it-INT4 quantized INT4 5.57B M apache-2.0 pytorch 0 33.6k
TheDrummer/Big-Tiger-Gemma-27B-v3-GGUF quantized GGUF — — — TheDrummer 27 27.4k
RedHatAI/gemma-3-27b-it-quantized.w8a8 quantized -quant 28.8B L gemma RedHatAI 7 28.3k
mradermacher/gemma-3-27b-it-GGUF quantized GGUF — — gemma mradermacher 5 20.7k
NeoChen1024/gemma-3-27b-it-NVFP4 quantized NVFP4 17.6B L gemma NeoChen1024 3 17.5k
DevQuasar-10/google.gemma-3-27b-it-GGUF quantized GGUF — — — DevQuasar-10 0 16.9k
NbAiLab/borealis-27b finetune — 27.4B L other NbAiLab 10 15.7k
second-state/gemma-3-27b-it-GGUF quantized GGUF — — gemma second-state 0 15.5k
neo4j/text-to-cypher-Gemma-3-27B-Instruct-2025.04.0 finetune — 27.4B L gemma neo4j 11 14.2k
TheDrummer/Gemma-3-R1-27B-v1-GGUF quantized GGUF — — — TheDrummer 13 13.7k
TheDrummer/Big-Tiger-Gemma-27B-v3 finetune — — — — TheDrummer 61 11k
TheCluster/gemma-3-27b-it-uncensored-mlx-4bit quantized mlx — — gemma TheCluster 4 13.7k
Tesslate/Synthia-S1-27b finetune — 27.4B L gemma Tesslate 102 8.5k
mradermacher/gemma-3-27b-it-i1-GGUF quantized GGUF — — gemma mradermacher 4 12.1k
MISHANM/google-gemma-3-27b-it-fp8 quantized -fp8 27.4B L — MISHANM 3 11.7k

Repository changelog

6 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 6 commits

DateCommitSHA
2025-03-21 Update README.md (#35) 005ad34
2025-03-21 Update README.md (#34) d2a0c03
2025-03-19 Adding top_k and top_p to generation_config.json 1ead709
2025-03-12 Update README.md dfb98f2
2025-03-12 Update chat_template (#3) 8ae719a
2025-03-12 Super-squash branch 'main' using huggingface_hub da8b0ba

All providers

6 providers · 6 endpoints

Where to run 6 providers · 6 endpoints

Hosted endpoints observed for gemma-3-27b-it, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.08/M.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
DeepInfra
hf, deepinfra, openrouter
google/gemma-3-27b-it 128K fp8 $0.08 $0.16 33.1 310 ms yes live 2026-10-26
Parasail
parasail, openrouter
parasail-gemma3-27b-it 128K fp8 $0.08 $0.45 — — — serverless 2026-10-26
NextBit
openrouter
google/gemma-3-27b-it 128K fp8 $0.08 $0.35 — — — live 2026-10-26
Nebius
openrouter
google/gemma-3-27b-it 107K fp8 $0.10 $0.30 — — — live 2026-10-26
Novita
openrouter
google/gemma-3-27b-it 96K bf16 $0.12 $0.20 — — — live 2026-10-26
Featherless
hf
google/gemma-3-27b-it — — — — — — — live 2026-10-26

Articles and coverage

35 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official6

developers.googleblog.com2025-04-18officialauthorityHN front pageabout the gemma 3 familyHN 602 pts · 276 comments1,077 words
Google released Gemma 3 Quantization-Aware Training (QAT) models that incorporate quantization during training to reduce memory usage while maintaining accuracy. Applying QAT on ~5,000 steps reduces the perplexity drop by 54% when quantizing down to Q4_0, allowing the 27B variant to fit in 14.1 GB of VRAM instead of 54 GB. These int4 models run efficiently on consumer hardware like the NVIDIA RTX 3090 and are available via Ollama, llama.cpp, and MLX.written, reviewed, cited
  • Deploying the largest models often requires lower-precision formats like FP8, potentially accepting a performance trade-off for feasibility.
  • The Gemmaverse offers many alternatives using Post-Training Quantization (PTQ) with contributions from members such as Bartowski, Unsloth, and GGML.
developers.googleblog.com2025-06-26officialauthorityHN front pageabout the gemma 3 familyHN 405 pts · 191 comments1,690 words
Gemma 3n is a mobile-first AI model family designed for on-device use with multimodal capabilities. The E2B and E4B versions have raw parameters of 5B and 8B but operate with as little as 2GB and 3GB of memory respectively. It supports 140 languages for text and includes a MobileNet-V5-300M vision encoder that delivers a 13x speedup with quantization, requires 46% fewer parameters, and has a 4x smaller memory footprint.written, reviewed, cited
  • Developers can create custom-sized models between E2B and E4B by adjusting feed forward network hidden dimensions from 8192 to 16384.
  • The Gemma 3n audio encoder processes clips up to 30 seconds at launch but supports arbitrarily long audios with additional training.
developers.googleblog.com2025-05-20officialauthorityHN front pageabout the gemma 3 familyHN 441 pts · 163 comments904 words
ai.google.dev2025-03-23officialauthorityHN front pageabout the gemma 3 familyHN 202 pts · 32 comments2,144 words
developers.googleblog.comofficialauthorityabout the gemma 3 family1,645 words
deepmind.googleofficialauthorityabout the gemma 3 family386 words

Analysis4

github.com2026-07-04authorityabout the gemma 3 familyHN 6 pts · 2 comments193 words
MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models. The library API and CLI are under active development, therefore they may change without any deprecation notice. The framework is distributed under GPLv3 license and can be installed using Homebrew package manager with brew tap ybubnov/metalchat.written, reviewed, cited
unsloth.ai2025-03-19authorityHN front pageabout the gemma 3 familyHN 226 pts · 78 comments
storage.googleapis.com2025-03-12HN front pageabout the gemma 3 familyHN 488 pts · 245 comments
github.com2026-01-26authorityabout the gemma 3 familyHN 65 pts · 23 comments2,207 words
All coverage tracked for this model (35) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Gemma explained: What's new in Gemma 3developers.googleblog.com official—2026-10-07exa
Gemma 3 - Google DeepMinddeepmind.google official—2026-10-07exa
Gemma 3 Technical Report - arXivarxiv.org—2026-10-07exa
[2503.19786] Gemma 3 Technical Reportar5iv.labs.arxiv.org—2026-10-07exa
Gemma 3 Technical Deep Dive - Architecture, Performance ...namangoyal.com—2026-10-07exa
Gemma 3 Technical Report — Paper Graphpaper-graph-ui.vercel.app—2026-10-07exa
Open-jev: One-pass option scoring with Gemma 3 4B, similar to jevgithub.com2026-09-172026-10-07hn
Show HN: Gemma 3 inference in pure C++ with Metal accelerationgithub.com2026-07-042026-10-07hn
Selectively reducing eval awareness and murder in Gemma 3 27B via steeringlesswrong.com2026-03-122026-10-07hn
I have written gemma3 inference in pure Cgithub.com2026-01-262026-10-07hn
Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-devicedevelopers.googleblog.com official2025-10-102026-10-07hn
Gemma 3 270M re-implemented in pure PyTorch for local tinkeringgithub.com2025-08-202026-10-07hn
Landrecords – cheap nationwide parcel dataset standardized using gemma3landrecords.us2025-08-202026-10-07hn
Gemma 3 270M: Compact model for hyper-efficient AIdevelopers.googleblog.com official2025-08-142026-10-07hn
I Gave Up Trying to Run Gemma 3 27B on AWS P3dn.24xlargemedium.com2025-08-112026-10-07hn
Gemma 3n: The Developer Guidesimonwillison.net2025-06-272026-10-07hn
Gemma 3n available in the open-source ecosystemhuggingface.co2025-06-262026-10-07hn
Introducing Gemma 3ndevelopers.googleblog.com official2025-06-262026-10-07hn
A C++ library to efficiently run Gemma-3N across various platformgithub.com2025-06-112026-10-07hn
Gemma 3n Architectural Innovations – Speculation and poking around in the modelold.reddit.com2025-05-252026-10-07hn
Gemma 3n preview: Mobile-first AIdevelopers.googleblog.com official2025-05-202026-10-07hn
Gemma 3 QAT Modelssimonwillison.net2025-04-192026-10-07hn
QAT optimized Gemma 3 slash VRAM needs 54GB –> 14.1GB while maintaining qualityold.reddit.com2025-04-192026-10-07hn
Gemma 3 QAT Models: Bringing AI to Consumer GPUsdevelopers.googleblog.com official2025-04-182026-10-07hn
Technical Deep-dive into Gemma3 🤖: Next generation models for small and mid range tasksvizuara.substack.com2025-04-032026-10-07exa
Gemma 3 27B on Novita AI: Really a Single-GPU Model? - Novitablogs.novita.ai2025-03-312026-10-07exa
Gemma3 Function Callingai.google.dev official2025-03-232026-10-07hn
Google calls Gemma 3 the most powerful AI model you can run on one GPUtheverge.com2025-03-202026-10-07hn
Fine-tune Google's Gemma 3unsloth.ai2025-03-192026-10-07hn
Google's Gemma 3 is an open source, multimodal single-GPU AI 128K context windowarstechnica.com2025-03-132026-10-07hn
Gemma 3: What You Need To Know - Gradient Flowgradientflow.com2025-03-132026-10-07exa
Gemma3 – The current strongest model that fits on a single GPUollama.com2025-03-122026-10-07hn
Gemma 3: The most capable model you can run on a single GPU or TPUblog.google official2025-03-122026-10-07hn
Gemma 3: Google's new multimodal modelsai.google.dev official2025-03-122026-10-07hn
Gemma 3 Technical Report [pdf]storage.googleapis.com2025-03-122026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3.8-27B · 27.8B
    same size band (L), same task (image-text-to-text), more providers, permissive license
  • Qwen3.6-27B · 27.8B
    same size band (L), same task (image-text-to-text), permissive license
  • Qwen3.5-27B · 27.8B
    same size band (L), same task (image-text-to-text), permissive license

Sources

5 sources

Sources

Hub snapshot: 2026-10-26 · HF API: 2026-10-26 07:14 UTC · Providers: 2026-10-26 07:26 UTC · Articles: 2026-10-26 07:27 UTC · Summary: 2026-10-07 14:59 UTC · Last verified 2026-10-26 07:27 UTC

Follow gemma-3-27b-it

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.