The story so far
Weights, every dated article, and repo commits on one rail.
10 dated articles and 6 repo commits so far
Teal is the weights (2025-03-01), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.
Up to date
google Gemma Terms of Use out 20 months ago
12.2B parameters, images and text in, text out, 128K tokens of context. 3 providers serve it from $0.040 per million input tokens.
Verified 2026-10-25 Rank #63 in LLMs · score 105.1 method v1 Sources 4 Downloads 30d 330.4k · #209 of 619 tracked
Changed this week: Cheapest input price fell 20%: $0.050 → $0.040 per 1M (OpenRouter).2026-10-24
Picked by rule from 35 tracked pieces: the lab's own post, the most shared, a field report, the latest.
MetalChat is a Metal-accelerated C++ framework and command line interpreter for inference of Meta Llama, Google Gemma, and Liquid models.
The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.
2 providers with a live price, from $0.040 to $0.075 per million input tokens; the median is $0.057. One dot per provider, cheapest in teal.
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
Served by 3 API providers; heavily run locally (164 quantized builds); a big base for builders (869 fine-tunes, adapters and merges).
Top Spaces running it: pliny-the-prompter/obliteratus ♥ 621 · huggingface-projects/gemma-3-12b-it ♥ 165 · build-small-hackathon/claim-ready ♥ 71 · ginigen-ai/smol-worldcup ♥ 59
Weights only, an estimate: leave room for the KV cache. Method
About 7.3 GB at INT4, 15 GB at FP8, 29 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Third-party measurements only; author-reported numbers stay in Reference, marked as such.
30.43. Each tick is a model on this site with a measured BFCL row; author-reported numbers stay in Reference. Percent (overall accuracy). Prompt
Source · leaderboard · 2026-10-25
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2025-03-01), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.
1,033 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
| Benchmark | Value | Setting / notes | Reported by | Date |
|---|---|---|---|---|
| measured BFCL · Call tools and APIs | 30.43 percent (overall accuracy) | Prompt5 sub-scores
| leaderboard | 2026-10-25 |
| author-reported AGIEval | 57.4 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported ARC Challenge · Chat and follow instructions | 68.9 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported BBH · Reason through hard problems | 72.6 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Commonsense QA sets · Chat and follow instructions | 78.8 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Commonsense QA sets · Chat and follow instructions | 81.8 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Commonsense QA sets · Chat and follow instructions | 53.4 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Commonsense QA sets · Chat and follow instructions | 78.2 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Commonsense QA sets · Chat and follow instructions | 31.4 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Commonsense QA sets · Chat and follow instructions | 88.3 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported DROP | 72.2 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported GSM8K · Reason through hard problems | 71 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported HellaSwag · Chat and follow instructions | 84.2 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported MATH-500 · Reason through hard problems | 43.3 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported MMLU · Reason through hard problems | 74.5 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported MMLU-Pro · Reason through hard problems | 45.3 | Gemma 3 PT 12B | model author | 2026-10-07 |
| author-reported Winogrande · Chat and follow instructions | 74.3 | Gemma 3 PT 12B | model author | 2026-10-07 |
The model uses a Gemma3ForConditionalGeneration architecture to process text and image inputs for text generation tasks.[1] It is released under the Gemma Terms of Use and supports a 128K context window.[2][3]
Generated 2026-10-07 15:00 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | image-text-to-text |
|---|---|
| Library | transformers |
| Architectures | Gemma3ForConditionalGeneration |
| Model type | gemma3 |
| Dtype | bfloat16 |
| Params by dtype | BF16: 12,187,325,040 |
| Size band | L |
| MoE | no |
| Context length | 131,072 (provider listing) |
| Gated | manual |
| Papers | arXiv:1905.07830, arXiv:1905.10044, arXiv:1911.11641, arXiv:1904.09728, arXiv:1705.03551, arXiv:1911.01547, arXiv:1907.10641, arXiv:1903.00161, arXiv:2009.03300, arXiv:2304.06364, arXiv:2103.03874, arXiv:2110.14168, arXiv:2311.12022, arXiv:2108.07732, arXiv:2107.03374, arXiv:2210.03057, arXiv:2106.03193, arXiv:1910.11856, arXiv:2502.12404, arXiv:2502.21228, arXiv:2404.16816, arXiv:2104.12756, arXiv:2311.16502, arXiv:2203.10244, arXiv:2404.12390, arXiv:1810.12440, arXiv:1908.02660, arXiv:2312.11805 |
| License | Gemma Terms of Use (gemma) |
| Hub snapshot | 2026-10-25 |
vLLM: supported · Gemma3ForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Gemma3ForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for gemma-3-12b-it: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 29 GB · Single high-end GPU (<80 GB) |
|---|---|
| FP8 (1 byte/param) | 15 GB · Single GPU (<24 GB) |
| INT4 (0.5 bytes/param) | 7.3 GB · Single GPU (<24 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
Base model: google/gemma-3-12b-pt
quantized: 164finetune: 424merge: 11adapter: 434
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| MaziyarPanahi/gemma-3-12b-it-GGUF | quantized | GGUF | — | — | — | MaziyarPanahi | 19 | 3.4M |
| Comfy-Org/ltx-2 | finetune | — | — | — | other | Comfy-Org | 168 | 3M |
| abhishekchohan/gemma-3-12b-it-quantized-W4A16 | quantized | -quant | 12.3B | L | gemma | abhishekchohan | 8 | 2.5M |
| unsloth/gemma-3-12b-it-GGUF | quantized | GGUF | — | — | gemma | unsloth | 202 | 1.5M |
| lmstudio-community/gemma-3-12b-it-GGUF | quantized | GGUF | — | — | gemma | lmstudio-community | 45 | 1.5M |
| unsloth/gemma-3-12b-it-unsloth-bnb-4bit | quantized | -bnb | 12.4B | L | gemma | unsloth | 23 | 1.2M |
| gaunernst/gemma-3-12b-it-int4-awq | quantized | int4 | 12.2B | L | gemma | gaunernst | 25 | 905.2k |
| google/gemma-3-12b-it-qat-q4_0-gguf | quantized | q4_0 | — | — | gemma | 304 | 845.1k | |
| google/gemma-3-12b-it-qat-q4_0-unquantized | finetune | q4_0 | 12.2B | L | gemma | 208 | 515.4k | |
| ggml-org/gemma-3-12b-it-GGUF | quantized | GGUF | — | — | gemma | ggml-org | 32 | 437.6k |
| bartowski/google_gemma-3-12b-it-GGUF | quantized | GGUF | — | — | gemma | bartowski | 51 | 308.9k |
| Lightricks/gemma-3-12b-it-qat-q4_0-unquantized | finetune | q4_0 | 12.2B | L | gemma | Lightricks | 9 | 247.2k |
| ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g | quantized | GPTQ | 12.3B | L | gemma | ISTA-DASLab | 6 | 200.9k |
| unsloth/gemma-3-12b-it-bnb-4bit | quantized | -bnb | 12.5B | L | gemma | unsloth | 45 | 187.8k |
| RedHatAI/gemma-3-12b-it-quantized.w4a16 | quantized | -quant | 13.3B | L | gemma | RedHatAI | 3 | 174.5k |
| farbodtavakkoli/OTel-LLM-12B-Safety | finetune | — | — | — | apache-2.0 | farbodtavakkoli | 0 | 174.3k |
| farbodtavakkoli/OTel-LLM-12B-IT | finetune | — | — | — | apache-2.0 | farbodtavakkoli | 0 | 166.8k |
| DreamFast/gemma-3-12b-it-heretic | quantized | GGUF | 12.2B | L | gemma | DreamFast | 94 | 145.6k |
| mlabonne/gemma-3-12b-it-abliterated | finetune | — | 12.2B | L | gemma | mlabonne | 33 | 139.2k |
| lmstudio-community/gemma-3-12B-it-qat-GGUF | quantized | GGUF | — | — | gemma | lmstudio-community | 13 | 131.4k |
| mlabonne/gemma-3-12b-it-abliterated-GGUF | quantized | GGUF | — | — | gemma | mlabonne | 55 | 118k |
| DreamFast/gemma-3-12b-it-heretic-v2 | quantized | GGUF | 12.2B | L | gemma | DreamFast | 104 | 79.7k |
| pytorch/gemma-3-12b-it-FP8 | quantized | -FP8 | — | — | apache-2.0 | pytorch | 2 | 70.3k |
| leon-se/gemma-3-12b-it-FP8-Dynamic | quantized | -FP8 | 12.2B | L | gemma | leon-se | 13 | 67.1k |
| RedHatAI/gemma-3-12b-it-FP8-dynamic | quantized | -FP8 | 12.2B | L | apache-2.0 | RedHatAI | 7 | 60.2k |
| NeoChen1024/gemma-3-12b-it-NVFP4 | quantized | NVFP4 | 8.49B | M | gemma | NeoChen1024 | 2 | 57.3k |
| pytorch/gemma-3-12b-it-AWQ-INT4 | quantized | AWQ | — | — | apache-2.0 | pytorch | 1 | 48.6k |
| TheDrummer/Tiger-Gemma-12B-v3-GGUF | quantized | GGUF | — | — | — | TheDrummer | 23 | 43.5k |
| INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0 | finetune | — | 12.2B | L | gemma | INSAIT-Institute | 22 | 39.1k |
| RedHatAI/gemma-3-12b-it-quantized.w8a8 | quantized | -quant | 13.2B | L | gemma | RedHatAI | 6 | 35.2k |
| pytorch/gemma-3-12b-it-INT4 | quantized | INT4 | 2.80B | M | apache-2.0 | pytorch | 2 | 34.9k |
| google/gemma-3-12b-it-qat-int4-unquantized | finetune | int4 | 12.2B | L | gemma | 12 | 34.3k | |
| nocturne23/gemma-3-12b-it-Q4_K_M-GGUF | quantized | GGUF | — | — | gemma | nocturne23 | 9 | 27.3k |
| Andycurrent/gemma-3-12b-it-uncensored-GGUF | quantized | GGUF | — | — | gemma | Andycurrent | 11 | 23.7k |
| DavidAU/Gemma-3-12b-it-MAX-HORROR-Imatrix-GGUF | quantized | Imatrix | — | — | gemma | DavidAU | 17 | 23k |
| allura-org/Gemma-3-Glitter-12B | merge | — | 12.2B | L | — | allura-org | 28 | 20.7k |
| TheDrummer/Tiger-Gemma-12B-v3 | finetune | — | — | — | — | TheDrummer | 32 | 19.7k |
| second-state/gemma-3-12b-it-GGUF | quantized | GGUF | — | — | gemma | second-state | 2 | 20.9k |
| mlabonne/gemma-3-12b-it-abliterated-v2 | finetune | — | 11.8B | L | gemma | mlabonne | 30 | 16.9k |
| gaunernst/gemma-3-12b-it-qat-autoawq | quantized | awq | 12.2B | L | gemma | gaunernst | 7 | 17.9k |
| Date | Commit | SHA |
|---|---|---|
| 2025-03-21 | Update README.md (#15) | 96b6f1e |
| 2025-03-21 | Update README.md (#14) | bf0e2fc |
| 2025-03-19 | Adding top_k and top_p to generation_config.json | d82ecc1 |
| 2025-03-12 | Update README.md | 7553b6f |
| 2025-03-12 | Update chat_template (#4) | 6df4c7d |
| 2025-03-12 | Super-squash branch 'main' using huggingface_hub | 3aa32c4 |
Hosted endpoints observed for gemma-3-12b-it, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.04/M.
| Provider | Model ref | Context | Quant | $/M in | $/M out | tok/s | TTFT | Tools | Status | Observed |
|---|---|---|---|---|---|---|---|---|---|---|
| DeepInfra hf, deepinfra, openrouter | google/gemma-3-12b-it | 128K | bfloat16 | $0.04 | $0.12 | 72 | 302 ms | yes | live | 2026-10-25 |
| NextBit openrouter | google/gemma-3-12b-it | 128K | int4 | $0.07 | $0.15 | — | — | — | live | 2026-10-24 |
| Featherless hf | google/gemma-3-12b-it | — | — | — | — | — | — | — | live | 2026-10-25 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:32 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:00 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.