Models › paligemma family

paligemma-3b-mix-224

google Gemma Terms of Use out 2 years ago

2.92B parameters, images and text in, text out.

Verified 2026-10-25 Rank #470 in LLMs · score 77.3 method v1 Sources 3 Downloads 30d 75.3k · #346 of 619 tracked

Can I run it?1.8GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-24
Do people use it?75.3kdownloads, 30 days#346 of 619 we track · below the median+0 likes, downloads −10% this week108 likesHugging Face2026-10-24

Worth reading

Picked by rule from 11 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 121 HN pts

PaliGemma: Open-Source Multimodal Model by Google

Google released PaliGemma, a 3 billion parameter open source multimodal model combining SigLIP and Gemma at the 2024 Google I/O event.

  • PaliGemma is not designed to be used directly, but to be transferred by fine-tuning to specific tasks.
  • Fine-tuning only the attention layers may result in limited performance improvements for the model.
blog.roboflow.com 2024-05-15 121 HN pts · 101 comments 2.1k words about the paligemma family family
Latest · 20 months ago

PaliGemma 2 mix: A vision-language model for multiple tasks

Google launched PaliGemma 2 mix checkpoints in February 2025, offering a vision-language model tuned for multiple tasks like captioning and OCR.

developers.googleblog.com 2025-02-19 2 HN pts 537 words about the paligemma family family

11 best of 11 tracked

The 2 picks above, plus these 9. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticlePaliGemma 2: Powerful Vision-Language Models, Simple Fine-Tuningdevelopers.googleblog.com · 2024-12-05 · 218 HN pts · official
  2. ArticlePaliGemmaai.google.dev · 2024-05-14 · 145 HN pts · official
  3. PaperPaliGemma: A versatile 3B VLM for transferarxiv.org · 2024-07-11 · 5 HN pts
  4. ArticlePaliGemma Keras Quickstartcolab.research.google.com · 2024-05-22 · 3 HN pts · official
  5. ArticlePaliGemma 2 – New vision language models by Googlehuggingface.co · 2024-12-05 · 1 HN pts
  6. ArticleA Primer on Fine-Tuning PaliGemma and VLMsdatature.io · 2024-06-20 · 2 HN pts
  7. ArticleHow to Fine-Tune PaliGemma for Object Detectionblog.roboflow.com · 2024-05-17 · 2 HN pts
  8. ArticleComputer Vision à La Apple: Building Multimodal Adapters for On-Device LLMstensorsense.com · 2024-08-22
  9. DiscussionReal-time multimodal analysis using one 4090 and open-source paligemmax.com · 2024-05-18 · 1 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 2 quantized builds and 46 Spaces.

  • As a service0no API provider listed
  • On own hardware2quantized builds
  • Built on4922 fine-tunes · 27 adapters · 0 merges
  • In apps46Hugging Face Spaces

Top Spaces running it: Justinrune/LLaMA-Factory ♥ 12 · dwb2023/hf_extractor ♥ 6 · dwb2023/omniscience ♥ 6 · V-E-D/paligamma ♥ 3

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 1.8 GB at INT4, 3.5 GB at FP8, 7.0 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.8 GB of weights (estimate; KV cache and activations extra)INT41.8 GBFP8: about 3.5 GB of weights (estimate; KV cache and activations extra)FP83.5 GBBF16: about 7.0 GB of weights (estimate; KV cache and activations extra)BF167.0 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.8 GB of weights (estimate; KV cache and activations extra)INT41.8 GBFP8: about 3.5 GB of weights (estimate; KV cache and activations extra)FP83.5 GBBF16: about 7.0 GB of weights (estimate; KV cache and activations extra)BF167.0 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2024-05-12), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

51 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

51 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

2 quantized (Hugging Face model tree)22 fine-tunes (Hugging Face model tree)27 adapters (Hugging Face model tree)2 quantized22 fine-tunes27 adapters
2 quantized (Hugging Face model tree)22 fine-tunes (Hugging Face model tree)27 adapters (Hugging Face model tree)2 quantized22 fine-tunes27 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

PaliGemma is a vision-language model with 2.92B parameters that processes image and text inputs to generate text outputs.[1][2] This specific version is fine-tuned on a mixture of downstream academic datasets using 224*224 input images.[3]

  1. parameters human
  2. “takes both image and text as input and generates text as …”
  3. “fine-tuned with 224*224 input images and 256 token input/…”

Generated 2026-10-07 15:10 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

3 use cases

What it is good at 3 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

18 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesPaliGemmaForConditionalGeneration
Model typepaligemma
Dtypefloat32
Params by dtypeF32: 2,923,466,480
Size bandM
MoEno
Gatedmanual
PapersarXiv:2310.09199, arXiv:2303.15343, arXiv:2403.08295, arXiv:1706.03762, arXiv:2010.11929, arXiv:2209.06794, arXiv:2209.04372, arXiv:2103.01913, arXiv:2205.12522, arXiv:2110.11624, arXiv:2108.03353, arXiv:2010.04295, arXiv:2401.06209, arXiv:2305.10355, arXiv:2203.10244, arXiv:1810.12440, arXiv:1905.13648, arXiv:1608.00272, arXiv:1908.04913, arXiv:2407.07726
LicenseGemma Terms of Use (gemma)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · PaliGemmaForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for paligemma-3b-mix-224: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)7.0 GB · Single GPU (<24 GB)
FP8 (1 byte/param)3.5 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)1.8 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: google/paligemma 51 derivatives on the Hub

finetune: 22adapter: 27quantized: 2

Top variants (40 shown, ranked by downloads)

Relation
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
ilaydaergur/check_points finetune — 2.92B M gemma ilaydaergur 0 2.2k
hansa15100/openimage_r16_epoch10_model adapter — — — gemma hansa15100 0 1.5k
hansa15100/openimage adapter — — — gemma hansa15100 0 1.2k
mklissarov/paligemma_sweep_from_mix_fulltrain finetune — 2.92B M gemma mklissarov 0 443
mklissarov/paligemma_sweep_from_mix_fulltrain_10epoch finetune — 2.92B M gemma mklissarov 0 353
lamao-ab/paligemma-blind-assist-qlora-merged-v1 quantized — 2.92B M gemma lamao-ab 0 332
mklissarov/paligemma_sweep_from_mix_visiontrain_2epoch finetune — 2.92B M gemma mklissarov 0 278
mklissarov/paligemma_sweep_from_mix_fulltrain_25epoch finetune — 2.92B M gemma mklissarov 0 265
gowthamvenkat/paligemma-mix_3b_224_2epochs adapter — — — gemma gowthamvenkat 0 160
allenai/MolmoBot-Pi0-DROID finetune — 3.50B M gemma allenai 3 0
lamao-ab/paligemma-blind-assist-lora-merged-v1 adapter — 2.92B M gemma lamao-ab 0 144
Donald8585/paligemma-caption-finetuned adapter — — — — Donald8585 0 110
adishourya/results__fullrun__0710-151659 adapter — — — gemma adishourya 0 101
jesusgs01/results_fold_1 finetune — 2.92B M gemma jesusgs01 0 86
acchf/vision-qlora-pali-test finetune — 2.92B M gemma acchf 0 79
SHRemon97/paligemma_Mix_Med_VQA_Overall adapter — — — gemma SHRemon97 0 67
nm-testing/paligemma-3b-mix-224-FP8-dynamic quantized -FP8 3.45B M — nm-testing 0 42
barqawiz/paligemma-leprosy-detector-v1 adapter — — — — barqawiz 0 41
Bekbolat/paligemma_vqav2 adapter — — — gemma Bekbolat 0 35
akiulian/paligemma_vqav2 adapter — — — gemma akiulian 0 34
mklissarov/paligemma_sweep_from_mix finetune — 2.92B M gemma mklissarov 0 33
mklissarov/paligemma_sweep_from_mix_visiontrain_10epoch finetune — 2.92B M gemma mklissarov 0 33
hllj/paligemma-3b-mix-224-vi-llava-checkpoint-10000 adapter — — — — hllj 0 31
mockingmonkey/pali_result adapter — 2.92B M gemma mockingmonkey 0 31
jesusgs01/results_fold_3 finetune — 2.92B M gemma jesusgs01 0 31
acchf/vision-qlora-pali-test-total finetune — 2.92B M gemma acchf 0 31
acchf/vision-qlora-pali-test-mlflow finetune — 2.92B M gemma acchf 0 30
koolkittykat/paligemma_trash_segm_adapter adapter — — — — koolkittykat 0 29
akiulian/paligemma_vqav2-ep1-1000rows adapter — — — gemma akiulian 0 28
jesusgs01/results_solo_fold_1 finetune — 2.92B M gemma jesusgs01 0 28
zinoubm/paligemma_vqav2 adapter — — — gemma zinoubm 0 27
ishitas2365/paligemma-artifact-detector-finetuned adapter — — — — ishitas2365 0 27
mklissarov/paligemma_sweep_from_mix_2 finetune — 2.92B M gemma mklissarov 0 26
acchf/tagsgemma finetune — 2.92B M gemma acchf 0 25
mklissarov/paligemma_sweep_from_mix_fulltrain_1epoch finetune — 2.92B M gemma mklissarov 0 24
mklissarov/paligemma_sweep_from_mix_visiontrain_1epoch finetune — 2.92B M gemma mklissarov 0 24
koolkittykat/paligemma_trash_json_adapter adapter — — — — koolkittykat 0 24
adishourya/results__fullrun__0310-134147 adapter — — — gemma adishourya 0 24
aloofzebra03/VR2_finetuned-paligemma-lora adapter — — — — aloofzebra03 0 23
acchf/vision-tags-paligemma-qlora finetune — — — gemma acchf 0 23

Repository changelog

8 commits

Repository changelog 8 commits

DateCommitSHA
2024-07-19 Add citation link (#11) d1d8734
2024-07-18 Add citation (#10) 7951e01
2024-06-27 Update link to terms (#8) 76633f6
2024-05-17 Link to demo (#3) 2e5297f
2024-05-14 Metadata, transformers usage examples (#1) ce8b692
2024-05-12 Upload PaliGemmaForConditionalGeneration a710d81
2024-05-12 Upload processor 35d3845
2024-05-12 initial commit cc9b0d2

Articles and coverage

11 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official5

developers.googleblog.com2024-12-05officialauthorityHN front pageabout the paligemma familyHN 218 pts · 27 comments468 words
Google introduces PaliGemma 2, the next evolution in tunable vision-language models built upon the Gemma 2 family. This update adds vision capabilities to make fine-tuning easier and offers multiple model sizes ranging from 3B to 28B parameters alongside resolutions of 224px, 448px, and 896px. The models function as a drop-in replacement for existing users, enabling detailed captioning and specialized tasks like chemical formula recognition without major code modifications.written, reviewed, cited
ai.google.dev2024-05-14officialauthorityHN front pageabout the paligemma familyHN 145 pts · 15 comments264 words
Google released PaliGemma 2 and PaliGemma, lightweight open vision-language models inspired by PaLI-3 that take both images and text as inputs. PaliGemma 2 comes in 3B, 10B, and 28B parameter sizes based on Gemma 2 variants, while the original PaliGemma is only 3B. These models support resolutions of 224 x 224, 448 x 448, and 896 x 896 pixels.written, reviewed, cited
developers.googleblog.com2025-02-19officialauthorityabout the paligemma familyHN 2 pts · 0 comments537 words
Google launched PaliGemma 2 mix checkpoints in February 2025, offering a vision-language model tuned for multiple tasks like captioning and OCR. These models come in sizes of 3B, 10B, and 28B parameters and support resolutions of 224px and 448px. Users can explore capabilities on the Hugging Face demo, download weights from Kaggle and Hugging Face, or deploy directly in Vertex Model Garden.written, reviewed, cited
colab.research.google.com2024-05-22officialabout the paligemma familyHN 3 pts · 0 comments5 words
huggingface.co2024-12-05authorityabout the paligemma familyHN 1 pts · 0 comments1,778 words
Google releases PaliGemma 2, a new vision language model family combining SigLIP with Gemma 2. The models come in 3B, 10B, and 28B parameter sizes and support input resolutions of 224x224, 448x448, and 896x896. Fine-tuned variants on the DOCCI dataset achieve NES scores of 28.4 and 20.3 at 448x448 resolution.written, reviewed, cited

Analysis4

blog.roboflow.com2024-05-15HN front pageabout the paligemma familyHN 121 pts · 101 comments2,051 words
Google released PaliGemma, a 3 billion parameter open source multimodal model combining SigLIP and Gemma at the 2024 Google I/O event. The model features permissive commercial licensing and is designed explicitly to be fine-tuned on custom data rather than used out of the box. Engineers can self-host it on cloud infrastructure or larger edge devices like NVIDIA Jetsons.written, reviewed, cited
  • PaliGemma is not designed to be used directly, but to be transferred by fine-tuning to specific tasks.
  • Fine-tuning only the attention layers may result in limited performance improvements for the model.
  • Object detection prompts must include specific keywords like 'detect' or 'segment' to yield correct results.
arxiv.org2024-07-11authorityabout the paligemma familyHN 5 pts · 0 comments294 words
PaliGemma is a 3B parameter open Vision-Language Model built on the SigLIP-So400m vision encoder and the Gemma-2B language model. The model is trained to be a versatile and broadly knowledgeable base model that is effective to transfer. It achieves strong performance on almost 40 diverse tasks including standard VLM benchmarks and specialized tasks such as remote-sensing and segmentation.written, reviewed, cited
blog.roboflow.com2024-05-17about the paligemma familyHN 2 pts · 0 comments1,374 words
datature.io2024-06-20about the paligemma familyHN 2 pts · 0 comments3,246 words

Community1

x.com2024-05-18about the paligemma familyHN 1 pts · 0 comments
All coverage tracked for this model (11) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
PaliGemma 2 mix: A vision-language model for multiple tasksdevelopers.googleblog.com official2025-02-192026-10-07hn
PaliGemma 2 – New vision language models by Googlehuggingface.co2024-12-052026-10-07hn
PaliGemma 2: Powerful Vision-Language Models, Simple Fine-Tuningdevelopers.googleblog.com official2024-12-052026-10-07hn
Computer Vision à La Apple: Building Multimodal Adapters for On-Device LLMstensorsense.com2024-08-222026-10-07hn
PaliGemma: A versatile 3B VLM for transferarxiv.org2024-07-112026-10-07hn
A Primer on Fine-Tuning PaliGemma and VLMsdatature.io2024-06-202026-10-07hn
PaliGemma Keras Quickstartcolab.research.google.com official2024-05-222026-10-07hn
Real-time multimodal analysis using one 4090 and open-source paligemmax.com2024-05-182026-10-07hn
How to Fine-Tune PaliGemma for Object Detectionblog.roboflow.com2024-05-172026-10-07hn
PaliGemma: Open-Source Multimodal Model by Googleblog.roboflow.com2024-05-152026-10-07hn
PaliGemmaai.google.dev official2024-05-142026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • dots.ocr · 3.04B
    same size band (M), same task (image-text-to-text), permissive license
  • paligemma2-3b-pt-224 · 3.03B
    same size band (M), same task (image-text-to-text)
  • d1-3B · 3.12B
    same size band (M), same task (image-text-to-text)

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:39 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:10 UTC · Last verified 2026-10-25

Follow paligemma-3b-mix-224

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.