Models › paligemma family

paligemma-3b-pt-224

google Gemma Terms of Use out 2 years ago

2.92B parameters, images and text in, text out.

Verified 2026-10-25 Rank #234 in LLMs · score 86.8 method v1 Sources 3 Downloads 30d 260.1k · #228 of 619 tracked

Can I run it?1.8GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Gemma Terms of UseGoogle's terms + prohibited-use policy; must pass terms downstreamlicence file2026-10-24
Do people use it?260.1kdownloads, 30 days#228 of 619 we track · top 37%+11 likes, downloads −4% this week660 likesHugging Face2026-10-24

Worth reading

Picked by rule from 13 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 121 HN pts

PaliGemma: Open-Source Multimodal Model by Google

Google released PaliGemma, a 3 billion parameter open source multimodal model combining SigLIP and Gemma at the 2024 Google I/O event.

  • PaliGemma is not designed to be used directly, but to be transferred by fine-tuning to specific tasks.
  • Fine-tuning only the attention layers may result in limited performance improvements for the model.
blog.roboflow.com 2024-05-15 121 HN pts · 101 comments 2.1k words about the paligemma family family
Latest · 20 months ago

PaliGemma 2 mix: A vision-language model for multiple tasks

Google launched PaliGemma 2 mix checkpoints in February 2025, offering a vision-language model tuned for multiple tasks like captioning and OCR.

developers.googleblog.com 2025-02-19 2 HN pts 537 words about the paligemma family family

13 best of 13 tracked

The 2 picks above, plus these 11. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticlePaliGemma 2: Powerful Vision-Language Models, Simple Fine-Tuningdevelopers.googleblog.com · 2024-12-05 · 218 HN pts · official
  2. ArticlePaliGemmaai.google.dev · 2024-05-14 · 145 HN pts · official
  3. ArticleGemma explained: PaliGemma architecture - Google Developers Blogdevelopers.googleblog.com · 2024-09-05 · official
  4. PaperPaliGemma: A versatile 3B VLM for transferarxiv.org · 2024-07-11 · 5 HN pts
  5. ArticlePaliGemma Keras Quickstartcolab.research.google.com · 2024-05-22 · 3 HN pts · official
  6. ArticlePaliGemma 2 – New vision language models by Googlehuggingface.co · 2024-12-05 · 1 HN pts
  7. ArticleA Primer on Fine-Tuning PaliGemma and VLMsdatature.io · 2024-06-20 · 2 HN pts
  8. ArticleHow to Fine-Tune PaliGemma for Object Detectionblog.roboflow.com · 2024-05-17 · 2 HN pts
  9. ArticleComputer Vision à La Apple: Building Multimodal Adapters for On-Device LLMstensorsense.com · 2024-08-22
  10. DiscussionReal-time multimodal analysis using one 4090 and open-source paligemmax.com · 2024-05-18
  11. ArticlePaliGemma 3B: Google Vision-Language Model | Fine-Tuning Guide (2026) | Local AI Masterlocalaimaster.com · 2025-10-28

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 1 quantized builds and 30 Spaces.

  • As a service0no API provider listed
  • On own hardware1quantized builds
  • Built on34685 fine-tunes · 261 adapters · 0 merges
  • In apps30Hugging Face Spaces

Top Spaces running it: Justinrune/LLaMA-Factory ♥ 12 · pavel321/huggingface-cli-completion ♥ 2 · nsandiman/uarizona-msis-capstone-group5-imagecraft ♥ 1 · gatilin/florence-forge-webui ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 1.8 GB at INT4, 3.5 GB at FP8, 7.0 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.8 GB of weights (estimate; KV cache and activations extra)INT41.8 GBFP8: about 3.5 GB of weights (estimate; KV cache and activations extra)FP83.5 GBBF16: about 7.0 GB of weights (estimate; KV cache and activations extra)BF167.0 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.8 GB of weights (estimate; KV cache and activations extra)INT41.8 GBFP8: about 3.5 GB of weights (estimate; KV cache and activations extra)FP83.5 GBBF16: about 7.0 GB of weights (estimate; KV cache and activations extra)BF167.0 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 10 repo commits so far

Teal is the weights (2024-05-12), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

347 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

347 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

1 quantized (Hugging Face model tree)85 fine-tunes (Hugging Face model tree)261 adapters (Hugging Face model tree)1 quantized85 fine-tunes261 adapters
1 quantized (Hugging Face model tree)85 fine-tunes (Hugging Face model tree)261 adapters (Hugging Face model tree)1 quantized85 fine-tunes261 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

3 use cases

What it is good at 3 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

18 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesPaliGemmaForConditionalGeneration
Model typepaligemma
Dtypefloat32
Params by dtypeF32: 2,923,466,480
Size bandM
MoEno
Gatedmanual
PapersarXiv:2310.09199, arXiv:2303.15343, arXiv:2403.08295, arXiv:1706.03762, arXiv:2010.11929, arXiv:2209.06794, arXiv:2209.04372, arXiv:2103.01913, arXiv:2205.12522, arXiv:2110.11624, arXiv:2108.03353, arXiv:2010.04295, arXiv:2401.06209, arXiv:2305.10355, arXiv:2203.10244, arXiv:1810.12440, arXiv:1905.13648, arXiv:1608.00272, arXiv:1908.04913, arXiv:2407.07726
LicenseGemma Terms of Use (gemma)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · PaliGemmaForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for paligemma-3b-pt-224: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)7.0 GB · Single GPU (<24 GB)
FP8 (1 byte/param)3.5 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)1.8 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: google/paligemma 347 derivatives on the Hub

finetune: 85adapter: 261quantized: 1

Top variants (40 shown, ranked by downloads)

Relation
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
lerobot/pi05_base finetune — 3.62B M gemma lerobot 111 172.7k
lerobot/pi0_base finetune — 3.50B M gemma lerobot 30 135.9k
lerobot/pi0fast-base finetune — 2.92B M gemma lerobot 27 24.7k
NYUAD-ComNets/VehiclePaliGemma finetune — 2.92B M gemma NYUAD-ComNets 3 10.1k
NYUAD-ComNets/FaceScanPaliGemma_Race finetune — 2.92B M gemma NYUAD-ComNets 1 7.5k
HaomingSong/lerobot-pi0-bridge finetune — 3.24B M mit HaomingSong 1 7.4k
HaomingSong/lerobot-pi0-fractal finetune — 3.24B M mit HaomingSong 1 6.9k
merve/paligemma_vqav2 finetune — 2.92B M gemma merve 15 2.9k
NYUAD-ComNets/FaceScanPaliGemma_Gender finetune — 2.92B M gemma NYUAD-ComNets 3 751
NYUAD-ComNets/FaceScanPaliGemma_Age finetune — 2.92B M gemma NYUAD-ComNets 0 754
MohammedSohail111/shroom-paligemma adapter — — — gemma MohammedSohail111 0 753
utischoolnlp/paligemma_multimodal_query_rewrite finetune — 2.92B M gemma utischoolnlp 1 646
Fer14/paligemma_coffee_machine_caption finetune — — — mit Fer14 2 578
NYUAD-ComNets/FaceScanPaliGemma_Emotion finetune — 2.92B M gemma NYUAD-ComNets 0 671
MahmoudRox/Paligemma_VQAMED2019 adapter — — — gemma MahmoudRox 5 405
Bikas0/paligemma_vqav2 adapter — — — gemma Bikas0 0 570
alakxender/paligemma-dhivehi-xs adapter — — — gemma alakxender 0 554
andrejikica/paligemma_finetune adapter — — — gemma andrejikica 0 495
tahamajs/plamma adapter — — — mit tahamajs 3 271
dwb2023/paligemma-cnmc-ft adapter — — — gemma dwb2023 1 357
BabaK07/pixeltext-ai finetune — — — apache-2.0 BabaK07 0 355
mklissarov/paligemma_vqav2 finetune — 2.92B M gemma mklissarov 0 295
gokulsabari/paligemma-adapter-new finetune — 2.92B M gemma gokulsabari 0 290
shivanikerai/paligemma_ean_4.0 adapter — — — gemma shivanikerai 0 282
DepositorOP/paligemma_vqav2 finetune — 2.92B M gemma DepositorOP 0 275
seyviour/paligemma_vqav2 adapter — — — gemma seyviour 0 273
pepijn223/output finetune — 2.92B M gemma pepijn223 0 271
mklissarov/paligemma_sweep_from_pt finetune — 2.92B M gemma mklissarov 0 270
mervinpraison/paligemma_vqav2 adapter — — — gemma mervinpraison 0 260
eagle0504/paligemma_vqav2 finetune — 2.92B M gemma eagle0504 0 260
yan06200/paligemma_ft_test finetune — 2.92B M gemma yan06200 0 246
nanom/paligemma-3b-224-ft-vizwiztxtvqa finetune — 2.92B M gemma nanom 0 238
nhero/paligemma_emotion_all finetune — 2.92B M gemma nhero 0 234
linhtrann21/ft_paligemma1 finetune — 2.92B M gemma linhtrann21 0 227
nanom/paligemma-3b-224-vizwiz finetune — 2.92B M gemma nanom 0 225
statking/paligemma_vqa_lower finetune — 2.92B M gemma statking 0 194
linhtrann21/ft_paligemma_vqav2_small finetune — 2.92B M gemma linhtrann21 0 178
lyleokoth/code-extraction adapter — — — gemma lyleokoth 0 176
dwb2023/paligemma_rlaifv-V-1 adapter — — — gemma dwb2023 0 173
SushantGautam/MEDVQACpaligemma-adapter adapter — — — gemma SushantGautam 0 170

Repository changelog

10 commits

Repository changelog 10 commits

DateCommitSHA
2024-09-21 Update How to Use - Blog Link (#20) 35e4f46
2024-09-21 Update code sample to import BitsAndBytesConfig (#25) 3f14679
2024-07-19 Add citation link (#23) a2bce05
2024-07-18 Add citation (#22) 103e37b
2024-06-27 Update link to terms (#17) 7be6e0d
2024-05-17 Link to demo (#7) 54bc972
2024-05-14 Metadata, transformers usage examples (#1) 99f3b66
2024-05-12 Upload PaliGemmaForConditionalGeneration 9beb8bd
2024-05-12 Upload processor 471c923
2024-05-12 initial commit 07bbfbb

Articles and coverage

13 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official6

developers.googleblog.com2024-12-05officialauthorityHN front pageabout the paligemma familyHN 218 pts · 27 comments468 words
Google introduces PaliGemma 2, the next evolution in tunable vision-language models built upon the Gemma 2 family. This update adds vision capabilities to make fine-tuning easier and offers multiple model sizes ranging from 3B to 28B parameters alongside resolutions of 224px, 448px, and 896px. The models function as a drop-in replacement for existing users, enabling detailed captioning and specialized tasks like chemical formula recognition without major code modifications.written, reviewed, cited
ai.google.dev2024-05-14officialauthorityHN front pageabout the paligemma familyHN 145 pts · 15 comments264 words
Google released PaliGemma 2 and PaliGemma, lightweight open vision-language models inspired by PaLI-3 that take both images and text as inputs. PaliGemma 2 comes in 3B, 10B, and 28B parameter sizes based on Gemma 2 variants, while the original PaliGemma is only 3B. These models support resolutions of 224 x 224, 448 x 448, and 896 x 896 pixels.written, reviewed, cited
developers.googleblog.com2025-02-19officialauthorityabout the paligemma familyHN 2 pts · 0 comments537 words
Google launched PaliGemma 2 mix checkpoints in February 2025, offering a vision-language model tuned for multiple tasks like captioning and OCR. These models come in sizes of 3B, 10B, and 28B parameters and support resolutions of 224px and 448px. Users can explore capabilities on the Hugging Face demo, download weights from Kaggle and Hugging Face, or deploy directly in Vertex Model Garden.written, reviewed, cited
developers.googleblog.com2024-09-05officialauthorityabout the paligemma family1,071 words
PaliGemma is a lightweight open vision-language model combining the SigLIP vision encoder with the Gemma 2B language model. The model uses a Gemma tokenizer with 256000 tokens, extended by 1024 entries for image coordinates and 128 entries for segmentation, totaling 257216 tokens. Image patches are 14x14 pixel squares processed through an encoder supporting up to 256 positions.written, reviewed, cited
  • The patch embedding convolution uses a kernel size of (14, 14) with a stride of (14, 14) to process RGB images.
  • The model extends the Gemma tokenizer vocabulary with 1024 entries representing coordinates in normalized image-space.
  • PaliGemma-3B-mix-224 was trained with a sequence length of 256 for both input text and output text tokens.
colab.research.google.com2024-05-22officialabout the paligemma familyHN 3 pts · 0 comments5 words
huggingface.co2024-12-05authorityabout the paligemma familyHN 1 pts · 0 comments1,778 words
Google releases PaliGemma 2, a new vision language model family combining SigLIP with Gemma 2. The models come in 3B, 10B, and 28B parameter sizes and support input resolutions of 224x224, 448x448, and 896x896. Fine-tuned variants on the DOCCI dataset achieve NES scores of 28.4 and 20.3 at 448x448 resolution.written, reviewed, cited

Analysis4

blog.roboflow.com2024-05-15HN front pageabout the paligemma familyHN 121 pts · 101 comments2,051 words
Google released PaliGemma, a 3 billion parameter open source multimodal model combining SigLIP and Gemma at the 2024 Google I/O event. The model features permissive commercial licensing and is designed explicitly to be fine-tuned on custom data rather than used out of the box. Engineers can self-host it on cloud infrastructure or larger edge devices like NVIDIA Jetsons.written, reviewed, cited
  • PaliGemma is not designed to be used directly, but to be transferred by fine-tuning to specific tasks.
  • Fine-tuning only the attention layers may result in limited performance improvements for the model.
  • Object detection prompts must include specific keywords like 'detect' or 'segment' to yield correct results.
arxiv.org2024-07-11authorityabout the paligemma familyHN 5 pts · 0 comments294 words
PaliGemma is a 3B parameter open Vision-Language Model built on the SigLIP-So400m vision encoder and the Gemma-2B language model. The model is trained to be a versatile and broadly knowledgeable base model that is effective to transfer. It achieves strong performance on almost 40 diverse tasks including standard VLM benchmarks and specialized tasks such as remote-sensing and segmentation.written, reviewed, cited
blog.roboflow.com2024-05-17about the paligemma familyHN 2 pts · 0 comments1,374 words
datature.io2024-06-20about the paligemma familyHN 2 pts · 0 comments3,246 words
All coverage tracked for this model (13) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
PaliGemma 3B: Google Vision-Language Model | Fine-Tuning Guide (2026) | Local AI Masterlocalaimaster.com2025-10-282026-10-07exa
PaliGemma 2 mix: A vision-language model for multiple tasksdevelopers.googleblog.com official2025-02-192026-10-07hn
PaliGemma 2 – New vision language models by Googlehuggingface.co2024-12-052026-10-07hn
PaliGemma 2: Powerful Vision-Language Models, Simple Fine-Tuningdevelopers.googleblog.com official2024-12-052026-10-07hn
Gemma explained: PaliGemma architecture - Google Developers Blogdevelopers.googleblog.com official2024-09-052026-10-07exa
Computer Vision à La Apple: Building Multimodal Adapters for On-Device LLMstensorsense.com2024-08-222026-10-07hn
PaliGemma: A versatile 3B VLM for transferarxiv.org2024-07-112026-10-07hn
A Primer on Fine-Tuning PaliGemma and VLMsdatature.io2024-06-202026-10-07hn
PaliGemma Keras Quickstartcolab.research.google.com official2024-05-222026-10-07hn
Real-time multimodal analysis using one 4090 and open-source paligemmax.com2024-05-182026-10-07hn
How to Fine-Tune PaliGemma for Object Detectionblog.roboflow.com2024-05-172026-10-07hn
PaliGemma: Open-Source Multimodal Model by Googleblog.roboflow.com2024-05-152026-10-07hn
PaliGemmaai.google.dev official2024-05-142026-10-07hn

Papers

8 papers

Papers 8

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • dots.ocr · 3.04B
    same size band (M), same task (image-text-to-text), permissive license
  • paligemma2-3b-pt-224 · 3.03B
    same size band (M), same task (image-text-to-text)
  • d1-3B · 3.12B
    same size band (M), same task (image-text-to-text)

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25

Follow paligemma-3b-pt-224

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.