Models › Llama-3.2 family

Llama-3.2-90B-Vision-Instruct

meta-llama Llama 3.2 Community License out 2 years ago

88.6B parameters, images and text in, text out.

Verified 2026-10-25 Rank #648 in LLMs · score 73.1 method v1 Sources 3 Downloads 30d 508 · #607 of 619 tracked

Can I run it?53GB at INT4Estimatefits a 64 GB Mac (unified memory)method
Can I use it?Llama 3.2 Community LicenseAs 3.1; EU multimodal restriction in the textlicence file2026-10-24
Do people use it?508downloads, 30 days#607 of 619 we track · below the median366 likesHugging Face2026-10-24

Worth reading

Picked by rule from 25 tracked pieces: the lab's own post, the most shared, a field report, the latest.

25 best of 25 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleLlama 3.2: Revolutionizing edge AI and vision with open, customizable modelsai.meta.com · 2024-09-25 · 924 HN pts · official
  2. ArticleLlama 3.2 released: Multimodal, 1B to 90B sizesllama.com · 2024-09-25 · 89 HN pts · official
  3. ArticleI Self-Hosted Llama 3.2 with Coolify on My Home Servergeek.sg · 2024-10-16 · 221 HN pts
  4. ArticleOllama 0.4 is released with support for Meta's Llama 3.2 Vision models locallyollama.com · 2024-11-06 · 182 HN pts
  5. ArticleLlama can now see and run on your device – welcome Llama 3.2huggingface.co · 2024-09-25 · 26 HN pts
  6. ArticleDownload Llama 3.2 1B, 3B, 11B, 90Bllama.com · 2024-09-25 · official
  7. ArticleShow HN: Fine-tuned Llama 3.2 3B to match 70B models for local transcriptsbilawal.net · 2025-09-01
  8. ArticleShow HN: Llama 3.2 3B and Keiro Research achieves 85% on SimpleQAkeirolabs.cloud · 2026-03-07
  9. ArticleVerbatim AI – on-device transcription (Whisper) + summaries (Llama 3.2)apps.apple.com · 2026-04-21 · 2 HN pts
  10. CodeLlama 3.2 Releasegithub.com · 2024-09-25 · 12 HN pts
  11. ArticleLoad Llama-3.2 WebGPU in the browser from a local foldersimonwillison.net · 2025-09-09 · 3 HN pts
  12. ArticleRWKV-7 beats Llama 3.2 with 3x fewer training tokens and formally exceeds TC^0ai.gopubby.com · 2026-02-23
  13. CodePydanticAI using Ollama (llama3.2) running locallygithub.com · 2024-12-06
  14. CodeShow HN: Recall – open-source local file organizer using Llama 3.2 and Ollamagithub.com · 2025-12-10
  15. CodeImplementing the Llama 3.2 1B and 3B Architectures from Scratchgithub.com · 2024-10-05
  16. CodeShow HN: MLX.zig – Llama 3.2 in Ziggithub.com · 2025-03-14
  17. ArticleOpen Source wireframe to app powered by Llama 3.2 Visionnapkins.dev · 2024-09-25
  18. ArticleShow HN: Finetune Llama 3.2 Vision in a Colabcolab.research.google.com · 2024-11-21
  19. DiscussionLlama 3.2: Lightweight models for edge devicestwitter.com · 2024-09-25
  20. DiscussionLlama 3.2 1B and 3B on-device modelstwitter.com · 2024-09-25
  21. ArticleRun Llama 3.2 3B on your phoneapps.apple.com · 2025-01-18
  22. ArticleLLama3.2-vision as almost perfect OCR?demo.doctractor.com · 2024-11-18
  23. DiscussionI built this robot and gave it a llama3.2 braintwitter.com · 2025-01-14

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 6 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware6quantized builds
  • Built on96 fine-tunes · 3 adapters · 0 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: algorithmicsuperintelligence/OptiLLM ♥ 27 · NiansuhAI/Main ♥ 10 · davehusk/meta-llama-Llama-3.2-90B-Vision-Instruct ♥ 3 · tavli/anne-kalori-asistani ♥ 2

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 64 GB Mac (unified memory) at INT4

About 53 GB at INT4, 106 GB at FP8, 213 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 53 GB of weights (estimate; KV cache and activations extra)INT453 GBFP8: about 106 GB of weights (estimate; KV cache and activations extra)FP8106 GBBF16: about 213 GB of weights (estimate; KV cache and activations extra)BF16213 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 53 GB of weights (estimate; KV cache and activations extra)INT453 GBFP8: about 106 GB of weights (estimate; KV cache and activations extra)FP8106 GBBF16: about 213 GB of weights (estimate; KV cache and activations extra)BF16213 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 0 repo commits so far

Teal is the weights (2024-09-19), amber triangles are 10 dated articles (each links to it).

What people built on it

15 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

15 derivatives on the Hub, led by 6 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

6 quantized (Hugging Face model tree)6 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)6 quantized6 fine-tunes3 adapters
6 quantized (Hugging Face model tree)6 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)6 quantized6 fine-tunes3 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesMllamaForConditionalGeneration
Model typemllama
Params by dtypeBF16: 88,593,355,323
Size bandXL
MoEno
Gatedmanual
PapersarXiv:2204.05149
LicenseLlama 3.2 Community License (llama3.2)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: not in registry · MllamaForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · MllamaForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-3.2-90B-Vision-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)213 GB · Multi-GPU node (<640 GB)
FP8 (1 byte/param)106 GB · Multi-GPU node (<640 GB)
INT4 (0.5 bytes/param)53 GB · Single high-end GPU (<80 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

15 variants

Lineage

Original model Family: meta-llama/Llama-3.2 15 derivatives on the Hub

quantized: 6finetune: 6adapter: 3

Top variants (15 shown, ranked by downloads)

Relation
Quant
Size
15 rows
Variant Relation Quant Params Band License Author Likes Downloads
RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic quantized -FP8 88.6B XL llama3.2 RedHatAI 12 445.5k
unsloth/Llama-3.2-90B-Vision-Instruct-bnb-4bit quantized -bnb 91.3B XL llama3.2 unsloth 19 57.7k
unsloth/Llama-3.2-90B-Vision-Instruct finetune — 88.6B XL llama3.2 unsloth 18 40.7k
mlx-community/Llama-3.2-90B-Vision-Instruct-4bit finetune -4bit 88.6B XL llama3.2 mlx-community 5 16.6k
OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc quantized int4 14.5B L llama3.2 OPEA 0 2.9k
amd/Llama-3.2-90B-Vision-Instruct-FP8-KV quantized -FP8 88.6B XL llama3.2 amd 1 1.7k
unsloth/Llama-3.2-90B-Vision-Instruct-unsloth-bnb-4bit quantized -bnb 88.6B XL llama3.2 unsloth 2 514
osllmai-community/Llama-3.2-90B-Vision-Instruct finetune — — — llama3.2 osllmai-community 0 580
kiddobellamy/Llama_Vision finetune — — — mit kiddobellamy 1 341
gghfez/Llama-3.3-90B-Vision-merged finetune — 88.6B XL llama3.3 gghfez 5 50
itsanurag/Llama-3.2-90B-Vision-Instruct-bnb-4bit quantized -bnb 91.3B XL llama3.2 itsanurag 0 74
haniu/vision adapter — — — llama3.2 haniu 0 70
haniu/textvision adapter — — — llama3.2 haniu 0 56
haniu/text adapter — — — llama3.2 haniu 0 54
SaiChamakura/fine-tuned-visionllama90B finetune — — — — SaiChamakura 0 33

Articles and coverage

25 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official2

ai.meta.com2024-09-25officialauthorityHN front pageabout the Llama 3.2 familyHN 924 pts · 328 comments2,460 words
Meta releases Llama 3.2, featuring small and medium-sized vision LLMs (11B and 90B) alongside lightweight text-only models (1B and 3B) designed for edge and mobile devices. The 11B and 90B models serve as drop-in replacements for their corresponding text model equivalents while the 1B and 3B models support a context length of 128K tokens and are enabled on day one for Qualcomm and MediaTek hardware. Both pre-trained and aligned vision models are available for fine-tuning using torchtune and local deployment via torchchat, with weights based on BFloat16 numerics.written, reviewed, cited
  • The 11B and 90B vision models require an entirely new model architecture that supports image reasoning.
  • Developers can keep all text-only capabilities intact because the adapter training intentionally did not update the language-model parameters.
  • The 1B and 3B models are created by using structured pruning in a single shot manner from the Llama 3.1 8B.
llama.com2024-09-25officialauthorityabout the Llama 3.2 familyHN 89 pts · 19 comments42 words

Analysis8

github.com2024-11-21authorityHN front pageabout the Llama 3.2 familyHN 579 pts · 99 comments5,768 words
The project trained a Sparse Autoencoder on 6.5 Billion activations from Llama 3.2-3B layer 23 over 10 epochs. Data capture processed 25 million sentences totaling 4TB of raw activation data compressed to 3.2TB.generated, cited
geek.sg2024-10-16HN front pageabout the Llama 3.2 familyHN 221 pts · 90 comments2,289 words
A guide details self-hosting Llama 3.2 on a home server using Coolify and Ollama. The author achieved a 10x reduction in inference time by enabling GPU acceleration on an NVIDIA GeForce RTX 2060 using the CUDA toolkit and nvidia-container-toolkit. The setup involves installing Ubuntu 24, configuring Cloudflare Tunnels, and managing CUDA toolkits.written, reviewed, cited
  • Anyone with physical access can read your data if you avoid LVM or disk encryption for smoother reboots.
  • Cloudflare provides free SSL certificates only for wildcard domains at the top level, not on subdomains.
  • The Ollama service initially runs on the CPU until the NVIDIA Container Toolkit is installed and configured.
github.com2026-06-23authorityabout the Llama 3.2 familyHN 2 pts · 0 comments196 words
A minimal implementation of Llama 3.2 Instruct inference runs in ~100 lines of pure Numpy code. The project supports Python ≥ 3.10 and includes backends for PyTorch and Jax alongside the primary Numpy version. Ingredients in Llama 3.2 include RoPE with the Llama-3 frequency scaling, GQA, RMSNorm, SwiGLU MLP, and a shared unembedding / embedding matrix.written, reviewed, cited
ollama.com2024-11-06HN front pageabout the Llama 3.2 familyHN 182 pts · 25 comments202 words
huggingface.co2024-09-25authorityabout the Llama 3.2 familyHN 26 pts · 1 comments3,434 words
apps.apple.com2026-04-21about the Llama 3.2 familyHN 2 pts · 1 comments
github.com2024-09-25authorityabout the Llama 3.2 familyHN 12 pts · 0 comments
simonwillison.net2025-09-09authorityabout the Llama 3.2 familyHN 3 pts · 0 comments
All coverage tracked for this model (25) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Show HN: MinLlama – Llama 3.2 inference in ~100 lines of NumPygithub.com2026-06-232026-10-07hn
Verbatim AI – on-device transcription (Whisper) + summaries (Llama 3.2)apps.apple.com2026-04-212026-10-07hn
Show HN: Llama 3.2 3B and Keiro Research achieves 85% on SimpleQAkeirolabs.cloud2026-03-072026-10-07hn
RWKV-7 beats Llama 3.2 with 3x fewer training tokens and formally exceeds TC^0ai.gopubby.com2026-02-232026-10-07hn
Show HN: Recall – open-source local file organizer using Llama 3.2 and Ollamagithub.com2025-12-102026-10-07hn
Load Llama-3.2 WebGPU in the browser from a local foldersimonwillison.net2025-09-092026-10-07hn
Show HN: Fine-tuned Llama 3.2 3B to match 70B models for local transcriptsbilawal.net2025-09-012026-10-07hn
Show HN: MLX.zig – Llama 3.2 in Ziggithub.com2025-03-142026-10-07hn
Run Llama 3.2 3B on your phoneapps.apple.com2025-01-182026-10-07hn
I built this robot and gave it a llama3.2 braintwitter.com2025-01-142026-10-07hn
PydanticAI using Ollama (llama3.2) running locallygithub.com2024-12-062026-10-07hn
Show HN: Llama 3.2 Interpretability with Sparse Autoencodersgithub.com2024-11-212026-10-07hn
Show HN: Finetune Llama 3.2 Vision in a Colabcolab.research.google.com2024-11-212026-10-07hn
LLama3.2-vision as almost perfect OCR?demo.doctractor.com2024-11-182026-10-07hn
Ollama 0.4 is released with support for Meta's Llama 3.2 Vision models locallyollama.com2024-11-062026-10-07hn
I Self-Hosted Llama 3.2 with Coolify on My Home Servergeek.sg2024-10-162026-10-07hn
Implementing the Llama 3.2 1B and 3B Architectures from Scratchgithub.com2024-10-052026-10-07hn
Llama can now see and run on your device – welcome Llama 3.2huggingface.co2024-09-252026-10-07hn
Open Source wireframe to app powered by Llama 3.2 Visionnapkins.dev2024-09-252026-10-07hn
Llama 3.2 1B and 3B on-device modelstwitter.com2024-09-252026-10-07hn
Llama 3.2: Lightweight models for edge devicestwitter.com2024-09-252026-10-07hn
Llama 3.2 Releasegithub.com2024-09-252026-10-07hn
Llama 3.2: Revolutionizing edge AI and vision with open, customizable modelsai.meta.com official2024-09-252026-10-07hn
Download Llama 3.2 1B, 3B, 11B, 90Bllama.com official2024-09-252026-10-07hn
Llama 3.2 released: Multimodal, 1B to 90B sizesllama.com official2024-09-252026-10-07hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:40 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:12 UTC · Last verified 2026-10-25

Follow Llama-3.2-90B-Vision-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.