Models › Llama-3.2 family

Llama-3.2-1B-Instruct

unsloth Llama 3.2 Community License out 2 years ago

1.24B parameters, text in, text out, 128K tokens of context.

Verified 2026-10-25 Rank #484 in LLMs · score 76.9 method v1 Sources 3 Downloads 30d 983.9k · #112 of 619 tracked

Can I run it?0.7GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Llama 3.2 Community LicenseAs 3.1; EU multimodal restriction in the textlicence file2026-10-24
Do people use it?983.9kdownloads, 30 days#112 of 619 we track · top 18%+4 likes, downloads +23% this week107 likesHugging Face2026-10-24

Worth reading

Picked by rule from 25 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 924 HN pts

Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

Meta releases Llama 3.2, featuring small and medium-sized vision LLMs (11B and 90B) alongside lightweight text-only models (1B and 3B) designed for edge and mobile devices.

  • The 11B and 90B vision models require an entirely new model architecture that supports image reasoning.
  • Developers can keep all text-only capabilities intact because the adapter training intentionally did not update the language-model parameters.
ai.meta.com 2024-09-25 924 HN pts · 328 comments 2.5k words about the Llama 3.2 family family

25 best of 25 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: Llama 3.2 Interpretability with Sparse Autoencodersgithub.com · 2024-11-21 · 579 HN pts
  2. ArticleLlama 3.2 released: Multimodal, 1B to 90B sizesllama.com · 2024-09-25 · 89 HN pts
  3. ArticleI Self-Hosted Llama 3.2 with Coolify on My Home Servergeek.sg · 2024-10-16 · 221 HN pts
  4. ArticleOllama 0.4 is released with support for Meta's Llama 3.2 Vision models locallyollama.com · 2024-11-06 · 182 HN pts
  5. ArticleLlama can now see and run on your device – welcome Llama 3.2huggingface.co · 2024-09-25 · 26 HN pts
  6. ArticleShow HN: Fine-tuned Llama 3.2 3B to match 70B models for local transcriptsbilawal.net · 2025-09-01
  7. ArticleDownload Llama 3.2 1B, 3B, 11B, 90Bllama.com · 2024-09-25 · 7 HN pts
  8. ArticleShow HN: Llama 3.2 3B and Keiro Research achieves 85% on SimpleQAkeirolabs.cloud · 2026-03-07
  9. ArticleVerbatim AI – on-device transcription (Whisper) + summaries (Llama 3.2)apps.apple.com · 2026-04-21 · 2 HN pts
  10. CodeLlama 3.2 Releasegithub.com · 2024-09-25 · 12 HN pts
  11. ArticleLoad Llama-3.2 WebGPU in the browser from a local foldersimonwillison.net · 2025-09-09
  12. ArticleRWKV-7 beats Llama 3.2 with 3x fewer training tokens and formally exceeds TC^0ai.gopubby.com · 2026-02-23
  13. CodePydanticAI using Ollama (llama3.2) running locallygithub.com · 2024-12-06
  14. CodeShow HN: Recall – open-source local file organizer using Llama 3.2 and Ollamagithub.com · 2025-12-10
  15. CodeImplementing the Llama 3.2 1B and 3B Architectures from Scratchgithub.com · 2024-10-05
  16. CodeShow HN: MLX.zig – Llama 3.2 in Ziggithub.com · 2025-03-14
  17. ArticleOpen Source wireframe to app powered by Llama 3.2 Visionnapkins.dev · 2024-09-25
  18. ArticleShow HN: Finetune Llama 3.2 Vision in a Colabcolab.research.google.com · 2024-11-21
  19. DiscussionLlama 3.2: Lightweight models for edge devicestwitter.com · 2024-09-25
  20. DiscussionLlama 3.2 1B and 3B on-device modelstwitter.com · 2024-09-25
  21. ArticleRun Llama 3.2 3B on your phoneapps.apple.com · 2025-01-18
  22. ArticleLLama3.2-vision as almost perfect OCR?demo.doctractor.com · 2024-11-18
  23. DiscussionI built this robot and gave it a llama3.2 braintwitter.com · 2025-01-14

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 82 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware82quantized builds
  • Built on1,067606 fine-tunes · 440 adapters · 21 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: KwabsHug/GameConfigIdea ♥ 17 · Nymbo/Llama-3.2-1B-Instruct ♥ 4 · FlameF0X/SLM-Playground ♥ 4 · RavichandraNayakar/customer_support_env ♥ 3

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.7 GB at INT4, 1.5 GB at FP8, 3.0 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.7 GB of weights (estimate; KV cache and activations extra)INT40.7 GBFP8: about 1.5 GB of weights (estimate; KV cache and activations extra)FP81.5 GBBF16: about 3.0 GB of weights (estimate; KV cache and activations extra)BF163.0 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.7 GB of weights (estimate; KV cache and activations extra)INT40.7 GBFP8: about 1.5 GB of weights (estimate; KV cache and activations extra)FP81.5 GBBF16: about 3.0 GB of weights (estimate; KV cache and activations extra)BF163.0 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2024-09-25), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

1,149 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

1,149 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

82 quantized (Hugging Face model tree)606 fine-tunes (Hugging Face model tree)21 merges (Hugging Face model tree)440 adapters (Hugging Face model tree)82 quantized606 fine-tunes21 merges440 adapters
82 quantized (Hugging Face model tree)606 fine-tunes (Hugging Face model tree)21 merges (Hugging Face model tree)440 adapters (Hugging Face model tree)82 quantized606 fine-tunes21 merges440 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Dtypebfloat16
Params by dtypeBF16: 1,235,814,400
Size bandS
MoEno
Context length131,072 (config.json max_position_embeddings)
Languagesen
LicenseLlama 3.2 Community License (llama3.2)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-3.2-1B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)3.0 GB · Edge (<4 GB)
FP8 (1 byte/param)1.5 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.7 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from meta-llama/Llama-3.2-1B-Instruct Family: unsloth/Llama-3.2 1,149 derivatives on the Hub

Base model: meta-llama/Llama-3.2-1B-Instruct

finetune: 606quantized: 82adapter: 440merge: 21

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
ai-nexuz/llama-3.2-1b-instruct-fine-tuned finetune — 1.24B S apache-2.0 ai-nexuz 1 9k
ProdocAI/EndConvo-health-1b-GGUF-v1 quantized GGUF 1.24B S mit ProdocAI 4 5.4k
RTO-RL/Llama3.2-1B-RewardModel finetune — 1.24B S — RTO-RL 0 5.6k
ncbateman/tuning-miner-output adapter — — — llama3.2 ncbateman 0 4.7k
mecha-org/linux-command-generator-llama3.2-1b adapter GGUF 1.24B S other mecha-org 0 3.5k
skshmjn/llama-3.2-1B-Mongo-query-generator quantized GGUF 1.24B S apache-2.0 skshmjn 0 2.8k
DevQuasar-4/unsloth.Llama-3.2-1B-Instruct-GGUF quantized GGUF — — — DevQuasar-4 0 2.1k
Qalbun-AI/QalbunLLM-V1 quantized GGUF 1.24B S apache-2.0 Qalbun-AI 1 1.9k
Zynerji/Ektome-Llama-3.2-1Bi-PristinelyUncensored quantized GGUF 1.24B S apache-2.0 Zynerji 0 1.8k
ProdocAI/Intent-classification-1b-GGUF-v1 quantized GGUF — — mit ProdocAI 4 1.5k
genaforvena/huivam_finnegan_llama3.2-1b quantized GGUF 1.24B S cc0-1.0 genaforvena 0 1.6k
alpha-ai/clinical-info-corrector-1B quantized GGUF — — other alpha-ai 2 1.3k
leonvanbokhorst/Llama-3.2-1B-Instruct-Complaint finetune — 1.24B S apache-2.0 leonvanbokhorst 0 1.1k
harshwardhanjadhav/llama3.2-1b-CoT finetune — 1.24B S apache-2.0 harshwardhanjadhav 1 910
roky-dev/my-custom-llama-3.2-1b-merged merge — 1.24B S — roky-dev 0 957
hrsvrn/linux-llama3.21b quantized GGUF 1.24B S apache-2.0 hrsvrn 1 891
TheRimboo/UnivGuelma-ChatBot-Llama-instruct-1B quantized GGUF — — apache-2.0 TheRimboo 0 767
OpenWeightsAI/Vynis-0.1-2b-instant finetune — 1.24B S apache-2.0 OpenWeightsAI 0 731
lakshyaixi/Llama_3_2_1B_Filler_v8_SFT finetune — 1.24B S apache-2.0 lakshyaixi 0 719
mohammedaouamri5/univ-chat quantized GGUF — — apache-2.0 mohammedaouamri5 0 715
MaxwellMensah/fraud_model_v7 adapter GGUF 1.24B S llama3.2 MaxwellMensah 0 692
bunnycore/Llama-3.2-1b-Chatml-RP merge — 1.50B S — bunnycore 0 689
theprint/Llama3.2-1B-ThinkMix-Full finetune — 1.24B S apache-2.0 theprint 0 684
edwardw483/model quantized GGUF — — apache-2.0 edwardw483 0 675
liodon-ai/Llama-3.2-1B-Instruct-imatrix-GGUF quantized imatrix — — other liodon-ai 0 630
Wladastic/Mini-Think-Base-1B finetune — 1.24B S llama3.2 Wladastic 1 566
Venkat9990/finance-specialist-v7 adapter GGUF 1.24B S apache-2.0 Venkat9990 1 565
SamMikaelson/llama-3.2-1b-hermes-function-calling-merged finetune — 1.24B S apache-2.0 SamMikaelson 0 615
NotASI/FineTome-v1.5-Llama3.2-1B-1007 merge — 1.24B S llama3.2 NotASI 1 551
Fu01978/Llama-3.2-1B-4B-Quad-MoE merge — 3.65B M llama3.2 Fu01978 0 593
theprint/Llama3.2-1B-FantasySciFi-Full finetune — 1.24B S apache-2.0 theprint 0 586
khazarai/MentalChat-16K finetune — 1.24B S llama3.2 khazarai 3 434
theprint/Llama3.2-1B-FantasySciFi finetune — 1.24B S apache-2.0 theprint 0 554
Trelis/Llama-3.2-1B-Instruct-MATH-synthetic finetune — 1.24B S apache-2.0 Trelis 0 545
puettmann/LlaMaestra-3.2-1B-Translation-bnb-4bit quantized -bnb 1.27B S llama3.2 puettmann 3 376
Fetuffo78/Llama-3.2-1B-Instruct-Q4_K_M-GGUF quantized GGUF — — llama3.2 Fetuffo78 1 445
cdarkgtown/chess_carlsen_default_setting_finetune_model quantized GGUF — — apache-2.0 cdarkgtown 0 455
solanoalex/college-predictor-llama finetune — 1.24B S apache-2.0 solanoalex 0 446
solanoalex/college-predictor-llama-v2 finetune — 1.24B S apache-2.0 solanoalex 0 430
bunnycore/Llama-3.2-1B-Instruct-RP merge — 1.24B S — bunnycore 0 429

Repository changelog

16 commits

Repository changelog 16 commits

DateCommitSHA
2025-05-09 Upload folder using huggingface_hub 5a8abab
2025-04-26 Add files using upload-large-folder tool 8bb5cb0
2025-02-25 Add files using upload-large-folder tool 9b58d4a
2025-01-23 Add files using upload-large-folder tool eb49081
2025-01-22 Add files using upload-large-folder tool 2906abd
2025-01-22 Add files using upload-large-folder tool 0430e71
2024-12-09 Update README.md 22e9fdb
2024-12-09 Update README.md dd34ae5
2024-09-30 Upload tokenizer 50ea995
2024-09-29 Upload tokenizer bd6d978
2024-09-29 Upload tokenizer d5a34d2
2024-09-25 Update README.md d2b9e36
2024-09-25 Update README.md 1f0a267
2024-09-25 Upload tokenizer 4e20426
2024-09-25 Upload LlamaForCausalLM 518b1bc
2024-09-25 initial commit 5c597a7

Articles and coverage

25 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

ai.meta.com2024-09-25authorityHN front pageabout the Llama 3.2 familyHN 924 pts · 328 comments2,460 words
Meta releases Llama 3.2, featuring small and medium-sized vision LLMs (11B and 90B) alongside lightweight text-only models (1B and 3B) designed for edge and mobile devices. The 11B and 90B models serve as drop-in replacements for their corresponding text model equivalents while the 1B and 3B models support a context length of 128K tokens and are enabled on day one for Qualcomm and MediaTek hardware. Both pre-trained and aligned vision models are available for fine-tuning using torchtune and local deployment via torchchat, with weights based on BFloat16 numerics.written, reviewed, cited
  • The 11B and 90B vision models require an entirely new model architecture that supports image reasoning.
  • Developers can keep all text-only capabilities intact because the adapter training intentionally did not update the language-model parameters.
  • The 1B and 3B models are created by using structured pruning in a single shot manner from the Llama 3.1 8B.

Analysis9

github.com2024-11-21authorityHN front pageabout the Llama 3.2 familyHN 579 pts · 99 comments5,768 words
The project trained a Sparse Autoencoder on 6.5 Billion activations from Llama 3.2-3B layer 23 over 10 epochs. Data capture processed 25 million sentences totaling 4TB of raw activation data compressed to 3.2TB.generated, cited
llama.com2024-09-25authorityabout the Llama 3.2 familyHN 89 pts · 19 comments42 words
geek.sg2024-10-16HN front pageabout the Llama 3.2 familyHN 221 pts · 90 comments2,289 words
A guide details self-hosting Llama 3.2 on a home server using Coolify and Ollama. The author achieved a 10x reduction in inference time by enabling GPU acceleration on an NVIDIA GeForce RTX 2060 using the CUDA toolkit and nvidia-container-toolkit. The setup involves installing Ubuntu 24, configuring Cloudflare Tunnels, and managing CUDA toolkits.written, reviewed, cited
  • Anyone with physical access can read your data if you avoid LVM or disk encryption for smoother reboots.
  • Cloudflare provides free SSL certificates only for wildcard domains at the top level, not on subdomains.
  • The Ollama service initially runs on the CPU until the NVIDIA Container Toolkit is installed and configured.
github.com2026-06-23authorityabout the Llama 3.2 familyHN 2 pts · 0 comments196 words
A minimal implementation of Llama 3.2 Instruct inference runs in ~100 lines of pure Numpy code. The project supports Python ≥ 3.10 and includes backends for PyTorch and Jax alongside the primary Numpy version. Ingredients in Llama 3.2 include RoPE with the Llama-3 frequency scaling, GQA, RMSNorm, SwiGLU MLP, and a shared unembedding / embedding matrix.written, reviewed, cited
ollama.com2024-11-06HN front pageabout the Llama 3.2 familyHN 182 pts · 25 comments202 words
huggingface.co2024-09-25authorityabout the Llama 3.2 familyHN 26 pts · 1 comments3,434 words
llama.com2024-09-25authorityHN 7 pts · 0 comments42 words
apps.apple.com2026-04-21about the Llama 3.2 familyHN 2 pts · 1 comments
github.com2024-09-25authorityabout the Llama 3.2 familyHN 12 pts · 0 comments
All coverage tracked for this model (25) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Show HN: MinLlama – Llama 3.2 inference in ~100 lines of NumPygithub.com2026-06-232026-10-07hn
Verbatim AI – on-device transcription (Whisper) + summaries (Llama 3.2)apps.apple.com2026-04-212026-10-07hn
Show HN: Llama 3.2 3B and Keiro Research achieves 85% on SimpleQAkeirolabs.cloud2026-03-072026-10-07hn
RWKV-7 beats Llama 3.2 with 3x fewer training tokens and formally exceeds TC^0ai.gopubby.com2026-02-232026-10-07hn
Show HN: Recall – open-source local file organizer using Llama 3.2 and Ollamagithub.com2025-12-102026-10-07hn
Load Llama-3.2 WebGPU in the browser from a local foldersimonwillison.net2025-09-092026-10-07hn
Show HN: Fine-tuned Llama 3.2 3B to match 70B models for local transcriptsbilawal.net2025-09-012026-10-07hn
Show HN: MLX.zig – Llama 3.2 in Ziggithub.com2025-03-142026-10-07hn
Run Llama 3.2 3B on your phoneapps.apple.com2025-01-182026-10-07hn
I built this robot and gave it a llama3.2 braintwitter.com2025-01-142026-10-07hn
PydanticAI using Ollama (llama3.2) running locallygithub.com2024-12-062026-10-07hn
Show HN: Llama 3.2 Interpretability with Sparse Autoencodersgithub.com2024-11-212026-10-07hn
Show HN: Finetune Llama 3.2 Vision in a Colabcolab.research.google.com2024-11-212026-10-07hn
LLama3.2-vision as almost perfect OCR?demo.doctractor.com2024-11-182026-10-07hn
Ollama 0.4 is released with support for Meta's Llama 3.2 Vision models locallyollama.com2024-11-062026-10-07hn
I Self-Hosted Llama 3.2 with Coolify on My Home Servergeek.sg2024-10-162026-10-07hn
Implementing the Llama 3.2 1B and 3B Architectures from Scratchgithub.com2024-10-052026-10-07hn
Llama can now see and run on your device – welcome Llama 3.2huggingface.co2024-09-252026-10-07hn
Open Source wireframe to app powered by Llama 3.2 Visionnapkins.dev2024-09-252026-10-07hn
Llama 3.2 1B and 3B on-device modelstwitter.com2024-09-252026-10-07hn
Llama 3.2: Lightweight models for edge devicestwitter.com2024-09-252026-10-07hn
Llama 3.2 Releasegithub.com2024-09-252026-10-07hn
Llama 3.2: Revolutionizing edge AI and vision with open, customizable modelsai.meta.com2024-09-252026-10-07hn
Download Llama 3.2 1B, 3B, 11B, 90Bllama.com2024-09-252026-10-07hn
Llama 3.2 released: Multimodal, 1B to 90B sizesllama.com2024-09-252026-10-07hn

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:41 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:13 UTC · Last verified 2026-10-25

Follow Llama-3.2-1B-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.