Show HN: Llama 3.2 Interpretability with Sparse Autoencoders
The project trained a Sparse Autoencoder on 6.5 Billion activations from Llama 3.2-3B layer 23 over 10 epochs.
Up to date
meta-llama Llama 3.2 Community License out 2 years ago
10.7B parameters, images and text in, text out.
Verified 2026-10-25 Rank #131 in LLMs · score 94.6 method v1 Sources 3 Downloads 30d 57.5k · #371 of 619 tracked
Picked by rule from 34 tracked pieces: the lab's own post, the most shared, a field report, the latest.
The project trained a Sparse Autoencoder on 6.5 Billion activations from Llama 3.2-3B layer 23 over 10 epochs.
A minimal implementation of Llama 3.2 Instruct inference runs in ~100 lines of pure Numpy code.
The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
No API provider serves it, so its downloads are people running it themselves: 20 quantized builds and 100 Spaces.
Top Spaces running it: huggingface-projects/llama-3.2-vision-11B ♥ 389 · algorithmicsuperintelligence/OptiLLM ♥ 27 · build-small-hackathon/pawmap ♥ 11 · NiansuhAI/Main ♥ 10
Weights only, an estimate: leave room for the KV cache. Method
About 6.4 GB at INT4, 13 GB at FP8, 26 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2024-09-18), amber triangles are 10 dated articles (each links to it).
493 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | image-text-to-text |
|---|---|
| Library | transformers |
| Architectures | MllamaForConditionalGeneration |
| Model type | mllama |
| Params by dtype | BF16: 10,670,220,835 |
| Size band | L |
| MoE | no |
| Gated | manual |
| Papers | arXiv:2204.05149 |
| License | Llama 3.2 Community License (llama3.2) |
| Hub snapshot | 2026-10-25 |
vLLM: not in registry · MllamaForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · MllamaForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for Llama-3.2-11B-Vision-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 26 GB · Single high-end GPU (<80 GB) |
|---|---|
| FP8 (1 byte/param) | 13 GB · Single GPU (<24 GB) |
| INT4 (0.5 bytes/param) | 6.4 GB · Single GPU (<24 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
quantized: 20finetune: 161adapter: 308merge: 4
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit | quantized | -bnb | 11.0B | L | llama3.2 | unsloth | 86 | 1.2M |
| unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit | quantized | -bnb | 10.7B | L | llama3.2 | unsloth | 30 | 904.4k |
| unsloth/Llama-3.2-11B-Vision-Instruct | finetune | — | 10.7B | L | llama3.2 | unsloth | 89 | 683.1k |
| leafspark/Llama-3.2-11B-Vision-Instruct-GGUF | quantized | GGUF | — | — | llama3.2 | leafspark | 74 | 322k |
| Xkev/Llama-3.2V-11B-cot | finetune | — | 10.7B | L | apache-2.0 | Xkev | 158 | 76.4k |
| SeanScripts/Llama-3.2-11B-Vision-Instruct-nf4 | quantized | -nf4 | 10.8B | L | llama3.2 | SeanScripts | 13 | 39.3k |
| omkarthawakar/LlamaV-o1 | finetune | — | 10.7B | L | apache-2.0 | omkarthawakar | 95 | 27.6k |
| mlx-community/Llama-3.2-11B-Vision-Instruct-8bit | finetune | -8bit | 10.7B | L | llama3.2 | mlx-community | 9 | 28.6k |
| mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated | finetune | — | 10.7B | L | llama3.2 | mlx-community | 7 | 28.3k |
| mlx-community/Llama-3.2-11B-Vision-Instruct-4bit | finetune | -4bit | 10.7B | L | llama3.2 | mlx-community | 8 | 20.7k |
| royleibov/Llama-3.2-11B-Vision-Instruct-ZipNN-Compressed | finetune | — | — | — | llama3.2 | royleibov | 4 | 17.2k |
| pbatra/Llama-3.2-11B-Vision-Instruct-GGUF | quantized | GGUF | — | — | llama3.2 | pbatra | 5 | 14.5k |
| EnlistedGhost/Llama-3.2-11B-Vision-Instruct-OLLAMA | quantized | GGUF | — | — | llama3.2 | EnlistedGhost | 2 | 11.6k |
| AdaptLLM/biomed-Llama-3.2-11B-Vision-Instruct | finetune | — | 10.7B | L | llama3.2 | AdaptLLM | 2 | 10.1k |
| Sci-fi-vy/Llama-3.2-11B-Vision-Instruct-GGUF | quantized | GGUF | — | — | llama3.2 | Sci-fi-vy | 1 | 7.9k |
| amd/Llama-3.2-11B-Vision-Instruct-FP8-KV | quantized | -FP8 | 10.7B | L | llama3.2 | amd | 1 | 6.3k |
| lamm-mit/Cephalo-Llama-3.2-11B-Vision-Instruct-128k | finetune | — | 10.7B | L | apache-2.0 | lamm-mit | 6 | 4.7k |
| mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated-4-bit | finetune | — | 10.7B | L | llama3.2 | mlx-community | 1 | 4.7k |
| fahadh4ilyas/llama3.2-11B-Vision-Instruct-INT4-GPTQ | quantized | INT4 | 10.7B | L | llama3.2 | fahadh4ilyas | 1 | 4.6k |
| OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc | quantized | int4 | 3.11B | M | llama3.2 | OPEA | 2 | 4k |
| cragtmp/taskgt705-450 | adapter | — | — | — | — | cragtmp | 0 | 3.9k |
| mlx-community/Llama-3.2-11B-Vision-Instruct-abliterated-8-bit | finetune | — | 10.7B | L | llama3.2 | mlx-community | 1 | 2.9k |
| Kendamarron/Llama-3.2-11B-Vision-Instruct-Swallow-8B-Merge | merge | — | 10.7B | L | llama3.2 | Kendamarron | 3 | 2.1k |
| fbaldassarri/meta-llama_Llama-3.2-11B-Vision-Instruct-OpenVino | finetune | — | — | — | llama3.2 | fbaldassarri | 1 | 2.2k |
| Kun-Xiang/AtomThink-Llama-3.2-Vision-11B | finetune | — | 10.7B | L | — | Kun-Xiang | 2 | 2k |
| monirehebrahimi/fine-tuned-visionllama | adapter | — | — | — | — | monirehebrahimi | 0 | 1.7k |
| EricB/Llama-3.2-11B-Vision-Instruct-UQFF | quantized | — | — | — | — | EricB | 16 | 880 |
| zhangsongbo365/Llama-3.2V-11B-cot-nf4 | quantized | -nf4 | 11.0B | L | apache-2.0 | zhangsongbo365 | 0 | 1.7k |
| AdaptLLM/remote-sensing-Llama-3.2-11B-Vision-Instruct | finetune | — | 10.7B | L | llama3.2 | AdaptLLM | 4 | 1.3k |
| OrchardPair/Llama-3.2-11B-Vision-Instruct-4bit | finetune | -4bit | 10.7B | L | llama3.2 | OrchardPair | 0 | 1.4k |
| fairy322/Llama-3.2-11B-Vision-Instruct-abliterated-8-bit | finetune | — | 10.7B | L | llama3.2 | fairy322 | 0 | 1.4k |
| Kadins/Llama-3.2-Vision-chinese-lora | adapter | — | — | — | apache-2.0 | Kadins | 12 | 682 |
| cragtmp/t3r | adapter | — | — | — | — | cragtmp | 0 | 1.1k |
| Cannae-AI/MedicalLlama3.2-vision-11B-IT | finetune | — | 10.7B | L | apache-2.0 | Cannae-AI | 12 | 457 |
| Aekanun/thai-handwriting-llm | finetune | — | — | — | apache-2.0 | Aekanun | 7 | 690 |
| AdaptLLM/food-Llama-3.2-11B-Vision-Instruct | finetune | — | 10.7B | L | llama3.2 | AdaptLLM | 6 | 676 |
| OPEA/Llama-3.2-11B-Vision-Instruct-qvision-int4-sym-inc | quantized | int4 | 2.43B | M | — | OPEA | 1 | 893 |
| maum-ai/Llama-3.2-MAAL-11B-Vision-v0.1 | finetune | — | 10.7B | L | llama3.2 | maum-ai | 1 | 881 |
| vector-institute/Llama3.2-Multimodal-Newsmedia-Bias-Detector | finetune | — | 11.0B | L | cc | vector-institute | 4 | 505 |
| HuanjinYao/Mulberry_llama_11b | finetune | — | 10.7B | L | apache-2.0 | HuanjinYao | 1 | 636 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:34 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:01 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.