Models › Llama-3.1 family

Llama-3.1-Nemotron-Nano-VL-8B-V1

nvidia NVIDIA Open Model License (nvidia-open-model-license) out 17 months ago

8.72B parameters, images and text in, text out.

Verified 2026-10-25 Rank #453 in LLMs · score 77.9 method v1 Sources 3 Downloads 30d 82.7k · #334 of 619 tracked

Can I run it?5.2GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?NVIDIA Open Model License (nvidia-open-model-license)Attribution requiredlicence file2026-10-24
Do people use it?82.7kdownloads, 30 days#334 of 619 we track · below the median+3 likes, downloads +4% this week188 likesHugging Face2026-10-24

Worth reading

Picked by rule from 25 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 437 HN pts
llama.meta.com 2024-07-23 437 HN pts · 269 comments 42 words about the Llama 3.1 family family

25 best of 25 tracked

The 3 picks above, plus these 22. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUgithub.com · 2026-02-21
  2. Codeg1: Using Llama-3.1 70B on Groq to create o1-like reasoning chainsgithub.com · 2024-09-15
  3. ArticleLlama 3.1 405B now runs at 969 tokens/s on Cerebras Inferencecerebras.ai · 2024-11-19
  4. CodeLlama 3.1 Omni Modelgithub.com · 2024-09-18
  5. CodeShow HN: Tune LLaMa3.1 on Google Cloud TPUsgithub.com · 2024-09-11 · 189 HN pts
  6. CodeLlama 3.1 in Cgithub.com · 2024-07-24 · 212 HN pts
  7. CodeLongwriter – Increase llama3.1 output to 10k wordsgithub.com · 2024-10-07 · 154 HN pts
  8. ArticleHermes 3: The First Fine-Tuned Llama 3.1 405B Modellambdalabs.com · 2024-08-15
  9. DiscussionCerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8Btwitter.com · 2024-08-27 · 95 HN pts
  10. ArticleLlama 3.1: Our most capable models to dateai.meta.com · 2024-07-23 · 27 HN pts
  11. ArticleWhy Llama 3.1 is Importanttimkellogg.me · 2024-07-23 · 56 HN pts
  12. ArticleMeta Llama 3.1 405Bopenrouter.ai · 2024-07-23
  13. ArticleCoding with Llama 3.1, New DeepSeek Coder and Mistral Largeaider.chat · 2024-07-25 · 32 HN pts
  14. ArticleLlama-3.1 supports tool calls via promptingbraintrust.dev · 2024-07-26
  15. ArticleMeta releases an open-weights GPT-4-level AI model, Llama 3.1 405Barstechnica.com · 2024-07-23
  16. ArticleShow HN: Run Llama 3.1 8B in the browserapp.wiz.chat · 2024-07-28
  17. VideoRunning the latest Llama 3.1 8B on Raspberry Pi [video]youtube.com · 2024-07-30
  18. ArticleShow HN: Finetune Llama-3.1 2x faster in a Colabcolab.research.google.com · 2024-07-23
  19. ArticleBenchmarking Llama 3.1 405B on 8x AMD MI300X GPUsdstack.ai · 2024-10-09
  20. DiscussionReflection-Llama-3.1-70B is Llama-3 with LoRAold.reddit.com · 2024-09-08
  21. ArticleNvidia's new Llama-3.1 Nemotron Ultra outperforms DeepSeek R1 at half the sizeventurebeat.com · 2025-04-11
  22. ArticleChat with Meta Llama 3.1 405Bllama3.replicate.dev · 2024-07-23

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 1 quantized builds and 16 Spaces.

  • As a service0no API provider listed
  • On own hardware1quantized builds
  • Built on21 fine-tunes · 1 adapters · 0 merges
  • In apps16Hugging Face Spaces

Top Spaces running it: Gapeleon/Llama-3.1-Nemotron-Nano-VL-8B-V1-Demo ♥ 7 · ArtShumov/Whyx-PROmpTea ♥ 3 · ayushKishor/plutoV2_miniProject_3rd-yr ♥ 2 · shiva0013/YT-AI-Automation ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 5.2 GB at INT4, 11 GB at FP8, 21 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.2 GB of weights (estimate; KV cache and activations extra)INT45.2 GBFP8: about 11 GB of weights (estimate; KV cache and activations extra)FP811 GBBF16: about 21 GB of weights (estimate; KV cache and activations extra)BF1621 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.2 GB of weights (estimate; KV cache and activations extra)INT45.2 GBFP8: about 11 GB of weights (estimate; KV cache and activations extra)FP811 GBBF16: about 21 GB of weights (estimate; KV cache and activations extra)BF1621 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-06-03), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

3 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

3 derivatives on the Hub, led by 1 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

1 quantized (Hugging Face model tree)1 fine-tune (Hugging Face model tree)1 adapter (Hugging Face model tree)1 quantized1 fine-tune1 adapter
1 quantized (Hugging Face model tree)1 fine-tune (Hugging Face model tree)1 adapter (Hugging Face model tree)1 quantized1 fine-tune1 adapter

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

9 rows

Benchmarks 9 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (9)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AI2D · Understand images and video85.0% percent—model author2026-10-07
author-reported ChartQA · Understand images and video86.3% percent—model author2026-10-07
author-reported DocVQA · Extract text from documents91.2% percent—model author2026-10-07
author-reported InfoVQA · Extract text from documents77.4% percent—model author2026-10-07
author-reported MMMU · Understand images and video48.2% percent—model author2026-10-07
author-reported OCRBench · Extract text from documents839—model author2026-10-07
author-reported OCRBench · Extract text from documents60.1% percent—model author2026-10-07
author-reported OCRBench · Extract text from documents37.9% percent—model author2026-10-07
author-reported Video-MME · Understand images and video54.7% percentCalculated with 1 tile per imagemodel author2026-10-07

What the card says

2 cited sentences

Summary generated, cited

The model performs image summarization and text-image analysis under the NVIDIA Open Model License.[1][2] It utilizes a Transformer architecture with a C-RADIOv2-H vision encoder and a Llama-3.1-8B-Instruct language encoder.[3][4]

  1. “Image summarization. Text-image analysis”
  2. license
  3. “Network Type: Transformer”
  4. “Vision Encoder: [C-RADIOv2-H]”

Generated 2026-10-07 15:12 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

3 use cases

What it is good at 3 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

14 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
Params by dtypeBF16: 8,721,768,454
Size bandM
MoEno
LicenseNVIDIA Open Model License (nvidia-open-model-license) (other)
Hub snapshot2026-10-25

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-3.1-Nemotron-Nano-VL-8B-V1: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)21 GB · Single GPU (<24 GB)
FP8 (1 byte/param)11 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)5.2 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

3 variants

Lineage

Original model Family: nvidia/Llama-3.1 3 derivatives on the Hub

quantized: 1adapter: 1finetune: 1

Top variants (3 shown, ranked by downloads)

Relation
3 rows
Variant Relation Quant Params Band License Author Likes Downloads
ekryski/Llama-3.1-Nemotron-Nano-VL-8B-V1-4bit quantized -4bit 8.72B M apache-2.0 ekryski 1 624
Nayana-cognitivelab/Llama_Nemotron_SectionOCR_SFT_En_Kn_15000 adapter — 8.72B M other Nayana-cognitivelab 0 128
runanywhere/nemotron_nano_vl_8b_HNPU finetune — — — other runanywhere 0 0

Repository changelog

11 commits

Repository changelog 11 commits

DateCommitSHA
2025-12-04 Update README 437f4e2
2025-06-13 Update README 8dd8d15
2025-06-12 Update README fbd4f16
2025-06-12 Update README fea8968
2025-06-10 Update README 58eef79
2025-06-09 Update model class name 961cb9f
2025-06-05 Update README a02869b
2025-06-05 Update README and examples 1fbc10a
2025-06-03 Update paths 67c7cea
2025-06-03 Initial commit 1e8e8e6
2025-06-03 initial commit 6a5079e

Articles and coverage

25 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency.

Official1

research.nvidia.com2024-11-17officialauthorityHN 20 pts · 1 comments

Analysis8

llama.meta.com2024-07-23HN front pageabout the Llama 3.1 familyHN 437 pts · 269 comments42 words
understandingai.org2025-06-15HN front pageabout the Llama 3.1 familyHN 191 pts · 305 comments
github.com2024-09-11authorityHN front pageabout the Llama 3.1 familyHN 189 pts · 52 comments869 words
github.com2024-07-24authorityHN front pageabout the Llama 3.1 familyHN 212 pts · 36 comments5,858 words
github.com2024-10-07authorityHN front pageabout the Llama 3.1 familyHN 154 pts · 29 comments6,696 words
ai.meta.com2024-07-23authorityabout the Llama 3.1 familyHN 27 pts · 3 comments2,136 words
timkellogg.me2024-07-23about the Llama 3.1 familyHN 56 pts · 23 comments
aider.chat2024-07-25about the Llama 3.1 familyHN 32 pts · 7 comments

Community1

twitter.com2024-08-27about the Llama 3.1 familyHN 95 pts · 42 comments
All coverage tracked for this model (25) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUgithub.com2026-02-212026-10-07hn
Meta's Llama 3.1 can recall 42 percent of the first Harry Potter bookunderstandingai.org2025-06-152026-10-07hn
Nvidia's new Llama-3.1 Nemotron Ultra outperforms DeepSeek R1 at half the sizeventurebeat.com2025-04-112026-10-07hn
Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inferencecerebras.ai2024-11-192026-10-07hn
Nvidia presents Llama-Mesh: Generating 3D Mesh with Llama 3.1 8Bresearch.nvidia.com official2024-11-172026-10-07hn
Benchmarking Llama 3.1 405B on 8x AMD MI300X GPUsdstack.ai2024-10-092026-10-07hn
Longwriter – Increase llama3.1 output to 10k wordsgithub.com2024-10-072026-10-07hn
Llama 3.1 Omni Modelgithub.com2024-09-182026-10-07hn
g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chainsgithub.com2024-09-152026-10-07hn
Show HN: Tune LLaMa3.1 on Google Cloud TPUsgithub.com2024-09-112026-10-07hn
Reflection-Llama-3.1-70B is Llama-3 with LoRAold.reddit.com2024-09-082026-10-07hn
Cerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8Btwitter.com2024-08-272026-10-07hn
Hermes 3: The First Fine-Tuned Llama 3.1 405B Modellambdalabs.com2024-08-152026-10-07hn
Running the latest Llama 3.1 8B on Raspberry Pi [video]youtube.com2024-07-302026-10-07hn
Show HN: Run Llama 3.1 8B in the browserapp.wiz.chat2024-07-282026-10-07hn
Llama-3.1 supports tool calls via promptingbraintrust.dev2024-07-262026-10-07hn
Coding with Llama 3.1, New DeepSeek Coder and Mistral Largeaider.chat2024-07-252026-10-07hn
Llama 3.1 in Cgithub.com2024-07-242026-10-07hn
Why Llama 3.1 is Importanttimkellogg.me2024-07-232026-10-07hn
Show HN: Finetune Llama-3.1 2x faster in a Colabcolab.research.google.com2024-07-232026-10-07hn
Meta releases an open-weights GPT-4-level AI model, Llama 3.1 405Barstechnica.com2024-07-232026-10-07hn
Meta Llama 3.1 405Bopenrouter.ai2024-07-232026-10-07hn
Chat with Meta Llama 3.1 405Bllama3.replicate.dev2024-07-232026-10-07hn
Llama 3.1: Our most capable models to dateai.meta.com2024-07-232026-10-07hn
Llama 3.1llama.meta.com2024-07-232026-10-07hn

Similar models

3 models

Similar models

  • Qwen3-VL-8B-Instruct · 8.77B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • Qwen3.5-9B · 9.65B
    same task (image-text-to-text), more providers, permissive license
  • Qwen2.5-VL-7B-Instruct · 8.29B
    same size band (M), same task (image-text-to-text), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:40 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:12 UTC · Last verified 2026-10-25

Follow Llama-3.1-Nemotron-Nano-VL-8B-V1

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.