Models › Llama-3.1 family

Llama-3.1-Nemotron-Nano-8B-v1

nvidia NVIDIA Open Model License (nvidia-open-model-license) out 19 months ago

8.03B parameters, text in, text out, 128K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #568 in LLMs · score 74.5 method v1 Sources 3 Downloads 30d 6.1k · #531 of 619 tracked

Can I run it?4.8GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?NVIDIA Open Model License (nvidia-open-model-license)Attribution requiredlicence file2026-10-24
Do people use it?6.1kdownloads, 30 days#531 of 619 we track · below the median+1 likes, downloads −3% this week228 likesHugging Face2026-10-24

Worth reading

Picked by rule from 25 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 437 HN pts
llama.meta.com 2024-07-23 437 HN pts · 269 comments 42 words about the Llama 3.1 family family

25 best of 25 tracked

The 3 picks above, plus these 22. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUgithub.com · 2026-02-21
  2. Codeg1: Using Llama-3.1 70B on Groq to create o1-like reasoning chainsgithub.com · 2024-09-15
  3. ArticleLlama 3.1 405B now runs at 969 tokens/s on Cerebras Inferencecerebras.ai · 2024-11-19
  4. CodeLlama 3.1 Omni Modelgithub.com · 2024-09-18
  5. CodeShow HN: Tune LLaMa3.1 on Google Cloud TPUsgithub.com · 2024-09-11 · 189 HN pts
  6. CodeLlama 3.1 in Cgithub.com · 2024-07-24 · 212 HN pts
  7. CodeLongwriter – Increase llama3.1 output to 10k wordsgithub.com · 2024-10-07 · 154 HN pts
  8. ArticleHermes 3: The First Fine-Tuned Llama 3.1 405B Modellambdalabs.com · 2024-08-15
  9. DiscussionCerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8Btwitter.com · 2024-08-27 · 95 HN pts
  10. ArticleLlama 3.1: Our most capable models to dateai.meta.com · 2024-07-23 · 27 HN pts
  11. ArticleWhy Llama 3.1 is Importanttimkellogg.me · 2024-07-23 · 56 HN pts
  12. ArticleMeta Llama 3.1 405Bopenrouter.ai · 2024-07-23
  13. ArticleCoding with Llama 3.1, New DeepSeek Coder and Mistral Largeaider.chat · 2024-07-25 · 32 HN pts
  14. ArticleLlama-3.1 supports tool calls via promptingbraintrust.dev · 2024-07-26
  15. ArticleMeta releases an open-weights GPT-4-level AI model, Llama 3.1 405Barstechnica.com · 2024-07-23
  16. ArticleShow HN: Run Llama 3.1 8B in the browserapp.wiz.chat · 2024-07-28
  17. VideoRunning the latest Llama 3.1 8B on Raspberry Pi [video]youtube.com · 2024-07-30
  18. ArticleShow HN: Finetune Llama-3.1 2x faster in a Colabcolab.research.google.com · 2024-07-23
  19. ArticleBenchmarking Llama 3.1 405B on 8x AMD MI300X GPUsdstack.ai · 2024-10-09
  20. DiscussionReflection-Llama-3.1-70B is Llama-3 with LoRAold.reddit.com · 2024-09-08
  21. ArticleNvidia's new Llama-3.1 Nemotron Ultra outperforms DeepSeek R1 at half the sizeventurebeat.com · 2025-04-11
  22. ArticleChat with Meta Llama 3.1 405Bllama3.replicate.dev · 2024-07-23

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 24 quantized builds for local use.

  • As a service1Featherless
  • On own hardware24quantized builds
  • Built on269 fine-tunes · 9 adapters · 8 merges
  • In apps33Hugging Face Spaces

Top Spaces running it: ginigen-ai/smol-worldcup ♥ 59 · aimevzulari/Prompt_Uzmani ♥ 46 · build-small-hackathon/HearthNet ♥ 6 · build-small-hackathon/Scholar-Lens ♥ 3

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.8 GB at INT4, 9.6 GB at FP8, 19 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.8 GB of weights (estimate; KV cache and activations extra)INT44.8 GBFP8: about 9.6 GB of weights (estimate; KV cache and activations extra)FP89.6 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.8 GB of weights (estimate; KV cache and activations extra)INT44.8 GBFP8: about 9.6 GB of weights (estimate; KV cache and activations extra)FP89.6 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-03-16), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

50 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

50 derivatives on the Hub, led by 24 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

24 quantized (Hugging Face model tree)9 fine-tunes (Hugging Face model tree)8 merges (Hugging Face model tree)9 adapters (Hugging Face model tree)24 quantized9 fine-tunes8 merges9 adapters
24 quantized (Hugging Face model tree)9 fine-tunes (Hugging Face model tree)8 merges (Hugging Face model tree)9 adapters (Hugging Face model tree)24 quantized9 fine-tunes8 merges9 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

16 rows

Benchmarks 16 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (16)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AIME 2025 · Reason through hard problems0% pass@1Reasoning Offmodel author2026-10-07
author-reported AIME 2025 · Reason through hard problems47.1% pass@1Reasoning Onmodel author2026-10-07
author-reported BFCL · Call tools and APIs63.9% percentReasoning Offmodel author2026-10-07
author-reported BFCL · Call tools and APIs63.6% percentReasoning Onmodel author2026-10-07
author-reported GPQA Diamond · Reason through hard problems39.4% pass@1Reasoning Offmodel author2026-10-07
author-reported GPQA Diamond · Reason through hard problems54.1% pass@1Reasoning Onmodel author2026-10-07
author-reported IFEval · Chat and follow instructions74.7% percentReasoning Off (Strict:Prompt)model author2026-10-07
author-reported IFEval · Chat and follow instructions82.1% percentReasoning Off (Strict:Instruction)model author2026-10-07
author-reported IFEval · Chat and follow instructions71.9% percentReasoning On (Strict:Prompt)model author2026-10-07
author-reported IFEval · Chat and follow instructions79.3% percentReasoning On (Strict:Instruction)model author2026-10-07
author-reported MATH-500 · Reason through hard problems36.6% pass@1Reasoning Offmodel author2026-10-07
author-reported MATH-500 · Reason through hard problems95.4% pass@1Reasoning Onmodel author2026-10-07
author-reported MBPP · Write code with agents66.1% pass@1Reasoning Offmodel author2026-10-07
author-reported MBPP · Write code with agents84.6% pass@1Reasoning Onmodel author2026-10-07
author-reported MT-Bench · Chat and follow instructions7.9Reasoning Offmodel author2026-10-07
author-reported MT-Bench · Chat and follow instructions8.1Reasoning Onmodel author2026-10-07

What the card says

2 cited sentences

Summary generated, cited

This dense decoder-only Transformer model is designed for tasks such as RAG, tool calling, and instruction-following.[1][2] The model is released under the NVIDIA Open Model License and supports a context length of up to 131,072 tokens.[3][4]

  1. “Dense decoder-only Transformer model”
  2. “tasks, such as RAG and tool calling”
  3. license
  4. “Context length up to 131,072 tokens”

Generated 2026-10-07 15:13 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

6 use cases

What it is good at 6 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Dtypebfloat16
Params by dtypeBF16: 8,030,261,248
Size bandM
MoEno
Context length131,072 (config.json max_position_embeddings)
Languagesen
PapersarXiv:2505.00949, arXiv:2502.00203
LicenseNVIDIA Open Model License (nvidia-open-model-license) (other)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-3.1-Nemotron-Nano-8B-v1: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)19 GB · Single GPU (<24 GB)
FP8 (1 byte/param)9.6 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.8 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: nvidia/Llama-3.1 50 derivatives on the Hub

quantized: 24finetune: 9merge: 8adapter: 9

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
unsloth/Llama-3.1-Nemotron-Nano-8B-v1-GGUF quantized GGUF — — other unsloth 12 89.9k
bartowski/nvidia_Llama-3.1-Nemotron-Nano-8B-v1-GGUF quantized GGUF — — other bartowski 11 32.4k
mradermacher/Llama-3.1-Nemotron-Nano-8B-v1-i1-GGUF quantized GGUF — — other mradermacher 3 12.5k
ArtusDev/nvidia_Llama-3.1-Nemotron-Nano-8B-v1-AWQ quantized AWQ 8.14B M other ArtusDev 1 11.2k
unsloth/Llama-3.1-Nemotron-Nano-8B-v1 finetune — 8.03B M other unsloth 1 8.8k
mmnga/Llama-3.1-Nemotron-Nano-8B-v1-gguf quantized gguf — — unknown mmnga 1 7.5k
mradermacher/Llama-3.1-Nemotron-Nano-8B-v1-GGUF quantized GGUF — — other mradermacher 2 6.1k
tensorblock/Llama-3.1-Nemotron-Nano-8B-v1-GGUF quantized GGUF — — other tensorblock 6 5.2k
Zynerji/Ektome-Nemotron-Nano-8B-PristinelyUncensored quantized GGUF 8.03B M other Zynerji 2 3.9k
redponike/Llama-3.1-Nemotron-Nano-8B-v1-GGUF quantized GGUF — — — redponike 1 3.6k
nvidia/DLER-Llama-Nemotron-8B-Merge-Research finetune — 8.03B M — nvidia 20 2.5k
DevQuasar-10/nvidia.Llama-3.1-Nemotron-Nano-8B-v1-GGUF quantized GGUF — — — DevQuasar-10 1 2.4k
olaverse/MIST-Mini-8B merge — 8.03B M llama3.1 olaverse 4 792
NikolayKozloff/Llama-3.1-Nemotron-Nano-8B-v1-Q8_0-GGUF quantized Q8_0 — — other NikolayKozloff 1 659
bourn23/nvidia-llama-3.1-nemotron-nano-8b-v1-mlx-4bit quantized mlx 8.03B M other bourn23 0 645
jkim96/Llama-3.1-Nemotron-Nano-8B-v1-DASHQ-Q2-GGUF quantized GGUF — — other jkim96 0 510
yeahdongcn/nvidia-llama-3_1-nemotron-nano-8b-v1-q4_k_m-gguf quantized gguf — — other yeahdongcn 1 416
jesusoctavioas/Llama-3.1-Nemotron-Nano-8B-v1-mlx-4Bit quantized mlx 8.03B M other jesusoctavioas 0 457
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF quantized GGUF — — other itlwas 1 387
marcuscedricridia/8B-Nemotaur-IT merge — 8.03B M — marcuscedricridia 2 214
bourn23/nvidia-llama-3.1-nemotron-nano-8b-v1-mlx finetune mlx 8.03B M other bourn23 0 260
BareMetalAI/Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ quantized -W4A16 4.60B M other BareMetalAI 0 250
Nelathan/Llama-3.1-8B-rooted merge — 8.03B M — Nelathan 0 232
Echo9Zulu/Llama-3.1-Nemotron-Nano-8B-v1-int4_sym-awq-se-ov finetune awq — — apache-2.0 Echo9Zulu 0 212
KalaiarasiS14/Llama-3.1-Nemotron-Nano-8B-v1-Q4_0-GGUF quantized Q4_0 — — other KalaiarasiS14 1 131
huggingkot/Llama-3.1-Nemotron-Nano-8B-v1-bnb-4bit finetune -bnb 8.25B M — huggingkot 0 176
shylane/Llama-3.1-Nemotron-Nano-8B-v1-Q6_K-GGUF quantized Q6_K — — other shylane 1 123
GrimsenClory/Llama-3.1-Nemotron-Nano-8B-v1-Q6_K-GGUF quantized Q6_K — — other GrimsenClory 0 153
vpakarinen/llama-nemotron-8b-lora-uncensored adapter — — — other vpakarinen 0 150
agentlans/Llama3.1-Nemo-Thinker finetune — 8.03B M other agentlans 1 68
Nitral-Archive/L3.1_NN-8B-test1 merge — 8.03B M — Nitral-Archive 0 115
zacks917/AutoDeco-Llama-Nemotron-8B finetune — 2.10M S — zacks917 0 113
mfbaig35r/hts-nemotron-8b-lora-v1 adapter — — — other mfbaig35r 1 61
Xiaojian9992024/Llama3.1-8B-Dyanka-Preview merge — 8.03B M — Xiaojian9992024 0 102
remyxai/SpaceThinker-Nemotron-8B finetune — — — — remyxai 2 0
gsxrchris/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF quantized GGUF — — other gsxrchris 0 93
JaHyoun/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF quantized GGUF — — other JaHyoun 0 68
huggingkot/Llama-3.1-Nemotron-Nano-8B-v1-q4f16_1-MLC quantized — — — — huggingkot 0 65
abdelstark/llama-3.1-nemotron-nano-8b-xlam-tool-calling-lora adapter — — — other abdelstark 0 62
Jazco4/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF quantized GGUF — — other Jazco4 0 60

Repository changelog

7 commits

Repository changelog 7 commits

DateCommitSHA
2025-10-15 Update README.md 54641c1
2025-10-09 Update README.md 16011e5
2025-05-08 Update README.md a22e1c5
2025-05-05 add link to technical report 029ff12
2025-04-23 Include expected behaviour for Reasoning ON d10ce65
2025-03-16 Initial commit 42f62a4
2025-03-16 initial commit cecc65a

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Llama-3.1-Nemotron-Nano-8B-v1, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
nvidia/Llama-3.1-Nemotron-Nano-8B-v1 — — — — — — — live 2026-10-25

Articles and coverage

25 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency.

Official1

research.nvidia.com2024-11-17officialauthorityHN 20 pts · 1 comments

Analysis8

llama.meta.com2024-07-23HN front pageabout the Llama 3.1 familyHN 437 pts · 269 comments42 words
understandingai.org2025-06-15HN front pageabout the Llama 3.1 familyHN 191 pts · 305 comments
github.com2024-09-11authorityHN front pageabout the Llama 3.1 familyHN 189 pts · 52 comments869 words
github.com2024-07-24authorityHN front pageabout the Llama 3.1 familyHN 212 pts · 36 comments5,858 words
github.com2024-10-07authorityHN front pageabout the Llama 3.1 familyHN 154 pts · 29 comments6,696 words
ai.meta.com2024-07-23authorityabout the Llama 3.1 familyHN 27 pts · 3 comments2,136 words
timkellogg.me2024-07-23about the Llama 3.1 familyHN 56 pts · 23 comments
aider.chat2024-07-25about the Llama 3.1 familyHN 32 pts · 7 comments

Community1

twitter.com2024-08-27about the Llama 3.1 familyHN 95 pts · 42 comments
All coverage tracked for this model (25) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUgithub.com2026-02-212026-10-07hn
Meta's Llama 3.1 can recall 42 percent of the first Harry Potter bookunderstandingai.org2025-06-152026-10-07hn
Nvidia's new Llama-3.1 Nemotron Ultra outperforms DeepSeek R1 at half the sizeventurebeat.com2025-04-112026-10-07hn
Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inferencecerebras.ai2024-11-192026-10-07hn
Nvidia presents Llama-Mesh: Generating 3D Mesh with Llama 3.1 8Bresearch.nvidia.com official2024-11-172026-10-07hn
Benchmarking Llama 3.1 405B on 8x AMD MI300X GPUsdstack.ai2024-10-092026-10-07hn
Longwriter – Increase llama3.1 output to 10k wordsgithub.com2024-10-072026-10-07hn
Llama 3.1 Omni Modelgithub.com2024-09-182026-10-07hn
g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chainsgithub.com2024-09-152026-10-07hn
Show HN: Tune LLaMa3.1 on Google Cloud TPUsgithub.com2024-09-112026-10-07hn
Reflection-Llama-3.1-70B is Llama-3 with LoRAold.reddit.com2024-09-082026-10-07hn
Cerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8Btwitter.com2024-08-272026-10-07hn
Hermes 3: The First Fine-Tuned Llama 3.1 405B Modellambdalabs.com2024-08-152026-10-07hn
Running the latest Llama 3.1 8B on Raspberry Pi [video]youtube.com2024-07-302026-10-07hn
Show HN: Run Llama 3.1 8B in the browserapp.wiz.chat2024-07-282026-10-07hn
Llama-3.1 supports tool calls via promptingbraintrust.dev2024-07-262026-10-07hn
Coding with Llama 3.1, New DeepSeek Coder and Mistral Largeaider.chat2024-07-252026-10-07hn
Llama 3.1 in Cgithub.com2024-07-242026-10-07hn
Why Llama 3.1 is Importanttimkellogg.me2024-07-232026-10-07hn
Show HN: Finetune Llama-3.1 2x faster in a Colabcolab.research.google.com2024-07-232026-10-07hn
Meta releases an open-weights GPT-4-level AI model, Llama 3.1 405Barstechnica.com2024-07-232026-10-07hn
Meta Llama 3.1 405Bopenrouter.ai2024-07-232026-10-07hn
Chat with Meta Llama 3.1 405Bllama3.replicate.dev2024-07-232026-10-07hn
Llama 3.1: Our most capable models to dateai.meta.com2024-07-232026-10-07hn
Llama 3.1llama.meta.com2024-07-232026-10-07hn

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.1-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen3-8B · 8.19B
    same size band (M), same task (text-generation), more providers, permissive license
  • Meta-Llama-3-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:41 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:13 UTC · Last verified 2026-10-25

Follow Llama-3.1-Nemotron-Nano-8B-v1

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.