Models › Llama-3.1 family

meta-llama Llama 3.1 Community License out 2 years ago

8.03B parameters, text in, text out. 1 provider serves it.

Verified 2026-10-25 Rank #66 in LLMs · score 104.6 method v1 Sources 3 Downloads 30d 607.3k · #151 of 619 tracked

Changed this week: 1 new quantized build on the Hub (336 in all).2026-10-24

Can I run it?4.8GB at INT4Estimatefits a 16 GB cardmethodCommunity: Started Llama 3.1 8B Locally →
Can I use it?Llama 3.1 Community License'Built with Llama' attribution; >700M MAU clauselicence file2026-10-24
Do people use it?607.3kdownloads, 30 days#151 of 619 we track · top 24%+18 likes, downloads −8% this week2,687 likesHugging Face2026-10-24

Worth reading

Picked by rule from 47 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 212 HN pts
github.com 2024-07-24 212 HN pts · 36 comments 5.9k words about the Llama 3.1 family family

25 best of 47 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUgithub.com · 2026-02-21
  2. ArticleLlama 3.1llama.meta.com · 2024-07-23 · 437 HN pts · official
  3. Codeg1: Using Llama-3.1 70B on Groq to create o1-like reasoning chainsgithub.com · 2024-09-15
  4. ArticleLlama 3.1 405B now runs at 969 tokens/s on Cerebras Inferencecerebras.ai · 2024-11-19
  5. CodeLlama 3.1 Omni Modelgithub.com · 2024-09-18
  6. CodeShow HN: Tune LLaMa3.1 on Google Cloud TPUsgithub.com · 2024-09-11 · 189 HN pts
  7. CodeLongwriter – Increase llama3.1 output to 10k wordsgithub.com · 2024-10-07 · 154 HN pts
  8. ArticleHermes 3: The First Fine-Tuned Llama 3.1 405B Modellambdalabs.com · 2024-08-15
  9. ArticleLlama 3.1: Our most capable models to dateai.meta.com · 2024-07-23 · 27 HN pts · official
  10. DiscussionCerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8Btwitter.com · 2024-08-27 · 95 HN pts
  11. ArticleWhy Llama 3.1 is Importanttimkellogg.me · 2024-07-23 · 56 HN pts
  12. ArticleHardware LLM Taalas Reaches >14,000 TPS on Llama 3.1 8Btaalas.com · 2026-05-21 · 3 HN pts
  13. ArticleNvidia presents Llama-Mesh: Generating 3D Mesh with Llama 3.1 8Bresearch.nvidia.com · 2024-11-17 · 20 HN pts
  14. ArticleMeta Llama 3.1 405Bopenrouter.ai · 2024-07-23
  15. ArticleTracing tokens through Llama 3.1 8B inference on H100skrithik.xyz · 2026-05-10
  16. ArticleCoding with Llama 3.1, New DeepSeek Coder and Mistral Largeaider.chat · 2024-07-25
  17. ArticleLlama-3.1 supports tool calls via promptingbraintrust.dev · 2024-07-26
  18. ArticleMeta releases an open-weights GPT-4-level AI model, Llama 3.1 405Barstechnica.com · 2024-07-23
  19. DiscussionAsk HN: What are the machine requirements for a LLM like Llama-3.1-8B?news.ycombinator.com · 2026-04-17
  20. ArticleShow HN: Run Llama 3.1 8B in the browserapp.wiz.chat · 2024-07-28
  21. VideoRunning the latest Llama 3.1 8B on Raspberry Pi [video]youtube.com · 2024-07-30
  22. ArticleShow HN: Finetune Llama-3.1 2x faster in a Colabcolab.research.google.com · 2024-07-23
  23. ArticleBenchmarking Llama 3.1 405B on 8x AMD MI300X GPUsdstack.ai · 2024-10-09

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; heavily run locally (336 quantized builds); a big base for builders (2,929 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware336quantized builds
  • Built on2,9291,503 fine-tunes · 1,355 adapters · 71 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: fancyfeast/joy-caption-pre-alpha ♥ 1,477 · gokaygokay/FLUX-Prompt-Generator ♥ 1,400 · pliny-the-prompter/obliteratus ♥ 621 · OpenEvals/evaluation-guidebook ♥ 367

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.8 GB at INT4, 9.6 GB at FP8, 19 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.8 GB of weights (estimate; KV cache and activations extra)INT44.8 GBFP8: about 9.6 GB of weights (estimate; KV cache and activations extra)FP89.6 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.8 GB of weights (estimate; KV cache and activations extra)INT44.8 GBFP8: about 9.6 GB of weights (estimate; KV cache and activations extra)FP89.6 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 0 repo commits so far

Teal is the weights (2024-07-14), amber triangles are 10 dated articles (each links to it).

What people built on it

3,265 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

3,265 derivatives on the Hub, led by 1,503 fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

336 quantized (Hugging Face model tree)1,503 fine-tunes (Hugging Face model tree)71 merges (Hugging Face model tree)1,355 adapters (Hugging Face model tree)336 quantized1,503 fine-tunes71 merges1,355 adapters
336 quantized (Hugging Face model tree)1,503 fine-tunes (Hugging Face model tree)71 merges (Hugging Face model tree)1,355 adapters (Hugging Face model tree)336 quantized1,503 fine-tunes71 merges1,355 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Params by dtypeBF16: 8,030,261,248
Size bandM
MoEno
Gatedmanual
PapersarXiv:2204.05149
LicenseLlama 3.1 Community License (llama3.1)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-3.1-8B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)19 GB · Single GPU (<24 GB)
FP8 (1 byte/param)9.6 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.8 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: meta-llama/Llama-3.1 3,265 derivatives on the Hub

quantized: 336finetune: 1,503adapter: 1,355merge: 71

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
unsloth/Meta-Llama-3.1-8B-bnb-4bit quantized -bnb 8.25B M llama3.1 unsloth 112 2.8M
RedHatAI/Meta-Llama-3.1-8B-FP8 quantized -FP8 8.03B M llama3.1 RedHatAI 10 1.6M
NousResearch/Hermes-3-Llama-3.1-8B-GGUF quantized GGUF — — llama3 NousResearch 216 1.5M
context-labs/Meta-Llama-3.1-8B-Instruct-FP16 finetune -FP16 8.03B M llama3.1 context-labs 1 1.3M
dphn/Dolphin3.0-Llama3.1-8B-GGUF quantized GGUF — — llama3.1 dphn 240 804.8k
dphn/Dolphin3.0-Llama3.1-8B finetune — 8.03B M llama3.1 dphn 407 669.6k
allenai/Llama-3.1-Tulu-3-8B-SFT finetune — 8.03B M llama3.1 allenai 37 576.4k
fdtn-ai/Foundation-Sec-8B finetune — 8.03B M apache-2.0 fdtn-ai 334 270k
OpenSciLM/Llama-3.1_OpenScholar-8B finetune — — — llama3.1 OpenSciLM 87 240.4k
dphn/dolphin-2.9.4-llama3.1-8b finetune — 8.03B M llama3.1 dphn 106 225.3k
unsloth/Llama-3.1-8B-unsloth-bnb-4bit quantized -bnb 8.24B M llama3.1 unsloth 6 211.5k
NousResearch/DeepHermes-3-Llama-3-8B-Preview finetune — 8.03B M llama3 NousResearch 373 179.4k
FriendliAI/Meta-Llama-3.1-8B-Instruct-int8 quantized int8 8.03B M llama3.1 FriendliAI 1 179.9k
unsloth/Llama-3.1-8B finetune — 8.03B M llama3.1 unsloth 6 163.1k
dphn/dolphin-2.9.4-llama3.1-8b-gguf quantized gguf — — llama3.1 dphn 76 156.8k
Mungert/DeepHermes-3-Llama-3-8B-Preview-GGUF quantized GGUF — — llama3 Mungert 6 146.9k
unsloth/Llama-3.1-8B-bnb-4bit quantized -bnb 8.25B M llama3.1 unsloth 0 136.5k
NCSOFT/Llama-VARCO-8B-Instruct finetune — 8.03B M llama3.1 NCSOFT 83 83.9k
UCODE/agent-llama finetune — 8.03B M llama3.1 UCODE 0 76.3k
reasonir/ReasonIR-8B finetune — 7.50B M cc-by-nc-4.0 reasonir 57 63k
nvidia/OpenMath2-Llama3.1-8B finetune — 8.03B M llama3.1 nvidia 37 53.5k
NousResearch/DeepHermes-3-Llama-3-8B-Preview-GGUF quantized GGUF — — llama3 NousResearch 90 50.1k
FriendliAI/Meta-Llama-3.1-8B-Instruct-fp8 quantized -fp8 8.03B M llama3.1 FriendliAI 0 48.8k
NAPS-ai/naps-llama-3_1_instruct-v0.6.0 finetune — 8.03B M apache-2.0 NAPS-ai 0 46.7k
unsloth/Llama-3.1-Storm-8B finetune — 8.03B M llama3.1 unsloth 3 45.3k
Mungert/Llama-3.1-8B-Instruct-GGUF quantized GGUF — — llama3.1 Mungert 7 42.7k
microsoft/UserLM-8b finetune — 8.03B M mit microsoft 398 22.7k
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16 quantized -quant 8.03B M llama3.1 RedHatAI 1 37.7k
Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1 finetune — 8.03B M llama3.1 Magpie-Align 3 35k
philschmid/code-llama-3-1-8b-text-to-sql-lora adapter — — — llama3.1 philschmid 6 33.4k
gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES merge — 8.03B M llama3.1 gaverfraxz 1 31.5k
Bllossom/llama-3.1-Korean-Bllossom-Vision-8B finetune — 8.35B M llama3.1 Bllossom 114 25.5k
danielm1405/lr-1e-05-epochs-1.0-cbqa-exqa-mcqa-paraphrase-sentiment-struct-summ-topic_cls-ddfb4b10 finetune — 266K S — danielm1405 0 29.6k
deepcogito/cogito-v1-preview-llama-8B finetune — 8.03B M llama3.1 deepcogito 51 26.6k
Magpie-Align/MagpieLM-8B-SFT-v0.1 finetune — 8.03B M llama3.1 Magpie-Align 3 28.5k
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8 quantized -quant 8.03B M llama3.1 RedHatAI 5 27.1k
Mungert/Foundation-Sec-8B-GGUF quantized GGUF — — apache-2.0 Mungert 6 26k
unsloth/Llama-3.1-Storm-8B-bnb-4bit quantized -bnb 8.25B M llama3.1 unsloth 7 24.4k
RedHatAI/Sparse-Llama-3.1-8B-2of4 finetune — 8.03B M llama3.1 RedHatAI 62 17k
dnotitia/Llama-DNA-1.0-8B-Instruct finetune — 8.03B M cc-by-nc-4.0 dnotitia 61 16.1k

Repository changelog

1 change
changed in the last 7 daysOther: 2026-10-24all changes

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Llama-3.1-8B, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
meta-llama/Llama-3.1-8B — — — — — — — live 2026-10-25

Articles and coverage

47 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency.

Official2

llama.meta.com2024-07-23officialHN front pageabout the Llama 3.1 familyHN 437 pts · 269 comments42 words
ai.meta.com2024-07-23officialauthorityabout the Llama 3.1 familyHN 27 pts · 3 comments2,136 words

Analysis7

understandingai.org2025-06-15HN front pageabout the Llama 3.1 familyHN 191 pts · 305 comments
github.com2024-09-11authorityHN front pageabout the Llama 3.1 familyHN 189 pts · 52 comments869 words
github.com2024-07-24authorityHN front pageabout the Llama 3.1 familyHN 212 pts · 36 comments5,858 words
github.com2024-10-07authorityHN front pageabout the Llama 3.1 familyHN 154 pts · 29 comments6,696 words
timkellogg.me2024-07-23about the Llama 3.1 familyHN 56 pts · 23 comments
taalas.com2026-05-21HN 3 pts · 1 comments
research.nvidia.com2024-11-17authorityHN 20 pts · 1 comments

Community1

twitter.com2024-08-27about the Llama 3.1 familyHN 95 pts · 42 comments
All coverage tracked for this model (47) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Final performance comparison for Llama 3.1 8B across six ...researchgate.net—2026-10-07exa
Llama 3.1 8B Review — Benchmarks, Pricing & AI Panel Verdict | TopReviewed.aitopreviewed.ai—2026-10-07exa
LLM Deep-dive: Llama 3.1predli.com—2026-10-07exa
Llama 3.1: An In-Depth Analysis of the Next Generation Large Language Modelresearchgate.net—2026-10-07exa
Llama 3.1 8B Review: Benchmarks, Pricing & Features (2026) | What's The Big Datawhatsthebigdata.com—2026-10-07exa
Llama 3.1 8B in 2026: Still Worth Running? | BestLLMforbestllmfor.com2026-05-272026-10-07exa
Hardware LLM Taalas Reaches >14,000 TPS on Llama 3.1 8Btaalas.com2026-05-212026-10-07hn
Tracing tokens through Llama 3.1 8B inference on H100skrithik.xyz2026-05-102026-10-07hn
Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B?news.ycombinator.com2026-04-172026-10-07hn
Llama 3.1 8B Review 2026: Setup & Performance Guide | Agentic Rankedagenticranked.com2026-04-032026-10-07exa
Show HN: Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPUgithub.com2026-02-212026-10-07hn
Llama 3.1 | meta-llama/llama-models | DeepWikideepwiki.com2025-07-302026-10-07exa
Meta's Llama 3.1 can recall 42 percent of the first Harry Potter bookunderstandingai.org2025-06-152026-10-07hn
Nvidia's new Llama-3.1 Nemotron Ultra outperforms DeepSeek R1 at half the sizeventurebeat.com2025-04-112026-10-07hn
Make Llama 3.1 8B talk in Rick Sanchez's stylegithub.com2025-01-092026-10-07hn
Show HN: Llama 3.1 8B CPU Inference in a Browser via WebAssemblygalqiwi.github.io2024-12-252026-10-07hn
Distilling Llama3.1 8B into 1B in torchtunepytorch.org2024-12-102026-10-07hn
Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inferencecerebras.ai2024-11-192026-10-07hn
Nvidia presents Llama-Mesh: Generating 3D Mesh with Llama 3.1 8Bresearch.nvidia.com2024-11-172026-10-07hn
Chat with Llama 3.1 8Byosunai.com2024-11-162026-10-07hn
Benchmarking Llama 3.1 405B on 8x AMD MI300X GPUsdstack.ai2024-10-092026-10-07hn
Longwriter – Increase llama3.1 output to 10k wordsgithub.com2024-10-072026-10-07hn
Fine-tuned Llama 3.1 8B in just $2.69blog.monsterapi.ai2024-09-262026-10-07hn
Llama 3.1 Omni Modelgithub.com2024-09-182026-10-07hn
g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chainsgithub.com2024-09-152026-10-07hn
Show HN: Tune LLaMa3.1 on Google Cloud TPUsgithub.com2024-09-112026-10-07hn
Reflection-Llama-3.1-70B is Llama-3 with LoRAold.reddit.com2024-09-082026-10-07hn
Show HN: I built a website where you can easily fine-tune Llama 3.1 modelstunellama.com2024-09-042026-10-07hn
Cerebras launches inference for Llama 3.1; benchmarked at 1846 tokens/s on 8Btwitter.com2024-08-272026-10-07hn
Started Llama 3.1 8B Locallym-ruminer.medium.com2024-08-212026-10-07hn
Show HN: Dive into Transformers and LLM World – Llama 3.1 in Go, Step by Stepgithub.com2024-08-182026-10-07hn
Prune and Distill Llama-3.1 8B to an Nvidia Llama-3.1-Minitron 4Bdeveloper.nvidia.com2024-08-162026-10-07hn
Hermes 3: The First Fine-Tuned Llama 3.1 405B Modellambdalabs.com2024-08-152026-10-07hn
A comparative study of fine-tuning GPT-4o-mini, Gemini Flash 1.5, Llama-3.1-8Bpatched.codes2024-08-132026-10-07hn
Running the latest Llama 3.1 8B on Raspberry Pi [video]youtube.com2024-07-302026-10-07hn
Show HN: Run Llama 3.1 8B in the browserapp.wiz.chat2024-07-282026-10-07hn
Llama-3.1 supports tool calls via promptingbraintrust.dev2024-07-262026-10-07hn
Coding with Llama 3.1, New DeepSeek Coder and Mistral Largeaider.chat2024-07-252026-10-07hn
Llama 3.1 in Cgithub.com2024-07-242026-10-07hn
Why Llama 3.1 is Importanttimkellogg.me2024-07-232026-10-07hn
Show HN: Finetune Llama-3.1 2x faster in a Colabcolab.research.google.com2024-07-232026-10-07hn
Meta releases an open-weights GPT-4-level AI model, Llama 3.1 405Barstechnica.com2024-07-232026-10-07hn
Meta Llama 3.1 405Bopenrouter.ai2024-07-232026-10-07hn
Chat with Meta Llama 3.1 405Bllama3.replicate.dev2024-07-232026-10-07hn
Llama 3.1: Our most capable models to dateai.meta.com official2024-07-232026-10-07hn
Llama 3.1llama.meta.com official2024-07-232026-10-07hn
Llama 3.1 8B - The 8B Benchmark Model (2026 Guide) | Every Local AIeverylocalai.com2024-07-232026-10-07exa

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-8B · 8.19B
    same size band (M), same task (text-generation), more providers, permissive license
  • Meta-Llama-3-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen2.5-7B-Instruct · 7.62B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:33 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:00 UTC · Last verified 2026-10-25

Follow Llama-3.1-8B

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.