Models › Llama-2 family

meta-llama Llama 2 Community License out 3 years ago

6.74B parameters, text in, text out.

Verified 2026-10-25 Rank #114 in LLMs · score 97.4 method v1 Sources 3 Downloads 30d 435.6k · #174 of 619 tracked

Can I use it?Llama 2 Community LicenseAttribution; >700M MAU clause; acceptable-use policylicence file2026-10-24
Do people use it?435.6kdownloads, 30 days#174 of 619 we track · top 28%+11 likes, downloads −33% this week2,474 likesHugging Face2026-10-24

Worth reading

Picked by rule from 38 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 955 HN pts

Fine-tune your own Llama 2 to replace GPT-3.5/4

Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set.

news.ycombinator.com 2023-09-12 955 HN pts · 181 comments 10k words about the Llama 2 family family
Latest · 3 years ago

Run Llama 2 uncensored locally

Ollama enables local execution of uncensored Llama 2 variants, such as the 7B model fine-tuned using Wizard-Vicuna conversation dataset and Nous Hermes Llama 2 13B fine-tuned on over 300,000 instructions.

  • The uncensored model provides a specific recipe for dangerously spicy mayo including ingredients like cayenne pepper and paprika.
  • The uncensored model describes the manufacturing process for Tylenol by combining paracetamol with aspirin, caffeine, and diphenhydramine.
ollama.ai 2023-08-02 722 HN pts · 212 comments 1.3k words about the Llama 2 family family

25 best of 38 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleLlama 2ai.meta.com · 2023-07-18 · 2,268 HN pts · official
  2. CodeLlama2.c: Inference llama 2 in one file of pure Cgithub.com · 2023-07-23 · 707 HN pts
  3. CodeShow HN: Khoj – Chat offline with your second brain using Llama 2github.com · 2023-07-30 · 565 HN pts
  4. CodeM2 Ultra can run 128 streams of Llama 2 7B in parallelgithub.com · 2023-10-11 · 268 HN pts
  5. ArticleGuide to running Llama 2 locallyreplicate.com · 2023-07-25 · 683 HN pts
  6. ArticleAccessing Llama 2 from the command-line with the LLM-replicate pluginsimonwillison.net · 2023-07-18 · 200 HN pts
  7. ArticleUnderstanding Llama 2 and the New Code Llama LLMsmagazine.sebastianraschka.com · 2023-08-30 · 170 HN pts
  8. CodeLlama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2github.com · 2023-10-05 · 320 HN pts
  9. CodeShow HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2github.com · 2023-08-16
  10. PaperLlama 2 Longarxiv.org · 2023-09-29
  11. CodeLlama 2 on ONNX runs locallygithub.com · 2023-08-10
  12. PaperLlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAsarxiv.org · 2024-09-27
  13. ArticleLLaMA2 Chat 70B outperformed ChatGPTtatsu-lab.github.io · 2023-07-27
  14. ArticleFast and Portable Llama2 Inference on the Heterogeneous Edgesecondstate.io · 2023-11-13
  15. ArticleJetMoE: Reaching LLaMA2 performance with 0.1M dollarsresearch.myshell.ai · 2024-04-04
  16. CodeShow HN: Llama2 Embeddings FastAPI Servergithub.com · 2023-08-15
  17. ArticleFine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Modelsanyscale.com · 2023-08-11
  18. ArticleA simple guide to fine-tuning Llama 2brev.dev · 2023-07-24
  19. ArticleWhat's new in Llama 2 and how to run it locallyagi-sphere.com · 2023-08-06
  20. DiscussionLeCun: Qualcomm working with Meta to run Llama-2 on mobile devicestwitter.com · 2023-07-23
  21. ArticleLoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70Blesswrong.com · 2023-10-13
  22. ArticleFast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparseneuralmagic.com · 2023-11-23
  23. DiscussionVicuna v1.5 series, featuring 4K and 16K context, based on Llama 2twitter.com · 2023-08-03

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 78 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware78quantized builds
  • Built on3,456990 fine-tunes · 2,455 adapters · 11 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: pliny-the-prompter/obliteratus ♥ 621 · tomg-group-umd/lm-watermarking ♥ 100 · Illia56/Ask-AI-Youtube ♥ 81 · Norod78/OpenELM_3B_Demo ♥ 59

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.0 GB at INT4, 8.1 GB at FP8, 16 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.0 GB of weights (estimate; KV cache and activations extra)INT44.0 GBFP8: about 8.1 GB of weights (estimate; KV cache and activations extra)FP88.1 GBBF16: about 16 GB of weights (estimate; KV cache and activations extra)BF1616 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.0 GB of weights (estimate; KV cache and activations extra)INT44.0 GBFP8: about 8.1 GB of weights (estimate; KV cache and activations extra)FP88.1 GBBF16: about 16 GB of weights (estimate; KV cache and activations extra)BF1616 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 0 repo commits so far

Teal is the weights (2023-07-13), amber triangles are 10 dated articles (each links to it).

What people built on it

3,534 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

3,534 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

78 quantized (Hugging Face model tree)990 fine-tunes (Hugging Face model tree)11 merges (Hugging Face model tree)2,455 adapters (Hugging Face model tree)78 quantized990 fine-tunes11 merges2,455 adapters
78 quantized (Hugging Face model tree)990 fine-tunes (Hugging Face model tree)11 merges (Hugging Face model tree)2,455 adapters (Hugging Face model tree)78 quantized990 fine-tunes11 merges2,455 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Params by dtypeF32: 2,048 · F16: 6,738,415,616
Size bandM
MoEno
Gatedmanual
PapersarXiv:2307.09288
LicenseLlama 2 Community License (llama2)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-2-7b-hf: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)16 GB · Single GPU (<24 GB)
FP8 (1 byte/param)8.1 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.0 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: meta-llama/Llama-2 3,534 derivatives on the Hub

quantized: 78finetune: 990adapter: 2,455merge: 11

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
TheBloke/Llama-2-7B-GPTQ quantized GPTQ 6.74B M llama2 TheBloke 81 1.8M
TheBloke/Llama-2-7B-GGUF quantized GGUF — — llama2 TheBloke 207 625.3k
allenai/tulu-2-7b finetune — — — — allenai 11 151.8k
allenai/tulu-2-dpo-7b finetune — — — other allenai 21 118.8k
Styxxxx/llama2_7b_lora-common_gen adapter — — — — Styxxxx 0 100.8k
Styxxxx/llama2_7b_lora-multirc adapter — — — — Styxxxx 0 99.9k
Styxxxx/llama2_7b_lora-arc_challenge adapter — — — — Styxxxx 0 97.9k
Styxxxx/llama2_7b_lora-arc_easy adapter — — — — Styxxxx 0 91.8k
rinna/youri-7b finetune — 6.74B M llama2 rinna 21 89.1k
Styxxxx/llama2_7b_lora-cosmos_qa adapter — — — — Styxxxx 0 89.2k
Styxxxx/llama2_7b_lora-copa adapter — — — — Styxxxx 0 84.4k
TheBloke/Llama-2-7B-AWQ quantized AWQ 6.74B M llama2 TheBloke 17 79.3k
Styxxxx/llama2_7b_lora-dart adapter — — — — Styxxxx 0 79.6k
Styxxxx/llama2_7b_lora-anli_r1 adapter — — — — Styxxxx 0 78.2k
Styxxxx/llama2_7b_lora-natural_questions adapter — — — — Styxxxx 0 77k
Styxxxx/llama2_7b_lora-openbookqa adapter — — — — Styxxxx 0 74.2k
Styxxxx/llama2_7b_lora-glue_mrpc adapter — — — — Styxxxx 0 68.4k
Styxxxx/llama2_7b_lora-wmt16_translate_deen adapter — — — — Styxxxx 0 64.2k
Styxxxx/llama2_7b_lora-wmt16_translate_csen adapter — — — — Styxxxx 0 62.4k
RedHatAI/Llama-2-7b-gsm8k finetune — — — — RedHatAI 5 61.9k
Styxxxx/llama2_7b_lora-web_nlg_en adapter — — — — Styxxxx 0 61.7k
Styxxxx/llama2_7b_lora-drop adapter — — — — Styxxxx 0 56k
diffusionfamily/diffullama finetune — 6.74B M apache-2.0 diffusionfamily 14 53.3k
Styxxxx/llama2_7b_lora-sst2 adapter — — — — Styxxxx 0 53.4k
Styxxxx/llama2_7b_lora-anli_r2 adapter — — — — Styxxxx 0 52.9k
Styxxxx/llama2_7b_lora-wmt16_translate_fien adapter — — — — Styxxxx 0 52.9k
Styxxxx/llama2_7b_lora-yelp_polarity_reviews adapter — — — — Styxxxx 0 52.4k
swapnilbp/llama_tweet_ptune adapter — — — — swapnilbp 0 49.3k
Styxxxx/llama2_7b_lora-bool_q adapter — — — — Styxxxx 0 49.2k
Styxxxx/llama2_7b_lora-trivia_qa adapter — — — — Styxxxx 0 48.1k
Styxxxx/llama2_7b_lora-definite_pronoun_resolution adapter — — — — Styxxxx 1 47.7k
Styxxxx/llama2_7b_lora-glue_qqp adapter — — — — Styxxxx 0 47.1k
Styxxxx/llama2_7b_lora-record adapter — — — — Styxxxx 0 47k
Styxxxx/llama2_7b_lora-wnli adapter — — — — Styxxxx 0 46.3k
Styxxxx/llama2_7b_lora-story_cloze adapter — — — — Styxxxx 0 45.5k
Styxxxx/llama2_7b_lora-paws_wiki adapter — — — — Styxxxx 0 44.5k
Styxxxx/llama2_7b_lora-mnli_matched adapter — — — — Styxxxx 0 43.3k
Styxxxx/llama2_7b_lora-mnli_mismatched adapter — — — — Styxxxx 0 42.8k
Styxxxx/llama2_7b_lora-anli_r3 adapter — — — — Styxxxx 0 41k
Styxxxx/llama2_7b_lora-qnli adapter — — — — Styxxxx 0 40.2k

Articles and coverage

38 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

ai.meta.com2023-07-18officialauthorityHN front pageabout the Llama 2 familyHN 2,268 pts · 820 comments42 words

Analysis8

github.com2023-07-23authorityHN front pageabout the Llama 2 familyHN 707 pts · 165 comments4,774 words
The llama2.c repository offers a 700-line pure C file for training and inferring Llama 2 models, currently supporting fp32 inference for models up to 7B parameters. Work on model quantization is currently ongoing, but the project includes a 110M parameter model trained on the TinyStories dataset.written, reviewed, cited
  • Models larger than 7B are unusably slow because the repo performs float32 inference.
  • The 13B+ model variant fails due to integer flow errors in pointer arithmetic.
github.com2023-07-30authorityHN front pageabout the Llama 2 familyHN 565 pts · 150 comments218 words
Khoj is an open-source, self-hostable AI platform that lets users get answers from the web or their docs. It enables building custom agents and scheduling automations while supporting online or local LLMs like gpt, claude, gemini, llama, qwen, and mistral. Users can get started for free and contribute to the community-sustained project.written, reviewed, cited
ollama.ai2023-08-02HN front pageabout the Llama 2 familyHN 722 pts · 212 comments1,251 words
Ollama enables local execution of uncensored Llama 2 variants, such as the 7B model fine-tuned using Wizard-Vicuna conversation dataset and Nous Hermes Llama 2 13B fine-tuned on over 300,000 instructions. The 13B model stands out for its long responses, lower hallucination rate, and absence of OpenAI censorship mechanisms. Users can run these models via commands like ollama run llama2-uncensored to bypass standard safety refusals.written, reviewed, cited
  • The uncensored model provides a specific recipe for dangerously spicy mayo including ingredients like cayenne pepper and paprika.
  • The uncensored model describes the manufacturing process for Tylenol by combining paracetamol with aspirin, caffeine, and diphenhydramine.
github.com2023-10-11authorityHN front pageHN 268 pts · 173 comments1,224 words
replicate.com2023-07-25HN front pageabout the Llama 2 familyHN 683 pts · 170 comments603 words
simonwillison.net2023-07-18authorityHN front pageabout the Llama 2 familyHN 200 pts · 43 comments1,144 words
magazine.sebastianraschka.com2023-08-30authorityHN front pageabout the Llama 2 familyHN 170 pts · 34 comments4,048 words
github.com2023-10-05authorityHN front pageabout the Llama 2 familyHN 320 pts · 55 comments4,153 words

Community1

news.ycombinator.com2023-09-12HN front pageabout the Llama 2 familyHN 955 pts · 181 comments10,023 words
Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set. While fine-tuning requires 1000+ examples and is less flexible than prompting, a fine-tuned Llama 7B is 50x cheaper than GPT-3.5 per token, costing just $19 to classify 2M recipes versus $23k for GPT-4.written, reviewed, cited
All coverage tracked for this model (38) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
LLAMA 2 Paper and Model Deep Dive — The GenAI Guidebookravinkumar.com—2026-10-07exa
Llama 2 7B Hf by meta-llamallm.extractum.io—2026-10-07exa
Llama 2 7B Hf by NousResearchllm.extractum.io—2026-10-07exa
Llama 2 7B Hf by meta-llama — VRAM 13.5GB, 4K context | LLM Explorerllm-explorer.com—2026-10-07exa
LlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAsarxiv.org2024-09-272026-10-07hn
JetMoE: Reaching LLaMA2 performance with 0.1M dollarsresearch.myshell.ai2024-04-042026-10-07hn
Deep Dive into Llama 2: Architecture, Pre‑training, SF… | BestHubbesthub.dev2024-03-272026-10-07exa
Fast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparseneuralmagic.com2023-11-232026-10-07hn
Fast and Portable Llama2 Inference on the Heterogeneous Edgesecondstate.io2023-11-132026-10-07hn
Comparing the Performance of LLMs: A Deep Dive into Roberta, Llama 2, and Mistral for Disaster Tweets Analysis with Lorahuggingface.co2023-11-072026-10-07exa
Visualizing the inner world of a large language model (Llama 2 7B)landrewwray.github.io2023-10-192026-10-07exa
LoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70Blesswrong.com2023-10-132026-10-07hn
M2 Ultra can run 128 streams of Llama 2 7B in parallelgithub.com2023-10-112026-10-07hn
Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2github.com2023-10-052026-10-07hn
Llama 2 Longarxiv.org2023-09-292026-10-07hn
Fine-tune your own Llama 2 to replace GPT-3.5/4news.ycombinator.com2023-09-122026-10-07hn
LLAMA 2 Model Benchmarks: Insights for Performance Evaluationtruefoundry.com2023-09-122026-10-07exa
Understanding Llama 2 and the New Code Llama LLMsmagazine.sebastianraschka.com2023-08-302026-10-07hn
Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaperanyscale.com2023-08-292026-10-07hn
WebLLM: Llama2 in the Browserwebllm.mlc.ai2023-08-292026-10-07hn
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2github.com2023-08-162026-10-07hn
Show HN: Llama2 Embeddings FastAPI Servergithub.com2023-08-152026-10-07hn
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Modelsanyscale.com2023-08-112026-10-07hn
Llama 2 on ONNX runs locallygithub.com2023-08-102026-10-07hn
What's new in Llama 2 and how to run it locallyagi-sphere.com2023-08-062026-10-07hn
Vicuna v1.5 series, featuring 4K and 16K context, based on Llama 2twitter.com2023-08-032026-10-07hn
Cookbook: Finetuning Llama 2 in your own cloud environment, privatelyblog.skypilot.co2023-08-022026-10-07hn
Run Llama 2 uncensored locallyollama.ai2023-08-022026-10-07hn
Show HN: Khoj – Chat offline with your second brain using Llama 2github.com2023-07-302026-10-07hn
Understanding LLaMA-2 Architecture & its Ginormous Impact on GenAI | by Kunal Sawarkar | Towards Generative AI | Mediummedium.com2023-07-292026-10-07exa
LLaMA2 Chat 70B outperformed ChatGPTtatsu-lab.github.io2023-07-272026-10-07hn
Guide to running Llama 2 locallyreplicate.com2023-07-252026-10-07hn
A simple guide to fine-tuning Llama 2brev.dev2023-07-242026-10-07hn
Llama2.c: Inference llama 2 in one file of pure Cgithub.com2023-07-232026-10-07hn
LeCun: Qualcomm working with Meta to run Llama-2 on mobile devicestwitter.com2023-07-232026-10-07hn
Paper Summary: Llama2 – Lawrence Wulawrencewu.net2023-07-232026-10-07exa
Accessing Llama 2 from the command-line with the LLM-replicate pluginsimonwillison.net2023-07-182026-10-07hn
Llama 2ai.meta.com official2023-07-182026-10-07hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.1-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen2.5-7B-Instruct · 7.62B
    same size band (M), same task (text-generation), more providers, permissive license
  • Mistral-7B-Instruct-v0.2 · 7.24B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:33 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:00 UTC · Last verified 2026-10-25

Follow Llama-2-7b-hf

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.