Models › Llama-2 family

Llama-2-7b-chat-hf

NousResearch Not declared out 3 years ago

6.74B parameters, text in, text out, 4K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #643 in LLMs · score 73.2 method v1 Sources 3 Downloads 30d 11.7k · #501 of 619 tracked

Can I run it?4.0GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Not declaredNo license declared on the model cardlicence file2026-10-24
Do people use it?11.7kdownloads, 30 days#501 of 619 we track · below the median+0 likes, downloads −19% this week201 likesHugging Face2026-10-24

Worth reading

Picked by rule from 28 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 2,268 HN pts
ai.meta.com 2023-07-18 2,268 HN pts · 820 comments 42 words about the Llama 2 family family
Latest · 3 years ago

Fine-tune your own Llama 2 to replace GPT-3.5/4

Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set.

news.ycombinator.com 2023-09-12 955 HN pts · 181 comments 10k words about the Llama 2 family family

25 best of 28 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeLlama2.c: Inference llama 2 in one file of pure Cgithub.com · 2023-07-23 · 707 HN pts
  2. CodeShow HN: Khoj – Chat offline with your second brain using Llama 2github.com · 2023-07-30 · 565 HN pts
  3. ArticleRun Llama 2 uncensored locallyollama.ai · 2023-08-02 · 722 HN pts
  4. CodeM2 Ultra can run 128 streams of Llama 2 7B in parallelgithub.com · 2023-10-11 · 268 HN pts
  5. ArticleGuide to running Llama 2 locallyreplicate.com · 2023-07-25 · 683 HN pts
  6. ArticleAccessing Llama 2 from the command-line with the LLM-replicate pluginsimonwillison.net · 2023-07-18 · 200 HN pts
  7. ArticleUnderstanding Llama 2 and the New Code Llama LLMsmagazine.sebastianraschka.com · 2023-08-30 · 170 HN pts
  8. CodeLlama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2github.com · 2023-10-05 · 320 HN pts
  9. CodeShow HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2github.com · 2023-08-16
  10. PaperLlama 2 Longarxiv.org · 2023-09-29
  11. CodeLlama 2 on ONNX runs locallygithub.com · 2023-08-10
  12. PaperLlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAsarxiv.org · 2024-09-27
  13. ArticleLLaMA2 Chat 70B outperformed ChatGPTtatsu-lab.github.io · 2023-07-27
  14. ArticleFast and Portable Llama2 Inference on the Heterogeneous Edgesecondstate.io · 2023-11-13
  15. ArticleJetMoE: Reaching LLaMA2 performance with 0.1M dollarsresearch.myshell.ai · 2024-04-04
  16. CodeShow HN: Llama2 Embeddings FastAPI Servergithub.com · 2023-08-15
  17. ArticleFine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Modelsanyscale.com · 2023-08-11
  18. ArticleA simple guide to fine-tuning Llama 2brev.dev · 2023-07-24
  19. ArticleWhat's new in Llama 2 and how to run it locallyagi-sphere.com · 2023-08-06
  20. DiscussionLeCun: Qualcomm working with Meta to run Llama-2 on mobile devicestwitter.com · 2023-07-23
  21. ArticleLoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70Blesswrong.com · 2023-10-13
  22. ArticleFast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparseneuralmagic.com · 2023-11-23
  23. DiscussionVicuna v1.5 series, featuring 4K and 16K context, based on Llama 2twitter.com · 2023-08-03

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 21 quantized builds for local use; a big base for builders (620 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware21quantized builds
  • Built on620142 fine-tunes · 467 adapters · 11 merges
  • In apps66Hugging Face Spaces

Top Spaces running it: Vision-CAIR-Admin/MiniGPT-v2 ♥ 113 · sambanovasystems/enterprise_knowledge_retriever ♥ 4 · teganmosi/medicalchatbot ♥ 1 · prensofslavs/freudian-dream-interpreter ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.0 GB at INT4, 8.1 GB at FP8, 16 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.0 GB of weights (estimate; KV cache and activations extra)INT44.0 GBFP8: about 8.1 GB of weights (estimate; KV cache and activations extra)FP88.1 GBBF16: about 16 GB of weights (estimate; KV cache and activations extra)BF1616 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.0 GB of weights (estimate; KV cache and activations extra)INT44.0 GBFP8: about 8.1 GB of weights (estimate; KV cache and activations extra)FP88.1 GBBF16: about 16 GB of weights (estimate; KV cache and activations extra)BF1616 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2023-07-18), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

641 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

641 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

21 quantized (Hugging Face model tree)142 fine-tunes (Hugging Face model tree)11 merges (Hugging Face model tree)467 adapters (Hugging Face model tree)21 quantized142 fine-tunes11 merges467 adapters
21 quantized (Hugging Face model tree)142 fine-tunes (Hugging Face model tree)11 merges (Hugging Face model tree)467 adapters (Hugging Face model tree)21 quantized142 fine-tunes11 merges467 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

12 rows

Benchmarks 12 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (12)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AGI Eval29.3Llama 2 7Bmodel author2026-10-07
author-reported BBH · Reason through hard problems32.6Llama 2 7Bmodel author2026-10-07
author-reported Code16.8Llama 2 7Bmodel author2026-10-07
author-reported Commonsense Reasoning63.9Llama 2 7Bmodel author2026-10-07
author-reported MATH-500 · Reason through hard problems14.6Llama 2 7Bmodel author2026-10-07
author-reported MMLU · Reason through hard problems45.3Llama 2 7Bmodel author2026-10-07
author-reported Reading Comprehension61.3Llama 2 7Bmodel author2026-10-07
author-reported Toxigen21.25Llama 2 7Bmodel author2026-10-07
author-reported Toxigen0Llama-2-Chat 7Bmodel author2026-10-07
author-reported TruthfulQA · Chat and follow instructions33.29Llama 2 7Bmodel author2026-10-07
author-reported TruthfulQA · Chat and follow instructions57.04Llama-2-Chat 7Bmodel author2026-10-07
author-reported World Knowledge48.9Llama 2 7Bmodel author2026-10-07

What the card says

1 cited sentence

Summary generated, cited

This fine-tuned model is optimized for dialogue use cases and is intended for commercial and research use in English.[1][2]

  1. “optimized for dialogue use cases”
  2. “intended for commercial and research use in English”

Generated 2026-10-07 15:13 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

3 use cases

What it is good at 3 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Dtypefloat16
Params by dtypeF16: 6,738,417,664
Size bandM
MoEno
Context length4,096 (config.json max_position_embeddings)
Languagesen
LicenseNot declared
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-2-7b-chat-hf: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)16 GB · Single GPU (<24 GB)
FP8 (1 byte/param)8.1 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.0 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: NousResearch/Llama-2 641 derivatives on the Hub

merge: 11quantized: 21finetune: 142adapter: 467

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
InnerI/I-Code-NousLlama7B-slerp merge — 6.74B M llama2 InnerI 0 9.9k
xaviviro/llama-2-7b-chat-catala-GGUF quantized GGUF — — — xaviviro 1 9.3k
mradermacher/Llama-2-7b-chat-hf-i1-GGUF quantized GGUF — — — mradermacher 0 7k
OPTML-Group/TOFU-origin-Llama-2-7b-chat finetune — 6.74B M mit OPTML-Group 0 6.9k
fradinho/llama-mistral merge — 7.24B M mit fradinho 0 6.1k
Thimira/sinhala-llama-2-7b-chat-hf adapter — — — llama2 Thimira 3 4.9k
mradermacher/Llama-2-7b-chat-hf-GGUF quantized GGUF — — — mradermacher 0 3.1k
UnderstandLing/llama-2-7b-chat-es adapter — — — — UnderstandLing 5 2.1k
HeshamHaroon/llama-2-7b-chat-ar adapter — — — apache-2.0 HeshamHaroon 4 1.3k
RedHatAI/Llama2-7b-chat-pruned50-quant-ds quantized -quant — — — RedHatAI 9 831
arcee-ai/Patent-Llama-7B-Chat-Slerp merge — 6.74B M — arcee-ai 1 743
UnderstandLing/llama-2-7b-chat-fr adapter — — — — UnderstandLing 0 784
Sentdex/Walls1337bot-Llama2-7B-003.005.5000 adapter — — — apache-2.0 Sentdex 2 598
NireekshanAI/FineTuned_NIRI_LLM quantized GGUF — — apache-2.0 NireekshanAI 1 519
A2H0H0R1/Llama-2-7b-chat-hf-biology finetune — — — apache-2.0 A2H0H0R1 1 454
yashhanamghar9099/Yash-Llama2-7B-QLoRA-v1 adapter — 6.74B M — yashhanamghar9099 0 472
sakshamjkjk/chatbot-fine-tune quantized — 6.84B M apache-2.0 sakshamjkjk 0 387
chrystians/llama-2-7b-chat-pl-polish-polski adapter — — — — chrystians 3 229
devshaheen/Llama-2-7b-chat-finetune finetune — 6.74B M mit devshaheen 0 331
bablu75/results finetune — — — — bablu75 1 278
UnderstandLing/llama-2-7b-chat-pt adapter — — — — UnderstandLing 2 220
ethicsadvisorproject/Llama-2-7b-ethical-chat-finetune finetune — — — mit ethicsadvisorproject 0 318
SURESHBEEKHANI/Llama-2-7b-chat-finetune finetune — — — mit SURESHBEEKHANI 1 264
A2H0H0R1/llama2-7B-gpt4 adapter — — — other A2H0H0R1 0 308
CNBOOMBOOM/coffeechat-model adapter — — — — CNBOOMBOOM 0 306
Chhaya/odia-llama-7b adapter — — — — Chhaya 0 300
Jaimefebe/llama-2-7b-euskara-v1 adapter — — — — Jaimefebe 2 179
mncster/Llama-2-7b-chat-hf-Q8_0-GGUF quantized Q8_0 — — — mncster 0 256
ratish03/Llama-2-7b-chat-finetune finetune — — — — ratish03 0 247
manojpatil/llama-2-7b-chat-lora-adaptor adapter — — — — manojpatil 0 244
rohan105/Llama-2-7b-chat-finetune finetune — — — — rohan105 0 244
Drewww/llama-2-7b-mlabonne-enhanced finetune — — — — Drewww 0 240
mergekit-community/grok-13b-chat merge — 6.74B M — mergekit-community 0 230
UnderstandLing/llama-2-7b-chat-nl adapter — — — — UnderstandLing 1 177
Ghufran27/medical-llama2-7b finetune — 6.74B M llama2 Ghufran27 1 172
UnderstandLing/llama-2-7b-chat-tr adapter — — — — UnderstandLing 2 114
mirfan899/llama2-7b-usum quantized — 6.87B M mit mirfan899 1 162
reecursion123/Llama-2-7b-therapist-chatbot quantized — — — — reecursion123 0 207
YieldInc/aiql01 quantized — — — — YieldInc 0 205
nurank/hdb-llm adapter — — — — nurank 1 143

Repository changelog

5 commits

Repository changelog 5 commits

DateCommitSHA
2024-06-03 Update generation_config.json (#7) 351844e
2023-07-18 Update config.json 37892f3
2023-07-18 Update config.json 404e40e
2023-07-18 Update README.md 91b1d32
2023-07-18 Squashing commit bd90846

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Llama-2-7b-chat-hf, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
NousResearch/Llama-2-7b-chat-hf — — — — — — — live 2026-10-25

Articles and coverage

28 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis9

ai.meta.com2023-07-18authorityHN front pageabout the Llama 2 familyHN 2,268 pts · 820 comments42 words
github.com2023-07-23authorityHN front pageabout the Llama 2 familyHN 707 pts · 165 comments4,774 words
The llama2.c repository offers a 700-line pure C file for training and inferring Llama 2 models, currently supporting fp32 inference for models up to 7B parameters. Work on model quantization is currently ongoing, but the project includes a 110M parameter model trained on the TinyStories dataset.written, reviewed, cited
  • Models larger than 7B are unusably slow because the repo performs float32 inference.
  • The 13B+ model variant fails due to integer flow errors in pointer arithmetic.
github.com2023-07-30authorityHN front pageabout the Llama 2 familyHN 565 pts · 150 comments218 words
Khoj is an open-source, self-hostable AI platform that lets users get answers from the web or their docs. It enables building custom agents and scheduling automations while supporting online or local LLMs like gpt, claude, gemini, llama, qwen, and mistral. Users can get started for free and contribute to the community-sustained project.written, reviewed, cited
ollama.ai2023-08-02HN front pageabout the Llama 2 familyHN 722 pts · 212 comments1,251 words
Ollama enables local execution of uncensored Llama 2 variants, such as the 7B model fine-tuned using Wizard-Vicuna conversation dataset and Nous Hermes Llama 2 13B fine-tuned on over 300,000 instructions. The 13B model stands out for its long responses, lower hallucination rate, and absence of OpenAI censorship mechanisms. Users can run these models via commands like ollama run llama2-uncensored to bypass standard safety refusals.written, reviewed, cited
  • The uncensored model provides a specific recipe for dangerously spicy mayo including ingredients like cayenne pepper and paprika.
  • The uncensored model describes the manufacturing process for Tylenol by combining paracetamol with aspirin, caffeine, and diphenhydramine.
github.com2023-10-11authorityHN front pageHN 268 pts · 173 comments1,224 words
replicate.com2023-07-25HN front pageabout the Llama 2 familyHN 683 pts · 170 comments603 words
simonwillison.net2023-07-18authorityHN front pageabout the Llama 2 familyHN 200 pts · 43 comments1,144 words
magazine.sebastianraschka.com2023-08-30authorityHN front pageabout the Llama 2 familyHN 170 pts · 34 comments4,048 words
github.com2023-10-05authorityHN front pageabout the Llama 2 familyHN 320 pts · 55 comments4,153 words

Community1

news.ycombinator.com2023-09-12HN front pageabout the Llama 2 familyHN 955 pts · 181 comments10,023 words
Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set. While fine-tuning requires 1000+ examples and is less flexible than prompting, a fine-tuned Llama 7B is 50x cheaper than GPT-3.5 per token, costing just $19 to classify 2M recipes versus $23k for GPT-4.written, reviewed, cited
All coverage tracked for this model (28) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
LlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAsarxiv.org2024-09-272026-10-07hn
JetMoE: Reaching LLaMA2 performance with 0.1M dollarsresearch.myshell.ai2024-04-042026-10-07hn
Fast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparseneuralmagic.com2023-11-232026-10-07hn
Fast and Portable Llama2 Inference on the Heterogeneous Edgesecondstate.io2023-11-132026-10-07hn
LoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70Blesswrong.com2023-10-132026-10-07hn
M2 Ultra can run 128 streams of Llama 2 7B in parallelgithub.com2023-10-112026-10-07hn
Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2github.com2023-10-052026-10-07hn
Llama 2 Longarxiv.org2023-09-292026-10-07hn
Fine-tune your own Llama 2 to replace GPT-3.5/4news.ycombinator.com2023-09-122026-10-07hn
Understanding Llama 2 and the New Code Llama LLMsmagazine.sebastianraschka.com2023-08-302026-10-07hn
Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaperanyscale.com2023-08-292026-10-07hn
WebLLM: Llama2 in the Browserwebllm.mlc.ai2023-08-292026-10-07hn
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2github.com2023-08-162026-10-07hn
Show HN: Llama2 Embeddings FastAPI Servergithub.com2023-08-152026-10-07hn
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Modelsanyscale.com2023-08-112026-10-07hn
Llama 2 on ONNX runs locallygithub.com2023-08-102026-10-07hn
What's new in Llama 2 and how to run it locallyagi-sphere.com2023-08-062026-10-07hn
Vicuna v1.5 series, featuring 4K and 16K context, based on Llama 2twitter.com2023-08-032026-10-07hn
Cookbook: Finetuning Llama 2 in your own cloud environment, privatelyblog.skypilot.co2023-08-022026-10-07hn
Run Llama 2 uncensored locallyollama.ai2023-08-022026-10-07hn
Show HN: Khoj – Chat offline with your second brain using Llama 2github.com2023-07-302026-10-07hn
LLaMA2 Chat 70B outperformed ChatGPTtatsu-lab.github.io2023-07-272026-10-07hn
Guide to running Llama 2 locallyreplicate.com2023-07-252026-10-07hn
A simple guide to fine-tuning Llama 2brev.dev2023-07-242026-10-07hn
Llama2.c: Inference llama 2 in one file of pure Cgithub.com2023-07-232026-10-07hn
LeCun: Qualcomm working with Meta to run Llama-2 on mobile devicestwitter.com2023-07-232026-10-07hn
Accessing Llama 2 from the command-line with the LLM-replicate pluginsimonwillison.net2023-07-182026-10-07hn
Llama 2ai.meta.com2023-07-182026-10-07hn

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:41 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:13 UTC · Last verified 2026-10-25

Follow Llama-2-7b-chat-hf

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.