Llama-2-7b-chat-hf

meta-llama Llama 2 Community License out 3 years ago

6.74B parameters, text in, text out.

Verified 2026-10-25 Rank #107 in LLMs · score 98.5 method v1 Sources 3 Downloads 30d 119.1k · #298 of 619 tracked

Can I run it?4.0GB at INT4Estimatefits a 16 GB cardmethodCommunity: Llama 2 7B Chat Hf by meta-llama — VRAM 13.5GB, 4K context | LLM Explorer →

Can I use it?Llama 2 Community LicenseAttribution; >700M MAU clause; acceptable-use policylicence file2026-10-24

Do people use it?119.1kdownloads, 30 days#298 of 619 we track · top 48%+13 likes, downloads −47% this week4,919 likesHugging Face2026-10-24

Worth reading

Picked by rule from 37 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 955 HN pts

Fine-tune your own Llama 2 to replace GPT-3.5/4

Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set.

news.ycombinator.com 2023-09-12 955 HN pts · 181 comments 10k words about the Llama 2 family family

Latest · 3 years ago

Run Llama 2 uncensored locally

The uncensored model provides a specific recipe for dangerously spicy mayo including ingredients like cayenne pepper and paprika.
The uncensored model describes the manufacturing process for Tylenol by combining paracetamol with aspirin, caffeine, and diphenhydramine.

ollama.ai 2023-08-02 722 HN pts · 212 comments 1.3k words about the Llama 2 family family

25 best of 37 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

ArticleLlama 2ai.meta.com · 2023-07-18 · 2,268 HN pts · official
CodeLlama2.c: Inference llama 2 in one file of pure Cgithub.com · 2023-07-23 · 707 HN pts
CodeShow HN: Khoj – Chat offline with your second brain using Llama 2github.com · 2023-07-30 · 565 HN pts
CodeM2 Ultra can run 128 streams of Llama 2 7B in parallelgithub.com · 2023-10-11 · 268 HN pts
ArticleGuide to running Llama 2 locallyreplicate.com · 2023-07-25 · 683 HN pts
ArticleAccessing Llama 2 from the command-line with the LLM-replicate pluginsimonwillison.net · 2023-07-18 · 200 HN pts
ArticleUnderstanding Llama 2 and the New Code Llama LLMsmagazine.sebastianraschka.com · 2023-08-30 · 170 HN pts
CodeLlama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2github.com · 2023-10-05 · 320 HN pts
CodeShow HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2github.com · 2023-08-16
PaperLlama 2 Longarxiv.org · 2023-09-29
CodeLlama 2 on ONNX runs locallygithub.com · 2023-08-10
PaperLlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAsarxiv.org · 2024-09-27
ArticleLLaMA2 Chat 70B outperformed ChatGPTtatsu-lab.github.io · 2023-07-27
ArticleFast and Portable Llama2 Inference on the Heterogeneous Edgesecondstate.io · 2023-11-13
ArticleJetMoE: Reaching LLaMA2 performance with 0.1M dollarsresearch.myshell.ai · 2024-04-04
CodeShow HN: Llama2 Embeddings FastAPI Servergithub.com · 2023-08-15
ArticleFine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Modelsanyscale.com · 2023-08-11
ArticleA simple guide to fine-tuning Llama 2brev.dev · 2023-07-24
ArticleWhat's new in Llama 2 and how to run it locallyagi-sphere.com · 2023-08-06
DiscussionLeCun: Qualcomm working with Meta to run Llama-2 on mobile devicestwitter.com · 2023-07-23
ArticleLoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70Blesswrong.com · 2023-10-13
ArticleFast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparseneuralmagic.com · 2023-11-23
DiscussionVicuna v1.5 series, featuring 4K and 16K context, based on Llama 2twitter.com · 2023-08-03

Show all 23

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 103 quantized builds and 100 Spaces.

As a service0no API provider listed
On own hardware103quantized builds
Built on1,958744 fine-tunes · 1,209 adapters · 5 merges
In apps100+Hugging Face Spaces

Top Spaces running it: IndexTeam/IndexTTS-2-Demo ♥ 849 · pliny-the-prompter/obliteratus ♥ 621 · fffiloni/Image-to-Story ♥ 611 · Plachta/Seed-VC ♥ 550

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.0 GB at INT4, 8.1 GB at FP8, 16 GB at BF16: weights only, so leave room for the KV cache.

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 0 repo commits so far

Teal is the weights (2023-07-13), amber triangles are 10 dated articles (each links to it).

What people built on it

2,061 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

2,061 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

GGUF TheBloke/Llama-2-7B-Chat-GGUF for llama.cpp, Ollama, LM Studio 3.4M downloads GPTQ TheBloke/Llama-2-7B-Chat-GPTQ for vLLM, SGLang 3.1M downloads

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in LLMs

Facts

Llama-2-7b-chat-hf has 6.74B parameters. (safetensors metadata, observed 2026-10-24)
License: Llama 2 Community License (friction: attribution). Attribution; >700M MAU clause; acceptable-use policy. (license file, observed 2026-10-24)
Created 2023-07-13, last modified 2024-04-17. (HF API, observed 2026-10-24)
Access is gated on Hugging Face (manual). (HF API, observed 2026-10-24)

Pipeline tag	text-generation
Library	transformers
Architectures	LlamaForCausalLM
Model type	llama
Params by dtype	F16: 6,738,417,664
Size band	M
MoE	no
Gated	manual
Papers	arXiv:2307.09288
License	Llama 2 Community License (llama2)
Hub snapshot	2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-2-7b-chat-hf: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)	16 GB · Single GPU (<24 GB)
FP8 (1 byte/param)	8.1 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)	4.0 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: meta-llama/Llama-2 2,061 derivatives on the Hub

quantized: 103finetune: 744adapter: 1,209merge: 5

Top variants (40 shown, ranked by downloads)

Variant	Relation	Quant	Params	Band	License	Author	Likes	Downloads
TheBloke/Llama-2-7B-Chat-GGUF	quantized	GGUF	—	—	llama2	TheBloke	517	3.4M
TheBloke/Llama-2-7B-Chat-GPTQ	quantized	GPTQ	6.74B	M	llama2	TheBloke	267	3.1M
TheBloke/Llama-2-7B-Chat-AWQ	quantized	AWQ	6.74B	M	llama2	TheBloke	24	431.3k
TheBloke/Llama-2-7B-Chat-GGML	finetune	—	—	—	other	TheBloke	878	149.6k
mlc-ai/Llama-2-7b-chat-hf-q4f32_1-MLC	quantized	—	—	—	—	mlc-ai	2	109.8k
FinGPT/fingpt-forecaster_dow30_llama2-7b_lora	adapter	—	—	—	apache-2.0	FinGPT	157	77.9k
mlc-ai/Llama-2-7b-chat-hf-q4f16_1-MLC	quantized	—	—	—	—	mlc-ai	9	34.6k
second-state/Llama-2-7B-Chat-GGUF	quantized	GGUF	—	—	llama2	second-state	2	25.6k
ContinuousAT/Llama-2-7B-CAT	adapter	—	—	—	—	ContinuousAT	0	24.6k
MaziyarPanahi/Llama-2-7b-chat-hf-GGUF	quantized	GGUF	—	—	apache-2.0	MaziyarPanahi	0	10.1k
Atulit23/meta-llama-indian-constitution-chat	finetune	—	—	—	—	Atulit23	0	7.9k
dilip025/llama-2-7b	finetune	—	—	—	llama2	dilip025	0	7k
matrixportalx/Llama-2-7b-chat-hf-Q4_K_M-GGUF	quantized	GGUF	—	—	llama2	matrixportalx	7	5.9k
247labs/Llama-2-7b-Verse-Bot	quantized	GGUF	—	—	llama2	247labs	0	5.9k
oliverwang15/FinGPT_v32_Llama2_Sentiment_Instruction_LoRA_FT	adapter	—	—	—	—	oliverwang15	17	4.2k
5w4n/base-burmese-llm	quantized	GGUF	6.87B	M	llama2	5w4n	5	4.8k
QIAIUNCC/EYE-Llama_gqa	finetune	—	6.74B	M	mit	QIAIUNCC	2	4.6k
ifaouibadi/Llama-2-7b-Verse-Chat	quantized	GGUF	—	—	llama2	ifaouibadi	0	4k
SergeUSS/Llama-2-7B-Chat-GGUF	quantized	GGUF	—	—	llama2	SergeUSS	0	3.8k
nitinbhayana/Llama-2-7b-chat-hf-adapter-review-phrases-sentiments-v2.1	adapter	—	—	—	—	nitinbhayana	0	2.9k
aengusl/llama2-7b-sft-lora	adapter	—	—	—	llama2	aengusl	0	2.8k
vincentmin/llama-2-7b-reward-oasst1	adapter	—	—	—	—	vincentmin	1	2.7k
bineric/NorskGPT-Llama-7B-v0.1	finetune	—	6.74B	M	cc-by-nc-sa-4.0	bineric	3	2.5k
BackdoorLLM/Jailbreak_Llama2-7B_BadNets	adapter	—	—	—	mit	BackdoorLLM	0	2.5k
halflucifer/et2-experimental	quantized	GGUF	—	—	llama2	halflucifer	0	2.4k
AIRLab-POLIMI/llama-2-7b-chat-hf-btgenbot-adapter	adapter	—	—	—	—	AIRLab-POLIMI	1	2.1k
shivanikerai/Llama-2-7b-chat-hf-adapter-cat-subcat-mapping-v2.0	adapter	—	—	—	—	shivanikerai	0	2k
e-valente/Llama-2-7B-Chat-GGUF	quantized	GGUF	—	—	llama2	e-valente	1	1.8k
zhentaoyu/Llama-2-7b-chat-hf-Q4_0-GGUF	quantized	Q4_0	—	—	llama2	zhentaoyu	0	1.8k
tensorblock/Llama-2-7b-chat-hf-GGUF	quantized	GGUF	—	—	llama2	tensorblock	0	1.8k
shivanikerai/Llama-2-7b-chat-hf-adapter-brand-mapping-v2.0	adapter	—	—	—	—	shivanikerai	0	1.5k
FriendliAI/Llama-2-7b-chat-hf-fp8	finetune	-fp8	6.74B	M	llama2	FriendliAI	10	883
zhentaoyu/Llama-2-7b-chat-hf-Q4_K_S-GGUF	quantized	GGUF	—	—	llama2	zhentaoyu	0	1.3k
QIAIUNCC/EYE-Llama_qa	finetune	—	6.74B	M	mit	QIAIUNCC	0	1.2k
nitinbhayana/Llama-2-7b-chat-hf-adapter-beauty_baby_hpc_grocery_computer_kitchen	adapter	—	—	—	—	nitinbhayana	0	1.1k
therealcyberlord/llama2-qlora-finetuned-medical	adapter	—	—	—	—	therealcyberlord	5	685
Winindux/emowoz-llama2-sft	adapter	—	—	—	—	Winindux	0	921
al1231/Refiner-7B	adapter	—	—	—	mit	al1231	0	883
amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid	quantized	awq	—	—	llama2	amd	0	869
amd/Llama2-7b-chat-awq-g128-int4-asym-bf16-onnx-ryzen-strix	quantized	awq	—	—	llama2	amd	0	829

Articles and coverage

37 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

Llama 2

ai.meta.com2023-07-18officialauthorityHN front pageabout the Llama 2 familyHN 2,268 pts · 820 comments42 words

Analysis8

Llama2.c: Inference llama 2 in one file of pure C

github.com2023-07-23authorityHN front pageabout the Llama 2 familyHN 707 pts · 165 comments4,774 words

The llama2.c repository offers a 700-line pure C file for training and inferring Llama 2 models, currently supporting fp32 inference for models up to 7B parameters. Work on model quantization is currently ongoing, but the project includes a 110M parameter model trained on the TinyStories dataset.written, reviewed, cited

Models larger than 7B are unusably slow because the repo performs float32 inference.
The 13B+ model variant fails due to integer flow errors in pointer arithmetic.

Show HN: Khoj – Chat offline with your second brain using Llama 2

github.com2023-07-30authorityHN front pageabout the Llama 2 familyHN 565 pts · 150 comments218 words

Khoj is an open-source, self-hostable AI platform that lets users get answers from the web or their docs. It enables building custom agents and scheduling automations while supporting online or local LLMs like gpt, claude, gemini, llama, qwen, and mistral. Users can get started for free and contribute to the community-sustained project.written, reviewed, cited

Run Llama 2 uncensored locally

ollama.ai2023-08-02HN front pageabout the Llama 2 familyHN 722 pts · 212 comments1,251 words

Ollama enables local execution of uncensored Llama 2 variants, such as the 7B model fine-tuned using Wizard-Vicuna conversation dataset and Nous Hermes Llama 2 13B fine-tuned on over 300,000 instructions. The 13B model stands out for its long responses, lower hallucination rate, and absence of OpenAI censorship mechanisms. Users can run these models via commands like ollama run llama2-uncensored to bypass standard safety refusals.written, reviewed, cited

The uncensored model provides a specific recipe for dangerously spicy mayo including ingredients like cayenne pepper and paprika.
The uncensored model describes the manufacturing process for Tylenol by combining paracetamol with aspirin, caffeine, and diphenhydramine.

M2 Ultra can run 128 streams of Llama 2 7B in parallel

github.com2023-10-11authorityHN front pageHN 268 pts · 173 comments1,224 words

Guide to running Llama 2 locally

replicate.com2023-07-25HN front pageabout the Llama 2 familyHN 683 pts · 170 comments603 words

Accessing Llama 2 from the command-line with the LLM-replicate plugin

simonwillison.net2023-07-18authorityHN front pageabout the Llama 2 familyHN 200 pts · 43 comments1,144 words

Understanding Llama 2 and the New Code Llama LLMs

magazine.sebastianraschka.com2023-08-30authorityHN front pageabout the Llama 2 familyHN 170 pts · 34 comments4,048 words

Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2

github.com2023-10-05authorityHN front pageabout the Llama 2 familyHN 320 pts · 55 comments4,153 words

Community1

Fine-tune your own Llama 2 to replace GPT-3.5/4

news.ycombinator.com2023-09-12HN front pageabout the Llama 2 familyHN 955 pts · 181 comments10,023 words

Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set. While fine-tuning requires 1000+ examples and is less flexible than prompting, a fine-tuned Llama 7B is 50x cheaper than GPT-3.5 per token, costing just $19 to classify 2M recipes versus $23k for GPT-4.written, reviewed, cited

All coverage tracked for this model (37) — append-only, nothing is ever removed

Title	Source	Published	First seen	Signals
Llama 2 follow-up: too much RLHF, GPU sizing, technical ...	interconnects.ai	—	2026-10-07	exa
Llama 2 7B Chat Hf by meta-llama — VRAM 13.5GB, 4K context \| LLM Explorer	llm-explorer.com	—	2026-10-07	exa
Llama 2 7B Chat Hf by meta-llama	llm.extractum.io	—	2026-10-07	exa
Llama-2-7b-hf — fastest hardware by quant family — llamabench.ai	llamabench.ai	—	2026-10-07	exa
LlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAs	arxiv.org	2024-09-27	2026-10-07	hn
JetMoE: Reaching LLaMA2 performance with 0.1M dollars	research.myshell.ai	2024-04-04	2026-10-07	hn
Deep Dive into Llama 2: Architecture, Pre‑training, SF… \| BestHub	besthub.dev	2024-03-27	2026-10-07	exa
Fast Llama 2 on CPUs with Sparse Fine-Tuning and DeepSparse	neuralmagic.com	2023-11-23	2026-10-07	hn
Fast and Portable Llama2 Inference on the Heterogeneous Edge	secondstate.io	2023-11-13	2026-10-07	hn
LoRA Fine-Tuning Efficiently Undoes Safety Training from Llama 2-Chat 70B	lesswrong.com	2023-10-13	2026-10-07	hn
M2 Ultra can run 128 streams of Llama 2 7B in parallel	github.com	2023-10-11	2026-10-07	hn
Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2	github.com	2023-10-05	2026-10-07	hn
Llama 2 Long	arxiv.org	2023-09-29	2026-10-07	hn
Fine-tune your own Llama 2 to replace GPT-3.5/4	news.ycombinator.com	2023-09-12	2026-10-07	hn
LLAMA 2 Model Benchmarks: Insights for Performance Evaluation	truefoundry.com	2023-09-12	2026-10-07	exa
Understanding Llama 2 and the New Code Llama LLMs	magazine.sebastianraschka.com	2023-08-30	2026-10-07	hn
Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper	anyscale.com	2023-08-29	2026-10-07	hn
WebLLM: Llama2 in the Browser	webllm.mlc.ai	2023-08-29	2026-10-07	hn
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2	github.com	2023-08-16	2026-10-07	hn
Show HN: Llama2 Embeddings FastAPI Server	github.com	2023-08-15	2026-10-07	hn
Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models	anyscale.com	2023-08-11	2026-10-07	hn
Llama 2 on ONNX runs locally	github.com	2023-08-10	2026-10-07	hn
What's new in Llama 2 and how to run it locally	agi-sphere.com	2023-08-06	2026-10-07	hn
Vicuna v1.5 series, featuring 4K and 16K context, based on Llama 2	twitter.com	2023-08-03	2026-10-07	hn
Cookbook: Finetuning Llama 2 in your own cloud environment, privately	blog.skypilot.co	2023-08-02	2026-10-07	hn
Run Llama 2 uncensored locally	ollama.ai	2023-08-02	2026-10-07	hn
Show HN: Khoj – Chat offline with your second brain using Llama 2	github.com	2023-07-30	2026-10-07	hn
Understanding LLaMA-2 Architecture & its Ginormous Impact on GenAI \| by Kunal Sawarkar \| Towards Generative AI \| Medium	medium.com	2023-07-29	2026-10-07	exa
LLaMA2 Chat 70B outperformed ChatGPT	tatsu-lab.github.io	2023-07-27	2026-10-07	hn
Guide to running Llama 2 locally	replicate.com	2023-07-25	2026-10-07	hn
A simple guide to fine-tuning Llama 2	brev.dev	2023-07-24	2026-10-07	hn
Llama2.c: Inference llama 2 in one file of pure C	github.com	2023-07-23	2026-10-07	hn
LeCun: Qualcomm working with Meta to run Llama-2 on mobile devices	twitter.com	2023-07-23	2026-10-07	hn
Paper Review: Llama 2: Open Foundation and Fine-Tuned Chat Models – Andrey Lukyanenko	andlukyane.com	2023-07-20	2026-10-07	exa
Llama 2: Open Foundation and Fine-Tuned Chat Models	arxiv.org	2023-07-19	2026-10-07	exa
Accessing Llama 2 from the command-line with the LLM-replicate plugin	simonwillison.net	2023-07-18	2026-10-07	hn
Llama 2	ai.meta.com official	2023-07-18	2026-10-07	hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Llama 2: Open Foundation and Fine-Tuned Chat Models this model

Hugo Touvron, Louis Martin, Kevin Stone +65 · 2023-07-18 · PDF · HF paper page (252 upvotes)

Similar models

3 models

Similar models

Llama-3.1-8B-Instruct · 8.03B
same size band (M), same task (text-generation), more providers
Qwen2.5-7B-Instruct · 7.62B
same size band (M), same task (text-generation), more providers, permissive license
Mistral-7B-Instruct-v0.2 · 7.24B
same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:34 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:01 UTC · Last verified 2026-10-25

Follow Llama-2-7b-chat-hf

Watch this model

/feeds/models/meta-llama--Llama-2-7b-chat-hf.xml(RSS 2.0) · every change to Llama-2-7b-chat-hf
/feeds/families/meta-llama--Llama-2.xml(RSS 2.0) · every change across the Llama-2 family

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.