Models › CodeLlama family

codellama Llama 2 Community License out 3 years ago

6.74B parameters, text in, text out, 16K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #496 in LLMs · score 76.6 method v1 Sources 3 Downloads 30d 334.8k · #207 of 619 tracked

Can I run it?4.0GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Llama 2 Community LicenseAttribution; >700M MAU clause; acceptable-use policylicence file2026-10-24
Do people use it?334.8kdownloads, 30 days#207 of 619 we track · top 33%+0 likes, downloads −10% this week379 likesHugging Face2026-10-24

Worth reading

Picked by rule from 12 tracked pieces: the lab's own post, the most shared, a field report, the latest.

12 best of 12 tracked

The 2 picks above, plus these 10. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleBeating GPT-4 on HumanEval with a fine-tuned CodeLlama-34Bphind.com · 2023-08-25
  2. CodeSlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantizationgithub.com · 2023-10-06 · 156 HN pts
  3. ArticleShow HN: Open Interpreter – CodeLlama in your terminal, executing codeopeninterpreter.com · 2023-08-30 · 82 HN pts
  4. ArticleShow HN: I built local copilot alternative using Codellamamarketplace.visualstudio.com · 2023-11-21 · 38 HN pts
  5. CodeRun CodeLlama on a Serverless GPUgithub.com · 2023-08-27 · 3 HN pts
  6. DiscussionM2 Ultra runs codellama 34B F16 at 150 token per secondtwitter.com · 2023-10-12
  7. CodeLocal terminal companion, powered by CodeLLaMagithub.com · 2024-02-28 · 2 HN pts
  8. DiscussionMergeLlama-7B – A fine tune of CodeLlama for resolving merge conflictsold.reddit.com · 2024-10-05 · 3 HN pts
  9. ArticleCodeGemma vs. CodeLlamamsty.app · 2024-04-16 · 2 HN pts
  10. DiscussionI just said "what" to CodeLlamatwitter.com · 2024-01-31 · 2 HN pts

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 41 quantized builds for local use; a big base for builders (634 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware41quantized builds
  • Built on63479 fine-tunes · 549 adapters · 6 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: Vokturz/can-it-run-llm ♥ 1,053 · KBaba7/Quant ♥ 51 · EvanTHU/MotionLLM ♥ 43 · FallnAI/Quantize-HF-Models ♥ 19

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.0 GB at INT4, 8.1 GB at FP8, 16 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.0 GB of weights (estimate; KV cache and activations extra)INT44.0 GBFP8: about 8.1 GB of weights (estimate; KV cache and activations extra)FP88.1 GBBF16: about 16 GB of weights (estimate; KV cache and activations extra)BF1616 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.0 GB of weights (estimate; KV cache and activations extra)INT44.0 GBFP8: about 8.1 GB of weights (estimate; KV cache and activations extra)FP88.1 GBBF16: about 16 GB of weights (estimate; KV cache and activations extra)BF1616 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 26 repo commits so far

Teal is the weights (2023-08-24), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

675 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

675 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

41 quantized (Hugging Face model tree)79 fine-tunes (Hugging Face model tree)6 merges (Hugging Face model tree)549 adapters (Hugging Face model tree)41 quantized79 fine-tunes6 merges549 adapters
41 quantized (Hugging Face model tree)79 fine-tunes (Hugging Face model tree)6 merges (Hugging Face model tree)549 adapters (Hugging Face model tree)41 quantized79 fine-tunes6 merges549 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Dtypebfloat16
Params by dtypeBF16: 6,738,546,688
Size bandM
MoEno
Context length16,384 (config.json max_position_embeddings)
Languagescode
PapersarXiv:2308.12950
LicenseLlama 2 Community License (llama2)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for CodeLlama-7b-hf: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)16 GB · Single GPU (<24 GB)
FP8 (1 byte/param)8.1 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.0 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: codellama/CodeLlama 675 derivatives on the Hub

quantized: 41adapter: 549finetune: 79merge: 6

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
TheBloke/CodeLlama-7B-GGUF quantized GGUF — — llama2 TheBloke 135 206.9k
TheBloke/CodeLlama-7B-GPTQ quantized GPTQ 6.74B M llama2 TheBloke 14 20.7k
mradermacher/CodeLlama-7b-hf-i1-GGUF quantized GGUF — — llama2 mradermacher 0 14.4k
QuantFactory/MathCoder2-CodeLlama-7B-GGUF quantized GGUF — — apache-2.0 QuantFactory 2 6k
mradermacher/CodeLlama-7b-hf-GGUF quantized GGUF — — llama2 mradermacher 0 5.7k
TheBloke/CodeLlama-7B-AWQ quantized AWQ 6.74B M llama2 TheBloke 6 5k
QuantFactory/CodeLlama-7b-hf-GGUF quantized GGUF — — — QuantFactory 0 3.9k
pranav-pvnn/codellama-7b-python-ai-assistant-full-gguf quantized gguf — — llama2 pranav-pvnn 3 2.7k
monsterapi/codellama7b_codealpaca20k adapter — — — — monsterapi 2 2.6k
TheBloke/CodeLlama-7B-GGML finetune — — — llama2 TheBloke 27 860
allenai/codetulu-2-7b finetune — — — — allenai 1 1.3k
Junjie-Ye/TL-CodeLLaMA-2 finetune — — — apache-2.0 Junjie-Ye 1 1.1k
facebook/layerskip-codellama-7B finetune — 6.74B M other facebook 6 809
aravind-kesiraju/codellama-7b-hf-sql adapter — 6.85B M — aravind-kesiraju 0 978
alphahg/CodeLlama-7b-hf-rust-finetune-GGUF quantized GGUF — — llama2 alphahg 0 863
MathGenie/MathCoder2-CodeLlama-7B finetune — 6.74B M apache-2.0 MathGenie 5 597
codys12/MergeLlama-7b adapter — — — llama2 codys12 2 668
mlx-community/CodeLlama-7b-hf-4bit-mlx quantized -4bit 6.74B M llama2 mlx-community 0 636
philschmid/code-llama-7b-text-to-sql adapter — — — llama2 philschmid 4 377
maximuslee07/code-llama-7b-text-to-sql adapter — 6.74B M llama2 maximuslee07 0 553
monsterapi/codellama_7b_DolphinCoder adapter — — — apache-2.0 monsterapi 0 528
codersan/Enlighten_CodeCompletion adapter — — — — codersan 7 103
alphahg/CodeLlama-7b-hf-rust-finetune finetune — — — llama2 alphahg 1 399
shumi2011/vtb_codeV1_7b adapter GGUF 6.74B M — shumi2011 1 392
HARRY07979/CodeLlama-7b-hf-Q4_K_M-GGUF quantized GGUF — — llama2 HARRY07979 0 437
medxiaorudan/CodeLlama_CPP_FineTuned adapter — — — llama2 medxiaorudan 2 311
BohdanPetryshyn/codellama-7b-openapi-completion-ctx-lvl-fim-no-spm-inf-seq-a-32 adapter — — — llama2 BohdanPetryshyn 6 49
liodon-ai/CodeLlama-7b-hf-imatrix-GGUF quantized imatrix — — other liodon-ai 0 340
KonstantinKislov/CodeLlama_adapter_for_solving_the_problem_of_increasing_the_readability_of_decompiled_C_code adapter — — — — KonstantinKislov 3 185
liodon-ai/CodeLlama-7b-hf-ONNX quantized — — — other liodon-ai 0 292
PopularPenguin/CodeLlama-TextToSparql adapter — — — llama2 PopularPenguin 0 290
swordfish7412/Amigo_1.0 adapter — — — mit swordfish7412 2 174
SillyTilly/CodeLLama-7b-Poison-reup finetune — 6.74B M llama2 SillyTilly 1 222
ABerlanga/code-llama-7b-text-to-sql adapter — — — llama2 ABerlanga 2 165
ken123777/codellama-7b-code-review-v1 finetune — 6.74B M mit ken123777 1 214
choprahetarth/CodeLLaMa-SLERP merge — 6.74B M — choprahetarth 0 261
dhuynh95/EvilCodeLlama-7b adapter — 2.70B M llama2 dhuynh95 1 206
HARRY07979/CodeLlama-7b-hf-IQ4_NL-GGUF quantized GGUF — — llama2 HARRY07979 0 251
noeloco/modeltest1 adapter — — — llama2 noeloco 0 242
gair-prox/CodeLlama-7B-ProXMath finetune — — — llama2 gair-prox 1 185

Repository changelog

26 commits

Repository changelog 26 commits

DateCommitSHA
2024-04-12 Update README.md 6c284d1
2024-01-29 Update README.md 7f22f0a
2023-10-27 Fix link to responsible use guide (#20) bc52832
2023-08-28 Update README.md 3773f63
2023-08-28 delete unused checkpoints (#12) a6a8170
2023-08-28 Upload LlamaForCausalLM ab8c802
2023-08-28 CodeLlamaTokenizer (#11) 0b6e5ef
2023-08-25 Model capabilities (#9) 533ac5f
2023-08-25 Install transformers from main (#8) 82ad5cd
2023-08-25 use 6 shards instead of 2 be52f4a
2023-08-25 Adding `safetensors` variant of this model (#5) 0d6f9ee
2023-08-25 Update README.md 7571482
2023-08-25 Fix 13b and 34b instruct links, small typo (#2) 4a90c02
2023-08-24 Upload 2 files 31eddd0
2023-08-24 Update README.md 304c992
2023-08-24 Update README.md b9a2245
2023-08-24 Update README.md f274875
2023-08-24 add model weights ba606a6
2023-08-24 Update README.md aa112c5
2023-08-24 Update README.md 7202730
2023-08-24 Update README.md b0ef4a0
2023-08-24 Update README.md 8a68eed
2023-08-24 Update README.md 485cb6c
2023-08-24 Update README.md 7e58ad0
2023-08-24 Create README.md bca487f
2023-08-24 initial commit 7d63311

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for CodeLlama-7b-hf, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
codellama/CodeLlama-7b-hf — — — — — — — live 2026-10-25

Articles and coverage

12 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis8

github.com2023-10-06authorityHN front pageabout the CodeLlama familyHN 156 pts · 54 comments2,820 words
slowllama enables finetuning Llama2 and CodeLLama models up to 70B parameters on consumer hardware like MacBook Air or nVidia GPUs without quantization. The tool uses LoRA to limit updates and offloads transformer blocks to SSD, running on Apple M1 with 16Gb memory or M2 with 24Gb memory. Full finetuning is disabled to prevent SSD degradation, as full 70B updates require ~150Gb writes per iteration with AdamW. Engineers must accept long runtimes for non-interactive training.written, reviewed, cited
  • The project stores original 140Gb weights on a slower external SD card to free internal SSD space for sequential format weights.
  • Training requires running the forward pass twice to cache inputs on SSD before performing manual backward gradient propagation.
  • LoRA weights remain on RAM or GPU and are never offloaded to disk during the training process.
continue.dev2023-08-24HN front pageabout the CodeLlama familyHN 187 pts · 52 comments
openinterpreter.com2023-08-30about the CodeLlama familyHN 82 pts · 21 comments632 words
Open Interpreter is a terminal-based coding agent optimized for low-cost and open-weight models with model-specific harnesses for Kimi, Qwen, and DeepSeek. It runs inside an OS-level sandbox on macOS, Linux, and Windows where network access is gated by default. The project is open source under the Apache 2.0 License, and requests to hosted models are logged for up to 30 days.written, reviewed, cited
  • Open Interpreter inherits existing agent setups including AGENTS.md instructions, skills, and MCP servers from its Codex fork.
  • Network access remains disabled in permission profiles unless the user explicitly enables it within the sandbox configuration.
  • Users can run multiple concurrent coding sessions by using shell commands like interpreter resume or interpreter fork.
marketplace.visualstudio.com2023-11-21about the CodeLlama familyHN 38 pts · 6 comments514 words
Llama Coder is a self-hosted VS Code extension that replaces GitHub Copilot using Ollama and Codellama models. It works best with Mac M1/M2/M3 or with RTX 4090 hardware, and allows offloading to a dedicated machine via Ollama endpoint configuration. The extension recommends q4 quantization as optimal, with the 34b model requiring up to 32GB of RAM for operation.written, reviewed, cited
facebook.com2024-01-29about the CodeLlama familyHN 8 pts · 2 comments
github.com2023-08-27authorityabout the CodeLlama familyHN 3 pts · 0 comments140 words
github.com2024-02-28authorityabout the CodeLlama familyHN 2 pts · 0 comments635 words
msty.app2024-04-16about the CodeLlama familyHN 2 pts · 0 comments

Community2

old.reddit.com2024-10-05about the CodeLlama familyHN 3 pts · 0 comments
twitter.com2024-01-31about the CodeLlama familyHN 2 pts · 0 comments
All coverage tracked for this model (12) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
MergeLlama-7B – A fine tune of CodeLlama for resolving merge conflictsold.reddit.com2024-10-052026-10-07hn
CodeGemma vs. CodeLlamamsty.app2024-04-162026-10-07hn
Local terminal companion, powered by CodeLLaMagithub.com2024-02-282026-10-07hn
I just said "what" to CodeLlamatwitter.com2024-01-312026-10-07hn
Meta is releasing a new CodeLlamafacebook.com2024-01-292026-10-07hn
Show HN: I built local copilot alternative using Codellamamarketplace.visualstudio.com2023-11-212026-10-07hn
M2 Ultra runs codellama 34B F16 at 150 token per secondtwitter.com2023-10-122026-10-07hn
SlowLlama: Finetune llama2-70B and codellama on MacBook Air without quantizationgithub.com2023-10-062026-10-07hn
Show HN: Open Interpreter – CodeLlama in your terminal, executing codeopeninterpreter.com2023-08-302026-10-07hn
Run CodeLlama on a Serverless GPUgithub.com2023-08-272026-10-07hn
Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34Bphind.com2023-08-252026-10-07hn
Show HN: Use Code Llama as Drop-In Replacement for Copilot Chatcontinue.dev2023-08-242026-10-07hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:39 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:10 UTC · Last verified 2026-10-25

Follow CodeLlama-7b-hf

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.