Models › Llama family

Llama-xLAM-2-8b-fc-r

Salesforce CC BY-NC 4.0 out 19 months ago

8.03B parameters, text in, text out, 128K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #572 in LLMs · score 74.5 method v1 Sources 3 Downloads 30d 91.9k · #321 of 619 tracked

Can I run it?4.8GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?CC BY-NC 4.0Non-commercial only; commercial hosting not permitted without a separate licenselicence file2026-10-24
Does it work?46.68on BFCL#8 of 28 measuredleaderboard2026-10-25
Do people use it?91.9kdownloads, 30 days#321 of 619 we track · below the median+2 likes, downloads −7% this week66 likesHugging Face2026-10-24

Worth reading

Picked by rule from 13 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 1,311 HN pts

Llama.cpp 30B runs with only 6GB of RAM now

llama.cpp introduces a new file format enabling memory mapping for model weights, resulting in loading speeds 10 to 100 times faster.

  • The new format merges multi-file models like LLaMA 13B into a single file to prevent C++ code from reshaping data during loading.
github.com 2023-03-31 1,311 HN pts · 414 comments 989 words about the Llama family family
Latest · 2 years ago

Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

Meta releases Llama 3.2, featuring small and medium-sized vision LLMs (11B and 90B) alongside lightweight text-only models (1B and 3B) designed for edge and mobile devices.

  • The 11B and 90B vision models require an entirely new model architecture that supports image reasoning.
  • Developers can keep all text-only capabilities intact because the adapter training intentionally did not update the language-model parameters.
ai.meta.com 2024-09-25 924 HN pts · 328 comments 2.5k words about the Llama family family

13 best of 13 tracked

The 2 picks above, plus these 11. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleCode Llama, a state-of-the-art large language model for codingai.meta.com · 2023-08-24 · 970 HN pts
  2. ArticleThe LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPTthesequence.substack.com · 2023-04-09 · 791 HN pts
  3. CodeLlama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon supportgithub.com · 2023-03-10 · 989 HN pts
  4. CodeGpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMagithub.com · 2023-03-28 · 593 HN pts
  5. CodeRun Llama 13B with a 6GB graphics cardgist.github.com · 2023-05-14
  6. CodeLlama2.c: Inference llama 2 in one file of pure Cgithub.com · 2023-07-23 · 707 HN pts
  7. CodeShow HN: I built a free in-browser Llama 3 chatbot powered by WebGPUgithub.com · 2024-05-03 · 547 HN pts
  8. DiscussionFine-tune your own Llama 2 to replace GPT-3.5/4news.ycombinator.com · 2023-09-12 · 955 HN pts
  9. DiscussionMeta AI releases Code Llama 70Btwitter.com · 2024-01-29
  10. ArticleRun Llama 2 uncensored locallyollama.ai · 2023-08-02 · 722 HN pts
  11. ArticleLlama.ttf: A font which is also an LLMfuglede.github.io · 2024-06-23

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 9 quantized builds for local use; a big base for builders (111 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware9quantized builds
  • Built on1117 fine-tunes · 100 adapters · 4 merges
  • In apps1Hugging Face Spaces

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.8 GB at INT4, 9.6 GB at FP8, 19 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.8 GB of weights (estimate; KV cache and activations extra)INT44.8 GBFP8: about 9.6 GB of weights (estimate; KV cache and activations extra)FP89.6 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.8 GB of weights (estimate; KV cache and activations extra)INT44.8 GBFP8: about 9.6 GB of weights (estimate; KV cache and activations extra)FP89.6 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB

Estimate params × bytes per param × 1.2 · how we estimate

How it scores

Third-party measurements only; author-reported numbers stay in Reference, marked as such.

#8 of 28 on BFCL so far

46.68. Each tick is a model on this site with a measured BFCL row; author-reported numbers stay in Reference. Percent (overall accuracy). FC

zai-org/GLM-4.6: 72.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmoonshotai/Kimi-K2-Instruct: 59.06 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmldeepseek-ai/DeepSeek-V3.2-Exp: 54.12 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 52.15 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 48.71 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 47.99 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 46.78 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 42.57 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 41.39 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 41.03 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 40.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 37.77 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 36.7 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.68 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.52 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.3-70B-Instruct: 31.9 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-12b-it: 30.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-27b-it: 29.47 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmicrosoft/phi-4: 28.79 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-1.7B: 28.41 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-4-Scout-17B-16E-Instruct: 28.13 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.1-8B-Instruct: 25.83 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 23.93 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 22.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.2-3B-Instruct: 21.95 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-4b-it: 19.62 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-1b-it: 7.17 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.html010046.68 · #8 of 28
zai-org/GLM-4.6: 72.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmoonshotai/Kimi-K2-Instruct: 59.06 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmldeepseek-ai/DeepSeek-V3.2-Exp: 54.12 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 52.15 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 48.71 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-235B-A22B-Instruct-2507: 47.99 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-32B: 46.78 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 42.57 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 41.39 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 41.03 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-8B: 40.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-14B: 37.77 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-30B-A3B-Instruct-2507: 36.7 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.68 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-4B-Instruct-2507: 35.52 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.3-70B-Instruct: 31.9 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-12b-it: 30.43 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-27b-it: 29.47 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmicrosoft/phi-4: 28.79 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-1.7B: 28.41 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-4-Scout-17B-16E-Instruct: 28.13 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.1-8B-Instruct: 25.83 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 23.93 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlQwen/Qwen3-0.6B: 22.38 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlmeta-llama/Llama-3.2-3B-Instruct: 21.95 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-4b-it: 19.62 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.htmlgoogle/gemma-3-1b-it: 7.17 · observed 2026-10-25 · https://gorilla.cs.berkeley.edu/leaderboard.html010046.68 · #8 of 28

Source · leaderboard · 2026-10-25

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-03-27), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

120 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

120 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

9 quantized (Hugging Face model tree)7 fine-tunes (Hugging Face model tree)4 merges (Hugging Face model tree)100 adapters (Hugging Face model tree)9 quantized7 fine-tunes4 merges100 adapters
9 quantized (Hugging Face model tree)7 fine-tunes (Hugging Face model tree)4 merges (Hugging Face model tree)100 adapters (Hugging Face model tree)9 quantized7 fine-tunes4 merges100 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

2 rows

Benchmarks 2 rows

measured third-party leaderboard row (1)author-reported number from the model card or eval files (1)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
measured BFCL · Call tools and APIs46.68 percent (overall accuracy)FC
5 sub-scores
  • Non-Live AST Acc: 84.58
  • Live Acc: 67.95
  • Multi Turn Acc: 70
  • Web Search Acc: 6.5
  • Memory Acc: 13.98
leaderboard2026-10-25
author-reported τ-bench56.2% percentxLAM-2-70b-fc-rmodel author2026-10-07

What the card says

1 cited sentence

Summary generated, cited

The model is designed for multi-turn conversation and function-calling, and it is released under a CC BY-NC 4.0 license.[1][2]

  1. “Multi-turn Conversation, Function-calling”
  2. license

Generated 2026-10-07 15:14 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Dtypebfloat16
Params by dtypeBF16: 8,030,261,248
Size bandM
MoEno
Context length131,072 (config.json max_position_embeddings)
Languagesen
PapersarXiv:2504.03601, arXiv:2503.22673, arXiv:2409.03215, arXiv:2402.15506
LicenseCC BY-NC 4.0 (cc-by-nc-4.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Llama-xLAM-2-8b-fc-r: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)19 GB · Single GPU (<24 GB)
FP8 (1 byte/param)9.6 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.8 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: Salesforce/Llama 120 derivatives on the Hub

quantized: 9finetune: 7merge: 4adapter: 100

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
eaddario/Llama-xLAM-2-8b-fc-r-GGUF quantized GGUF — — cc-by-nc-4.0 eaddario 1 6k
DevQuasar-13/Salesforce.Llama-xLAM-2-8b-fc-r-GGUF quantized GGUF — — — DevQuasar-13 2 4.1k
neural-coder/xlam-finetuned-1 finetune — 8.03B M apache-2.0 neural-coder 0 3.7k
neural-coder/xlam-finetuned finetune — 8.03B M apache-2.0 neural-coder 1 3.1k
tensorblock/Salesforce_Llama-xLAM-2-8b-fc-r-GGUF quantized GGUF — — cc-by-nc-4.0 tensorblock 0 2.7k
mxmcc/Llama-xLAM-2-8b-fc-r-mlx-8Bit quantized mlx 8.03B M cc-by-nc-4.0 mxmcc 1 556
AtAndDev/UVOX-xLAM-2-8B finetune — 687M S mit AtAndDev 0 410
sunkencity/xLAM-GGUF quantized GGUF — — llama3.1 sunkencity 0 409
lwa201/Llama-xLAM-2-8b-fc-r-dpo-prune finetune — 8.03B M llama3.1 lwa201 0 236
yard/Llama-xLAM-2-8b-fc-r-Q4_K_M-GGUF quantized GGUF — — cc-by-nc-4.0 yard 0 209
AtAndDev/Magpie-xLAM-Supernova-8B merge — 8.03B M — AtAndDev 1 154
barretts/Llama-xLAM-2-8b-fc-r-slerp-attn_focus-Instruct merge — 8.03B M — barretts 0 161
sberryman/Llama-xLAM-2-8b-fc-r-Q4_K_M-GGUF quantized GGUF — — cc-by-nc-4.0 sberryman 0 121
neural-coder/finetuned-4 finetune — 8.03B M apache-2.0 neural-coder 0 108
barretts/Llama-xLAM-2-8b-fc-r-dare_ties-Instruct merge — 8.03B M — barretts 0 104
pasan1992/Llama-xLAM-2-8b-fc-r-Q4_K_M-GGUF quantized GGUF — — cc-by-nc-4.0 pasan1992 0 101
neural-coder/finetuned-irrelevant-1 finetune — 8.03B M other neural-coder 0 95
jkutchi/Llama-xLAM-2-8b-fc-r-Q4_K_M-GGUF quantized GGUF — — cc-by-nc-4.0 jkutchi 0 83
a3ilab-llm-uncertainty/zhtw_multi_only_gradient_accumulate32 adapter — — — — a3ilab-llm-uncertainty 0 83
a3ilab-llm-uncertainty/new_2560_3_epoch_xlam_apigen adapter — — — — a3ilab-llm-uncertainty 0 77
a3ilab-llm-uncertainty/multi1500_gradient_accumulate32_test2 adapter — — — — a3ilab-llm-uncertainty 0 76
a3ilab-llm-uncertainty/new_768_3_epoch_xlam_apigen adapter — — — — a3ilab-llm-uncertainty 0 73
neural-coder/finetuned-2 finetune — 8.03B M apache-2.0 neural-coder 0 72
a3ilab-llm-uncertainty/new_2560_1_epoch_xlam_apigen adapter — — — — a3ilab-llm-uncertainty 0 63
a3ilab-llm-uncertainty/xlam_8b_2048_with_FC_dataset adapter — — — — a3ilab-llm-uncertainty 0 60
a3ilab-llm-uncertainty/multi_eng_zhtw_and_apigen adapter — — — — a3ilab-llm-uncertainty 0 60
barretts/Llama-xLAM-2-8b-fc-r-slerp-Instruct merge — 8.03B M — barretts 0 58
a3ilab-llm-uncertainty/new_2560_3_epoch_xlam_all adapter — — — — a3ilab-llm-uncertainty 0 58
a3ilab-llm-uncertainty/xlam_8b_2048_with_FC_dataset_fix adapter — — — — a3ilab-llm-uncertainty 0 57
a3ilab-llm-uncertainty/xlam_8b_768_with_apigen adapter — — — — a3ilab-llm-uncertainty 0 56
a3ilab-llm-uncertainty/new_1024_2batch_3_epoch_xlam_apigen adapter — — — — a3ilab-llm-uncertainty 0 56
a3ilab-llm-uncertainty/xlam_lora_new_2560_1_3epoch_multi_all_nomlp adapter — — — — a3ilab-llm-uncertainty 0 54
a3ilab-llm-uncertainty/xlam_toolonlyloss_5ep_lr1e-5_r16a32 adapter — — — — a3ilab-llm-uncertainty 0 53
a3ilab-llm-uncertainty/xlam_1epoch_pythonic_turn5e-6_new adapter — — — — a3ilab-llm-uncertainty 0 47
a3ilab-llm-uncertainty/new_2560_3_epoch_xlam_apigen_without_mlp adapter — — — — a3ilab-llm-uncertainty 0 45
a3ilab-llm-uncertainty/xlam_8B_pythonic_zhtw_lr1e-5_ep1 adapter — — — other a3ilab-llm-uncertainty 0 45
a3ilab-llm-uncertainty/xlam_6epoch_bfcl_turn5e-6_fix_length_new adapter — — — — a3ilab-llm-uncertainty 0 44
a3ilab-llm-uncertainty/xlam_3epoch_all_only_zhtw adapter — — — — a3ilab-llm-uncertainty 0 43
a3ilab-llm-uncertainty/xlam_8B_pythonic_zhtw_lr5e-7_ep1_16_64 adapter — — — other a3ilab-llm-uncertainty 0 43
a3ilab-llm-uncertainty/xlam_lora_new_2560_1_3epoch_multi_4000_nomlp adapter — — — — a3ilab-llm-uncertainty 0 41

Repository changelog

10 commits

Repository changelog 10 commits

DateCommitSHA
2025-05-06 Update README.md a0efe39
2025-04-17 Update README.md d10ff96
2025-04-16 Upload xlam_tool_call_parser.py f7979db
2025-04-15 Update README.md bf1a808
2025-04-09 Upload folder using huggingface_hub 7e882f1
2025-04-07 Upload folder using huggingface_hub 519ce26
2025-04-07 Update README.md b3f01d2
2025-04-04 Create README.md 4ea6251
2025-03-28 Upload folder using huggingface_hub 8cf1707
2025-03-27 initial commit b7280b5

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Llama-xLAM-2-8b-fc-r, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
Salesforce/Llama-xLAM-2-8b-fc-r — — — — — — — live 2026-10-25

Articles and coverage

13 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official2

ai.meta.com2023-08-24authorityHN front pageabout the Llama familyHN 970 pts · 501 comments1,460 words
Meta released Code Llama, a code-specialized large language model built on Llama 2 that is free for research and commercial use. The family includes four sizes with 7B, 13B, 34B, and 70B parameters, trained on 500B tokens of code data (1T for the 70B model) and supporting up to 100,000 tokens of context. Benchmark testing showed Code Llama 34B scored 53.7% on HumanEval and 56.2% on MBPP, outperforming other open-source solutions.written, reviewed, cited
  • Code Llama - Python is a language-specialized variation of Code Llama, further fine-tuned on 100B tokens of Python code.
ai.meta.com2024-09-25authorityHN front pageabout the Llama familyHN 924 pts · 328 comments2,460 words
Meta releases Llama 3.2, featuring small and medium-sized vision LLMs (11B and 90B) alongside lightweight text-only models (1B and 3B) designed for edge and mobile devices. The 11B and 90B models serve as drop-in replacements for their corresponding text model equivalents while the 1B and 3B models support a context length of 128K tokens and are enabled on day one for Qualcomm and MediaTek hardware. Both pre-trained and aligned vision models are available for fine-tuning using torchtune and local deployment via torchchat, with weights based on BFloat16 numerics.written, reviewed, cited
  • The 11B and 90B vision models require an entirely new model architecture that supports image reasoning.
  • Developers can keep all text-only capabilities intact because the adapter training intentionally did not update the language-model parameters.
  • The 1B and 3B models are created by using structured pruning in a single shot manner from the Llama 3.1 8B.

Analysis6

thesequence.substack.com2023-04-09authorityHN front pageabout the Llama familyHN 791 pts · 504 comments837 words
Meta released Llama in 7B, 13B, 33B, and 65B parameter versions, which were leaked on 4chan and subsequently fine-tuned by researchers into models like Vicuna that match GPT-4 performance. Stanford University released Alpaca, an instruction-following model based on the Llama 7B variant, while UC Berkeley, CMU, Stanford, and UC San Diego open-sourced Vicuna. Additional projects include Koala from Berkeley AI Research, ChatLLama from Nebuly, and ColossalChat from the Colossal-AI project, all leveraging the leaked base model to create open-source conversational agents.written, reviewed, cited
  • Open source LLM alternatives previously lacked the ability to follow human instructions compared to API models.
  • BloombergGPT is a 50 billion LLM fine tuned in financial data based on the BLOOM architecture.
  • The Segment Anything Model was released with the largest computer vision segmentation dataset ever, containing 1-Billion masks.
github.com2023-03-10authorityHN front pageabout the Llama familyHN 989 pts · 284 comments494 words
llama.cpp enables LLM and VLM inference in C/C++ with minimal setup across various hardware. It supports 1.5-bit, 2-bit, 3-bit, 4-bit, 5-bit, 6-bit, and 8-bit integer quantization for faster inference and reduced memory use. Apple silicon is a first-class citizen optimized via ARM NEON, Accelerate and Metal frameworks, while CPU+GPU hybrid inference partially accelerates models larger than the total VRAM capacity.written, reviewed, cited
github.com2023-03-28authorityHN front pageabout the Llama familyHN 593 pts · 301 comments466 words
github.com2023-07-23authorityHN front pageabout the Llama familyHN 707 pts · 165 comments4,774 words
The llama2.c repository offers a 700-line pure C file for training and inferring Llama 2 models, currently supporting fp32 inference for models up to 7B parameters. Work on model quantization is currently ongoing, but the project includes a 110M parameter model trained on the TinyStories dataset.written, reviewed, cited
  • Models larger than 7B are unusably slow because the repo performs float32 inference.
  • The 13B+ model variant fails due to integer flow errors in pointer arithmetic.
github.com2024-05-03authorityHN front pageabout the Llama familyHN 547 pts · 139 comments233 words
Secret-llama is an entirely-in-browser LLM chatbot powered by the webllm inference engine that runs fully private without needing a server. It supports models like Llama 3 and Mistral, ranging in size from 600MB to 4.3GB, requiring WebGPU support. Users can try it directly online, while developers compile the React code using yarn build-and-preview.written, reviewed, cited
ollama.ai2023-08-02HN front pageabout the Llama familyHN 722 pts · 212 comments1,251 words
Ollama enables local execution of uncensored Llama 2 variants, such as the 7B model fine-tuned using Wizard-Vicuna conversation dataset and Nous Hermes Llama 2 13B fine-tuned on over 300,000 instructions. The 13B model stands out for its long responses, lower hallucination rate, and absence of OpenAI censorship mechanisms. Users can run these models via commands like ollama run llama2-uncensored to bypass standard safety refusals.written, reviewed, cited
  • The uncensored model provides a specific recipe for dangerously spicy mayo including ingredients like cayenne pepper and paprika.
  • The uncensored model describes the manufacturing process for Tylenol by combining paracetamol with aspirin, caffeine, and diphenhydramine.

Community2

github.com2023-03-31authorityHN front pageabout the Llama familyHN 1,311 pts · 414 comments989 words
llama.cpp introduces a new file format enabling memory mapping for model weights, resulting in loading speeds 10 to 100 times faster. This change allows safely loading models up to 2x larger, supports running many concurrent inference processes, and ensures tensors are aligned properly on a 32-byte boundary. Users who deleted old Meta LLaMA .pth files can use the migrate-ggml-2023-03-30-pr613.py script to convert old ggml files into the new mmap()'able format.written, reviewed, cited
  • The new format merges multi-file models like LLaMA 13B into a single file to prevent C++ code from reshaping data during loading.
news.ycombinator.com2023-09-12HN front pageabout the Llama familyHN 955 pts · 181 comments10,023 words
Fine-tuning open-source Llama 2 models can replace GPT-3.5 and GPT-4 for specific tasks, with a fine-tuned Llama 7B matching GPT-4 labels 95% of the time on a test set. While fine-tuning requires 1000+ examples and is less flexible than prompting, a fine-tuned Llama 7B is 50x cheaper than GPT-3.5 per token, costing just $19 to classify 2M recipes versus $23k for GPT-4.written, reviewed, cited
All coverage tracked for this model (13) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Llama 3.2: Revolutionizing edge AI and vision with open, customizable modelsai.meta.com2024-09-252026-10-07hn
Llama.ttf: A font which is also an LLMfuglede.github.io2024-06-232026-10-07hn
Show HN: I built a free in-browser Llama 3 chatbot powered by WebGPUgithub.com2024-05-032026-10-07hn
Meta AI releases Code Llama 70Btwitter.com2024-01-292026-10-07hn
Fine-tune your own Llama 2 to replace GPT-3.5/4news.ycombinator.com2023-09-122026-10-07hn
Code Llama, a state-of-the-art large language model for codingai.meta.com2023-08-242026-10-07hn
Run Llama 2 uncensored locallyollama.ai2023-08-022026-10-07hn
Llama2.c: Inference llama 2 in one file of pure Cgithub.com2023-07-232026-10-07hn
Run Llama 13B with a 6GB graphics cardgist.github.com2023-05-142026-10-07hn
The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPTthesequence.substack.com2023-04-092026-10-07hn
Llama.cpp 30B runs with only 6GB of RAM nowgithub.com2023-03-312026-10-07hn
Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMagithub.com2023-03-282026-10-07hn
Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon supportgithub.com2023-03-102026-10-07hn

Papers

4 papers

Papers 4

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.1-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen3-8B · 8.19B
    same size band (M), same task (text-generation), more providers, permissive license
  • Meta-Llama-3-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:42 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:14 UTC · Last verified 2026-10-25

Follow Llama-xLAM-2-8b-fc-r

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.