Models › DeepSeek-R1 family

DeepSeek-R1-Distill-Llama-70B

deepseek-ai MIT out 21 months ago

70.6B parameters, text in, text out, 128K tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #126 in LLMs · score 94.9 method v1 Sources 3 Downloads 30d 37k · #404 of 619 tracked

Changed this week: 1 new quantized build on the Hub (71 in all).2026-10-24

Can I run it?42GB at INT4Estimatefits a 64 GB Mac (unified memory)method
Can I use it?MITPermissivelicence file2026-10-24
Do people use it?37kdownloads, 30 days#404 of 619 we track · below the median+2 likes, downloads −22% this week822 likesHugging Face2026-10-24

Worth reading

Picked by rule from 37 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 1,843 HN pts
github.com 2025-01-20 1,843 HN pts · 663 comments 2.1k words about the DeepSeek R1 family family
Latest · 6 months ago

ZAYA1-8B matches DeepSeek-R1 on math with less than 1B active parameters

Zyphra released ZAYA1-8B, a model that matches DeepSeek-R1 on math benchmarks while using less than 1 billion active parameters.

  • The model was trained entirely on a 1,024 node AMD cluster built with IBM using AMD Pensando Pollara interconnect.
  • Zyphra trained ZAYA1-8B end to end on AMD Instinct MI300X GPUs for pretraining, midtraining, and supervised fine-tuning.
firethering.com 2026-05-07 117 HN pts · 56 comments 1.3k words about the DeepSeek R1 family family

25 best of 37 tracked

The 2 picks above, plus these 23. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. PaperDeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RLarxiv.org · 2025-01-25 · 1,351 HN pts
  2. ArticlePromising results from DeepSeek R1 for codesimonwillison.net · 2025-01-28 · 979 HN pts
  3. ArticleRun DeepSeek R1 Dynamic 1.58-bitunsloth.ai · 2025-01-28 · 767 HN pts
  4. ArticleOpen-R1: an open reproduction of DeepSeek-R1huggingface.co · 2025-01-28 · 394 HN pts
  5. CodeDeepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5github.com · 2025-02-15 · 306 HN pts
  6. ArticleHow to Run DeepSeek R1 671B Locally on a $2000 EPYC Serverdigitalspaceport.com · 2025-02-01
  7. CodeDeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeongithub.com · 2025-03-06
  8. ArticleThe Illustrated DeepSeek-R1newsletter.languagemodels.co · 2025-01-27 · 578 HN pts
  9. ArticleDeepSeek R1 Is Now Available on Azure AI Foundry and GitHubazure.microsoft.com · 2025-01-29 · 109 HN pts
  10. DiscussionComplete hardware and software setup for running Deepseek-R1 locallytwitter.com · 2025-01-29 · 250 HN pts
  11. CodeTinyZero: Reproduction of DeepSeek R1 Zero in countdown and multiplication tasksgithub.com · 2025-01-25
  12. CodeOpen Reproduction of DeepSeek-R1github.com · 2025-01-27
  13. ArticleOfficial DeepSeek R1 Now on Ollamaollama.com · 2025-01-20
  14. ArticleBerkeley Researchers Replicate DeepSeek R1's Core Tech for Just $30: A Small Modxyzlabs.substack.com · 2025-01-28
  15. CodeImplementing DeepSeek R1's GRPO algorithm from scratchgithub.com · 2025-04-13
  16. ArticleMini-R1: Reproduce DeepSeek R1 "Aha Moment"philschmid.de · 2025-01-31
  17. DiscussionDeepSeek R1 671B running on 2 M2 Ultras faster than reading speedtwitter.com · 2025-01-29
  18. ArticleHow to run DeepSeek R1 locallyworkos.com · 2025-01-29
  19. ArticleDeepSeek R1 Distill Llama 70B - Artificial Analysisartificialanalysis.ai · undated
  20. ArticleDeepSeek R1 (Jan '25) vs DeepSeek R1 Distill Llama 70B: Model Comparisonartificialanalysis.ai · undated
  21. ArticleHow to Run DeepSeek R1 Distilled Reasoning Models on RyzenAI and Radeon GPUsguru3d.com · 2025-02-02
  22. ArticleA new, faster DeepSeek R1-0528 variant appears from German labventurebeat.com · 2025-07-05
  23. ArticleRunning DeepSeek R1 Models Locally on NPUblogs.windows.com · 2025-02-01

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; heavily run locally (71 quantized builds); a big base for builders (119 fine-tunes, adapters and merges).

  • As a service1Featherless
  • On own hardware71quantized builds
  • Built on11925 fine-tunes · 57 adapters · 37 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: pliny-the-prompter/obliteratus ♥ 621 · hadadrjt/ai ♥ 86 · KBaba7/Quant ♥ 51 · ruslanmv/DeepSeek-R1-Chatbot ♥ 36

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 64 GB Mac (unified memory) at INT4

About 42 GB at INT4, 85 GB at FP8, 169 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 42 GB of weights (estimate; KV cache and activations extra)INT442 GBFP8: about 85 GB of weights (estimate; KV cache and activations extra)FP885 GBBF16: about 169 GB of weights (estimate; KV cache and activations extra)BF16169 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 42 GB of weights (estimate; KV cache and activations extra)INT442 GBFP8: about 85 GB of weights (estimate; KV cache and activations extra)FP885 GBBF16: about 169 GB of weights (estimate; KV cache and activations extra)BF16169 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-01-20), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

What people built on it

190 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

190 derivatives on the Hub, led by 71 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

71 quantized (Hugging Face model tree)25 fine-tunes (Hugging Face model tree)37 merges (Hugging Face model tree)57 adapters (Hugging Face model tree)71 quantized25 fine-tunes37 merges57 adapters
71 quantized (Hugging Face model tree)25 fine-tunes (Hugging Face model tree)37 merges (Hugging Face model tree)57 adapters (Hugging Face model tree)71 quantized25 fine-tunes37 merges57 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

1 row

Benchmarks 1 row

measured third-party leaderboard rowauthor-reported number from the model card or eval files (1)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported AIME 2024 · Reason through hard problems70 pass@1DeepSeek-R1-Distill-Llama-70Bmodel author2026-10-07

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLlamaForCausalLM
Model typellama
Dtypebfloat16
Params by dtypeBF16: 70,553,706,496
Size bandXL
MoEno
Context length131,072 (config.json max_position_embeddings)
PapersarXiv:2501.12948
LicenseMIT (mit)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for DeepSeek-R1-Distill-Llama-70B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)169 GB · Multi-GPU node (<640 GB)
FP8 (1 byte/param)85 GB · Multi-GPU node (<640 GB)
INT4 (0.5 bytes/param)42 GB · Single high-end GPU (<80 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: deepseek-ai/DeepSeek-R1 190 derivatives on the Hub

quantized: 71finetune: 25merge: 37adapter: 57

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — llama3.3 unsloth 122 1.5M
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic quantized -FP8 70.6B XL mit RedHatAI 10 514k
bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — — bartowski 45 459.9k
lmstudio-community/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — — lmstudio-community 5 161.3k
Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ quantized AWQ 70.6B XL llama3.3 Valdemardi 20 129k
unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit quantized -bnb 72.7B XL llama3.3 unsloth 26 74.2k
mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit quantized -4bit 70.6B XL — mlx-community 13 71.1k
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 quantized -quant 70.6B XL mit RedHatAI 6 52.2k
huihui-ai/DeepSeek-R1-Distill-Llama-70B-abliterated finetune — 70.6B XL — huihui-ai 105 47.3k
mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit quantized -8bit 70.6B XL — mlx-community 11 48.8k
mlx-community/DeepSeek-R1-Distill-Llama-70B finetune — 70.6B XL — mlx-community 6 34.3k
mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit quantized — 70.6B XL — mlx-community 5 32.9k
mlx-community/DeepSeek-R1-Distill-Llama-70B-6bit quantized — 70.6B XL — mlx-community 4 29.9k
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 quantized -quant 70.6B XL mit RedHatAI 2 24.1k
mradermacher/DeepSeek-R1-Distill-Llama-70B-i1-GGUF quantized GGUF — — mit mradermacher 4 22.3k
mradermacher/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — mit mradermacher 2 20.5k
unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit quantized -bnb 72.7B XL llama3.3 unsloth 9 18.4k
Steelskull/L3.3-Nevoria-R1-70b merge — 70.6B XL other Steelskull 100 11.3k
second-state/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — — second-state 1 14.2k
UNIVA-Bllossom/DeepSeek-llama3.3-Bllossom-70B finetune — 70.6B XL mit UNIVA-Bllossom 62 11.1k
empirischtech/DeepSeek-R1-Distill-Llama-70B-gptq-4bit quantized gptq 70.6B XL cc-by-4.0 empirischtech 1 13.5k
backyardai/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — mit backyardai 1 9.9k
zerofata/L3.3-GeneticLemonade-Unleashed-70B merge — 70.6B XL — zerofata 15 9.1k
mmnga/DeepSeek-R1-Distill-Llama-70B-gguf quantized gguf — — mit mmnga 0 8.4k
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF quantized Q4_0 — — — roleplaiapp 2 8.1k
gaianet/DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — — gaianet 1 7.2k
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q8_0-GGUF quantized Q8_0 — — — roleplaiapp 1 6.8k
featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — — featherless-ai-quants 1 5.9k
OPEA/DeepSeek-R1-Distill-Llama-70B-int4-gptq-sym-inc quantized int4 70.6B XL — OPEA 4 5.2k
DevQuasar-7/deepseek-ai.DeepSeek-R1-Distill-Llama-70B-GGUF quantized GGUF — — — DevQuasar-7 0 5.1k
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF quantized GGUF — — — roleplaiapp 0 4.4k
John1604/DeepSeek-R1-Distill-Llama-70B-gguf quantized gguf — — apache-2.0 John1604 3 3.4k
McG-221/DeepSeek-R1-Distill-Llama-70B-mlx-5Bit quantized mlx 70.6B XL mit McG-221 0 3.5k
ErikFeng/DeepSeek-R1-Distill-Llama-70B-Science-Q4_K_M-GGUF quantized GGUF — — mit ErikFeng 3 3.2k
Kaleto/DeepSeek-R1-Distill-Llama-70B-NVFP4 quantized NVFP4 40.6B XL mit Kaleto 2 2.9k
ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large finetune — 70.6B XL llama3.3 ArliAI 24 1.7k
typhoon-ai/llama3.1-typhoon2-deepseek-r1-70b-preview merge — 70.6B XL llama3.1 typhoon-ai 14 1.9k
strandline/DeepSeek-R1-Distill-Llama-70B-Q4-mlx quantized mlx 70.6B XL mit strandline 3 2.4k
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q2_K-GGUF quantized Q2_K — — — roleplaiapp 0 2.4k
AbteeXAILab/lumynax-reasoning-deepseek-r1-distill-llama-70b-gguf quantized gguf — — llama3.3 AbteeXAILab 2 2k

Repository changelog

12 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 12 commits

DateCommitSHA
2025-02-24 Update bib info b1c0b44
2025-02-09 Update tokenizer_config.json 0d6d11a
2025-02-01 Update README.md 008f3f3
2025-01-26 Update README.md 1772b07
2025-01-23 Update README.md b427a01
2025-01-22 Update tokenizer_config.json d0e68d7
2025-01-22 Update tokenizer_config.json a681c70
2025-01-21 Add generation_config.json 0aeb3b7
2025-01-21 add library tag for better code snippets and tags (#3) 76f6c0b
2025-01-20 Release DeepSeek-R1 07a264a
2025-01-20 Add files using upload-large-folder tool 288e64a
2025-01-20 initial commit 9ab39d5

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for DeepSeek-R1-Distill-Llama-70B, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
deepseek-ai/DeepSeek-R1-Distill-Llama-70B — — — — — — — live 2026-10-25

Articles and coverage

37 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis9

firethering.com2026-05-07HN front pageabout the DeepSeek R1 familyHN 117 pts · 56 comments1,293 words
Zyphra released ZAYA1-8B, a model that matches DeepSeek-R1 on math benchmarks while using less than 1 billion active parameters. The 8.4B parameter mixture of experts model activates only 760M parameters at inference and employs Markovian RSA to scale performance with compute budget. It requires a specific vLLM fork for local deployment and is available under an Apache 2.0 license.written, reviewed, cited
  • The model was trained entirely on a 1,024 node AMD cluster built with IBM using AMD Pensando Pollara interconnect.
  • Zyphra trained ZAYA1-8B end to end on AMD Instinct MI300X GPUs for pretraining, midtraining, and supervised fine-tuning.
  • The model requires Zyphra's own fork of vLLM to run properly because the standard vLLM install won't work.
arxiv.org2025-01-25authorityHN front pageabout the DeepSeek R1 familyHN 1,351 pts · 1,056 comments371 words
simonwillison.net2025-01-28authorityHN front pageabout the DeepSeek R1 familyHN 979 pts · 746 comments345 words
A PR for llama.cpp delivers x2 speed for WASM by optimizing SIMD instructions for qX_K_q8_K and qX_0_q8_0 dot product functions. Surprisingly, 99% of the code in this PR is written by DeekSeek-R1. The model spent 3-5 minutes thinking about each prompt to generate the optimization.written, reviewed, cited
github.com2025-01-20authorityHN front pageabout the DeepSeek R1 familyHN 1,843 pts · 663 comments2,107 words
unsloth.ai2025-01-28authorityHN front pageabout the DeepSeek R1 familyHN 767 pts · 332 comments
huggingface.co2025-01-28authorityHN front pageabout the DeepSeek R1 familyHN 394 pts · 234 comments890 words
github.com2025-02-15authorityHN front pageabout the DeepSeek R1 familyHN 306 pts · 156 comments766 words
newsletter.languagemodels.co2025-01-27HN front pageabout the DeepSeek R1 familyHN 578 pts · 118 comments1,715 words
azure.microsoft.com2025-01-29authorityHN front pageabout the DeepSeek R1 familyHN 109 pts · 49 comments

Community1

twitter.com2025-01-29HN front pageabout the DeepSeek R1 familyHN 250 pts · 192 comments
All coverage tracked for this model (37) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
DeepSeek R1 Distill Llama 70B - Artificial Analysisartificialanalysis.ai—2026-10-07exa
DeepSeek R1 (Jan '25) vs DeepSeek R1 Distill Llama 70B: Model Comparisonartificialanalysis.ai—2026-10-07exa
LocalAI LLM Testing: Deepseek R1 Distill Llama 70B Deepdive ...youtube.com—2026-10-07exa
DeepSeek: R1 Distill Llama 70B - AI Model Details & Bench...benchable.ai—2026-10-07exa
DeepSeek: R1 Distill Llama 70B — quality, speed & price analysis | The Known Goodtheknowngood.com—2026-10-07exa
DeepSeek-R1-Distill-Llama-70B - NVIDIA NGC Catalogcatalog.ngc.nvidia.com—2026-10-07exa
DeepSeek R1 Distill Llama 70Bopensourcesai.com—2026-10-07exa
ZAYA1-8B matches DeepSeek-R1 on math with less than 1B active parametersfirethering.com2026-05-072026-10-07hn
DeepSeek R1 Distill: Six Open Reasoning Models Compareddeepseekai.guide2026-04-252026-10-07exa
A new, faster DeepSeek R1-0528 variant appears from German labventurebeat.com2025-07-052026-10-07hn
Implementing DeepSeek R1's GRPO algorithm from scratchgithub.com2025-04-132026-10-07hn
DeepSeek-R1-671B-Q4_K_M with 1 or 2 Arc A770 on Xeongithub.com2025-03-062026-10-07hn
Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5github.com2025-02-152026-10-07hn
Show HN: Distill your own model from DeepSeek R1 in 30 mins (open+GUI)news.ycombinator.com2025-02-062026-10-07hn
Experience the DeepSeek R1 Distilled 'Reasoning' Models on Ryzen AI and Radeoncommunity.amd.com2025-02-042026-10-07hn
How to Run DeepSeek R1 Distilled Reasoning Models on RyzenAI and Radeon GPUsguru3d.com2025-02-022026-10-07hn
How to Run DeepSeek R1 671B Locally on a $2000 EPYC Serverdigitalspaceport.com2025-02-012026-10-07hn
Running DeepSeek R1 Models Locally on NPUblogs.windows.com2025-02-012026-10-07hn
How to run 1.58bit DeepSeek R1 with Open WebUIdocs.openwebui.com2025-01-312026-10-07hn
Mini-R1: Reproduce DeepSeek R1 "Aha Moment"philschmid.de2025-01-312026-10-07hn
DeepSeek R1 is far better than OpenAI o1 at finding bugs in pull requestsgreptile.com2025-01-302026-10-07hn
DeepSeek R1 Is Now Available on Azure AI Foundry and GitHubazure.microsoft.com2025-01-292026-10-07hn
How to run DeepSeek R1 locallyworkos.com2025-01-292026-10-07hn
Complete hardware and software setup for running Deepseek-R1 locallytwitter.com2025-01-292026-10-07hn
DeepSeek R1 671B running on 2 M2 Ultras faster than reading speedtwitter.com2025-01-292026-10-07hn
Berkeley Researchers Replicate DeepSeek R1's Core Tech for Just $30: A Small Modxyzlabs.substack.com2025-01-282026-10-07hn
Promising results from DeepSeek R1 for codesimonwillison.net2025-01-282026-10-07hn
GroqCloud Makes DeepSeek R1 Distill Llama 70B Availablegroq.com2025-01-282026-10-07hn
Run DeepSeek R1 Dynamic 1.58-bitunsloth.ai2025-01-282026-10-07hn
Open-R1: an open reproduction of DeepSeek-R1huggingface.co2025-01-282026-10-07hn
The Illustrated DeepSeek-R1newsletter.languagemodels.co2025-01-272026-10-07hn
DeepSeek R1 avilable in Groq playgroundconsole.groq.com2025-01-272026-10-07hn
Open Reproduction of DeepSeek-R1github.com2025-01-272026-10-07hn
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RLarxiv.org2025-01-252026-10-07hn
TinyZero: Reproduction of DeepSeek R1 Zero in countdown and multiplication tasksgithub.com2025-01-252026-10-07hn
Official DeepSeek R1 Now on Ollamaollama.com2025-01-202026-10-07hn
DeepSeek-R1github.com2025-01-202026-10-07hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:34 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:01 UTC · Last verified 2026-10-25

Follow DeepSeek-R1-Distill-Llama-70B

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.