Models › DeepSeek-V2 family

deepseek-ai DeepSeek License (deepseek) out 3 years ago

236B parameters (6 of 160 experts per token), text in, text out, 160K tokens of context.

Verified 2026-10-25 Rank #689 in LLMs · score 72.3 method v1 Sources 3 Downloads 30d 12.7k · #488 of 619 tracked

Can I use it?DeepSeek License (deepseek)Attribution requiredlicence file2026-10-24
Do people use it?12.7kdownloads, 30 days#488 of 619 we track · below the median+2 likes, downloads −22% this week358 likesHugging Face2026-10-24

Worth reading and watching

Picked by rule from 8 tracked pieces: the lab's own post, the most shared, a field report, the latest.

8 best of 8 tracked

The 4 picks above, plus these 4. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeDeepSeek-V2: A Strong, Economical, and Efficient Moe Language Modelgithub.com · 2024-05-07 · 14 HN pts
  2. PaperDeepSeek-V2: A Strong, Economical, and Efficient MOE Language Modelarxiv.org · 2025-01-01 · 3 HN pts
  3. CodeDeepSeek-V2 integrated, RAGFlow v0.5.0 is releasedgithub.com · 2024-05-08 · 7 HN pts
  4. ArticleBest Open Source LLM:Tencent Hunyuan-Large Outperforming Llama 3 and DeepSeek V2techwavearena.com · 2024-11-08 · 1 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 1 quantized builds and 15 Spaces.

  • As a service0no API provider listed
  • On own hardware1quantized builds
  • Built on11 fine-tunes · 0 adapters · 0 merges
  • In apps15Hugging Face Spaces

Top Spaces running it: Justinrune/LLaMA-Factory ♥ 12 · artificialguybr/CanIRunThisLLM ♥ 9 · Csplk/moondream2-batch-processing ♥ 8 · concedo/WebTokenizer ♥ 5

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits two 80 GB GPUs at INT4; too big for one

About 141 GB at INT4, 283 GB at FP8, 566 GB at BF16: weights only, so leave room for the KV cache. Every expert must be resident, so total parameters count.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 141 GB of weights (estimate; KV cache and activations extra)INT4141 GBFP8: about 283 GB of weights (estimate; KV cache and activations extra)FP8283 GBBF16: about 566 GB of weights (estimate; KV cache and activations extra)BF16566 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 141 GB of weights (estimate; KV cache and activations extra)INT4141 GBFP8: about 283 GB of weights (estimate; KV cache and activations extra)FP8283 GBBF16: about 566 GB of weights (estimate; KV cache and activations extra)BF16566 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

8 dated articles and 19 repo commits so far

Teal is the weights (2024-04-22), amber triangles are 8 dated articles (each links to it), grey ticks are repo commits.

What people built on it

2 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

2 derivatives on the Hub, led by 1 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

1 quantized (Hugging Face model tree)1 fine-tune (Hugging Face model tree)1 quantized1 fine-tune
1 quantized (Hugging Face model tree)1 fine-tune (Hugging Face model tree)1 quantized1 fine-tune

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

21 rows

Benchmarks 21 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (21)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported BBH · Reason through hard problems78.9Base Modelmodel author2026-10-07
author-reported BBH · Reason through hard problems81.3DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported BBH · Reason through hard problems79.7DeepSeek-V2 Chat (RL)model author2026-10-07
author-reported C-Eval · Work across languages81.7Base Modelmodel author2026-10-07
author-reported C-Eval · Work across languages80.9DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported C-Eval · Work across languages78DeepSeek-V2 Chat (RL)model author2026-10-07
author-reported CMMLU · Work across languages84Base Modelmodel author2026-10-07
author-reported CMMLU · Work across languages82.4DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported CMMLU · Work across languages81.6DeepSeek-V2 Chat (RL)model author2026-10-07
author-reported GSM8K · Reason through hard problems79.2Base Modelmodel author2026-10-07
author-reported HumanEval · Write code with agents48.8Base Modelmodel author2026-10-07
author-reported HumanEval · Write code with agents76.8DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported HumanEval · Write code with agents81.1DeepSeek-V2 Chat (RL)model author2026-10-07
author-reported LiveCodeBench · Write code with agents28.7DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported MATH-500 · Reason through hard problems43.6Base Modelmodel author2026-10-07
author-reported MBPP · Write code with agents66.6Base Modelmodel author2026-10-07
author-reported MBPP · Write code with agents70.4DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported MBPP · Write code with agents72DeepSeek-V2 Chat (RL)model author2026-10-07
author-reported MMLU · Reason through hard problems78.5Base Modelmodel author2026-10-07
author-reported MMLU · Reason through hard problems78.4DeepSeek-V2 Chat (SFT)model author2026-10-07
author-reported MMLU · Reason through hard problems77.8DeepSeek-V2 Chat (RL)model author2026-10-07

Use-case evidence

5 use cases

What it is good at 5 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs · MoE

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesDeepseekV2ForCausalLM
Model typedeepseek_v2
Dtypebfloat16
Params by dtypeBF16: 235,741,434,880
Size bandXXL
MoEyes
Experts160
Experts per token6
Context length163,840 (config.json max_position_embeddings)
PapersarXiv:2311.18743, arXiv:2405.04434
LicenseDeepSeek License (deepseek) (other)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · DeepseekV2ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · DeepseekV2ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for DeepSeek-V2: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)566 GB · Multi-GPU node (<640 GB)
FP8 (1 byte/param)283 GB · Multi-GPU node (<640 GB)
INT4 (0.5 bytes/param)141 GB · Multi-GPU node (<640 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra. MoE: all experts must be resident, so total parameters count.

All variants

2 variants

Lineage

Original model Family: deepseek-ai/DeepSeek-V2 2 derivatives on the Hub

quantized: 1finetune: 1

Top variants (2 shown, ranked by downloads)

Relation
2 rows
Variant Relation Quant Params Band License Author Likes Downloads
mradermacher/DeepSeek-V2-i1-GGUF quantized GGUF — — other mradermacher 0 900
mradermacher/DeepSeek-V2-GGUF finetune GGUF — — other mradermacher 0 0

Repository changelog

19 commits

Repository changelog 19 commits

DateCommitSHA
2024-06-08 docs: update README.md 4461458
2024-06-07 docs: update README.md f9b5644
2024-05-27 training: fix type mismatch when training (#6) 94cf30b
2024-05-09 Update code & readme e0828e3
2024-05-08 Update README.md 3d3dec2
2024-05-08 update citation info 1e51912
2024-05-07 Update README.md 3b7037d
2024-05-07 Update README.md ca159e6
2024-05-07 Update README.md d734100
2024-05-06 Update model names 44f7caf
2024-05-06 Update README.md 3d445e7
2024-05-06 Update README.md 70cd796
2024-05-06 Update README.md e8c35ff
2024-05-06 Update README.md 1142605
2024-05-06 Update README.md dd5954a
2024-05-06 Update README.md b3333a6
2024-05-06 Upload LICENSE e63dbae
2024-05-06 Upload folder using huggingface_hub 4c2b2d1
2024-04-22 initial commit b129598

Articles and coverage

8 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

deepseek.com2024-05-08officialauthorityHN 16 pts · 2 comments38 words

Analysis5

youtube.com2026-09-18HN 1 pts · 0 comments
github.com2024-05-07authorityHN 14 pts · 3 comments1,699 words
DeepSeek-V2 is a 236B parameter Mixture-of-Experts model pretrained on 8.1 trillion tokens that saves 42.5% of training costs while boosting maximum generation throughput to 5.76 times. The architecture utilizes MLA (Multi-head Latent Attention) to eliminate the bottleneck of inference-time key-value cache, thus supporting efficient inference. To utilize DeepSeek-V2 in BF16 format for inference, 80GB*8 GPUs are required.written, reviewed, cited
  • The open-source code runs slower on HuggingFace GPUs compared to the internal codebase due to platform constraints.
  • The SGLang framework supports FP8 KV Cache and offers the best latency and throughput among open-source frameworks for this model.
arxiv.org2025-01-01authorityHN 3 pts · 0 comments404 words
DeepSeek-V2 is a strong Mixture-of-Experts language model characterized by economical training and efficient inference. It comprises 236B total parameters, of which 21B are activated for each token, and supports a context length of 128K tokens. DeepSeek-V2 adopts innovative architectures including Multi-head Latent Attention (MLA) and DeepSeekMoE, where MLA guarantees efficient inference through significantly compressing the Key-Value (KV) cache into a latent vector.written, reviewed, cited
github.com2024-05-08authorityHN 7 pts · 0 comments460 words
techwavearena.com2024-11-08HN 1 pts · 0 comments53 words

Community2

old.reddit.com2024-05-16HN 21 pts · 0 comments
old.reddit.com2024-07-30HN 8 pts · 0 comments

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-235B-A22B · 235B
    same size band (XXL), also MoE, same task (text-generation), more providers, permissive license
  • MiniMax-M2.5 · 229B
    same size band (XXL), also MoE, same task (text-generation), more providers
  • Qwen3-235B-A22B-Instruct-2507 · 235B
    same size band (XXL), also MoE, same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:41 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:13 UTC · Last verified 2026-10-25

Follow DeepSeek-V2

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.