Models › DeepSeek family

deepseek-moe-16b-base

deepseek-ai DeepSeek License (deepseek) out 3 years ago

16.4B parameters, text in, text out.

Verified 2026-10-25 Rank #748 in LLMs · score 71.5 method v1 Sources 3 Downloads 30d 6.8k · #527 of 619 tracked

Can I run it?9.8GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?DeepSeek License (deepseek)Attribution requiredlicence file
Do people use it?6.8kdownloads, 30 days#527 of 619 we track · below the median169 likesHugging Face

Worth reading

Picked by rule from 9 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 1,843 HN pts
github.com 2025-01-20 1,843 HN pts · 663 comments 2.1k words about the DeepSeek family family
Latest · 45 days ago
twitter.com 2026-09-10 1,016 HN pts · 574 comments about the DeepSeek family family

9 best of 9 tracked

The 2 picks above, plus these 7. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleDeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysisartificialanalysis.ai · 2026-07-31 · 594 HN pts
  2. PaperDeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RLarxiv.org · 2025-01-25 · 1,351 HN pts
  3. CodeDeepSeek releases Janus Pro, a text-to-image generator [pdf]github.com · 2025-01-27 · 912 HN pts
  4. CodeDeepSeek OCRgithub.com · 2025-10-20
  5. ArticleOpenAI says it has evidence DeepSeek used its model to train competitorft.com · 2025-01-29 · 747 HN pts
  6. CodeDeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Daysgithub.com · 2025-02-21 · 757 HN pts
  7. CodeThe path to open-sourcing the DeepSeek inference enginegithub.com · 2025-04-14 · 550 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 12 quantized builds.

  • As a service0no API provider listed
  • On own hardware12quantized builds
  • Built on00 fine-tunes · 0 adapters · 0 merges
  • In apps0Hugging Face Spaces

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 9.8 GB at INT4, 20 GB at FP8, 39 GB at BF16: weights only, so leave room for the KV cache. Every expert must be resident, so total parameters count.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 9.8 GB of weights (estimate; KV cache and activations extra)INT49.8 GBFP8: about 20 GB of weights (estimate; KV cache and activations extra)FP820 GBBF16: about 39 GB of weights (estimate; KV cache and activations extra)BF1639 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 9.8 GB of weights (estimate; KV cache and activations extra)INT49.8 GBFP8: about 20 GB of weights (estimate; KV cache and activations extra)FP820 GBBF16: about 39 GB of weights (estimate; KV cache and activations extra)BF1639 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

What people built on it

12 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

12 derivatives on the Hub, most of them quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

12 quantized (Hugging Face model tree)12 quantized
12 quantized (Hugging Face model tree)12 quantized

All variants →

Reference

Everything else, folded: the full tables, every source.

Facts

15 fields

Listed in LLMs · MoE

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesDeepseekForCausalLM
Model typedeepseek
Params by dtypeBF16: 16,375,728,128
Size bandL
MoEyes
Experts per token6
PapersarXiv:2401.06066
LicenseDeepSeek License (deepseek) (other)
Hub snapshot2026-10-25

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for deepseek-moe-16b-base: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)39 GB · Single high-end GPU (<80 GB)
FP8 (1 byte/param)20 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)9.8 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra. MoE: all experts must be resident, so total parameters count.

All variants

12 variants

Lineage

Original model Family: deepseek-ai/DeepSeek 12 derivatives on the Hub

quantized: 12

Top variants (12 shown, ranked by downloads)

Quant
12 rows
Variant Relation Quant Params Band License Author Likes Downloads
Lucy-in-the-Sky/deepseek-moe-16b-base-Q4_K_M-GGUF quantized GGUF — — other Lucy-in-the-Sky 5 14.1k
mradermacher/deepseek-moe-16b-base-i1-GGUF quantized GGUF — — other mradermacher 0 13.1k
mradermacher/deepseek-moe-16b-base-GGUF quantized GGUF — — other mradermacher 0 4.6k
MikeKuykendall/deepseek-moe-16b-q4-k-m-cpu-offload-gguf quantized gguf — — apache-2.0 MikeKuykendall 4 1.6k
aumosita/deepseek-moe-16b-base-Q5_K_M-GGUF quantized GGUF — — other aumosita 0 1.4k
Lucy-in-the-Sky/deepseek-moe-16b-base-Q6_K-GGUF quantized Q6_K — — other Lucy-in-the-Sky 0 1.1k
Lucy-in-the-Sky/deepseek-moe-16b-base-Q8_0-GGUF quantized Q8_0 — — other Lucy-in-the-Sky 0 712
MikeKuykendall/deepseek-moe-16b-q8-0-cpu-offload-gguf quantized gguf — — apache-2.0 MikeKuykendall 0 527
MikeKuykendall/deepseek-moe-16b-cpu-offload-gguf quantized gguf — — apache-2.0 MikeKuykendall 0 382
MikeKuykendall/deepseek-moe-16b-q2-k-cpu-offload-gguf quantized gguf — — apache-2.0 MikeKuykendall 0 368
Lucy-in-the-Sky/deepseek-moe-16b-base-Q2_K-GGUF quantized Q2_K — — other Lucy-in-the-Sky 0 260
aumosita/deepseek-moe-16b-base-Q4_K_M-GGUF quantized GGUF — — other aumosita 0 224

Repository changelog

1 change
changed in the last 7 daysNew on the watch list: 2026-10-23all changes

Articles and coverage

9 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis7

artificialanalysis.ai2026-07-31authorityHN front pageabout the DeepSeek familyHN 594 pts · 312 comments1,118 words
DeepSeek V4 Flash 0731 (Max) is a 284B parameter open-weight model released on July 31, 2026, under the MIT license. It scores 34 on the Artificial Analysis Intelligence Index while costing $0.14 per 1M input tokens and utilizing only 13B active parameters during inference. The model supports a 1M token context window and outputs text at 149.8 tokens per second.written, reviewed, cited
  • This model is deprecated and benchmarking continues only for the default 10k input token workload.
  • The model is notably fast but generates output that is very verbose compared to the median.
  • For a blended rate using a 7:2:1 cache hit/input/output ratio, the cost is $0.07 per 1M tokens.
arxiv.org2025-01-25authorityHN front pageabout the DeepSeek familyHN 1,351 pts · 1,056 comments371 words
github.com2025-01-20authorityHN front pageabout the DeepSeek familyHN 1,843 pts · 663 comments2,107 words
github.com2025-01-27authorityHN front pageabout the DeepSeek familyHN 912 pts · 674 comments
ft.com2025-01-29HN front pageabout the DeepSeek familyHN 747 pts · 1,541 comments
github.com2025-02-21authorityHN front pageabout the DeepSeek familyHN 757 pts · 236 comments497 words
github.com2025-04-14authorityHN front pageabout the DeepSeek familyHN 550 pts · 63 comments412 words

Community1

twitter.com2026-09-10HN front pageabout the DeepSeek familyHN 1,016 pts · 574 comments
All coverage tracked for this model (9) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
DeepSeek v4.1 Flashtwitter.com2026-09-102026-10-14hn
DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysisartificialanalysis.ai2026-07-312026-10-14hn
DeepSeek OCRgithub.com2025-10-202026-10-14hn
The path to open-sourcing the DeepSeek inference enginegithub.com2025-04-142026-10-14hn
DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Daysgithub.com2025-02-212026-10-14hn
OpenAI says it has evidence DeepSeek used its model to train competitorft.com2025-01-292026-10-14hn
DeepSeek releases Janus Pro, a text-to-image generator [pdf]github.com2025-01-272026-10-14hn
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RLarxiv.org2025-01-252026-10-14hn
DeepSeek-R1github.com2025-01-202026-10-14hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • gpt-oss-20b · 20.9B
    same size band (L), also MoE, same task (text-generation), more providers, permissive license
  • DeepSeek-Coder-V2-Lite-Instruct · 15.7B
    same size band (L), also MoE, same task (text-generation)
  • DeepSeek-V2-Lite · 15.7B
    same size band (L), also MoE, same task (text-generation)

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-14 14:08 UTC · Last verified 2026-10-25

Follow deepseek-moe-16b-base

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.