Models › Kimi-Linear family

Kimi-Linear-48B-A3B-Instruct

moonshotai MIT out 12 months ago

49.1B parameters, 3B active, text in, text out. 1 provider serves it.

Verified 2026-10-25 Rank #252 in LLMs · score 85.8 method v1 Sources 3 Downloads 30d 143.4k · #277 of 619 tracked

Changed this week: 1 new quantized build on the Hub (25 in all).2026-10-24

Can I run it?30GB at INT4Estimatefits a 64 GB Mac (unified memory)method
Can I use it?MITPermissivelicence file2026-10-24
Do people use it?143.4kdownloads, 30 days#277 of 619 we track · top 45%+1 likes, downloads −22% this week610 likesHugging Face2026-10-24

Worth reading

Picked by rule from 12 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 306 HN pts

Kimi Linear: An Expressive, Efficient Attention Architecture (2025)

Kimi Linear is a hybrid linear attention architecture that outperforms full attention across short, long, and reinforcement learning contexts.

arxiv.org 2025-11-03 306 HN pts · 133 comments 436 words about the Kimi Linear family family
Latest · 8 months ago

Self-Hosted LLM Upgrade on AMD: Kimi Linear 48B, Qwen3 Coder Next, and Q2_K_XL

Kimi Linear 48B Instruct emerges as the best generalist model, while Qwen3 Coder Next serves as an immediate replacement for coding tasks on a homelab featuring 2× AMD AI Max+ 395 GPUs with 128GB unified memory each.

  • The author avoids Nvidia hardware due to a belief in the underdog and reported suffering.
  • Recent versions of llama.cpp have degraded performance for the Seed-OSS-36B-Instruct model.
site.bhamm-lab.com 2026-02-18 4 HN pts · 1 comments 2.6k words

12 best of 12 tracked

The 3 picks above, plus these 9. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeKimi Linear: An Expressive, Efficient Attention Architecturegithub.com · 2025-10-30 · 217 HN pts
  2. ArticleKimi Linear 48B A3B Instruct - Intelligence, Performance & ...artificialanalysis.ai · undated
  3. CodeExplanation of Gated DeltaNet (Qwen3-Next and Kimi Linear)github.com · 2025-11-03 · 3 HN pts
  4. ArticleKimi-Linear 48B: a real, verified 1M context on a Mac Studio M3 Ultra - Omar Shababomarshabab.com · undated
  5. ArticleKimi Linear 48B-A3B — BF16 — Recipes · How To Sparkhowtospark.com · undated
  6. ArticleArchitecture graph for moonshotai/Kimi-Linear-48B-A3B- ...hfviewer.com · undated
  7. ArticleKimi Linear 48B-A3B: Specs, Benchmarks & API | AI/TLDRai-tldr.dev · undated
  8. ArticleKimi Linear: An Expressive, Efficient Attention Architecturearxiviq.substack.com · 2025-11-01
  9. ArticleKimi Linear by Moonshot AIsonusahani.com · 2025-10-31

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 Featherless — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 25 quantized builds for local use.

  • As a service1Featherless
  • On own hardware25quantized builds
  • Built on1310 fine-tunes · 3 adapters · 0 merges
  • In apps2Hugging Face Spaces

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 64 GB Mac (unified memory) at INT4

About 30 GB at INT4, 59 GB at FP8, 118 GB at BF16: weights only, so leave room for the KV cache. Every expert must be resident, so total parameters count.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 30 GB of weights (estimate; KV cache and activations extra)INT430 GBFP8: about 59 GB of weights (estimate; KV cache and activations extra)FP859 GBBF16: about 118 GB of weights (estimate; KV cache and activations extra)BF16118 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 30 GB of weights (estimate; KV cache and activations extra)INT430 GBFP8: about 59 GB of weights (estimate; KV cache and activations extra)FP859 GBBF16: about 118 GB of weights (estimate; KV cache and activations extra)BF16118 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-10-30), amber triangles are 4 dated articles (each links to it), grey ticks are repo commits.

NovDecJanFebMarAprMayJunJulAugSepOct2025-12-16: 1 repo commit2025-11-25: 1 repo commit2025-11-17: 3 repo commits2025-11-13: 1 repo commit2025-11-01: 7 repo commits2025-10-30: 4 repo commitsKimi Linear: An Expressive, Efficient Attention Architecture (2025) · 2025-11-03Kimi Linear: An Expressive, Efficient Attention Architecture · 2025-10-30Self-Hosted LLM Upgrade on AMD: Kimi Linear 48B, Qwen3 Coder Next, and Q2_K_XL · 2026-02-18Explanation of Gated DeltaNet (Qwen3-Next and Kimi Linear) · 2025-11-03Weights 2025-10-30 · 2025-10-30Weights 2025-10-30now · 1 provider
NovDecJanFebMarAprMayJunJulAugSepOct2025-12-16: 1 repo commit2025-11-25: 1 repo commit2025-11-17: 3 repo commits2025-11-13: 1 repo commit2025-11-01: 7 repo commits2025-10-30: 4 repo commitsKimi Linear: An Expressive, Efficient Attention Architecture (2025) · 2025-11-03Kimi Linear: An Expressive, Efficient Attention Architecture · 2025-10-30Self-Hosted LLM Upgrade on AMD: Kimi Linear 48B, Qwen3 Coder Next, and Q2_K_XL · 2026-02-18Explanation of Gated DeltaNet (Qwen3-Next and Kimi Linear) · 2025-11-03Weights 2025-10-30 · 2025-10-30Weights 2025-10-30now · 1 provider

What people built on it

38 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

38 derivatives on the Hub, most of them quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

25 quantized (Hugging Face model tree)10 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)25 quantized10 fine-tunes3 adapters
25 quantized (Hugging Face model tree)10 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)25 quantized10 fine-tunes3 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

2 rows

Benchmarks 2 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (2)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported MMLU-Pro · Reason through hard problems51—model author2026-10-07
author-reported RULER · Read long documents84.3—model author2026-10-07

What the card says

1 cited sentence

Summary generated, cited

The architecture uses a hybrid linear attention mechanism and is released under an MIT license.[1][2]

  1. license
  2. “hybrid linear attention architecture”

Generated 2026-10-07 15:04 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in LLMs · MoE

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesKimiLinearForCausalLM
Model typekimi_linear
Dtypebfloat16
Params by dtypeBF16: 49,122,599,168 · F32: 82,560
Size bandXL
MoEyes
Experts256
PapersarXiv:2510.26692, arXiv:2412.06464
LicenseMIT (mit)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · KimiLinearForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · KimiLinearForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Kimi-Linear-48B-A3B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)118 GB · Multi-GPU node (<640 GB)
FP8 (1 byte/param)59 GB · Single high-end GPU (<80 GB)
INT4 (0.5 bytes/param)30 GB · Single high-end GPU (<80 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra. MoE: all experts must be resident, so total parameters count.

All variants

38 variants

Lineage

Original model Family: moonshotai/Kimi-Linear 38 derivatives on the Hub

finetune: 10quantized: 25adapter: 3

Top variants (38 shown, ranked by downloads)

Relation
Quant
Size
38 rows
Variant Relation Quant Params Band License Author Likes Downloads
yujiepan/kimi-linear-tiny-random finetune — 5.65M S — yujiepan 0 462.1k
cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit quantized AWQ 9.37B L mit cyankiwi 18 122.3k
bartowski/moonshotai_Kimi-Linear-48B-A3B-Instruct-GGUF quantized GGUF — — mit bartowski 30 96.4k
mradermacher/Kimi-Linear-48B-A3B-Instruct-i1-GGUF quantized GGUF — — mit mradermacher 3 29.4k
ymcki/Kimi-Linear-48B-A3B-Instruct-GGUF quantized GGUF — — mit ymcki 37 23.8k
DhruvalLabs/Kimi-Linear-48B-A3B-Instruct-GGUF quantized GGUF — — mit DhruvalLabs 3 17.3k
cerebras/Kimi-Linear-REAP-35B-A3B-Instruct finetune — 35.1B XL mit cerebras 70 9.7k
mlx-community/Kimi-Linear-48B-A3B-Instruct-4bit quantized -4bit 49.1B XL mit mlx-community 11 11.6k
Myric/Kimi-Linear-48B-A3B-Instruct-APEX-GGUF quantized GGUF — — mit Myric 0 12k
AaryanK/Kimi-Linear-48B-A3B-Instruct-GGUF quantized GGUF — — mit AaryanK 13 8.5k
noctrex/Kimi-Linear-48B-A3B-Instruct-MXFP4_MOE-GGUF quantized GGUF — — — noctrex 4 6.8k
Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 quantized nvfp4 28.0B L mit Firworks 10 6.4k
cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-8bit quantized AWQ 15.3B L mit cyankiwi 4 6.4k
mradermacher/Kimi-Linear-48B-A3B-Instruct-GGUF quantized GGUF — — mit mradermacher 1 4.1k
mlx-community/Kimi-Linear-48B-A3B-Instruct-6bit quantized — 49.1B XL mit mlx-community 3 3.5k
mlx-community/Kimi-Linear-48B-A3B-Instruct-8bit quantized -8bit 49.1B XL mit mlx-community 1 2.9k
brabooObrabo/Kimi-Linear-48B-A3B-Instruct-MXFP4-GS32-MLX quantized MXFP4 49.1B XL mit brabooObrabo 2 2.5k
mlx-community/Kimi-Linear-48B-A3B-Instruct-3bit quantized — 49.1B XL mit mlx-community 2 1.6k
infosave/Kimi-Linear-48B-A3B-Code-CMF quantized — — — mit infosave 0 1.4k
mlx-community/Kimi-Linear-48B-A3B-Instruct-mlx-bf16 finetune mlx 49.1B XL mit mlx-community 1 1.1k
mlx-community/Kimi-Linear-48B-A3B-Instruct-5bit quantized — 49.1B XL mit mlx-community 1 1.1k
JasmineBBB/Kimi-Linear-48B-A3B-Instruct-bnb-4bit quantized -bnb 49.1B XL mit JasmineBBB 1 716
mark-arts/kimi-linear-mlx-4bit quantized mlx 49.1B XL mit mark-arts 0 733
Kamali-Lab/Kimi-Linear-48B-A3B-Instruct-GGUF quantized GGUF — — mit Kamali-Lab 2 605
huawei-csl/Kimi-Linear-48B-A3B-Instruct-3bit-SINQ quantized — 7.20B M apache-2.0 huawei-csl 1 416
tiny-random/kimi-linear finetune — 5.65M S — tiny-random 0 451
Alpaczyk/Kimi-Linear-48B-A3B-Instruct-nvfp4 quantized nvfp4 28.0B L mit Alpaczyk 1 336
huawei-csl/Kimi-Linear-48B-A3B-Instruct-4bit-SINQ quantized -4bit 26.5B L apache-2.0 huawei-csl 3 202
TribeBlend/tribeblend-etl-kimi-linear-48b-a3b-instruct quantized GGUF — — other TribeBlend 0 260
Optivise/kimi-linear-48b-a3b-instruct-qlora-fine-tuned adapter — — — — Optivise 1 129
Moonlight556/Kimi-Linear-48B-A3B-DFlash-240k finetune — 451M S apache-2.0 Moonlight556 0 124
LeaderboardModel1/Kimi-Linear-48B-A3B-Instruct-AutoRound-W4A16-RTN finetune -W4A16 7.24B M — LeaderboardModel1 0 65
positron-ai/Kimi-Linear-48B-A3B-Instruct finetune — 49.1B XL mit positron-ai 0 45
masafy/kimi-fii-lora adapter — — — cc-by-sa-3.0 masafy 0 22
OistarsdataSolutions/NECRO-BOT adapter — — — bigscience-bloom-rail-1.0 OistarsdataSolutions 0 0
Rafael4882/dhx-teste finetune — — — bigcode-openrail-m Rafael4882 0 0
jashansinghTT/kimi-linear-48b-a3b-instruct-blackhole finetune — — — mit jashansinghTT 0 0
mamingyuan/Kimi-Linear-48B-A3B-Instruct-DUET-v3 finetune — — — other mamingyuan 0 0

Repository changelog

17 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 17 commits

DateCommitSHA
2025-12-16 Fix deprecated import for Transformers v5 compatibility (#19) e1df551
2025-11-25 Update README.md 806a95e
2025-11-17 Update README.md 828c457
2025-11-17 Update README.md e6fa68d
2025-11-17 Upload arxiv.png 9d37c46
2025-11-13 Fix FLA import errors d64a529
2025-11-01 Update README.md 6e163f3
2025-11-01 Update README.md 5eaec58
2025-11-01 Update README.md 06108b8
2025-11-01 Update README.md cbf1f86
2025-11-01 Update README.md e06dad3
2025-11-01 Upload github.png 3a7e0c5
2025-11-01 Improve model card: Add metadata, paper, and GitHub links (#7) cd777b7
2025-10-30 Fix LaTeX rendering issue on README.md (#2) fd1de63
2025-10-30 Update README.md 62a8341
2025-10-30 Upload folder using huggingface_hub 919416f
2025-10-30 initial commit ff5066e

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for Kimi-Linear-48B-A3B-Instruct, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Featherless
hf
moonshotai/Kimi-Linear-48B-A3B-Instruct — — — — — — — live 2026-10-25

Articles and coverage

12 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis10

arxiv.org2025-11-03authorityHN front pageabout the Kimi Linear familyHN 306 pts · 133 comments436 words
Kimi Linear is a hybrid linear attention architecture that outperforms full attention across short, long, and reinforcement learning contexts. The model features 3B activated parameters and 48B total parameters, reducing KV cache usage by up to 75% while achieving up to 6 times decoding throughput for a 1M context.written, reviewed, cited
github.com2025-10-30authorityHN front pageabout the Kimi Linear familyHN 217 pts · 47 comments607 words
MoonshotAI released Kimi Linear, a hybrid linear attention architecture that outperforms full attention methods across various contexts. On MMLU-Pro with 4k context length, it achieves 51.0 performance with similar speed as full attention, while showing Pareto-optimal performance and a 3.98x speedup on RULER with 128k context length. The model reduces the need for large KV caches by up 75% and offers 6.3x faster TPOT compared to MLA at long sequence lengths of 1M tokens.written, reviewed, cited
  • The hybrid architecture uses a 3:1 ratio of KDA-to-global MLA to reduce memory usage.
  • The model was trained on 5.7T tokens and released as two versions of checkpoints.
  • Deployment requires Python version 3.10 or higher and torch version 2.6 or higher.
artificialanalysis.aiauthority712 words
Kimi Linear 48B A3B Instruct is an open weights model released by Kimi on October 30, 2025. It features 49.1 billion total parameters with only 3 billion active parameters during inference and operates under the MIT license. The model scores 7 on the Artificial Analysis Intelligence Index and supports a 1M token context window for text-only inputs.written, reviewed, cited
site.bhamm-lab.com2026-02-18HN 4 pts · 1 comments2,606 words
Kimi Linear 48B Instruct emerges as the best generalist model, while Qwen3 Coder Next serves as an immediate replacement for coding tasks on a homelab featuring 2× AMD AI Max+ 395 GPUs with 128GB unified memory each. Heavy quantization using Q2_K_XL proves viable for long-running background workflows, despite MiniMax 2.5 and GLM 4.7 REAP being too slow for human-in-the-loop tasks when context exceeds 20k.written, reviewed, cited
  • The author avoids Nvidia hardware due to a belief in the underdog and reported suffering.
  • Recent versions of llama.cpp have degraded performance for the Seed-OSS-36B-Instruct model.
github.com2025-11-03authorityabout the Kimi Linear familyHN 3 pts · 0 comments2,128 words
Qwen3-Next and Kimi Linear employ a 3:1 ratio of Gated DeltaNet blocks to full attention layers to achieve linear scaling. Kimi Linear refines this with channel-wise gating for improved long-context reasoning and replaces Qwen3-Next's gated attention layers with Multi-Head Latent Attention (MLA) to reduce KV cache size. Qwen3-Next uses a scalar gate with a SiLU activation to control memory decay and update rates, ensuring training stability.written, reviewed, cited
omarshabab.com1,950 words
howtospark.com2,156 words
hfviewer.com3,314 words
benchmarklist.com923 words
ai-tldr.dev731 words
All coverage tracked for this model (12) — append-only, nothing is ever removed

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Jamba-v0.1 · 51.6B
    same size band (XL), also MoE, same task (text-generation), permissive license
  • Phi-3.5-MoE-instruct · 41.9B
    same size band (XL), also MoE, same task (text-generation), permissive license
  • GLM-4.7-Flash · 31.2B
    also MoE, same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25

Follow Kimi-Linear-48B-A3B-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.