Models › MiniCPM family

openbmb Apache 2.0 out 21 months ago

8.67B parameters, several kinds of input and output, 32K tokens of context.

Verified 2026-10-25 Rank #419 in LLMs · score 78.9 method v1 Sources 3 Downloads 30d 45.5k · #392 of 619 tracked

Changed this week: 1 new quantized build on the Hub (10 in all).2026-10-24

Can I run it?5.2GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?45.5kdownloads, 30 days#392 of 619 we track · below the median+4 likes, downloads −52% this week1,324 likesHugging Face2026-10-24

Worth reading

Picked by rule from 8 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 30 HN pts

Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project

A GitHub issue alleges that the llama3-V project copied code and model structures from MiniCPM-Llama3-V 2.5, noting that weight delta means are around 1e-4 and standard deviations cluster between 1.2e-3 and 1.4e-3.

  • The llama3-V tokenizer file size differs completely from the pre-release MinicPM-V-2 tokenizer.
  • The llama3-V project claims to reference LLaVA-UHD while omitting its identical implementation to MiniCPM-Llama3-V 2.5.
github.com 2024-06-03 30 HN pts · 7 comments 1.2k words about the MiniCPM family family
Latest · 4 months ago

Desk-Pet – a local-first desktop pet powered by MiniCPM5

MiniCPM Desk Pet runs the MiniCPM5-1B-GGUF model locally on macOS Apple Silicon or Windows x64 systems requiring about 2 GB disk space.

  • The app scans the machine for installed coding agents and prompts connection in one click.
  • Response speed depends on the user's chip, memory pressure, and the selected model.
github.com 2026-07-07 2 HN pts 719 words about the MiniCPM family family

8 best of 8 tracked

The 2 picks above, plus these 6. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: MiniCPM-2B Achieving Mistral-7B Performance on Snapdragon 835 SoCgithub.com · 2024-02-02
  2. PaperMiniCPM: Potential of Small Language Models W Scalable Training Strategiesarxiv.org · 2024-04-10 · 2 HN pts
  3. ArticleMiniCPM-v4.6 challenges larger multimodal models at 1.3B paramsfirethering.com · 2026-05-13 · 2 HN pts
  4. CodeMiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phonegithub.com · 2024-05-29 · 3 HN pts
  5. CodeMiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phonegithub.com · 2025-01-14 · 3 HN pts
  6. DiscussionMiniCPM: An end-side LLM achieves equivalent performance to Mistral-7Bold.reddit.com · 2024-02-02 · 2 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 10 quantized builds and 15 Spaces.

  • As a service0no API provider listed
  • On own hardware10quantized builds
  • Built on118 fine-tunes · 3 adapters · 0 merges
  • In apps15Hugging Face Spaces

Top Spaces running it: Staticaliza/Sense ♥ 2 · marstin/VLM-Lens ♥ 2 · mohan007/autism_exp_with_minicpm_o_2_6 ♥ 1 · SynaptechX/ImgTextParser ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 5.2 GB at INT4, 10 GB at FP8, 21 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.2 GB of weights (estimate; KV cache and activations extra)INT45.2 GBFP8: about 10 GB of weights (estimate; KV cache and activations extra)FP810 GBBF16: about 21 GB of weights (estimate; KV cache and activations extra)BF1621 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.2 GB of weights (estimate; KV cache and activations extra)INT45.2 GBFP8: about 10 GB of weights (estimate; KV cache and activations extra)FP810 GBBF16: about 21 GB of weights (estimate; KV cache and activations extra)BF1621 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-01-12), amber triangles are 7 dated articles (each links to it), grey ticks are repo commits.

MarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2026-08-18: 2 repo commits2025-10-05: 2 repo commits2025-06-20: 1 repo commit2025-06-17: 1 repo commit2025-05-13: 2 repo commits2025-03-28: 1 repo commit2025-03-03: 1 repo commit2025-02-20: 4 repo commits2025-02-17: 1 repo commit2025-02-11: 1 repo commit2025-01-26: 3 repo commits2025-01-24: 2 repo commits2025-01-23: 1 repo commit2025-01-22: 2 repo commits2025-01-21: 3 repo commits2025-01-20: 3 repo commitsDesk-Pet – a local-first desktop pet powered by MiniCPM5 · 2026-07-07Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project · 2024-06-03MiniCPM: Potential of Small Language Models W Scalable Training Strategies · 2024-04-10MiniCPM-v4.6 challenges larger multimodal models at 1.3B params · 2026-05-13MiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phone · 2024-05-29MiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phone · 2025-01-14MiniCPM: An end-side LLM achieves equivalent performance to Mistral-7B · 2024-02-02Weights 2025-01-12 · 2025-01-12Weights 2025-01-12now
MarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2026-08-18: 2 repo commits2025-10-05: 2 repo commits2025-06-20: 1 repo commit2025-06-17: 1 repo commit2025-05-13: 2 repo commits2025-03-28: 1 repo commit2025-03-03: 1 repo commit2025-02-20: 4 repo commits2025-02-17: 1 repo commit2025-02-11: 1 repo commit2025-01-26: 3 repo commits2025-01-24: 2 repo commits2025-01-23: 1 repo commit2025-01-22: 2 repo commits2025-01-21: 3 repo commits2025-01-20: 3 repo commitsDesk-Pet – a local-first desktop pet powered by MiniCPM5 · 2026-07-07Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project · 2024-06-03MiniCPM: Potential of Small Language Models W Scalable Training Strategies · 2024-04-10MiniCPM-v4.6 challenges larger multimodal models at 1.3B params · 2026-05-13MiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phone · 2024-05-29MiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phone · 2025-01-14MiniCPM: An end-side LLM achieves equivalent performance to Mistral-7B · 2024-02-02Weights 2025-01-12 · 2025-01-12Weights 2025-01-12now

What people built on it

21 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

21 derivatives on the Hub, led by 10 quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

10 quantized (Hugging Face model tree)8 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)10 quantized8 fine-tunes3 adapters
10 quantized (Hugging Face model tree)8 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)10 quantized8 fine-tunes3 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The model uses an end-to-end omni-modal architecture and is released under the Apache 2.0 license.[1][2]

  1. license
  2. “End-to-end Omni-modal Architecture”

Generated 2026-10-07 15:09 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagany-to-any
Librarytransformers
ArchitecturesMiniCPMO
Model typeminicpmo
Dtypebfloat16
Params by dtypeBF16: 8,674,997,028
Size bandM
MoEno
Context length32,768 (config.json max_position_embeddings)
Languagesmultilingual
PapersarXiv:2405.17220, arXiv:2408.01800
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · MiniCPMO · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · MiniCPMO · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for MiniCPM-o-2_6: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)21 GB · Single GPU (<24 GB)
FP8 (1 byte/param)10 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)5.2 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

21 variants

Lineage

Original model Family: openbmb/MiniCPM 21 derivatives on the Hub

quantized: 10finetune: 8adapter: 3

Top variants (21 shown, ranked by downloads)

Relation
Quant
Size
21 rows
Variant Relation Quant Params Band License Author Likes Downloads
openbmb/MiniCPM-o-2_6-gguf quantized gguf — — apache-2.0 openbmb 120 153.3k
openbmb/MiniCPM-o-2_6-int4 quantized int4 8.67B M apache-2.0 openbmb 54 98.6k
bartowski/MiniCPM-o-2_6-GGUF quantized GGUF — — — bartowski 7 30k
lmstudio-community/MiniCPM-o-2_6-GGUF quantized GGUF — — — lmstudio-community 8 23.5k
second-state/MiniCPM-o-2_6-GGUF quantized GGUF — — — second-state 9 6.6k
gaianet/MiniCPM-o-2_6-GGUF quantized GGUF — — — gaianet 0 3.3k
2dameneko/MiniCPM-o-2_6-nf4 quantized -nf4 8.91B M apache-2.0 2dameneko 0 2.9k
openbmb/MiniCPM-o-2_6-GPTQ quantized GPTQ 8.67B M apache-2.0 openbmb 4 452
jinzhuoran/OmniRewardModel finetune — 8.42B M cc-by-nc-4.0 jinzhuoran 5 323
hrithik-dev8/tiny-random-MiniCPM-o-2_6 finetune — 21.8M S apache-2.0 hrithik-dev8 0 522
Guilherme34/Samantha-omni-humanlike-lora adapter — — — — Guilherme34 3 301
Guilherme34/Samantha-omni-lora adapter — — — other Guilherme34 1 267
notlikejoe/tiny-random-MiniCPM-o-2_6 finetune — 6.17M S apache-2.0 notlikejoe 0 150
Tabish244/YouLearn-V9.1-MiniCPM5-1B-GGUF quantized GGUF — — apache-2.0 Tabish244 0 143
ipsilondev/voxcpm-spanish-lora-18k adapter — 802M S apache-2.0 ipsilondev 0 54
kirillrb/45 finetune — — — afl-3.0 kirillrb 1 0
OpenVINO/MiniCPM-o-2_6-int4-cw-ov quantized int4 — — apache-2.0 OpenVINO 0 6
George1234f/h finetune — — — apache-2.0 George1234f 0 0
brockfellows8/Ember finetune — — — gpl-3.0 brockfellows8 0 0
aydin1876/rma finetune — — — apache-2.0 aydin1876 0 0
AIExplorer1234/customer-churn-prediction finetune — — — apache-2.0 AIExplorer1234 0 0

Repository changelog

30 commits
changed in the last 7 daysOther: 2026-10-24all changes

Repository changelog 30 commits

DateCommitSHA
2026-08-18 Update README.md 06849bf
2026-08-18 Update README.md 4f264f5
2025-10-05 Update README.md 509805e
2025-10-05 Update README.md 1e5e304
2025-06-20 Update README.md 9da79ac
2025-06-17 Update README.md 40fb6f3
2025-05-13 Update resampler.py (#45) 1758aee
2025-05-13 Make model compatible with Transformers v4.49.0 (#40) 58b0fd1
2025-03-28 Supports MacOS in MiniCPM-o 2.6 (#19) df3d4c9
2025-03-03 Update README.md 9a8db9d
2025-02-20 Delete assets/qa.wav 33bfc71
2025-02-20 Delete assets/mimick.wav a535950
2025-02-20 Update README.md 4dedb07
2025-02-20 Upload assistant_female_voice.wav a323bd6
2025-02-17 Update modeling_minicpmo.py f343679
2025-02-11 Update modeling_minicpmo.py (#32) 954cd56
2025-01-26 Avoid duplicate input kwargs in `_decode` (#28) 34a6e7f
2025-01-26 Update README.md 77225ff
2025-01-26 Update README.md 19c5f03
2025-01-24 Update system prompt of assistant mode to make sure AudioEvals metric is replicable 7a26a08
2025-01-24 Update README.md 8329cd6
2025-01-23 Release `get_audio_placeholder` interface in processing (#24) ac4f235
2025-01-22 fix vision-only inference 4a25f99
2025-01-22 fix audio batch inference 1bbb766
2025-01-21 Update README.md 4e1cff2
2025-01-21 update readme 41a38b3
2025-01-21 support audio finetuning (#22) 2ea48c8
2025-01-20 add usage samples to readme 686e87a
2025-01-20 update readme, add audio input examples 7063fbc
2025-01-20 Update README.md 8670477

Articles and coverage

8 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis5

github.com2026-07-07authorityabout the MiniCPM familyHN 2 pts · 0 comments719 words
MiniCPM Desk Pet runs the MiniCPM5-1B-GGUF model locally on macOS Apple Silicon or Windows x64 systems requiring about 2 GB disk space. The application is distributed under the GNU AGPL-3.0-only license and supports downloading models from Hugging Face or ModelScope during the initial setup. It provides agent-aware reactions to coding tools and includes a neko-style persona adapter for desktop interaction.written, reviewed, cited
  • The app scans the machine for installed coding agents and prompts connection in one click.
  • Response speed depends on the user's chip, memory pressure, and the selected model.
  • Coding-agent reactions depend on each tool's integration behavior and may vary by version.
arxiv.org2024-04-10authorityabout the MiniCPM familyHN 2 pts · 0 comments449 words
MiniCPM introduces small language models with 1.2B and 2.4B parameters that match the performance of larger 7B to 13B LLMs. The approach employs extensive model wind tunnel experiments for stable scaling and utilizes a Warmup-Stable-Decay (WSD) learning rate scheduler to derive a higher compute optimal data-model ratio than Chinchilla Optimal. The family also includes MiniCPM-DPO, MiniCPM-MoE, and MiniCPM-128K variants.written, reviewed, cited
firethering.com2026-05-13about the MiniCPM familyHN 2 pts · 0 comments1,203 words
MiniCPM-V 4.6 is a 1.3B parameter multimodal model built to run on phones across iOS, Android, and HarmonyOS while handling image understanding, video analysis, OCR, and multi-image reasoning workloads. It introduces mixed 4x and 16x visual token compression which reduces visual encoding computation by more than 50% compared to standard approaches, enabling the full model to run on 4GB GPU memory or the GGUF variant on a 2GB CPU footprint. The model scores 13 on the Artificial Analysis Intelligence Index, outperforming Qwen3.5-0.8B on benchmarks like OmniDocBench where it reaches 84.6 against the rival's 47.0.written, reviewed, cited
  • The Thinking variant pushes MathVista to 75.6 but introduces latency that reduces lightweight responsiveness.
  • HallusionBench results show a hallucination rate of 30.6% compared to Qwen3.5-0.8B's 41.7%.
  • The GGUF variant runs on CPU at 2GB, while quantized variants like BNB and AWQ sit at 3GB GPU memory.
github.com2024-05-29authorityabout the MiniCPM familyHN 3 pts · 1 comments1,339 words
github.com2025-01-14authorityHN 3 pts · 0 comments1,339 words

Community2

github.com2024-06-03authorityabout the MiniCPM familyHN 30 pts · 7 comments1,234 words
A GitHub issue alleges that the llama3-V project copied code and model structures from MiniCPM-Llama3-V 2.5, noting that weight delta means are around 1e-4 and standard deviations cluster between 1.2e-3 and 1.4e-3. The accuser states the llama3-V implementation uses a Perceiver resampler with a single-layer cross-attention instead of a two-layer self-attention and incorrectly applies Sigmoid activation of SigLIP for training multimodal large language models. The MiniCPM-Llama3-V 2.5 team confirmed they are investigating the situation.written, reviewed, cited
  • The llama3-V tokenizer file size differs completely from the pre-release MinicPM-V-2 tokenizer.
  • The llama3-V project claims to reference LLaVA-UHD while omitting its identical implementation to MiniCPM-Llama3-V 2.5.
old.reddit.com2024-02-02about the MiniCPM familyHN 2 pts · 2 comments
All coverage tracked for this model (8) — append-only, nothing is ever removed

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • gemma-4-E4B-it · 8.00B
    same size band (M), same task (any-to-any), more providers, permissive license
  • gemma-4-E4B · 8.00B
    same size band (M), same task (any-to-any), permissive license
  • Qwen2.5-Omni-7B · 10.7B
    same task (any-to-any), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:39 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:09 UTC · Last verified 2026-10-25

Follow MiniCPM-o-2_6

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.