Models › MiniCPM family

openbmb Apache 2.0 out 9 months ago

9.37B parameters, several kinds of input and output, 40K tokens of context.

Verified 2026-10-25 Rank #359 in LLMs · score 81 method v1 Sources 3 Downloads 30d 366.9k · #191 of 619 tracked

Can I run it?5.6GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?366.9kdownloads, 30 days#191 of 619 we track · top 31%+14 likes, downloads −36% this week1,547 likesHugging Face2026-10-24

Worth reading

Picked by rule from 8 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 30 HN pts

Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project

A GitHub issue alleges that the llama3-V project copied code and model structures from MiniCPM-Llama3-V 2.5, noting that weight delta means are around 1e-4 and standard deviations cluster between 1.2e-3 and 1.4e-3.

  • The llama3-V tokenizer file size differs completely from the pre-release MinicPM-V-2 tokenizer.
  • The llama3-V project claims to reference LLaVA-UHD while omitting its identical implementation to MiniCPM-Llama3-V 2.5.
github.com 2024-06-03 30 HN pts · 7 comments 1.2k words about the MiniCPM family family
Latest · 4 months ago

Desk-Pet – a local-first desktop pet powered by MiniCPM5

MiniCPM Desk Pet runs the MiniCPM5-1B-GGUF model locally on macOS Apple Silicon or Windows x64 systems requiring about 2 GB disk space.

  • The app scans the machine for installed coding agents and prompts connection in one click.
  • Response speed depends on the user's chip, memory pressure, and the selected model.
github.com 2026-07-07 2 HN pts 719 words about the MiniCPM family family

8 best of 8 tracked

The 2 picks above, plus these 6. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: MiniCPM-2B Achieving Mistral-7B Performance on Snapdragon 835 SoCgithub.com · 2024-02-02
  2. PaperMiniCPM: Potential of Small Language Models W Scalable Training Strategiesarxiv.org · 2024-04-10 · 2 HN pts
  3. ArticleMiniCPM-v4.6 challenges larger multimodal models at 1.3B paramsfirethering.com · 2026-05-13 · 2 HN pts
  4. CodeMiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phonegithub.com · 2024-05-29 · 3 HN pts
  5. CodeMiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phonegithub.com · 2025-01-14 · 3 HN pts
  6. DiscussionMiniCPM: An end-side LLM achieves equivalent performance to Mistral-7Bold.reddit.com · 2024-02-02 · 2 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 12 quantized builds and 18 Spaces.

  • As a service0no API provider listed
  • On own hardware12quantized builds
  • Built on109 fine-tunes · 1 adapters · 0 merges
  • In apps18Hugging Face Spaces

Top Spaces running it: sitammeur/PicQ ♥ 56 · sitammeur/VidiQA ♥ 9 · build-small-hackathon/grandpas-bedtime-stories ♥ 7 · build-small-hackathon/multi-agent-lab ♥ 6

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 5.6 GB at INT4, 11 GB at FP8, 23 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.6 GB of weights (estimate; KV cache and activations extra)INT45.6 GBFP8: about 11 GB of weights (estimate; KV cache and activations extra)FP811 GBBF16: about 23 GB of weights (estimate; KV cache and activations extra)BF1623 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.6 GB of weights (estimate; KV cache and activations extra)INT45.6 GBFP8: about 11 GB of weights (estimate; KV cache and activations extra)FP811 GBBF16: about 23 GB of weights (estimate; KV cache and activations extra)BF1623 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2026-02-03), amber triangles are 7 dated articles (each links to it), grey ticks are repo commits.

MarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2026-10-24: 1 repo commit2026-10-16: 1 repo commit2026-08-18: 2 repo commits2026-08-03: 1 repo commit2026-07-06: 1 repo commit2026-05-19: 1 repo commit2026-05-10: 1 repo commit2026-03-07: 4 repo commits2026-03-06: 1 repo commit2026-03-04: 1 repo commit2026-02-25: 1 repo commit2026-02-23: 2 repo commits2026-02-15: 5 repo commits2026-02-13: 2 repo commits2026-02-12: 1 repo commit2026-02-11: 2 repo commits2026-02-10: 1 repo commit2026-02-09: 2 repo commitsDesk-Pet – a local-first desktop pet powered by MiniCPM5 · 2026-07-07Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project · 2024-06-03MiniCPM: Potential of Small Language Models W Scalable Training Strategies · 2024-04-10MiniCPM-v4.6 challenges larger multimodal models at 1.3B params · 2026-05-13MiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phone · 2024-05-29MiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phone · 2025-01-14MiniCPM: An end-side LLM achieves equivalent performance to Mistral-7B · 2024-02-02Weights 2026-02-03 · 2026-02-03Weights 2026-02-03now
MarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2026-10-24: 1 repo commit2026-10-16: 1 repo commit2026-08-18: 2 repo commits2026-08-03: 1 repo commit2026-07-06: 1 repo commit2026-05-19: 1 repo commit2026-05-10: 1 repo commit2026-03-07: 4 repo commits2026-03-06: 1 repo commit2026-03-04: 1 repo commit2026-02-25: 1 repo commit2026-02-23: 2 repo commits2026-02-15: 5 repo commits2026-02-13: 2 repo commits2026-02-12: 1 repo commit2026-02-11: 2 repo commits2026-02-10: 1 repo commit2026-02-09: 2 repo commitsDesk-Pet – a local-first desktop pet powered by MiniCPM5 · 2026-07-07Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project · 2024-06-03MiniCPM: Potential of Small Language Models W Scalable Training Strategies · 2024-04-10MiniCPM-v4.6 challenges larger multimodal models at 1.3B params · 2026-05-13MiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phone · 2024-05-29MiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phone · 2025-01-14MiniCPM: An end-side LLM achieves equivalent performance to Mistral-7B · 2024-02-02Weights 2026-02-03 · 2026-02-03Weights 2026-02-03now

What people built on it

22 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

22 derivatives on the Hub, most of them quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

12 quantized (Hugging Face model tree)9 fine-tunes (Hugging Face model tree)1 adapter (Hugging Face model tree)12 quantized9 fine-tunes1 adapter
12 quantized (Hugging Face model tree)9 fine-tunes (Hugging Face model tree)1 adapter (Hugging Face model tree)12 quantized9 fine-tunes1 adapter

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The architecture supports full-duplex multimodal live streaming for simultaneous vision, speech, and text processing.[1]

  1. “full-duplex multimodal live streaming”

Generated 2026-10-07 15:08 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

6 use cases

What it is good at 6 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Pipeline tagany-to-any
Librarytransformers
ArchitecturesMiniCPMO
Model typeminicpmo
Dtypebfloat16
Params by dtypeBF16: 9,371,787,666
Size bandL
MoEno
Context length40,960 (config.json max_position_embeddings)
PapersarXiv:2408.01800
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · MiniCPMO · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · MiniCPMO · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for MiniCPM-o-4_5: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)23 GB · Single GPU (<24 GB)
FP8 (1 byte/param)11 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)5.6 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

22 variants

Lineage

Original model Family: openbmb/MiniCPM 22 derivatives on the Hub

quantized: 12finetune: 9adapter: 1

Top variants (22 shown, ranked by downloads)

Relation
Quant
Size
22 rows
Variant Relation Quant Params Band License Author Likes Downloads
openbmb/MiniCPM-o-4_5-gguf quantized gguf — — apache-2.0 openbmb 176 386.5k
openbmb/MiniCPM-o-4_5-awq quantized awq 9.37B L apache-2.0 openbmb 23 267k
openbmb/MiniCPM-o-4_5-GPTQ quantized GPTQ 9.37B L apache-2.0 openbmb 2 6.8k
andrevp/MiniCPM-o-4_5-MLX-4bit quantized MLX 9.37B L apache-2.0 andrevp 6 4.3k
erenyeager-1/MiniCPM-o-4_5-gguf quantized gguf — — apache-2.0 erenyeager-1 0 1.2k
Gander-Omni/Gander quantized — — — apache-2.0 Gander-Omni 20 0
ericleigh007/MiniCPM-o-4_5-BNB-Int4 quantized -BNB 9.59B L other ericleigh007 1 589
sarat-adusumilli/minicpm-o-4_5-q4-visualizer quantized GGUF — — apache-2.0 sarat-adusumilli 1 535
ericleigh007/MiniCPM-o-4_5-BNB-Int8 quantized -BNB 9.37B L other ericleigh007 3 428
dystrio/MiniCPM-o-4_5-Sculpt-Throughput finetune — 8.41B M apache-2.0 dystrio 2 124
joyfox/JoyFox-OmniFlow-9B quantized — 9.37B L apache-2.0 joyfox 2 92
dystrio/MiniCPM-o-4_5-Sculpt-Default finetune — 9.15B L apache-2.0 dystrio 0 90
Edith08/MiniCPM-o-4_5-q4 quantized — 4.82B M apache-2.0 Edith08 0 65
dystrio/MiniCPM-o-4_5-Sculpt-Production finetune — 8.86B M apache-2.0 dystrio 0 62
cs-qyzhang/MiniCPM-o-4_5-tts-dflash finetune — 43.7M S — cs-qyzhang 0 60
dystrio/MiniCPM-o-4_5-Sculpt-Aggressive finetune — 7.79B M apache-2.0 dystrio 0 57
owaski/MiniCPM-o-4_5-SimulS2ST-zh-r4-1000h finetune — 8.87B M cc-by-nc-4.0 owaski 0 36
pkq233/minicpmo45-matchtime-window-v5-lora-continue204 adapter — — — other pkq233 0 32
vito95311/minicpm-o-guardian-pai finetune — — — apache-2.0 vito95311 0 0
carcinize/minicpm-o45-modyl-sft-lora finetune — — — — carcinize 0 0
carcinize/minicpm-o45-modyl-dpo-lora finetune — — — — carcinize 0 0
lingyuxing/Gander quantized — — — apache-2.0 lingyuxing 0 0

Repository changelog

30 commits
changed in the last 7 daysRepo commits: 2026-10-24all changes

Repository changelog 30 commits

DateCommitSHA
2026-10-24 Update README.md eb4141d
2026-10-16 Update README.md d59117d
2026-08-18 Update README.md 503e754
2026-08-18 Update README.md 3dd9b99
2026-08-03 Update: README.md 073dbbc
2026-07-06 Update modeling_minicpmo.py (#18) 1f76113
2026-05-19 Update README.md 4382fca
2026-05-10 Update README.md 6e88563
2026-03-07 Update README.md 44151b3
2026-03-07 Update README.md 4448bb9
2026-03-07 Update README.md 1c43f9a
2026-03-07 Update README.md 98f7b9f
2026-03-06 Update README.md 93899ef
2026-03-04 fix: stream in chat not return early (#16) b1d22a3
2026-02-25 Update README.md 672fbe5
2026-02-23 Update demo url 5ef9102
2026-02-23 Update demo url 204d0a7
2026-02-15 Update readme from github 0cabd57
2026-02-15 Update readme from github e861f2a
2026-02-15 Update readme from github e23c048
2026-02-15 Update readme from github 6ada8bb
2026-02-15 Update readme from github ab2d5c7
2026-02-13 Fix link ed428df
2026-02-13 Add omni casebook d4deb77
2026-02-12 Rename audio casebook a7313ef
2026-02-11 fix: pass use_audio to get_video_frame_audio_segments e5bee1c
2026-02-11 Delete assets/CosyVoice2-0.5B 5677265
2026-02-10 Update dependency ff38376
2026-02-09 Update README.md 2db3a13
2026-02-09 feat: update readme caused by using token2wav in non-streaming tts (#8) 55ab13c

Articles and coverage

8 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis5

github.com2026-07-07authorityabout the MiniCPM familyHN 2 pts · 0 comments719 words
MiniCPM Desk Pet runs the MiniCPM5-1B-GGUF model locally on macOS Apple Silicon or Windows x64 systems requiring about 2 GB disk space. The application is distributed under the GNU AGPL-3.0-only license and supports downloading models from Hugging Face or ModelScope during the initial setup. It provides agent-aware reactions to coding tools and includes a neko-style persona adapter for desktop interaction.written, reviewed, cited
  • The app scans the machine for installed coding agents and prompts connection in one click.
  • Response speed depends on the user's chip, memory pressure, and the selected model.
  • Coding-agent reactions depend on each tool's integration behavior and may vary by version.
arxiv.org2024-04-10authorityabout the MiniCPM familyHN 2 pts · 0 comments449 words
MiniCPM introduces small language models with 1.2B and 2.4B parameters that match the performance of larger 7B to 13B LLMs. The approach employs extensive model wind tunnel experiments for stable scaling and utilizes a Warmup-Stable-Decay (WSD) learning rate scheduler to derive a higher compute optimal data-model ratio than Chinchilla Optimal. The family also includes MiniCPM-DPO, MiniCPM-MoE, and MiniCPM-128K variants.written, reviewed, cited
firethering.com2026-05-13about the MiniCPM familyHN 2 pts · 0 comments1,203 words
MiniCPM-V 4.6 is a 1.3B parameter multimodal model built to run on phones across iOS, Android, and HarmonyOS while handling image understanding, video analysis, OCR, and multi-image reasoning workloads. It introduces mixed 4x and 16x visual token compression which reduces visual encoding computation by more than 50% compared to standard approaches, enabling the full model to run on 4GB GPU memory or the GGUF variant on a 2GB CPU footprint. The model scores 13 on the Artificial Analysis Intelligence Index, outperforming Qwen3.5-0.8B on benchmarks like OmniDocBench where it reaches 84.6 against the rival's 47.0.written, reviewed, cited
  • The Thinking variant pushes MathVista to 75.6 but introduces latency that reduces lightweight responsiveness.
  • HallusionBench results show a hallucination rate of 30.6% compared to Qwen3.5-0.8B's 41.7%.
  • The GGUF variant runs on CPU at 2GB, while quantized variants like BNB and AWQ sit at 3GB GPU memory.
github.com2024-05-29authorityabout the MiniCPM familyHN 3 pts · 1 comments1,339 words
github.com2025-01-14authorityabout the MiniCPM familyHN 3 pts · 0 comments1,339 words

Community2

github.com2024-06-03authorityabout the MiniCPM familyHN 30 pts · 7 comments1,234 words
A GitHub issue alleges that the llama3-V project copied code and model structures from MiniCPM-Llama3-V 2.5, noting that weight delta means are around 1e-4 and standard deviations cluster between 1.2e-3 and 1.4e-3. The accuser states the llama3-V implementation uses a Perceiver resampler with a single-layer cross-attention instead of a two-layer self-attention and incorrectly applies Sigmoid activation of SigLIP for training multimodal large language models. The MiniCPM-Llama3-V 2.5 team confirmed they are investigating the situation.written, reviewed, cited
  • The llama3-V tokenizer file size differs completely from the pre-release MinicPM-V-2 tokenizer.
  • The llama3-V project claims to reference LLaVA-UHD while omitting its identical implementation to MiniCPM-Llama3-V 2.5.
old.reddit.com2024-02-02about the MiniCPM familyHN 2 pts · 2 comments
All coverage tracked for this model (8) — append-only, nothing is ever removed

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • gemma-4-E4B-it · 8.00B
    same task (any-to-any), more providers, permissive license
  • Qwen2.5-Omni-7B · 10.7B
    same size band (L), same task (any-to-any), permissive license
  • gemma-4-E4B · 8.00B
    same task (any-to-any), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:38 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:08 UTC · Last verified 2026-10-25

Follow MiniCPM-o-4_5

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.