Models › MiniCPM family

openbmb Not declared out 2 years ago

8.10B parameters, images and text in, text out.

Verified 2026-10-26 07:27 UTC Rank #695 in LLMs · score 72.3 method v1 Sources 3 Downloads 30d 25.6k · #437 of 619 tracked

Can I run it?4.9GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Not declaredNo license declared on the model cardlicence file2026-10-26
Do people use it?25.6kdownloads, 30 days#437 of 619 we track · below the median+1 likes, downloads −22% this week1,062 likesHugging Face2026-10-26

Worth reading

Picked by rule from 8 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 30 HN pts

Llama3V is suspected to have been stolen from the MiniCPM-Llama3-v2.5 project

A GitHub issue alleges that the llama3-V project copied code and model structures from MiniCPM-Llama3-V 2.5, noting that weight delta means are around 1e-4 and standard deviations cluster between 1.2e-3 and 1.4e-3.

  • The llama3-V tokenizer file size differs completely from the pre-release MinicPM-V-2 tokenizer.
  • The llama3-V project claims to reference LLaVA-UHD while omitting its identical implementation to MiniCPM-Llama3-V 2.5.
github.com 2024-06-03 30 HN pts · 7 comments 1.2k words about the MiniCPM family family
Latest · 4 months ago

Desk-Pet – a local-first desktop pet powered by MiniCPM5

MiniCPM Desk Pet runs the MiniCPM5-1B-GGUF model locally on macOS Apple Silicon or Windows x64 systems requiring about 2 GB disk space.

  • The app scans the machine for installed coding agents and prompts connection in one click.
  • Response speed depends on the user's chip, memory pressure, and the selected model.
github.com 2026-07-07 2 HN pts 719 words about the MiniCPM family family

8 best of 8 tracked

The 2 picks above, plus these 6. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeShow HN: MiniCPM-2B Achieving Mistral-7B Performance on Snapdragon 835 SoCgithub.com · 2024-02-02
  2. PaperMiniCPM: Potential of Small Language Models W Scalable Training Strategiesarxiv.org · 2024-04-10 · 2 HN pts
  3. ArticleMiniCPM-v4.6 challenges larger multimodal models at 1.3B paramsfirethering.com · 2026-05-13 · 2 HN pts
  4. CodeMiniCPM-v2.6: GPT-4V Level MLLM for Single/Multi Image and Video on Your Phonegithub.com · 2024-05-29 · 3 HN pts
  5. CodeMiniCPM-O 2.6, GPT-4o Level MLLM for Vision, Speech and Multimodal on Your Phonegithub.com · 2025-01-14 · 3 HN pts
  6. DiscussionMiniCPM: An end-side LLM achieves equivalent performance to Mistral-7Bold.reddit.com · 2024-02-02 · 2 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 14 quantized builds and 45 Spaces.

  • As a service0no API provider listed
  • On own hardware14quantized builds
  • Built on3814 fine-tunes · 24 adapters · 0 merges
  • In apps45Hugging Face Spaces

Top Spaces running it: TIGER-Lab/MEGA-Bench ♥ 51 · bokesyo/MiniCPMV-RAG-PDFQA ♥ 30 · KwabsHug/GameConfigIdea ♥ 17 · tcy6/VisRAG_Pipeline ♥ 13

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.9 GB at INT4, 9.7 GB at FP8, 19 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.9 GB of weights (estimate; KV cache and activations extra)INT44.9 GBFP8: about 9.7 GB of weights (estimate; KV cache and activations extra)FP89.7 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.9 GB of weights (estimate; KV cache and activations extra)INT44.9 GBFP8: about 9.7 GB of weights (estimate; KV cache and activations extra)FP89.7 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2024-08-04), amber triangles are 7 dated articles (each links to it).

What people built on it

52 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

52 derivatives on the Hub, led by 24 adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

14 quantized (Hugging Face model tree)14 fine-tunes (Hugging Face model tree)24 adapters (Hugging Face model tree)14 quantized14 fine-tunes24 adapters
14 quantized (Hugging Face model tree)14 fine-tunes (Hugging Face model tree)24 adapters (Hugging Face model tree)14 quantized14 fine-tunes24 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The model supports vision, OCR, multi-image, and video modalities.[1]

  1. “vision, ocr, multi-image, video”

Generated 2026-10-07 15:15 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

6 use cases

What it is good at 6 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesMiniCPMV
Model typeminicpmv
Params by dtypeBF16: 8,099,175,152
Size bandM
MoEno
Gatedauto
PapersarXiv:2408.01800
LicenseNot declared
Hub snapshot2026-10-26

Servability

vLLM · SGLang

Servability

vLLM: supported · MiniCPMV · 4b1c04e76fe9ac3ca8b7e541dd423e7d5f38dc60SGLang: supported · MiniCPMV · 60d941293e3af27a12c6eb64e2c3e2e1a17f100f

vLLM registry (4b1c04e76fe9ac3ca8b7e541dd423e7d5f38dc60) · SGLang registry (60d941293e3af27a12c6eb64e2c3e2e1a17f100f) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for MiniCPM-V-2_6: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)19 GB · Single GPU (<24 GB)
FP8 (1 byte/param)9.7 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.9 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: openbmb/MiniCPM 52 derivatives on the Hub

quantized: 14finetune: 14adapter: 24

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
openbmb/MiniCPM-V-2_6-int4 quantized int4 8.10B M — openbmb 90 1M
openbmb/MiniCPM-V-2_6-gguf quantized gguf — — — openbmb 181 340.4k
bartowski/MiniCPM-V-2_6-GGUF quantized GGUF — — — bartowski 27 86k
second-state/MiniCPM-V-2_6-GGUF quantized GGUF — — — second-state 5 28.4k
lmstudio-community/MiniCPM-V-2_6-GGUF quantized GGUF — — — lmstudio-community 17 27.3k
openbmb/AgentCPM-GUI finetune — 8.10B M apache-2.0 openbmb 138 6.3k
gaianet/MiniCPM-V-2_6-GGUF quantized GGUF — — — gaianet 0 12.3k
AI-Engine/MiniCPM-V-2_6-GGUF quantized GGUF — — other AI-Engine 0 4.6k
happyme531/MiniCPM-V-2_6-rkllm finetune — — — — happyme531 21 673
esteban71150/MiniCPM-V-2_6-int4-YOLO quantized int4 8.32B M — esteban71150 0 1.2k
llmware/minicpm-2.6-gguf quantized gguf — — apache-2.0 llmware 0 1.1k
nm-testing/MiniCPM-V-2_6-FP8-dynamic quantized -FP8 8.10B M — nm-testing 0 651
openbmb/MiniCPM-V-2_6-GPTQ quantized GPTQ 8.10B M apache-2.0 openbmb 1 529
muhtasham/MiniCPM-V-2_6_ft_20240908_220534 finetune — 8.10B M — muhtasham 0 457
PengxiangLi/MAT finetune — 8.10B M cc-by-nc-sa-4.0 PengxiangLi 2 189
Pictorial/MiniCPM-V-2_6-int4 quantized int4 8.32B M — Pictorial 0 187
muhtasham/MiniCPM-V-2_6_ft_upsampled_3686400_pixels finetune — 8.10B M — muhtasham 0 169
pranay-ar/MiniCPM-V-2_6-int4 quantized int4 8.32B M — pranay-ar 0 160
mitvho09/robomind-minicpm-loco-lora adapter — — — — mitvho09 0 147
sag-uniroma2/MiniCPM-V-2_6-gqa-it-finetuned finetune — 8.10B M — sag-uniroma2 0 141
CelesteImperia/MiniCPM-V-2.6-OpenVINO-INT4 finetune INT4 — — apache-2.0 CelesteImperia 0 129
whalezzz/MM-RAIT-MiniCPM-V-2_6 finetune — 8.10B M mit whalezzz 0 123
MiLaKa78/Gogol adapter — — — apache-2.0 MiLaKa78 2 0
CelesteImperia/MiniCPM-V-2.6-OpenVINO-INT8 finetune INT8 — — apache-2.0 CelesteImperia 0 94
muhtasham/MiniCPM-V-2_6_lora_20240915_181155 adapter — — — — muhtasham 0 90
duongntd2/flowchart_understanding adapter — — — — duongntd2 0 87
bochu/MiniCPM-V-2_6-int4 quantized int4 8.32B M — bochu 0 79
federerjiang/minicpm_layout_lora_multisize adapter — — — — federerjiang 0 78
cjfcsjt/pretrain_minicpmv adapter — — — — cjfcsjt 0 73
baohuynhbk14/miniCPM_finetune_lora_viet_vqa adapter — — — — baohuynhbk14 0 55
MCG-NJU/MiniCPM-V-2_6-RA finetune — 8.10B M mit MCG-NJU 0 54
Aarya2004/minicpmv-cord-lora adapter — — — cc-by-4.0 Aarya2004 0 50
allllklkl/MiniCPM-V-2_6-gqa-it-finetuned finetune — 8.10B M — allllklkl 0 41
lei-HuggingFace/MiniCPM-V-2_6_LoRA_Adapter adapter — — — — lei-HuggingFace 0 32
Aarya2004/minicpmv-trade-lora adapter — — — apache-2.0 Aarya2004 0 32
muhtasham/MiniCPM-V-2_6_lora_20240917_011727 adapter — — — — muhtasham 0 30
muhtasham/MiniCPM-V-2_6_lora_20240916_155621 adapter — — — — muhtasham 0 27
federerjiang/minicpm_layout_ctw_crello_v2_ck3300 adapter — — — — federerjiang 0 25
cjfcsjt/minicpmv_visionlora_bs64 adapter — — — — cjfcsjt 0 22
federerjiang/minicpm_layout_ctw_crello_v2_ck2500 adapter — — — — federerjiang 0 22

Repository changelog

1 change
changed in the last 7 daysNew on the watch list: 2026-10-26all changes

Articles and coverage

8 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis5

github.com2026-07-07authorityabout the MiniCPM familyHN 2 pts · 0 comments719 words
MiniCPM Desk Pet runs the MiniCPM5-1B-GGUF model locally on macOS Apple Silicon or Windows x64 systems requiring about 2 GB disk space. The application is distributed under the GNU AGPL-3.0-only license and supports downloading models from Hugging Face or ModelScope during the initial setup. It provides agent-aware reactions to coding tools and includes a neko-style persona adapter for desktop interaction.written, reviewed, cited
  • The app scans the machine for installed coding agents and prompts connection in one click.
  • Response speed depends on the user's chip, memory pressure, and the selected model.
  • Coding-agent reactions depend on each tool's integration behavior and may vary by version.
arxiv.org2024-04-10authorityabout the MiniCPM familyHN 2 pts · 0 comments449 words
MiniCPM introduces small language models with 1.2B and 2.4B parameters that match the performance of larger 7B to 13B LLMs. The approach employs extensive model wind tunnel experiments for stable scaling and utilizes a Warmup-Stable-Decay (WSD) learning rate scheduler to derive a higher compute optimal data-model ratio than Chinchilla Optimal. The family also includes MiniCPM-DPO, MiniCPM-MoE, and MiniCPM-128K variants.written, reviewed, cited
firethering.com2026-05-13about the MiniCPM familyHN 2 pts · 0 comments1,203 words
MiniCPM-V 4.6 is a 1.3B parameter multimodal model built to run on phones across iOS, Android, and HarmonyOS while handling image understanding, video analysis, OCR, and multi-image reasoning workloads. It introduces mixed 4x and 16x visual token compression which reduces visual encoding computation by more than 50% compared to standard approaches, enabling the full model to run on 4GB GPU memory or the GGUF variant on a 2GB CPU footprint. The model scores 13 on the Artificial Analysis Intelligence Index, outperforming Qwen3.5-0.8B on benchmarks like OmniDocBench where it reaches 84.6 against the rival's 47.0.written, reviewed, cited
  • The Thinking variant pushes MathVista to 75.6 but introduces latency that reduces lightweight responsiveness.
  • HallusionBench results show a hallucination rate of 30.6% compared to Qwen3.5-0.8B's 41.7%.
  • The GGUF variant runs on CPU at 2GB, while quantized variants like BNB and AWQ sit at 3GB GPU memory.
github.com2024-05-29authorityHN 3 pts · 1 comments1,339 words
github.com2025-01-14authorityabout the MiniCPM familyHN 3 pts · 0 comments1,339 words

Community2

github.com2024-06-03authorityabout the MiniCPM familyHN 30 pts · 7 comments1,234 words
A GitHub issue alleges that the llama3-V project copied code and model structures from MiniCPM-Llama3-V 2.5, noting that weight delta means are around 1e-4 and standard deviations cluster between 1.2e-3 and 1.4e-3. The accuser states the llama3-V implementation uses a Perceiver resampler with a single-layer cross-attention instead of a two-layer self-attention and incorrectly applies Sigmoid activation of SigLIP for training multimodal large language models. The MiniCPM-Llama3-V 2.5 team confirmed they are investigating the situation.written, reviewed, cited
  • The llama3-V tokenizer file size differs completely from the pre-release MinicPM-V-2 tokenizer.
  • The llama3-V project claims to reference LLaVA-UHD while omitting its identical implementation to MiniCPM-Llama3-V 2.5.
old.reddit.com2024-02-02about the MiniCPM familyHN 2 pts · 2 comments
All coverage tracked for this model (8) — append-only, nothing is ever removed

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-VL-8B-Instruct · 8.77B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • Qwen2.5-VL-7B-Instruct · 8.29B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • Qwen3.5-9B · 9.65B
    same task (image-text-to-text), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-26 · HF API: 2026-10-26 07:24 UTC · Providers: 2026-10-26 07:26 UTC · Articles: 2026-10-26 07:27 UTC · Summary: 2026-10-07 15:15 UTC · Last verified 2026-10-26 07:27 UTC

Follow MiniCPM-V-2_6

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.