The story so far
Weights, every dated article, and repo commits on one rail.
21 repo commits since the weights landed
Teal is the weights (2024-09-30), grey ticks are repo commits.
Up to date
nvidia CC BY-NC 4.0 out 2 years ago
79.4B parameters, images and text in, text out.
Verified 2026-10-25 Rank #538 in LLMs · score 75.3 method v1 Sources 3 Downloads 30d 9.4k · #511 of 619 tracked
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
No API provider serves it, so its downloads are people running it themselves: 1 quantized builds and 7 Spaces.
Top Spaces running it: merve/vision_papers ♥ 118 · TIGER-Lab/MEGA-Bench ♥ 51
Weights only, an estimate: leave room for the KV cache. Method
About 48 GB at INT4, 95 GB at FP8, 191 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2024-09-30), grey ticks are repo commits.
13 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
| Benchmark | Value | Setting / notes | Reported by | Date |
|---|---|---|---|---|
| author-reported AI2D · Understand images and video | 94.2 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported AI2D · Understand images and video | 94.2 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported Avg. Accuracy | 84.1 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported Avg. Accuracy | 84.3 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported ChartQA · Understand images and video | 86 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported ChartQA · Understand images and video | 86 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported DocVQA · Extract text from documents | 92.6 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported DocVQA · Extract text from documents | 92.6 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported GSM8K · Reason through hard problems | 92.9 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported GSM8K · Reason through hard problems | 93.2 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported HumanEval · Write code with agents | 88.4 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported HumanEval · Write code with agents | 89 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported MATH-500 · Reason through hard problems | 73.1 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported MATH-500 · Reason through hard problems | 73.1 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported MMLU · Reason through hard problems | 82 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported MMLU · Reason through hard problems | 81.7 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported MMMU · Understand images and video | 58.7 / 54.9 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported MMMU · Understand images and video | 59.7 / 54.6 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported MathVista · Understand images and video | 65.2 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported MathVista · Understand images and video | 65.2 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported OCRBench · Extract text from documents | 852 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported OCRBench · Extract text from documents | 853 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported RealWorldQA · Understand images and video | 69.5 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported RealWorldQA · Understand images and video | 69.7 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported TextVQA · Understand images and video | 82.6 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| Benchmark | Value | Setting / notes | Reported by | Date |
|---|---|---|---|---|
| author-reported TextVQA · Understand images and video | 82.1 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
| author-reported VQAv2 · Understand images and video | 85.4 | NVLM-D 1.0 72B (Huggingface) | model author | 2026-10-07 |
| author-reported VQAv2 · Understand images and video | 85.4 | NVLM-D 1.0 72B (Megatron) | model author | 2026-10-07 |
NVLM-D-72B is a 79.4B parameter multimodal model designed for vision-language and text-only tasks.[1][2] The model uses a decoder-only architecture and is released under a CC BY-NC 4.0 license.[3][4]
Generated 2026-10-07 15:12 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | image-text-to-text |
|---|---|
| Library | transformers |
| Architectures | NVLM_D |
| Model type | NVLM_D |
| Dtype | bfloat16 |
| Params by dtype | BF16: 70,308,223,104 · F32: 9,071,370,240 |
| Size band | XL |
| MoE | no |
| Languages | en |
| Papers | arXiv:2409.11402 |
| License | CC BY-NC 4.0 (cc-by-nc-4.0) |
| Hub snapshot | 2026-10-25 |
vLLM: supported · NVLM_D · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for NVLM-D-72B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 191 GB · Multi-GPU node (<640 GB) |
|---|---|
| FP8 (1 byte/param) | 95 GB · Multi-GPU node (<640 GB) |
| INT4 (0.5 bytes/param) | 48 GB · Single high-end GPU (<80 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
quantized: 1merge: 1finetune: 10adapter: 1
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| SeanScripts/NVLM-D-72B-nf4 | quantized | -nf4 | 81.8B | XL | cc-by-nc-4.0 | SeanScripts | 10 | 18.4k |
| bkbj/Atest | merge | — | — | — | bigscience-openrail-m | bkbj | 0 | 263 |
| PIOTRsus123/BUMCYKCYK | finetune | — | — | — | — | PIOTRsus123 | 2 | 0 |
| peter0000/newrobot | finetune | — | — | — | openrail | peter0000 | 1 | 0 |
| renia2954/chatbot | finetune | — | — | — | apache-2.0 | renia2954 | 0 | 0 |
| A1wayzbeenrea1/New_one | finetune | — | — | — | cc-by-nc-sa-3.0 | A1wayzbeenrea1 | 0 | 0 |
| AdelfelteR/Harold | finetune | — | — | — | openrail++ | AdelfelteR | 0 | 0 |
| Arunic/Arunia | finetune | — | — | — | apache-2.0 | Arunic | 0 | 0 |
| laligaa/365 | finetune | — | — | — | wtfpl | laligaa | 0 | 0 |
| midhyaraj/voiceclone | finetune | — | — | — | apache-2.0 | midhyaraj | 0 | 0 |
| CapitaLeny/ShadowBoy | finetune | — | — | — | afl-3.0 | CapitaLeny | 0 | 0 |
| PrakashReddy77/NLP | adapter | — | — | — | bigscience-bloom-rail-1.0 | PrakashReddy77 | 0 | 0 |
| hussam05/yolov8 | finetune | — | — | — | — | hussam05 | 0 | 0 |
| Date | Commit | SHA |
|---|---|---|
| 2025-01-14 | Upload Notice.txt | 11e9e0f |
| 2025-01-14 | Update README.md | 4e2ec6f |
| 2025-01-08 | Add benchmark evaluation scripts | b925209 |
| 2025-01-07 | Add training code link | 07a7f16 |
| 2024-10-18 | Fix example code on README.md (#21) | 5a57d92 |
| 2024-10-16 | Update README | 32d8bf4 |
| 2024-10-15 | Add ethical considerations | 1171108 |
| 2024-10-08 | convert to safetensors | 8510b10 |
| 2024-10-08 | Adding `safetensors` variant of this model (#16) | ca656c5 |
| 2024-10-04 | Update readme | b988ade |
| 2024-10-02 | Add text only results | 732e074 |
| 2024-10-01 | Add `transformers` as library_name (#2) | 9cf8c9e |
| 2024-10-01 | Update pipeline tag (#1) | 1c71055 |
| 2024-10-01 | update tag | b942c1e |
| 2024-10-01 | update tag | f220154 |
| 2024-10-01 | Add logo | 2cebe7f |
| 2024-10-01 | Update readme | dad27a5 |
| 2024-10-01 | Update readme | ebd553d |
| 2024-10-01 | Uploading code | 2cebb4b |
| 2024-09-30 | Uploading checkpoints, tokenizers, and license | 0e2e85d |
| 2024-09-30 | initial commit | a9f1279 |
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:40 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:12 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.