Models › Qianfan family

baidu Apache 2.0 out 7 months ago

4.74B parameters, images and text in, text out, 32K tokens of context.

Verified 2026-10-25 Rank #296 in LLMs · score 84.1 method v1 Sources 3 Downloads 30d 42.3k · #395 of 619 tracked

Can I run it?2.8GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?42.3kdownloads, 30 days#395 of 619 we track · below the median+5 likes, downloads −5% this week1,215 likesHugging Face2026-10-24

Worth reading

Picked by rule from 8 tracked pieces: the lab's own post, the most shared, a field report, the latest.

8 best of 8 tracked

The 1 pick above, plus these 7. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. PaperQianfan-OCR: A Unified End-to-End Model for Document Intelligencearxiv.org · undated
  2. PaperQianfan-OCR: A Unified End-to-End Model for Document ...arxiv.org · undated
  3. ArticleQianfan Technical Hub | Baidu AI Cloudbaidubce.github.io · undated
  4. ArticleQianfan-OCR: A Unified End-to-End Model for Document Intelligence — Read with an AI tutorchapterpal.com · undated
  5. ArticleQianfan-OCR - Baidu Qianfan's end-to-end intelligent document modeldetect-ai.xyz · 2026-03-19
  6. ArticleQianfan-OCR: A Unified End-to-End Model for Document Intelligence | arXiv Sciencearxiv.science · 2026-03-11
  7. ArticleQianfan-OCR: A Unified End-to-End Model for Document Intelligence | alphaXivalphaxiv.org · 2026-03-11

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 5 quantized builds and 15 Spaces.

  • As a service0no API provider listed
  • On own hardware5quantized builds
  • Built on11 fine-tunes · 0 adapters · 0 merges
  • In apps15Hugging Face Spaces

Top Spaces running it: baidu/Qianfan-OCR-Demo ♥ 44 · jason1966/Qianfan-OCR-MLX ♥ 17

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 2.8 GB at INT4, 5.7 GB at FP8, 11 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.8 GB of weights (estimate; KV cache and activations extra)INT42.8 GBFP8: about 5.7 GB of weights (estimate; KV cache and activations extra)FP85.7 GBBF16: about 11 GB of weights (estimate; KV cache and activations extra)BF1611 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.8 GB of weights (estimate; KV cache and activations extra)INT42.8 GBFP8: about 5.7 GB of weights (estimate; KV cache and activations extra)FP85.7 GBBF16: about 11 GB of weights (estimate; KV cache and activations extra)BF1611 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2026-03-18), amber triangles are 4 dated articles (each links to it), grey ticks are repo commits.

What people built on it

6 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

6 derivatives on the Hub, most of them quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

5 quantized (Hugging Face model tree)1 fine-tune (Hugging Face model tree)5 quantized1 fine-tune
5 quantized (Hugging Face model tree)1 fine-tune (Hugging Face model tree)5 quantized1 fine-tune

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

37 rows

Benchmarks 37 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (37)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported CC-OCR · Extract text from documents76.7—model author2026-10-07
author-reported CC-OCR · Extract text from documents79.3—model author2026-10-07
author-reported CC-OCR · Extract text from documents92.8—model author2026-10-07
author-reported CharXiv · Extract text from documents94—model author2026-10-07
author-reported CharXiv · Extract text from documents85.2—model author2026-10-07
author-reported ChartQA · Understand images and video88.1—model author2026-10-07
author-reported ChartQA · Understand images and video42.9—model author2026-10-07
author-reported DocVQA · Extract text from documents92.8—model author2026-10-07
author-reported Key Information Extraction87.9Overall mean scoremodel author2026-10-07
author-reported Key Information Extraction87.9Overallmodel author2026-10-07
author-reported Nanonets KIE (F1)86.5—model author2026-10-07
author-reported OCRBench · Extract text from documents880—model author2026-10-07
author-reported OCRBench · Extract text from documents56enmodel author2026-10-07
author-reported OCRBench · Extract text from documents60.77zhmodel author2026-10-07
author-reported OCRBench · Extract text from documents95—model author2026-10-07
author-reported OCRBench · Extract text from documents82.8—model author2026-10-07
author-reported OCRBench · Extract text from documents82.3—model author2026-10-07
author-reported OCRVQA66.8—model author2026-10-07
author-reported OmniDocBench · Extract text from documents93.12End-to-endmodel author2026-10-07
author-reported OmniDocBench · Extract text from documents0.04TextEditmodel author2026-10-07
author-reported OmniDocBench · Extract text from documents92.43FormulaCDMmodel author2026-10-07
author-reported OmniDocBench · Extract text from documents91.02TableTEDsmodel author2026-10-07
author-reported OmniDocBench · Extract text from documents93.85TableTEDssmodel author2026-10-07
author-reported OmniDocBench · Extract text from documents0.05R-orderEditmodel author2026-10-07
author-reported PPS (pages/sec)1.02 otherW8A8model author2026-10-07
Show all 37 rows (12 more)
BenchmarkValueSetting / notesReported byDate
author-reported Terminal-Bench · Write code with agents85.9—model author2026-10-07
author-reported TextVQA · Understand images and video80—model author2026-10-07
author-reported olmOCR-bench · Extract text from documents79.8—model author2026-10-07
author-reported overall (allenai/olmOCR-bench)79.8—Qianfan-OCR technical report2026-10-24
author-reported arxiv_math (allenai/olmOCR-bench)80.1—Qianfan-OCR technical report2026-10-24
author-reported old_scans_math (allenai/olmOCR-bench)73.1—Qianfan-OCR technical report2026-10-24
author-reported table_tests (allenai/olmOCR-bench)81.6—Qianfan-OCR technical report2026-10-24
author-reported old_scans (allenai/olmOCR-bench)42—Qianfan-OCR technical report2026-10-24
author-reported multi_column (allenai/olmOCR-bench)80.4—Qianfan-OCR technical report2026-10-24
author-reported long_tiny_text (allenai/olmOCR-bench)89.1—Qianfan-OCR technical report2026-10-24
author-reported headers_footers (allenai/olmOCR-bench)92.2—Qianfan-OCR technical report2026-10-24
author-reported baseline (allenai/olmOCR-bench)99.6—Qianfan-OCR technical report2026-10-24

What the card says

2 cited sentences

Summary generated, cited

The multilingual model performs direct image-to-Markdown conversion and supports tasks like table extraction and document question answering.[1][2] It is released under the Apache 2.0 license and utilizes a vision-language architecture.[3][4]

  1. languages
  2. “direct image-to-Markdown conversion”
  3. license
  4. “single vision-language architecture”

Generated 2026-10-07 15:05 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesQianfanOCRForConditionalGeneration
Model typeqianfan_ocr
Dtypebfloat16
Params by dtypeBF16: 4,741,408,256
Size bandM
MoEno
Context length32,768 (config.json max_position_embeddings)
Languagesmultilingual
PapersarXiv:2603.13398, arXiv:2509.18189
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · QianfanOCRForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qianfan-OCR: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)11 GB · Single GPU (<24 GB)
FP8 (1 byte/param)5.7 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)2.8 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

6 variants

Lineage

Original model Family: baidu/Qianfan 6 derivatives on the Hub

quantized: 5finetune: 1

Top variants (6 shown, ranked by downloads)

Relation
Quant
6 rows
Variant Relation Quant Params Band License Author Likes Downloads
Reza2kn/Qianfan-OCR-GGUF quantized GGUF — — apache-2.0 Reza2kn 16 19.6k
Abiray/Qianfan-OCR-GGUF quantized GGUF — — apache-2.0 Abiray 1 4.3k
jason1966/Qianfan-OCR-MLX-4bit quantized MLX 4.74B M apache-2.0 jason1966 5 2.4k
DevQuasar/baidu.Qianfan-OCR-GGUF quantized GGUF — — — DevQuasar 0 2.1k
bssrdf/Qianfan-OCR-gguf quantized gguf — — apache-2.0 bssrdf 0 474
mat50013/Qianfan-OCR-MLX-BF16 finetune MLX 4.74B M apache-2.0 mat50013 0 409

Repository changelog

8 commits

Repository changelog 8 commits

DateCommitSHA
2026-04-29 Upload folder using huggingface_hub 623bf5d
2026-03-26 Update README.md 5e181e7
2026-03-19 correct example in readme (#6) 17fd115
2026-03-18 Update README.md 69ccfc5
2026-03-18 Upload folder using huggingface_hub 6a53ad3
2026-03-18 Add OlmOCRBench evaluation results (#1) f0d830f
2026-03-18 Upload folder using huggingface_hub e2b569a
2026-03-18 initial commit 0b0901d

Articles and coverage

8 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis8

arxiv.orgauthority7,993 words
Qianfan-OCR is a 4B-parameter end-to-end model that ranks first on OmniDocBench v1.5 with a score of 93.12. The model achieves the highest average score on public Key Information Extraction benchmarks, surpassing Gemini-3.1-Pro and Qwen3-VL-235B-A22B.generated, cited
arxiv.orgauthority7,993 words
Qianfan-OCR is a 4B-parameter end-to-end model that unifies document parsing, layout analysis, and understanding within a single vision-language architecture. It employs a Layout-as-Thought mechanism triggered by tokens to generate structured layout representations before final outputs, recovering explicit layout analysis capabilities lost in standard end-to-end pipelines. The model ranks first on OmniDocBench v1.5 with a score of 93.12 and utilizes a Qwen3-4B backbone with a vision encoder producing up to 4,096 visual tokens for fine-grained recognition.written, reviewed, cited
  • Qianfan-OCR surpasses Gemini-3.1-Pro, Gemini-3-Pro, Seed-2.0, and Qwen3-VL-235B-A22B on public Key Information Extraction benchmarks.
  • The vision encoder supports variable-resolution inputs up to 4K by dynamically tiling images into 448x448 patches.
spacenews.com2026-06-02about the Qianfan familyHN 2 pts · 1 comments88 words
baidubce.github.ioabout the Qianfan family4 words
chapterpal.com26 words
Qianfan-OCR ranks first among all end-to-end models on OmniDocBench v1.5 with a score of 93.12 and achieves 79.8 on OlmOCR Bench. The model posts the highest average of 87.9 across five public Key Information Extraction benchmarks, surpassing Gemini-3.1-Pro and Qwen3-VL-235B.generated, cited
detect-ai.xyz2026-03-191,194 words
arxiv.science2026-03-11240 words
alphaxiv.org2026-03-111,557 words

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3.5-4B · 4.66B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • gemma-3-4b-it · 4.30B
    same size band (M), same task (image-text-to-text), more providers
  • Qwen3-VL-4B-Instruct · 4.44B
    same size band (M), same task (image-text-to-text), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:37 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:05 UTC · Last verified 2026-10-25

Follow Qianfan-OCR

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.