Models › Qwen2 family

Qwen2-VL-7B-Instruct

Qwen Apache 2.0 out 2 years ago

8.29B parameters, images and text in, text out, 32K tokens of context.

Verified 2026-10-25 Rank #128 in LLMs · score 94.8 method v1 Sources 3 Downloads 30d 627.5k · #147 of 619 tracked

Can I run it?5.0GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?627.5kdownloads, 30 days#147 of 619 we track · top 24%+2 likes, downloads −6% this week1,295 likesHugging Face2026-10-24

Worth reading

Picked by rule from 9 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 155 HN pts

Llama.cpp Now Supports Qwen2-VL (Vision Language Model)

A pull request adds support for Qwen2VL to llama.cpp, introducing a new command-line tool called llama-qwen2vl-cli for inference.

  • The vision model's computation graph runs on a single backend using the unsupported RoPE Vulkan OP.
  • The IM2COL operation is only implemented for f32 and f16 data types on Metal.
github.com 2024-12-14 155 HN pts · 50 comments 954 words about the Qwen2 family family

9 best of 9 tracked

The 3 picks above, plus these 6. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleQwen2 LLM Releasedqwenlm.github.io · 2024-06-06 · 261 HN pts · official
  2. ArticleQwen2-Mathqwenlm.github.io · 2024-08-08 · 128 HN pts · official
  3. ArticleAn Analysis of Chinese LLM Censorship and Bias with Qwen 2 Instructhuggingface.co · 2024-06-09 · 16 HN pts
  4. ArticleQwen2.5-Max: The Next Leap in AI Innovationmedium.com · 2025-01-29 · 17 HN pts
  5. ArticleQwen2 7B Instruct vs Qwen2 VL 7B Instruct · Compare | BenchGeckobenchgecko.ai · undated
  6. ArticleQwen2 VL 7B Instruct — Hardware Requirements & Compatibility | llmrunllmrun.dev · undated

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 60 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware60quantized builds
  • Built on838614 fine-tunes · 224 adapters · 0 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: GanymedeNil/Qwen2-VL-7B ♥ 274 · alibaba-pai/EasyAnimate ♥ 172 · artificialguybr/qwen-vl ♥ 126 · maxiw/Qwen2-VL-Detection ♥ 111

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 5.0 GB at INT4, 9.9 GB at FP8, 20 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.0 GB of weights (estimate; KV cache and activations extra)INT45.0 GBFP8: about 9.9 GB of weights (estimate; KV cache and activations extra)FP89.9 GBBF16: about 20 GB of weights (estimate; KV cache and activations extra)BF1620 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 5.0 GB of weights (estimate; KV cache and activations extra)INT45.0 GBFP8: about 9.9 GB of weights (estimate; KV cache and activations extra)FP89.9 GBBF16: about 20 GB of weights (estimate; KV cache and activations extra)BF1620 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2024-08-28), amber triangles are 6 dated articles (each links to it), grey ticks are repo commits.

JulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-02-06: 1 repo commit2025-01-12: 1 repo commit2024-12-06: 1 repo commit2024-09-21: 1 repo commit2024-09-06: 1 repo commit2024-09-03: 1 repo commit2024-09-02: 1 repo commit2024-08-31: 1 repo commit2024-08-30: 1 repo commit2024-08-29: 7 repo commits2024-08-28: 2 repo commitsQwen2 LLM Released · 2024-06-06Qwen2-Math · 2024-08-08Llama.cpp Now Supports Qwen2-VL (Vision Language Model) · 2024-12-14An Analysis of Chinese LLM Censorship and Bias with Qwen 2 Instruct · 2024-06-09Alibaba Qwen2.5-Omni-7B: Open Source End-to-End Multimodal AI Model · 2025-03-27Qwen2.5-Max: The Next Leap in AI Innovation · 2025-01-29Weights 2024-08-28 · 2024-08-28Weights 2024-08-28now
JulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-02-06: 1 repo commit2025-01-12: 1 repo commit2024-12-06: 1 repo commit2024-09-21: 1 repo commit2024-09-06: 1 repo commit2024-09-03: 1 repo commit2024-09-02: 1 repo commit2024-08-31: 1 repo commit2024-08-30: 1 repo commit2024-08-29: 7 repo commits2024-08-28: 2 repo commitsQwen2 LLM Released · 2024-06-06Qwen2-Math · 2024-08-08Llama.cpp Now Supports Qwen2-VL (Vision Language Model) · 2024-12-14An Analysis of Chinese LLM Censorship and Bias with Qwen 2 Instruct · 2024-06-09Alibaba Qwen2.5-Omni-7B: Open Source End-to-End Multimodal AI Model · 2025-03-27Qwen2.5-Max: The Next Leap in AI Innovation · 2025-01-29Weights 2024-08-28 · 2024-08-28Weights 2024-08-28now

What people built on it

898 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

898 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

60 quantized (Hugging Face model tree)614 fine-tunes (Hugging Face model tree)224 adapters (Hugging Face model tree)60 quantized614 fine-tunes224 adapters
60 quantized (Hugging Face model tree)614 fine-tunes (Hugging Face model tree)224 adapters (Hugging Face model tree)60 quantized614 fine-tunes224 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

6 rows

Benchmarks 6 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (6)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported MMStar · Understand images and video60.7—model author2026-10-07
author-reported MTVQA26.3—model author2026-10-07
author-reported MVBench67—model author2026-10-07
author-reported MathVision · Understand images and video16.3—model author2026-10-07
author-reported OCRBench · Extract text from documents845—model author2026-10-07
author-reported RealWorldQA · Understand images and video70.1—model author2026-10-07

Use-case evidence

4 use cases

What it is good at 4 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

22 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesQwen2VLForConditionalGeneration
Model typeqwen2_vl
Dtypebfloat16
Params by dtypeBF16: 8,291,375,616
Size bandM
MoEno
Context length32,768 (config.json max_position_embeddings)
Languagesen
PapersarXiv:2409.12191, arXiv:2308.12966
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Qwen2VLForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Qwen2VLForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Qwen2-VL-7B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)20 GB · Single GPU (<24 GB)
FP8 (1 byte/param)9.9 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)5.0 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Fine-tuned from Qwen/Qwen2-VL-7B (same organization) Family: Qwen/Qwen2 898 derivatives on the Hub

Base model: Qwen/Qwen2-VL-7B

quantized: 60finetune: 614adapter: 224

Top variants (40 shown, ranked by downloads)

Relation
Quant
Size
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
Qwen/Qwen2-VL-7B-Instruct-AWQ quantized AWQ 8.29B M apache-2.0 Qwen 56 15.8M
Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4 quantized GPTQ 8.29B M apache-2.0 Qwen 43 801.6k
unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit quantized -bnb 8.50B M apache-2.0 unsloth 13 325.6k
Ertugrul/Qwen2-VL-7B-Captioner-Relaxed finetune — 8.29B M apache-2.0 Ertugrul 63 253.7k
bartowski/Qwen2-VL-7B-Instruct-GGUF quantized GGUF — — apache-2.0 bartowski 43 169.8k
Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8 quantized GPTQ 8.29B M apache-2.0 Qwen 37 148.9k
Alibaba-NLP/gme-Qwen2-VL-7B-Instruct finetune — 8.29B M apache-2.0 Alibaba-NLP 72 73k
unsloth/Qwen2-VL-7B-Instruct-bnb-4bit quantized -bnb 8.52B M apache-2.0 unsloth 6 66.7k
lmstudio-community/Qwen2-VL-7B-Instruct-GGUF quantized GGUF — — apache-2.0 lmstudio-community 6 60.2k
unsloth/Qwen2-VL-7B-Instruct finetune — 8.29B M apache-2.0 unsloth 6 56.8k
OS-Copilot/OS-Atlas-Base-7B finetune — 8.29B M apache-2.0 OS-Copilot 43 52.9k
OpenSearch-AI/Ops-MM-embedding-v1-7B finetune — 8.29B M apache-2.0 OpenSearch-AI 14 47.3k
TIGER-Lab/VLM2Vec-Qwen2VL-7B finetune — — — apache-2.0 TIGER-Lab 12 40.9k
microsoft/GUI-Actor-7B-Qwen2-VL finetune — 8.39B M mit microsoft 44 38.2k
TIGER-Lab/VLM2Vec-Qwen2VL-2B finetune — — — apache-2.0 TIGER-Lab 3 39.2k
erax-ai/EraX-VL-7B-V1.0 finetune — 8.29B M apache-2.0 erax-ai 44 30.1k
HuanjinYao/Mulberry_qwen2vl_7b finetune — 8.29B M apache-2.0 HuanjinYao 2 31.8k
allenai/olmOCR-7B-0225-preview-FP8 quantized -FP8 8.29B M apache-2.0 allenai 9 29.5k
thomas-yanxin/Qwen2-VL-7B-GGUF quantized GGUF — — apache-2.0 thomas-yanxin 10 25k
Djrango/Qwen2vl-Flux adapter — — — — Djrango 509 0
OS-Copilot/OS-Atlas-Pro-7B finetune — 8.29B M apache-2.0 OS-Copilot 31 18.2k
typhoon-ai/typhoon2-qwen2vl-7b-vision-instruct finetune — 8.29B M apache-2.0 typhoon-ai 21 18.2k
erax-ai/EraX-VL-7B-V1.5 finetune — 8.29B M apache-2.0 erax-ai 9 16.5k
second-state/Qwen2-VL-7B-Instruct-GGUF quantized GGUF — — apache-2.0 second-state 4 16.6k
OpenGVLab/VideoChat-R1_7B_caption finetune — 8.29B M apache-2.0 OpenGVLab 6 12.4k
prithivMLmods/coreOCR-7B-050325-preview finetune — 8.29B M apache-2.0 prithivMLmods 16 11k
ggml-org/Qwen2-VL-7B-Instruct-GGUF quantized GGUF — — apache-2.0 ggml-org 1 11.6k
CraftJarvis/minecraft-openha-qwen2vl-7b-2509 finetune — 8.29B M mit CraftJarvis 1 10.8k
DevQuasar-2/Qwen.Qwen2-VL-7B-Instruct-GGUF quantized GGUF — — — DevQuasar-2 4 10.6k
Mungert/olmOCR-7B-0225-preview-GGUF quantized GGUF — — apache-2.0 Mungert 2 10.5k
billatsectorflow/Qwen2-VL-7B-Instruct-GPTQ-Int4 quantized GPTQ 8.29B M apache-2.0 billatsectorflow 0 10.1k
Zery/Qwen2-VL-7B_visual_rft_lisa_IoU_reward finetune — 8.29B M apache-2.0 Zery 6 8.8k
NCSOFT/GME-VARCO-VISION-Embedding finetune — 8.29B M cc-by-nc-4.0 NCSOFT 12 8.2k
Michael4933/Migician finetune — 8.29B M apache-2.0 Michael4933 1 8.7k
yujiepan/qwen2-vl-tiny-random finetune — 4.90M S — yujiepan 1 8.4k
mradermacher/Qwen2-VL-7B-Instruct-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 0 7.2k
MayaKD/qwen2-vl-audio finetune — 8.94B M apache-2.0 MayaKD 0 6.6k
mlx-community/olmOCR-7B-0225-preview-4bit finetune -4bit 8.29B M apache-2.0 mlx-community 1 6.1k
Foreshhh/Qwen2-VL-7B-SafeRLHF finetune — 8.29B M apache-2.0 Foreshhh 3 5.6k
jingyiZ00/R1-VL-7B finetune — 8.29B M apache-2.0 jingyiZ00 1 4.8k

Repository changelog

18 commits

Repository changelog 18 commits

DateCommitSHA
2025-02-06 Add new version metadata (#75) eed1309
2025-01-12 Update README.md a28a094
2024-12-06 Update README.md a7a06a1
2024-09-21 Update README.md 51c4743
2024-09-06 Update generation_config.json (#22) 3ca981c
2024-09-03 add vcr results cacb254
2024-09-02 Update README.md (#6) d776c71
2024-08-31 add correct pipeline tag (#4) ccd09ac
2024-08-30 Update README.md (#3) ed24a23
2024-08-29 Update README.md 8f9fc0b
2024-08-29 Update README.md 6424504
2024-08-29 Update README.md 6010982
2024-08-29 Update README.md b6241d7
2024-08-29 Update README.md 1399c6f
2024-08-29 Create LICENSE 95aefb3
2024-08-29 Create README.md e1b32dd
2024-08-28 Initial commit f330ecb
2024-08-28 initial commit ba2e56f

Articles and coverage

9 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official3

qwenlm.github.io2024-06-06officialauthorityHN front pageabout the Qwen2 familyHN 261 pts · 130 comments4,713 words
Alibaba releases Qwen2, a new series of open-source models featuring five sizes ranging from 0.5B to 72B parameters. The update applies Group Query Attention to all sizes and trains on data in 27 additional languages besides English and Chinese. Specific instruction-tuned versions like Qwen2-7B-Instruct and Qwen2-72B-Instruct support extended context lengths up to 128K tokens, while smaller models adopt the Apache 2.0 license and the largest retains the Qianwen License.written, reviewed, cited
  • Qwen2-57B-A14B disables tie embedding because large sparse embeddings consume a large proportion of total model parameters.
  • Instruction-tuned models require the Needle in a Haystack task to verify correct long-context understanding beyond perplexity evaluation.
  • The Qwen2-72B-Instruct model performs comparably to GPT-4 in safety tests across four categories of multilingual unsafe queries.
qwenlm.github.io2024-08-08officialauthorityHN front pageabout the Qwen2 familyHN 128 pts · 38 comments5,833 words
Qwen2-Math is a series of specialized math language models built upon the Qwen2 LLMs that significantly outperforms the mathematical capabilities of open-source models and even closed-source models. The largest model, Qwen2-Math-72B-Instruct, is evaluated on benchmarks including GSM8K, Math, and MMLU-STEM using few-shot chain-of-thought prompting. Instruction tuning combines a dense reward signal with a binary signal via Rejection Sampling and reinforcement learning with Group Relative Policy Optimization (GRPO) after SFT.written, reviewed, cited
  • The model series primarily supports English, with bilingual English and Chinese math models scheduled for release soon.
  • Evaluation of multi-choice benchmarks including MMLU STEM and GaoKao problems uses a 5-shot setting instead of zero-shot.
  • Performance reporting for complex competition evaluations includes Greedy, Maj@64, RM@64, and RM@256 metrics.
huggingface.co2024-06-09authorityabout the Qwen2 familyHN 16 pts · 6 comments3,368 words
Qwen 2 Instruct models operate under an Apache 2.0 license but exhibit unique government-mandated alignment with significantly (>80%) fewer refusals in Chinese than English. The deccp dataset documents these behaviors, showing that responses to sensitive topics often include defensive nationalist propaganda or warnings rather than standard refusals. While the models are competitive on benchmarks, their output varies wildly in tone depending on the language used.written, reviewed, cited
  • Qwen2-72B-Instruct ranks just below Llama-3-70b-Instruct on the ChatArena Leaderboard several days after release.
  • The deccp dataset contains approximately 95 refusal questions used to evaluate Qwen2 Instructs censorship behavior.

Analysis5

alizila.com2025-03-27about the Qwen2 familyHN 29 pts · 3 comments
medium.com2025-01-29about the Qwen2 familyHN 17 pts · 4 comments
benchgecko.ai474 words
llm-explorer.com
llmrun.dev1,526 words

Community1

github.com2024-12-14authorityHN front pageabout the Qwen2 familyHN 155 pts · 50 comments954 words
A pull request adds support for Qwen2VL to llama.cpp, introducing a new command-line tool called llama-qwen2vl-cli for inference. The update includes vision model architecture and specific rope types like GGML_ROPE_TYPE_VISION for multi-resolution processing. Commenters report that llama-server does not yet support this model and users on Mac encounter unsupported IM2COL errors with Q4_k_m quantization.written, reviewed, cited
  • The vision model's computation graph runs on a single backend using the unsupported RoPE Vulkan OP.
  • The IM2COL operation is only implemented for f32 and f16 data types on Metal.

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3-VL-8B-Instruct · 8.77B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • Qwen2.5-VL-7B-Instruct · 8.29B
    same size band (M), same task (image-text-to-text), more providers, permissive license
  • Qwen3.5-9B · 9.65B
    same task (image-text-to-text), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:34 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:01 UTC · Last verified 2026-10-25

Follow Qwen2-VL-7B-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.