Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
Official3
qwenlm.github.io2024-06-06officialauthorityHN front pageabout the Qwen2 familyHN 261 pts · 130 comments4,713 words
Alibaba releases Qwen2, a new series of open-source models featuring five sizes ranging from 0.5B to 72B parameters. The update applies Group Query Attention to all sizes and trains on data in 27 additional languages besides English and Chinese. Specific instruction-tuned versions like Qwen2-7B-Instruct and Qwen2-72B-Instruct support extended context lengths up to 128K tokens, while smaller models adopt the Apache 2.0 license and the largest retains the Qianwen License.written, reviewed, cited
- Qwen2-57B-A14B disables tie embedding because large sparse embeddings consume a large proportion of total model parameters.
- Instruction-tuned models require the Needle in a Haystack task to verify correct long-context understanding beyond perplexity evaluation.
- The Qwen2-72B-Instruct model performs comparably to GPT-4 in safety tests across four categories of multilingual unsafe queries.
qwenlm.github.io2024-08-08officialauthorityHN front pageabout the Qwen2 familyHN 128 pts · 38 comments5,833 words
Qwen2-Math is a series of specialized math language models built upon the Qwen2 LLMs that significantly outperforms the mathematical capabilities of open-source models and even closed-source models. The largest model, Qwen2-Math-72B-Instruct, is evaluated on benchmarks including GSM8K, Math, and MMLU-STEM using few-shot chain-of-thought prompting. Instruction tuning combines a dense reward signal with a binary signal via Rejection Sampling and reinforcement learning with Group Relative Policy Optimization (GRPO) after SFT.written, reviewed, cited
- The model series primarily supports English, with bilingual English and Chinese math models scheduled for release soon.
- Evaluation of multi-choice benchmarks including MMLU STEM and GaoKao problems uses a 5-shot setting instead of zero-shot.
- Performance reporting for complex competition evaluations includes Greedy, Maj@64, RM@64, and RM@256 metrics.
huggingface.co2024-06-09authorityabout the Qwen2 familyHN 16 pts · 6 comments3,368 words
Qwen 2 Instruct models operate under an Apache 2.0 license but exhibit unique government-mandated alignment with significantly (>80%) fewer refusals in Chinese than English. The deccp dataset documents these behaviors, showing that responses to sensitive topics often include defensive nationalist propaganda or warnings rather than standard refusals. While the models are competitive on benchmarks, their output varies wildly in tone depending on the language used.written, reviewed, cited
- Qwen2-72B-Instruct ranks just below Llama-3-70b-Instruct on the ChatArena Leaderboard several days after release.
- The deccp dataset contains approximately 95 refusal questions used to evaluate Qwen2 Instructs censorship behavior.
Analysis6
arxiv.orgauthorityabout the Qwen2 family12,379 words
The Qwen2-VL-72B model achieves results comparable to leading models such as GPT-4o and Claude3.5-Sonnet across various multimodal benchmarks. Qwen2-VL is capable of understanding videos over 20 minutes in length, enhancing its ability to perform high-quality video-based question answering.generated, cited
alizila.com2025-03-27about the Qwen2 familyHN 29 pts · 3 comments
medium.com2025-01-29about the Qwen2 familyHN 17 pts · 4 comments
kaitchup.substack.comabout the Qwen2 family144 words
medium.comabout the Qwen2 family
Community1
github.com2024-12-14authorityHN front pageabout the Qwen2 familyHN 155 pts · 50 comments954 words
A pull request adds support for Qwen2VL to llama.cpp, introducing a new command-line tool called llama-qwen2vl-cli for inference. The update includes vision model architecture and specific rope types like GGML_ROPE_TYPE_VISION for multi-resolution processing. Commenters report that llama-server does not yet support this model and users on Mac encounter unsupported IM2COL errors with Q4_k_m quantization.written, reviewed, cited
- The vision model's computation graph runs on a single backend using the unsupported RoPE Vulkan OP.
- The IM2COL operation is only implemented for f32 and f16 data types on Metal.