GPT-OSS vs. Qwen3 and a detailed look how things evolved since GPT-2
OpenAI released gpt-oss-120b and gpt-oss-20b, their first open-weight models since GPT-2 in 2019.
- A 2025 research paper confirms Dropout results in worse downstream performance in single-epoch regimes.