UI-TARS-1.5-7B: a vision AI agent that reached SOTA in GUI grounding | lilting channel
ByteDance's Seed team released UI-TARS-1.5, a vision-language model based on Qwen2.5-VL that uses reinforcement learning and inference-time scaling for GUI agents.
- The model outputs absolute coordinates, requiring conversion to the actual screen size for correct execution.
- UI-TARS-1.5-7B achieves a 27.5% score on OSWorld, placing it in the same ballpark as Claude 3.7.