阿里千问开源多语言智能体基准 BabelArena，同一任务换语言工具调用可差 8 倍
阿里千问团队开源多语言 LLM 智能体基准 BabelArena，覆盖约 699 个规范任务与 23 种语言，约 1.6 万个任务实例，并配套 BabelFlow 适配流水线，论文见 arXiv:2609.23490。
Our latest open-source research has a pretty interesting name, inspired by the story of the Tower of Babel. What interests us about that story is how language barriers can get in the way of people working toward the same goal And when it comes to agents, there are a few more places for that understanding to break, like tool arguments, database entries, and search queries One example from BabelArena (yes that's the name, surprise) stuck with me: Qwen-3.8-Max completed the same shopping task in English and Telugu, getting the same four products. But it took 25 tool calls in English and 201 in Telugu, with repeated empty searches against the localized catalog. Even though both runs passed, we’d still want to see that difference before shipping. Sorry for the long story, hope you guys are still here. What I want to share is that we’ve open-sourced BabelArena to study these workflows across 23 languages. Code, datasets, and paper in the comment
