Ai2 推出 XYBench 评估模型是否回应真实问题
A model might mention unclogging a vacuum hose but focus most of its answer on buying a new vacuum.
摘要
模型可能提到疏通吸尘器软管,但大部分回答却集中在买一台新吸尘器上。 XYBench 检验模型是否:针对所提出的请求、潜在问题或两者都给出解决方案;它们关注什么;以及是否会劝阻错误的做法。
摘要由模型根据原文撰写,以原文为准。
正文 · 原文
A model might mention unclogging a vacuum hose but focus most of its answer on buying a new vacuum.
XYBench checks whether models: offer solutions for the stated request, the underlying problem, or both; what they focus on; & whether they discourage the mistaken approach.
来源:Ai2 · x.com
引用原文
allen_ai. A model might mention unclogging a vacuum hose but focus most of its answer on buying a new vacuum.[EB/OL]. (2026-11-14)[访问日期]. https://x.com/allen_ai/status/2121294719061815754.