Ai2 测试 LLM 能否理解用户目标
摘要
为测试大语言模型是否难以弄清用户想要什么,我们在用户提问旁明确写出了每位用户的目标。 即便如此,全部五个模型的回答引导用户避开错误方法的频率仍低于人类参考答案。
摘要由模型根据原文撰写,以原文为准。
正文 · 原文
To test whether LLMs were struggling to figure out what users wanted, we spelled out each user’s goal alongside their Q.
Even then, responses from all five models steered users away from mistaken approaches less often than human reference answers did.
来源:Ai2 · x.com
引用原文
allen_ai. To test whether LLMs were struggling to figure out what users wanted, we spelled out each user’s goal alongside their Q.[EB/OL]. (2026-11-14)[访问日期]. https://x.com/allen_ai/status/2121294721582514682.