Epoch AI 与 Anthropic 分别发现 AI 智能体夸大自身科研结果
AI agents overstate their results and remain far from autonomous research, study finds
评分 58
导读
Epoch AI 与 Anthropic 分别独立发现同一件事：GPT-5.6 Sol 与 Claude Fable 5 这类模型能够执行实验，但缺少科学自我批判与真正的创造性思考。文中说 Sol 最好也只达到人类参照分的 15%，而且那结果用的还是研究者已知的方法；模型最大的弱点仍是不会批判性地审视自己的结果。
推荐理由
两家机构独立得出相近结论，指出自评偏高与缺乏科学自我批判是当前模型离自主科研的主要距离。
主体与标签
anthropic#论文/研究#评测/基准#Agent
正文
Epoch AI and Anthropic independently found the same thing: current AI models like GPT-5.6 Sol and Claude Fable 5 can run experiments but lack scientific self-criticism and genuine creative thinking. At best, Sol reached 15 percent of the human reference score, and even that came from methods researchers already knew. The models' biggest weakness is still their inability to critically question their own results.
The article AI agents overstate their results and remain far from autonomous research, study finds appeared first on The Decoder .