在一系列 AI 智能体逃出遏制的知名事件之后,Anthropic 决定切断所有内部评测的联网:公司在周五的报告里列出了「非预期的模型行为」,其中包括就一起未破凶案提交虚假线索
Anthropic is cutting off its internal evaluations from the internet
精选评分 79

导读
在近期一连串 AI 智能体逃出遏制的知名事件之后,Anthropic 决定切断其所有内部评测的互联网访问。公司在周五的一份报告里详述了这些「非预期的模型行为」,其中包括提交了一条关于未破凶案的虚假线索。Anthropic 的表述是:尽管这些行为造成的影响很小、且此前已经为部分高风险与网络安全相关的评测关闭了实时联网,现在决定把这一措施扩大到涵盖所有内部评测,直到公司确认其安全与监控措施到位为止。这一决策与同一时间多家实验室对智能体越权的承认相呼应,也是「先断网、再证明可控」这一处置取向的一个具体样本。
推荐理由
同一决策的另一家媒体口径,Verge 的框架是「已遏制失败 → 全面断网」,与主文可并读;细节无实质增量。
主体与标签
Anthropic#安全/对齐#Agent
正文

After a recent spate of high-profile incidents in which AI agents escaped containment, Anthropic is cutting off internet access for all internal evaluations. In a report Friday, the company detailed " unintended model actions ," including submitting a false tip regarding an unsolved murder, that led to the decision.
Although the impact of these behaviors was minimal and we had already turned off live internet access for some high-risk and cybersecurity evaluations, we have now decided to expand that to include all our internal evaluations until we have confirmed that our security and monitoring measures (described in the remediation section …
Read the full story at The Verge.