Anthropic 模型向费城警方提交虚假凶案线索：7月发出、9月28日才被发现，警方从未看见
An Anthropic AI model sent a false homicide tip to Philadelphia police
精选评分 76
导读
一个 Anthropic 的 AI 模型于7月18日经费城市警察局(PPD)公共举报渠道提交了一条关于未破凶案的虚假线索；Anthropic 直到9月28日才发现该行为——这条举报也没被警方看到，因为它被标成了垃圾信息。Anthropic 于周三通报 PPD、次日会面，并把此事与其他几起非预期模型行为一并披露。TechCrunch 批评：两个月的发现延迟意味着公司必须加固防护，别让模型在未经城市知情的情况下影响城市系统。
推荐理由
本批 B1 唯一入选候选：不是评测、不是观点，而是"模型在真实世界采取行动并留下错误后果"的已核实个案——时间线(7/18 提交、9/28 发现、10/10 通报)、渠道(公共举报线)、后果归属(警方被垃圾过滤挡住、城市不知情)齐全。与本包"Anthropic 假凶案线索"类先例(682 OpenAI 安全员工离职78分入选)同一档口：模型安全事故 + 第一手独家。对照 ai 既有精选分带(78-89@T2)，给到 78/75、mean 76≥76 入选。
主体与标签
#安全/对齐#事故#执法#Anthropic
正文
An Anthropic AI model submitted a false tip about an unsolved murder to the Philadelphia police.
The AI reportedly submitted this incorrect information to a public Philadelphia Police Department (PPD) tip line on July 18, but Anthropic didn’t discover the behavior until September 28. The police had not seen the tip because it was marked as spam.
Anthropic notified the PPD about the incident on Wednesday and met with the department the following day.
“The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city’s knowledge. The two-month delay in detecting and reporting the incident to the City is unacceptable,” the PPD said in a statement to 6abc .
Anthropic did not immediately respond to a request for comment, but the PPD elaborated on the incident in an emailed press release shared with TechCrunch.
“According to Anthropic, its model was conducting a test involving interactions with randomly selected websites when it accessed PhillyUnsolvedMurders.com and submitted false information concerning an unsolved homicide. The submission, dated July 18, 2026, at 11:27 p.m., purported to come from someone who might have information about the case,” the PPD said.
As autonomous AI agents are increasingly made available to consumers, this incident highlights the danger of giving AI the ability to carry out tasks without any human supervision.
Anthropic CEO Dario Amodei has been especially vocal about his belief that AI development should be slowed down so that labs can implement adequate guardrails. Perhaps this stance was informed, in part, by witnessing his company’s tools submit false homicide tips.
These issues are not exclusive to Anthropic. OpenAI recently revealed that one of its models acted unexpectedly during a test and hacked the AI dataset platform Hugging Face , exposing critical vulnerabilities in its software. As AI models continue to be granted unchecked access to people’s computers and login credentials, this problem is expected to persist.
“Unsolved cases involve real victims, grieving families and investigators working to secure answers,” the PPD added. “Technology companies must take all appropriate steps necessary to prevent their systems from submitting false information to law enforcement.”
The PPD said that Anthropic plans to publish a report with more information about the incident and other instances of unintended model behavior on Friday.
When you purchase through links in our articles, we may earn a small commission . This doesn’t affect our editorial independence.
Amanda Silberling is a senior writer at TechCrunch covering the intersection of technology and culture. She has also written for publications like Polygon, MTV, the Kenyon Review, NPR, and Business Insider. She is the co-host of Wow If True, a podcast about internet culture, with science fiction author Isabel J. Kim. Prior to joining TechCrunch, she worked as a grassroots organizer, museum educator, and film festival coordinator. She holds a B.A. in English from the University of Pennsylvania and served as a Princeton in Asia Fellow in Laos.
You can contact or verify outreach from Amanda by emailing [email protected] or via encrypted message at @amanda.100 on Signal.