什么时候能说 AI 做出了科学发现:Anthropic 说它 950 个智能体跑了 21 小时,在一个已知酶周围标出一段此前没被记录过的重复模式,公告还把这种类比引向 CRISPR;生物学家则反驳「找到奇怪基因簇常常是简单的部分,难的是弄清这套系统到底做什么」,而哥本哈根大学一位研究者称自己的团队早已发现同一模式
When can we say AI made a scientific discovery?
精选评分 80
导读
上周三 Anthropic 宣布它今年早些时候成立了一个分子生物学实验室:Claude 智能体阅读并推测棘手的生物学问题,人类科学家则就它们报告的内容做实验。公司说这个由 AI 驱动的实验室已经做出了它的第一个发现。要理解 Anthropic 说这套系统做了什么,可以想象你正在一座有数百万条 DNA 序列的图书馆里翻检:朝突破迈出的一步,可能是找到一段编码了有趣酶的特殊序列;然后你要弄清那酶做什么,最终还要设法操纵它去做有用的事。Anthropic 称其 950 个智能体在 21 小时后找到的并不是一条全新序列,而是在一个已知酶周围的一段重复模式——一段它称此前从未被编目过的模式。但如果读 Anthropic 的公告,它说这段模式令人想起当年导向基因编辑技术 CRISPR 的那类发现,而 CRISPR「已经改变了科学与医学」——听起来这一大批智能体确实找到了了不得的东西。这些说法惹恼了一些生物学家。一位研究者的一篇帖文广泛流传,并被一家制药公司的董事长兼 CEO 转发背书,其中说:「找到一团奇怪的基因和重复序列,常常是容易的部分。难的地方、也是真正发现来自的地方,是弄清这套系统实际上做什么。」换句话说,智能体帮上了一些实验室里的杂活,但这算不上发现。文章由此推进到一个更一般的判断:即便 AI 做了某种令人印象深刻的事——比如在海量生物数据中找出仅凭人眼难以察觉的模式——这个结果本身也可能不构成科学的突破;对 AI 而言新奇的东西,对生物学家来说可能是常规、不令人意外,或者干脆没什么重要性。让问题更模糊的是,哥本哈根大学的生物学家 Mario Rodríguez Mestre 在周末表示,他的团队其实早已发现了这同一段模式(此点由《纽约时报》报道)。Mestre 平时在工作中常与 Claude 交流,他对 Anthropic 的说法提出了疑问。
推荐理由
把「AI 做出科学发现」这一说法推到检验台前:950 个智能体与 21 小时的具体规模、CRISPR 类比的使用、以及同行的两条反驳(发现不难、别人早已发现)齐备,是这一话题最有价值的讨论。
主体与标签
Anthropic#观点/评论#科研应用#Agent
正文
This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here .
Last Wednesday, Anthropic announced that earlier this year it had launched a molecular biology lab, where Claude agents read and conjecture about hard biology problems and human scientists run experiments on what they report. And this AI-powered lab, the company said, had made its first discovery.
To understand what Anthropic says its system did, imagine you’re flipping through a library of millions of DNA sequences, amassed as scientists sequence more and more of the living world. One step toward a breakthrough might be finding a peculiar sequence that encodes an interesting enzyme, perhaps. Then you’d need to figure out what that enzyme does and, eventually, how to manipulate it to do something useful.
What Anthropic says its system of 950 agents found after 21 hours was not a brand-new sequence. The agents instead flagged a repeating pattern surrounding a known enzyme, a particular pattern Anthropic said hadn’t been catalogued before. But if you read through Anthropic’s announcement, which calls this pattern “reminiscent” of what led to the gene-editing technology CRISPR that “has already transformed science and medicine,” it sounds as if this army of agents really found something of note.
These claims have angered some biologists. A viral post from one, subsequently endorsed by the chair and CEO of the drugmaker Eli Lilly, said that “finding a weird cluster of genes and repeats is often the easy part. The hard part, and where the real discoveries come from, is figuring out what the system actually does.” The agents helped with some laboratory grunt work, in other words. But a discovery it is not.
It’s a reminder that even if AI does something impressive—like finding a pattern in a mass of biological data that would be difficult to perceive with human eyes alone—the result itself may not constitute a breakthrough for science. What is novel for AI may be routine, unsurprising, or simply not that consequential to a biologist.
Muddying the issue further, Mario Rodríguez Mestre, a biologist at the University of Copenhagen, said over the weekend that his team had already discovered this particular pattern, the New York Times reported. Mestre, who regularly chatted with Claude in his work, wondered whether Anthropic’s team had learned from his conversations. Anthropic denies this, but Mestre says he’s stopping all use of Claude anyway.
Part of the problem here is that AI companies aren’t presenting their systems simply as tools scientists can use, like microscopes or supercomputers. They’re insisting that the AI systems are making discoveries themselves. To some, that approach is incompatible with how science actually works, with new knowledge more typically emerging from collaboration and an ever-growing arsenal of tools.
It’s also making people more skeptical of genuine progress when it happens. Whittling 200,000 candidates down to a few worth exploring is no small feat; it is legitimate scientific work. The fact that a general-purpose chatbot could do that work is notable, even if humans helped steer it and ultimately ran the experiments. But once the standard is whether Claude itself made a discovery, all that becomes evidence for one side or the other in a debate that has only two answers: breakthrough or bust.
Once we’re judging AI by whether it has made a discovery, it’s also tempting to shift the goalposts even after it really does seem to notch a win. Earlier this month, OpenAI said its own team agents had cracked a million-dollar problem in mathematics. But a couple of weeks later, nearly every AI skeptic in my feed was sharing an article asking whether it was the math problem that really mattered .
To be clear, the piece did not argue that OpenAI’s solution was wrong. Instead, it argued that the particular result may not be the one mathematicians care most about. Throw in the accusation by a mathematician that the models may have used some of his work without credit, and people are left thinking either OpenAI cheated or the solution wasn’t important anyway. Or both.
That’s part of what concerns Lucas Harrington, the biologist who wrote the post critiquing Anthropic’s announcement. He closed with a suggestion: AI companies, he said, should “set the bar high now, so that when an AI actually discovers a fundamentally new biological mechanism, everyone appreciates how big a deal it is.” But as OpenAI’s Sam Altman and Anthropic’s Dario Amodei race to one-up each other, raising the bar for scientific breakthroughs by AI might be the last thing on their minds.