研究：AI 编码生成更多代码、却没生成更多软件——人工审查成瓶颈
AI coding agents generate more code, but not more software
评分 56
导读
一项考察数百家企业真实编码实践的研究发现：AI 编码助手能高效生成大量可用代码，但代码的人工评审成了整体效率的显著瓶颈——"几乎没有证据表明企业因此增加了软件产出"。从业者早就知道不能信任 AI 代码的准确性、必须投入可观精力复审，研究把这层摩擦量化为"更多代码≠更多软件"。
推荐理由
研究转述摘要：核心命题(审查瓶颈、代码≠软件)与样本口径(数百家公司实际实践)可用，但本文只抓到摘要级内容、未含方法与效应量；属"AI 编码生产力再审视"的证据链一环(与包内 ReviewBench 基准 9365 同线)。T2 下未过精选线。
主体与标签
Ars Technica#论文/研究#编码#开发者#评测/基准
正文
Anyone who has even tangentially associated with computer programming knows that modern AI coding assistants and agents can be incredibly efficient at generating huge amounts of functional code . But coders making use of those tools also know better than to trust the accuracy of that code , meaning substantial effort needs to be spent reviewing any AI-generated output.
A recent study of actual coding practices across hundreds of firms finds that human code review forms a significant "bottleneck" for the overall efficiency of AI coding tools, resulting in "little evidence that firms increase software output or reduce employment" by using them. Any efficiency increased during the actual coding phase, the study authors find, is "absorbed by downstream constraints in the production process"; as "the code review process significantly increases in length, pull requests are more likely to require revisions, and reviewers leave more comments."
Cut once, measure twice
To come to these conclusions, Harvard University researchers Fiona Chen and James Stratton made use of aggregated analytics data from Jellyfish , which measures the granular output of engineering teams. That data encompasses 300 million individual "work events" (e.g., commits and pull requests) and issue management software data across more than 700,000 employees at over 700 relevant software development firms from 2021 through March of 2026.