ChatGPT 的输出在欧盟会被默认打上水印:OpenAI 自研的方法叫 textGrain 并附了技术论文,其他地区则默认为关;但文章直言目前根本没有完全有效可靠的标注手段,已有的 SynthID 与 C2PA 等标准对有基础技能的人也相当容易绕过
OpenAI will watermark ChatGPT outputs by default—but only in the EU
精选评分 76
导读
OpenAI 宣布将在欧盟对用 ChatGPT 生成的文本自动加水印。公司也会在其他地区提供这一水印功能,但在欧盟之外默认关闭。这一在欧洲的举措是为了遵守 8 月生效的欧盟 AI 法案——该法案要求以可被另一工具检测的方式标注由 AI 模型产出的内容。文章随即给出保留意见:至今仍然不存在完全有效且可靠的做法。SynthID 与 C2PA 之类的标准已经存在,但对任何具备基础知识的人来说都相对容易被绕过。OpenAI 的水印很可能也是如此:其方法为专有,公司称之为 textGrain,并发表了一篇技术论文解释原理;但总体上它与过去见过的 LLM 水印工具类似——在选词里嵌入人类读者看不出、也不会实质改变输出质量的模式,持有密钥的人则可以用专门的检测器找出来。OpenAI 表示将把检测器开放给有限数量的研究者与组织,并为其他人提供一套申请审批的流程逐步加入。这条记录的价值在于它把一个「监管要求 → 技术落地」的完整链条摊开:欧盟 AI 法案的可检测标注义务,逼出了厂商自研的专有水印;而它同时把这套方案的先天局限(易被绕过、检测器只对少数人开放)写在了明面上,这是评估内容溯源可行性时不可回避的两点。
推荐理由
把监管驱动的水印落地拆成了可评估的三件事:只对欧盟默认开、检测器只向有限研究者开放、以及方法易被绕过的固有局限。
主体与标签
OpenAI#产品更新#政策/监管#安全/对齐
正文
OpenAI will begin automatically watermarking text generated with ChatGPT in the European Union, the company has announced. It will also offer the watermarking feature in other regions, but it will be off by default outside of the EU.
The move in Europe is driven by a need to comply with the EU AI Act, which took effect in August. It requires marking content produced by AI models in a way that another tool can detect. Unfortunately, there is still no completely effective and reliable way to do that. A few standards already exist, like SynthID and the C2PA project, but they are relatively easy to circumvent for anyone with basic know-how.
The same is likely true for OpenAI's watermark. Its method is proprietary; the company calls it textGrain, and has published a technical paper explaining how it works. But in general, it works like other LLM watermarking tools we've seen in the past: It puts patterns in the word choices that are not clear to a human reader, and that don't meaningfully change the general quality of the output, but that someone with a key can use a specialized detector to find. OpenAI says it will be giving access to the detector to a limited number of researchers and organizations, and providing a request-for-approval process for others to be added over time.