返回行业内容

OpenAI 将在欧盟为 ChatGPT 和 Codex 文本加隐形水印

OpenAI will start watermarking ChatGPT’s text in the EU

评分 67

导读

OpenAI 宣布将在欧盟为 ChatGPT 和 Codex 生成的文本加入隐形水印,以符合 8 月 2 日生效的欧盟 AI 法案透明度规则,未来几周面向欧盟所有套餐用户推出;API 开发者从即日起可自行开启,但默认关闭,也不会在全球范围默认启用。水印不是可见符号,而是通过影响模型的选词形成,可随复制粘贴保留,OpenAI 称开启后模型性能没有明显变化,并同步发布了与宾夕法尼亚大学、耶鲁大学研究者合著的技术报告 textGrain。测试显示,替换 10% 的同义词会让检测率从约 92% 降至 66%,短文本、数学答案和翻译文本更难检测,检测器初期仅向获批准的研究者和专业机构开放。两个月前 Anthropic 已宣布对 Claude 文本加水印并在全球范围应用。

推荐理由

欧盟透明度规则生效后,OpenAI 只在欧盟默认开启文本水印,并给出改写削弱检测的实测数据。

主体与标签

OpenAI#行业动态#政策/监管#安全/对齐#现象/趋势

正文

OpenAI will start adding an invisible watermark to text generated by ChatGPT and Codex in the European Union to comply with the EU AI Act, the company said Monday in a blog post .

The EU AI Act’s transparency rules , which took effect on August 2, require AI companies to mark AI-generated content in a way other systems can identify.

OpenAI said the watermark will roll out over the coming weeks to eligible ChatGPT and Codex users on all plans, but only in the EU. Developers using OpenAI’s API anywhere in the world can turn it on for select models starting today; it’s off by default. OpenAI said it is not making text watermarking a global default at launch.

The watermark is not an actual symbol, but works by subtly shaping the model’s word choices, leaving a pattern readers can’t see, but a detector can pick up. Because it lives in the words themselves, it travels with the text when it’s copied and pasted. OpenAI said the watermark doesn’t identify the user, and that it saw no meaningful change in its models’ performance with it switched on.

OpenAI also published a technical report for its method, called textGrain, alongside the announcement. Co-written with researchers from the University of Pennsylvania and Yale, it walks through an example of using a secret key to sort next-word predictions to finish the sentence. Add hundreds of these nudges together, and the detector can spot AI-generated content using only the text and the key.

Can the watermark be removed by editing? OpenAI’s tests suggest yes. In one test, replacing 10% of words with synonyms dropped detection from about 92% to 66%. The company also said short passages, math answers, and translated text are harder to detect.

“These limitations contribute to our decision to provide initial detector access only to approved researchers and expert organizations, who can help us evaluate reliability and responsible uses,” said the company.

OpenAI also cautioned that a missing watermark “does not prove human authorship.” The text could be too short or too heavily edited, or it could come from another company’s AI.

“[Watermarks] can indicate that an OpenAI system generated or processed part of a passage, but not how much human judgment, editing, or creativity went into it,” the company said.

The announcement comes two months after Anthropic said it would watermark text generated by Claude, a move it’s applying worldwide. That decision drew backlash from some Claude users , who argued they had supplied “the instructions, context, decisions” while Claude was just “the tool.”

OpenAI had built a text watermark before but held off on releasing it, partly over concerns that users would switch to rivals that didn’t watermark, The Wall Street Journal reported in 2024.

Anthropic, Google, Meta, Microsoft, and OpenAI are among the companies that have committed to following the EU’s code of practice on AI-generated content.

When you purchase through links in our articles, we may earn a small commission . This doesn’t affect our editorial independence.

Aditya Mehta is a reporter at TechCrunch covering AI. He’s supported by the Tarbell Center for AI Journalism and attended UC Berkeley. You can contact from Aditya by emailing [email protected] or via encrypted message at adymehta.74 on Signal.

打开原文 ↗