John Z Black
Brunswick, ME • (207) 245-1010 • contact@johnzblack.com
This isn’t another “Brussels passes regulation” story you can safely ignore.
The European Council is moving to classify AI-generated non-consensual intimate images and CSAM under the AI Act’s “prohibited practices” category. Not high-risk. Not “regulated with conditions.” Banned. Same tier as subliminal manipulation and government social scoring.
Penalties? Up to 35 million euros or 7% of global annual turnover. For a large platform, that’s a number that gets the board’s attention immediately.
Still needs reconciliation with the European Parliament before it’s final law. But given the near-universal political consensus on NCII and CSAM, nobody’s stripping this provision out.
The obvious targets are platforms explicitly marketing nudification tools. But the harder question is about general-purpose image generators that can be misused for this. The EU has been clearer than most US policymakers about distinguishing purpose-built tools from misusable ones. Still, the line isn’t perfectly defined, and enforcement interpretation will matter a lot.
Open-source models are the murkiest territory. If someone downloads open weights and builds a nudification tool, does the original developer face liability? The AI Act focuses on entities that “place on the market” AI systems in the EU. Distributing open weights is a different fact pattern. This one’s going to need real legal analysis.
And here’s the thing about EU regulation. It tends to set the floor globally. Companies aren’t going to maintain separate European and American versions of the same product when the European version bans the product’s core function. The EU prohibition becomes the binding constraint everywhere.
For victims, this matters concretely. Treating the tool as prohibited rather than just the content shifts legal risk upstream to developers and platforms, where prevention can actually scale. That’s a different approach from making individual victims chase down content removal one image at a time.
Whether the rest of the world follows is the open question. But the EU moved first, and the standard is set.