AI platforms flippant about stopping deepfake porn; authorities stepping in
The article reports that some AI platforms are being criticized for not doing enough to stop the creation and distribution of deepfake pornography, especially content made without consent. A study of the AI content marketplace Civitai found the site had a policy banning deepfake porn of real people but still hosted tools and requests that made it easy to produce such material. Even though Civitai later expanded its ban and lost payment processing support, problematic deepfake generation remains available. Meanwhile, authorities in several countries are stepping in: French prosecutors raided X (formerly Twitter) over alleged deepfake and child abuse content, and UK regulators, including Ofcom and the ICO, have launched investigations into the AI model Grok for generating non-consensual sexual imagery. In the US, 37 state attorneys general have demanded that xAI improve safeguards against deepfake porn and new federal legislation aimed at combating non-consensual explicit AI-generated content has been acknowledged by the Senate.
