RAINN, the nation’s largest anti-sexual violence organization, has a problem with Grok’s new generative AI video tool’s “spicy” mode, which allows any user to create nude images and commit tech-enabled sexual abuse. According to The Verge’s Jess Weatherbed:

“While other video generators like Google’s Veo and OpenAI’s Sora have safeguards in place to prevent users from creating NSFW content and celebrity deepfakes, Grok Imagine is happy to do both simultaneously. In fact, it didn’t hesitate to spit out fully uncensored topless videos of Taylor Swift the very first time I used it — without me even specifically asking the bot to take her clothes off.”

This trend is part of a growing problem of image-based sexual abuse, in which pictures and videos — real or generated by AI — are used to harm another person.

This May, RAINN helped pass the Take It Down Act, which requires tech platforms to remove such content within 48 hours. Apparently, Grok didn’t get the memo.

What the Take It Down Act does:

• Criminalizes non-consensual sharing of intimate images, including AI deepfakes.
   
• Requires online platforms to remove harmful content within 48 hours of a verified request.

Megan Cutter, chief of victim services at RAINN, explained why the Take It Down Act is a step in the right direction for survivors:

“This kind of digital assault inflicts deep emotional harm, compounding betrayal with shame and exposure. No one should have their likeness weaponized against them. Thanks to the Take It Down Act, survivors now have a real path to justice. But laws only matter if platforms use them. We urge every technology company to honor this mandate and protect every person’s right to dignity online.”