Study: Reports of nonconsensual nude images are ignored on X

The platform neglected to remove deepfakes reported for nonconsensual nudity, a new study found.
By Anna Iovine  on 
x logo blurred on a smartphone
Credit: Kirill Kudryavtsev / AFP via Getty Images

X (formerly Twitter) takes swift action when taking down deepfake nude images that are reported as copyright violations — but not when they're reported under "nonconsensual nudity," a study has found.

The paper, published by researchers at the University of Michigan and Florida International University, is an audit of X's reporting systems and hasn't yet been peer-reviewed, 404 Media reported. Researchers created five AI "personas" of young white women (to prevent further variables of race, gender, and age) and then made 10 replica images of each, resulting in 50 images. In terms of the ethics around generating deepfake porn themselves, researchers said these images underwent a "rigorous verification process" to ensure they didn't represent an existing individual.

They posted these images to X on 10 "poster accounts" they created, and then they created five X accounts to report the images. Twenty-five images were reported as Digital Millennium Copyright Act (DMCA) violations, and the other 25 were reported as nonconsensual nudity.

Researchers then waited three weeks to see the results of these reports. All 25 images reported for copyright were removed from X within 25 hours. In contrast, none of the images reported for nonconsensual nudity were removed within the three-week waiting period.

Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

"Our findings reveal a significant disparity in the effectiveness of content removal processes between reports made under the DMCA and those made under X's internal nonconsensual nudity policy," the study states. "This highlights the need for stronger and directed regulations and protocols to protect victim-survivors."

X owner Elon Musk dissolved the platform's trust and safety council in 2022, but the site has recently opened up two dozen safety and cybersecurity positions in the U.S. Mashable has reached out to X for comment.

Earlier this year, WIRED found that victims of nonconsensual deepfake porn leveraged copyright laws to take down deepfakes on Google.

If you have had intimate images shared without your consent, call the Cyber Civil Rights Initiative’s 24/7 hotline at 844-878-2274 for free, confidential support. The CCRI website also includes helpful information as well as a list of international resources.

anna iovine, a white woman with curly chin-length brown hair, smiles at the camera
Anna Iovine
Associate Editor, Features

Anna Iovine is associate editor of features at Mashable. Previously, as the sex and relationships reporter, she covered topics ranging from dating apps to pelvic pain. Before Mashable, Anna was a social editor at VICE and freelanced for publications such as Slate and the Columbia Journalism Review. Follow her on X @annaroseiovine.


Recommended For You
Google announces new tactics to curb explicit deepfakes
Laptop with Google Search pulled up.

How Big Tech is approaching explicit, nonconsensual deepfakes
A photo collage in which a woman's appearance is covered by a variety of mismatched facial features.

Microsoft Bing amps up its ability to stop explicit deepfake images from appearing in Search results
The Microsoft Bing logo on a dark phone screen.

Google Gemini now lets you create AI-generated images of people — but there's a catch
AI-generated image of a woman holding a bouquet of flowers

Reports indicate Grindr outage in Milwaukee, where the RNC is
Grindr displays its banner outside of the New York Stock Exchange

Trending on Mashable
Wordle today: Answer, hints for October 11
a phone displaying Wordle

NYT Connections today: Hints and answers for October 11
A phone displaying the New York Times game 'Connections.'

NYT Connections today: Hints and answers for October 10
A phone displaying the New York Times game 'Connections.'

Astronomers just found a galaxy way too advanced for its time
Galaxy forming in the early universe

'The Platform 2's twisty ending, explained
A close-up of a topless, bald man holding a lit lighter.
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!