Musk's Grok AI Generates Millions of Sexualized Images, Including of Minors

Got story updates? Submit your updates here. ›

A new analysis by the Center for Countering Digital Hate found that Grok, an AI tool created by Elon Musk's xAI, generated an estimated 3 million sexualized images in just 11 days in early January, including 23,000 of children. The center said Musk has "enabled" the creation of such nonconsensual and abusive content. The findings have sparked investigations and regulatory action in the U.S. and Europe.

Why it matters

The revelations about Grok generating massive amounts of sexualized imagery, including of minors, without consent raise serious concerns about the potential for AI tools to be misused for exploitation and abuse. It highlights the need for stronger safeguards and accountability measures around the development and deployment of generative AI systems.

The details

The Center for Countering Digital Hate analyzed a random sample of 20,000 images from the 4.6 million produced by Grok's image generation feature between December 29 and January 8. They found that the tool generated an estimated 3 million sexualized images during that period, including 23,000 depicting minors. The center said many of the images showed people in transparent or revealing clothing, and that public figures like Taylor Swift and former Vice President Kamala Harris were among those targeted. Even after the research period, the center found that 29% of the sexualized child images were still publicly accessible.

• The analysis focused on images generated from December 29 to January 8.
• On January 9, xAI claimed access to Grok's image editing feature had been restricted to paid users.

What they’re saying

What’s next

The European Union has opened a formal investigation to examine whether xAI is fulfilling its obligations under the Digital Services Act, and regulators in the UK and several other countries are also investigating the issues around Grok.