French prosecutors are examining whether a wave of sexually explicit deepfake images generated by Grok — the AI chatbot linked to Elon Musk’s social media platform X — was deliberately encouraged to increase the company’s valuation. The investigation follows widespread outrage over Grok’s ability to produce non‑consensual sexualised images of women, girls and, in some cases, children.
According to French officials, the controversy may have been intentionally amplified ahead of a planned June 2026 stock market listing involving a new entity created through the merger of SpaceX and X AI. Prosecutors said they have alerted the U.S. Department of Justice and lawyers at the Securities and Exchange Commission about their concerns.
Rapid Spread of Non‑Consensual Images
Grok’s image‑generation tool allowed users to tag the chatbot in posts and request altered or fabricated photos. Investigators say many users exploited the system by uploading images of women and prompting Grok to “undress” them or place them in revealing clothing. The bot’s outputs triggered global alarm after reports showed that sexualised images of women — and some appearing to depict minors — were produced at scale. European regulators have since opened multiple investigations into the system.
International Scrutiny Intensifies
Authorities in France, the U.K., and other countries have launched probes into both Grok and platform X. French police raided X’s Paris offices earlier this year as part of a broader investigation into the spread of child sexual abuse images and deepfakes. Musk has been summoned for questioning as part of that inquiry. [cbc.ca]
In parallel, several governments — including Malaysia, India, and France — are pursuing separate investigations into whether Grok facilitated the creation of illegal content. Regulators have expressed concern that Grok’s safety measures were too easily bypassed, enabling a “mass digital undressing spree,” as described in reporting on the bot’s lax safeguards.
Regulatory and Legal Fallout
The European Union has launched a formal investigation to determine whether X has complied with digital safety laws requiring platforms to limit the spread of harmful and illegal content. Some countries have banned or restricted the chatbot entirely while others consider tougher penalties for Musk’s companies. [apnews.com]
In response to mounting pressure, X has said it maintains a “zero‑tolerance” policy for child sexual exploitation and non‑consensual nudity. The company introduced new restrictions aimed at blocking requests for sexualised image generation in certain regions, though regulators say the measures are still insufficient. [pbs.org]
EU Moves Toward a Ban on Sexualised AI Deepfakes
The Grok scandal has accelerated momentum within the European Union to ban AI tools that generate sexualised deepfakes. Earlier this month, EU member states backed rules prohibiting systems that create non‑consensual intimate imagery or child sexual abuse material. Lawmakers have argued the issue goes beyond one case, raising broader questions about the power of AI technologies to harm individuals.