X faces global scrutiny after Grok chatbot generated exploitative images

Elon Musk’s social media platform X (formerly known as Twitter) is facing mounting regulatory scrutiny across multiple jurisdictions after its Grok chatbot was used to create and share AI-generated sexualized images of children and women.

Authorities in Europe, India, and Malaysia have launched investigations, while officials in Brazil and the UK have also raised concerns, marking one of the most serious global regulatory challenges yet for Musk’s AI ambitions.

The controversy centers on Grok Imagine, a recently updated feature that allows users to generate images from text-based prompts directly on X.

Over the past few weeks, the tool has reportedly been used to produce and circulate nonconsensual, intimate images (NCII), including content depicting minors.

Many of these images have spread widely on the platform, prompting intervention from regulators and safety advocates.

Regulators move across Europe, Asia and Latin America

In Europe, the issue has drawn sharp criticism from officials.

At a press conference on Monday, European Commission spokesperson Thomas Regnier said the authority was “very seriously looking into this matter,” adding that X and Grok were offering a “spicy mode” that produced explicit sexual content, including childlike images.

“This is not ‘spicy,’” Regnier said. “This is illegal. This is appalling. This is disgusting.”

Britain’s media watchdog Ofcom confirmed it has requested information from X regarding the Grok issues.

In India, the Ministry of Electronics and Information Technology ordered X late last week to conduct a “comprehensive technical, procedural and governance-level review” of Grok, setting a Jan. 5 deadline for compliance.

Malaysia’s Communications and Multimedia Commission said it is investigating the platform and will summon company representatives, urging stronger safeguards aligned with local laws.

In Brazil, a member of parliament said she had asked the federal public prosecutor and the country’s data protection authority to suspend Grok’s use until an investigation is completed.

Musk, xAI and the safety debate

While safety experts and technology critics condemned the proliferation of exploitative images, Musk appeared to mock the controversy by sharing Grok-generated images on X, including one depicting himself in a bikini.

X later issued its first public response via its official Safety account, stating it takes action against illegal content, including child sexual abuse material (CSAM), through removals, account suspensions, and cooperation with law enforcement.

Musk separately warned that anyone prompting Grok to create illegal content would face the same consequences as uploading such material.

An xAI employee said Grok Imagine had been updated, but did not specify whether changes addressed the generation of harmful explicit images.

In the US, the National Center on Sexual Exploitation called on the Department of Justice and Federal Trade Commission to investigate.

While federal agencies declined to comment, NCOSE said existing laws banning the creation and distribution of CSAM could apply even to virtually created content in certain circumstances.

Traffic rises despite the controversy

Despite the backlash, X’s user engagement has not suffered.

Data from Apptopia shows daily downloads of Grok have risen 54% since Jan. 2, while daily downloads of X climbed 25% over the past three days.

Critics argue the episode highlights weaknesses in X’s trust and safety infrastructure, particularly around AI-generated content.