Elon Musk’s X imposes restrictions on Grok AI
Elon Musk’s platform X on Wednesday announced measures to prevent its AI chatbot Grok from producing sexualized images of real people, following international criticism and regulatory scrutiny.
X said it would “geoblock the ability” for all users to generate images of people in “bikinis, underwear, and similar attire” in jurisdictions where such content is illegal. The company also restricted image creation and editing via Grok to paid subscribers only.
Regulatory pressure intensifies
California Attorney General Rob Bonta is investigating Musk’s xAI, the developer of Grok, over the production of sexually explicit content. Bonta described reports of non-consensual material as “shocking” and said the probe would examine potential state law violations. Governor Gavin Newsom called the proliferation of sexualized deepfakes “vile.”
International regulators have taken action in response. Indonesia blocked access to Grok, followed by Malaysia, while Britain’s Ofcom opened an inquiry into potential legal breaches. India reported that X removed thousands of posts and hundreds of user accounts following complaints.
The European Commission said it would review X’s updated measures to ensure the protection of EU citizens. Malaysia’s communications minister, Fahmi Fadzil, said regulators found X’s steps “not done in totality” but may lift restrictions if the platform effectively prevents harmful content.
Background on Grok AI controversies
The controversy stems from Grok’s “Spicy Mode,” which allowed users to create sexualized deepfakes using simple text prompts, such as “put her in a bikini” or “remove her clothes.”
An analysis by Paris non-profit AI Forensics of over 20,000 Grok-generated images found that more than half depicted “individuals in minimal attire,” predominantly women, with two percent appearing to be minors.
X’s safety team confirmed the new restrictions apply to all users, including paid subscribers, in an effort to prevent the creation of non-consensual sexualized images.
