X, the platform owned by Elon Musk, has introduced measures to prevent its AI chatbot Grok from generating explicit images of real people. The move comes after widespread criticism over the creation of sexualized images of women and children using the platform’s “Spicy Mode” feature. This feature allowed users to create deepfakes of individuals in revealing clothing using simple text prompts.
To address these concerns, X has implemented technological measures to prevent the editing of images of real people in bikinis, underwear, and similar attire. This restriction applies to all users, including paid subscribers, and will be enforced through geoblocking in jurisdictions where such actions are deemed illegal. The platform’s safety team stated that these measures are designed to prevent the generation of non-consensual, sexually explicit material.
The announcement follows an investigation launched by California’s attorney general into xAI, the developer of Grok, over the generation of explicit content. International pressure had been building on xAI to rein in Grok, with several countries taking action against the platform. Indonesia and Malaysia have blocked access to Grok, while India has reported that X removed thousands of posts and hundreds of user accounts in response to its complaints.
In the UK, the media regulator Ofcom has opened a probe into whether X failed to comply with UK law over the sexual images. France’s commissioner for children has also referred Grok’s generated images to French prosecutors and the European Union. These developments highlight the growing concern over the misuse of AI technology to create explicit content and the need for platforms to take responsibility for regulating such content.
The introduction of these measures by X is a significant step towards addressing the issue, but it remains to be seen how effective they will be in preventing the generation of explicit images. As the use of AI technology continues to evolve, it is essential for platforms to prioritize user safety and adhere to regulatory requirements to prevent the spread of harmful content. With the global community watching, X and other platforms must demonstrate their commitment to responsible AI practices and protect users from the risks associated with explicit content.
