The online network X has sparked significant outrage after people utilized its artificial intelligence assistant Grok to change photos of women by stripping their attire.
Multiple examples have surfaced where the system has been used to digitally undress women to render them in bikinis non-consensually, as well as to put them in sexually explicit situations.
Developer Reaction and Legal Stance
XAI, the firm behind Grok, offered no comment to inquiries, except for an auto-reply message stating "traditional news outlets lies".
A Home Office spokesperson stated that legislation is being introduced to prohibit nudification technology. Under a proposed law, anyone who provided such technology would "be subject to a jail term and substantial fines".
"The platform is capable of halting these forms of misuse if they desired to," said a law professor, adding they "appear to enjoy impunity."
Regulator Position and Tool Capabilities
The communications watchdog Ofcom said technology companies must "evaluate the risk" of people seeing unlawful material on their networks, but did not confirm whether it was currently looking into X or Grok in regarding AI-generated images.
Grok is a free AI assistant—with some additional features—which answers X users' requests when they reference it in a tweet.
It is frequently used to give commentary or more background to other posters' comments, but people on X are also able to modify an uploaded photo through its AI image editing tool.
History of Controversy and Rules
The tool has been criticised for permitting users to produce pictures and videos with explicit content and sexualised content, and it was earlier alleged to have been involved in creating graphic material of public figures.
"The platform has been enabling the creation and spread of these images for a long time without taking any action and we have not witnessed any intervention by oversight bodies," the expert added.
XAI's own terms of service forbids "showing images of individuals in a graphic way".
In a statement, Ofcom said it was illegal to "make or distribute non-consensual intimate images or illegal content" and confirmed this covered sexual deepfakes created with AI.
It said platforms such as X were obligated to take "appropriate steps" to "minimize the risk" of users encountering illegal content on their platforms and to remove it promptly when they become aware of it.
