Ofcom has contacted Elon Musk’s company XAI after reports that its AI tool, Grok, can create sexualised images of children and digitally undress women. The regulator is also looking into claims that Grok has produced inappropriate images of real people.
Users have reportedly prompted Grok to alter images of women, making them appear in bikinis or sexual situations without consent. XAI warned users not to generate illegal content, including child sexual abuse material. Elon Musk added that anyone asking Grok to create illegal content would face the same consequences as uploading it themselves.
XAI’s policy forbids producing pornographic images of real people. Despite this, some users have exploited the AI, including creating images of Catherine, Princess of Wales, in states of undress. Kensington Palace has been approached for comment.
Authorities around the world are monitoring the situation. The European Commission said it is “seriously looking into this matter,” while officials in France, Malaysia, and India are also assessing Grok’s misuse. The UK’s Internet Watch Foundation confirmed receiving reports about Grok-generated images, though none met the legal threshold for child sexual abuse material.
Dame Chi Onwurah, chair of the Science, Innovation and Technology Committee, called the reports “deeply disturbing.”
European Commission spokesperson Thomas Regnier described the images as “appalling” and “disgusting” and stressed that such content has no place in Europe. X has already faced a €120m fine for breaching EU Digital Services rules.
The UK Home Office is introducing laws to ban nudification tools. Under the new rules, anyone providing technology that creates sexualised images without consent could face prison and heavy fines
