LONDON, U.K.: Elon Musk's X is now under scrutiny in the United Kingdom, with the media regulator, the Office of Communications (Ofcom), launching an investigation into sexually explicit deepfake images being created on the Grok AI chatbot.
A new British law will come into force this week that makes creating sexual deepfakes an offence.
Technology Minister Liz Kendall told lawmakers on January 12 that the government will also make it illegal for companies to supply tools designed to create deepfakes.
The Ofcom probe puts more pressure on the social media platform of the world's richest man, which is already facing criminal and regulatory probes around the world, from France to India.
"Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning," it said in a statement.
Platforms must protect people in Britain from illegal content, the regulator said, adding that it would not "hesitate to investigate where we suspect companies are failing in their duties, especially where there's a risk of harm to children."
When asked about the investigation, X pointed to a previous statement saying that it takes action against illegal content on the platform, including child sexual abuse material, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.
"Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content," it said.
The regulator is under pressure to act after Prime Minister Keir Starmer last week called the images "disgusting" and "unlawful". Musk's X had to "get a grip" on Grok, he said.
Following initial action against porn sites that did not have adequate age checks, the Grok case will likely be the first big test of Britain's online safety law, which was enacted in 2023 but is being implemented in stages by Ofcom.
Asked whether X could be banned, Business Secretary Peter Kyle said: "Yes, of course," but he noted that the power to do so lies with Ofcom.
Meanwhile, reacting to the controversy, Musk said Britain's government "just wants to suppress free speech."
Kendall, however, told lawmakers it was not an issue of free speech but one about tackling violence against women and girls.
She said victims and the public expected quick, firm action from Ofcom, and that X could immediately stop the illegal sharing of content on its platform.
Under the Online Safety Act, tech companies must prevent UK users from accessing illegal material and remove it once they become aware of it.
X has already been criticised in other countries over the feature, which can generate images of women and minors in revealing clothing.
French officials have reported X to prosecutors and regulators, calling the material "clearly illegal," while Indian authorities have also sought explanations. Indonesia and Malaysia temporarily blocked Grok over the weekend.
