Grok turns off image generator for most users after outcry over sexualised AI imagery

A picture


Grok, Elon Musk’s AI tool, has switched off its image creation function for the vast majority of users after a widespread outcry about its use to create sexually explicit and violent imagery,The move comes after Musk was threatened with fines, regulatory action and reports of a possible ban on X in the UK,The tool had been used to manipulate images of women to remove their clothes and put them in sexualised positions,The function to do so has been switched off except for paying subscribers,Posting on X, Musk’s social media network, Grok said: “Image generation and editing are currently limited to paying subscribers.

”That means the vast majority of users of the platform cannot create images using Grok.Those who do have their full details and credit card information stored by X, so can be identified if the function is misused.The public @Grok account has had its image generation capabilities heavily restricted.However, there is also a separate Grok app, which does not share images publicly, on which non-paying users have reported still being able to generate sexualised imagery of women and children.Research revealed by the Guardian found it had been used to create pornographic videos of women without their consent, as well as images of women being shot and killed.

Musk is facing the threat of regulatory action from around the world after Grok was used to create nonconsensual sexual imagery.Keir Starmer, the UK prime minister, threatened on Wednesday to take strong action against the social media company.He demanded that X “get a grip” of the deluge of AI-created photos of partly clothed women and children on the platform, describing the content as “disgraceful” and “disgusting”.Indicating that a de facto ban of X should be considered, Starmer said the communications regulator Ofcom “has our full support to take action in relation to this”.Under the UK’s Online Safety Act, Ofcom has the power in serious cases to seek a court order to block a website or app in the UK.

It can also impose fines of up to 10% of a company’s global turnover.Starmer added: “It’s unlawful.We’re not going to tolerate it.I’ve asked for all options to be on the table.It’s disgusting.

X need to get their act together and get this material down.We will take action on this because it’s simply not tolerable.”Thousands of sexualised images of women have been created without their consent over the past two weeks, after the Grok image creation feature was updated at the end of December.Musk has faced repeated public calls to remove or restrict the feature, but until now the social media app had not acted.Jess Asato, a Labour MP who has been campaigning for better regulation of pornography, said: “While it is a step forward to have removed the universal access to Grok’s disgusting nudifying features, this still means paying users can take images of women without their consent to sexualise and brutalise them.

Paying to put semen, bullet holes or bikinis on women is still digital sexual assault and xAI should disable the feature for good,”Some of the most offensive content is being created off the X platform, which is integrated with Grok, via the Grok Imagine tool,Research by AI Forensics, a Paris-based non-profit organisation, found about 800 images and videos created by the Grok Imagine app that included pornographic and sexually violent content,Paul Bouchaud, a researcher at AI Forensics, said: “These are fully pornographic videos and they look professional,”One photorealistic AI video viewed by the NGO showed a woman, tattooed with the slogan “do not resuscitate”, with a knife between her legs.

Other images and videos contained erotic imagery, images of women undressing, suggestive poses and videos depicting full nudity and sexual acts,“Overall, the content is significantly more explicit than the bikini trend previously observed on X,” said Bouchaud,X has been contacted for comment,
politicsSee all
A picture

Lib Dems call on Reform MPs to donate income from X to charity amid Grok row

The Liberal Democrats have urged Reform UK MPs who receive payment from X for their posts to donate the money to charities working to combat sexual exploitation, after the site was flooded with AI-generated sexualised images of women and children.The Lib Dem spokesperson for science, innovation and technology, Victoria Collins, said Nigel Farage and other MPs paid by the Elon Musk-owned site were receiving “tainted money”.A series of MPs have called for the government to stop posting on X after the site’s inbuilt AI tool Grok started generating huge numbers of images of women and children in bikinis or other minimal attire, often in sexually provocative poses, in response to user prompts.The site has now limited the image creation function to paying subscribers, a move that Downing Street condemned as turning “an AI feature that allows the creation of unlawful images into a premium service”.X users who are verified earn money based on the amount of engagement they generate

A picture

Home Office tells Gaza academic his bid to bring family to UK not urgent

A Palestinian academic has failed in his latest attempt to be reunited with his family in the UK after the Home Office concluded their case was not urgent and it was more appropriate for his two children to remain with their mother in a tent in Gaza.Bassem Abudagga was also told in a letter from Home Office officials that no reason had been found that was “sufficiently compelling” to defer a requirement that his wife attend a visa application centre (VAC) in Gaza so she could provide fingerprints to satisfy the conditions for evacuation.No such facility remains in Gaza as a result of Israeli bombardments, which have continued despite the fragile ceasefire – a fact that Abudagga says the Home Office is well aware of.Abudagga last saw his wife, Marim, son Karim, six, and daughter Talya, 10, four weeks before the October 7 attack in 2023 when he returned for a visit to Gaza.He had won a scholarship to study for a PhD at York St John University in 2022 and is regarded by his tutors as a model student

A picture

The world is in chaos. So thank God for the UK’s lone fixed point: Liz Truss

A world on the brink. Regime change in Venezuela. Greenland under threat from Donald Trump. Shadow fleet tanker seized by the US and the Brits in the North Atlantic. The Europeans battling to keep America onside in any Ukraine peace deal

A picture

Labour’s swift pubs U-turn shows government learning – and repeating Treasury mistakes

Political U-turns come in various forms, and as news of the latest government reversal drifted out, this one connected to the plight of the pub trade, Labour MPs could take comfort in one thing: at least it happened quickly.While last summer’s change of stance on benefit reforms was forced on Downing Street by open rebellion, and those for pensioners’ winter fuel payments and inheritance tax for farmers followed months of dissent, the decision to revisit decisions on business rates took a matter of weeks.“It would have been better if we hadn’t done it at all, but at least it was reversed quickly,” said one MP about the promised new look at business rates valuations, which the hospitality trade say would have seen major increases for pubs and hotels.“Maybe they are learning. And to give the government credit, they have been in proper listening mode over this

A picture

Software tackling deepfakes to be piloted for Scottish and Welsh elections

Election officials are working “at speed” with the Home Office on a pilot project to combat the use of deepfakes to target candidates standing in this year’s Scottish and Welsh elections.Officials at the Electoral Commission in Scotland said they and the Home Office expected software capable of detecting AI-generated deepfake videos and images to be operational before election campaigns begin in late March.Sarah Mackie, the commission’s chief in Scotland, said that if the software detected a hoax video or image, officials would contact the police, the candidate concerned and inform the public, although she acknowledged it could not always provide 100% certainty.They would then urge the social media platform to take the content down, she said. However, because such action is currently voluntary, the commission also wants legally enforceable “takedown” powers that would require media platforms to remove hoax material

A picture

Badenoch claims forthcoming business rates U-turn for pubs ‘too little, too late’ – as it happened

We don’t yet know the extent of the government U-turn shortly to be announced related to business rates for pubs and other parts of the hospitality sector. (See 2.24pm.)But Kemi Badenoch is already saying it is “too little, too late”. In a post on social media, she says:Yesterday Keir Starmer told us Labour had ‘turned a corner