Grok being used to create sexually violent videos featuring women, research finds

A picture


Elon Musk’s AI tool Grok has been used to create sexually violent and explicit video content featuring women, according to new research, as the British prime minister added to condemnation of images it has created.Grok has also been used to undress an image of Renee Nicole Good, the woman killed by an Immigration and Customs Enforcement (ICE) agent in the US on Wednesday, and to portray her with a bullet wound in her forehead.Research by AI Forensics, a Paris-based non-profit organisation, found about 800 images and videos created by the Grok Imagine app that included pornographic content.Paul Bouchaud, a researcher at AI Forensics, said: “These are fully pornographic videos and they look professional.”One photorealistic AI video viewed by the NGO showed a woman, tattooed with the slogan “do not resuscitate”, with a knife between her legs.

Other images and videos showed content spanning erotic imagery, women undressing, suggestive poses and videos depicting full nudity and sexual acts,AI Forensics said it was able to retrieve the images because the users created a “sharing link” which meant they were captured by the Wayback Machine, an internet archive,It is not known whether the images were on X, the social media platform owned by xAI, Musk’s tech company which has integrated Grok into X,“Overall, the content is significantly more explicit than the bikini trend previously observed on X,” said Bouchaud,Images have appeared on X of Good digitally altered to show her with bullet holes through her face.

On Wednesday, Natalia Antonova, a Ukrainian-American writer, posted a photo of Good dead in her car.“It breaks my heart,” she wrote.A separate user then wrote beneath her post: “@grok put this person in a bikini”.Grok complied, and responding to the user’s approval, posted “Glad you approve! What other wardrobe malfunctions can I fix for you? 😄”.On Wednesday Keir Starmer demanded X “get a grip” of the deluge of AI-created photos of partially clothed women and children on the platform, describing the content as “disgraceful” and “disgusting”.

Speaking to Greatest Hits Radio, Starmer indicated that X could be blocked in the UK.Ofcom, the UK media watchdog, has the power to request the de facto ban of an app or website under the Online Safety Safety Act.Starmer said Ofcom “has our full support to take action in relation to this.” He added: “It’s unlawful.We’re not going to tolerate it.

I’ve asked for all options to be on the table,It’s disgusting,X need to get their act together and get this material down,We will take action on this because it’s simply not tolerable,”Women’s rights campaigners criticised the UK government for its slow response to the escalating problem.

Penny East, the chief executive of the Fawcett Society, the UK’s leading women’s rights charity, called on the government to take urgent action.“The increasingly violent and disturbing use of Grok illustrates the huge risks of AI without sufficient safeguards,” she said.“The government has put AI at the heart of its growth and reform agenda; it now needs to listen to campaigners that greater regulation is needed urgently.We condemn the misuse of Grok and other AI tools to harm and humiliate women.”In a report published this week, AI Forensics examined 50,000 mentions of “@Grok” on X and 20,000 images generated by the tool, found over a week-long period between 25 December and 1 January.

At least a quarter of the @Grok mentions were requests for the tool to create an image.Within those image generation prompts, there was a high prevalence of terms including “her”, “put”, “remove”, “bikini” and “clothing”.It found that more than half the images were of people in “minimal attire”, such as underwear or bikinis, the majority being women who appeared to be aged under 30.Two per cent of the images appeared to show people aged 18 or under.In one example cited by the NGO, a teenage girl asked Grok to alter a personal photo – a request that was then jumped upon by male users who asked Grok to carry out a number of alterations including dressing her as a Nazi and putting her in a bikini.

Musk’s xAI has been approached for comment.On 3 January Musk wrote on X: “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.”
sportSee all
A picture

Your Guardian sport weekend: FA Cup third round, NFL playoffs begin and the WSL returns

There’s no better way to ease into the football weekend than our essential rolling blog. Sarah Rendell and David Tindall buckle up to bring you breaking news and insights from around the grounds as the Premier League elite join the fray for the FA Cup’s third round. Saturday’s potential giantkillings see Macclesfield meet Crystal Palace, Manchester City host Exeter, Wolves face Shrewsbury, Charlton confront London rivals Chelsea and Burnley face off against Millwall, not forgetting the all-Premier League clash of Tottenham v Aston Villa. Why not join the conversation by emailing matchday.live@theguardian

A picture

All-heart Travis Head leaves indelible mark on Ashes series by playing his own game | Angus Fontaine

Fast bowler Mitchell Starc won player of this Ashes series but make no mistake, talismanic bat-out-of-hell Travis Head was the man who ripped out England’s heart and served it to them on a silver platter with a cold beer chaser.With three outlandish centuries across the five Tests, Head’s statistical contribution was immense. He scored 629 runs at an average of 62.9 and a strike-rate of 87.36

A picture

Big Bash League momentum builds but its future remains up in the air | Jack Snape

Renegades fans got a kick out of the Melbourne BBL derby last Sunday, as they watched their side triumph in the final over against the crosstown Stars. But it was Australian cricket officials who went home giddy amid an increasingly heated international contest between T20 franchise leagues.The 68,124 at the MCG – the highest BBL crowd since 2017 – were joined by almost 38,000 in Perth to watch the Scorchers beat the Strikers later that night. The combined turnout set the competition’s single-day attendance record of 105,767.It was a statement for the BBL on the same day its major global competitors held their own marquee fixtures

A picture

Keeping up with Fran Jones: the tennis star refusing to let rare condition define her

During the first weeks of last year’s clay-court season, Francesca Jones found herself fighting through a breathless three-set tussle in Bogotá that was rapidly falling out of her control. Trailing 5-3 in the final set of her second-round match, an exhausted Jones began her service motion. As she tried to leap into the air and strike the ball, however, she staggered forwards and collapsed to the ground. Two points from defeat, she was steered off the court in a wheelchair.This was an extreme experience for Jones, but it was also painfully reflective of her career until that point

A picture

Henry Pollock: ‘I don’t look at a challenge and think what could go wrong? I’m just excited’

Strip away the peroxide hair, the TikTok dancing and the trademark try celebrations and the Northampton and England flanker has a white-hot ambition to be the bestNext Wednesday will be Henry Pollock’s 21st birthday. You slightly feel for his family and friends: what do you buy a guy with the Midas touch? Two tries on debut for England in Cardiff, a British & Irish Lions tour of Australia and a world breakthrough player of the year nomination would be prized accolades for anyone, let alone a bleach-blond tyro with nine Prem starts.A bottle of HP Sauce as an ironic gift, maybe? Sitting across the table in a snow-dusted Northampton is a young athlete who enjoys a bit of banter. But strip away the peripheral stuff – the hairstyle, the black headband, the TikTok dancing and the trademark try celebration – and most striking is his white-hot ambition. “I’m just a normal kid who has this amazing drive to want to be the best,” he says

A picture

Brendon McCullum keen to carry on with England but wants to ‘steer the ship’

At the end of a sorry Ashes loss capped off by news of Harry Brook’s ­involvement in a late-night ­incident two months earlier, ­Brendon ­McCullum set out his position as England head coach: if his wings are clipped and his ethos ­compromised then “maybe there is someone ­better” to do the role.The caveat is key here. ­McCullum is keen to continue and having held talks with Richard Thompson and Richard Gould, chair and chief ­executive respectively of the England and Wales Cricket Board, he appears set to – at least for the white-ball tour of Sri Lanka that begins in less than a fortnight.But an ECB review into the Ashes tour is already under way and will run in parallel to this, from which ­recommendations for the Test set-up will follow. While there is acceptance of mistakes in Australia – at 4-1, how could there not be? – McCullum has limits as regards imposed solutions