Tech companies and UK child safety agencies to test AI tools’ ability to create abuse images

A picture


Tech companies and child protection agencies will be given the power to test whether artificial intelligence tools can produce child abuse images under a new UK law.The announcement was made as a safety watchdog revealed that reports of AI-generated child sexual abuse material [CSAM] have more than doubled in the past year from 199 in 2024 to 426 in 2025.Under the change, the government will give designated AI companies and child safety organisations permission to examine AI models – the underlying technology for chatbots such as ChatGPT and image generators such as Google’s Veo 3 – and ensure they have safeguards to prevent them from creating images of child sexual abuse.Kanishka Narayan, the minister for AI and online safety, said the move was “ultimately about stopping abuse before it happens”, adding: “Experts, under strict conditions, can now spot the risk in AI models early.”The changes have been introduced because it is illegal to create and possess CSAM, meaning that AI developers and others cannot create such images as part of a testing regime.

Until now, the authorities have had to wait until AI-generated CSAM is uploaded online before dealing with it.This law is aimed at heading off that problem by helping to prevent the creation of those images at source.The changes are being introduced by the government as amendments to the crime and policing bill, legislation which is also introducing a ban on possessing, creating or distributing AI models designed to generate child sexual abuse material.This week Narayan visited the London base of Childline, a helpline for children, and listened to a mock-up of a call to counsellors featuring a report of AI-based abuse.The call portrayed a teenager seeking help after he had been blackmailed by a sexualised deepfake of himself, constructed using AI.

“When I hear about children experiencing blackmail online, it is a source of extreme anger in me and rightful anger amongst parents,” he said,The Internet Watch Foundation, which monitors CSAM online, said reports of AI-generated abuse material – such as a webpage that may contain multiple images – had more than doubled so far this year,Instances of category A material – the most serious form of abuse – rose from 2,621 images or videos to 3,086,Girls were overwhelmingly targeted, making up 94% of illegal AI images in 2025, while depictions of newborns to two-year-olds rose from five in 2024 to 92 in 2025,Kerry Smith, the chief executive of the Internet Watch Foundation, said the law change could “a vital step to make sure AI products are safe before they are released”.

“AI tools have made it so survivors can be victimised all over again with just a few clicks, giving criminals the ability to make potentially limitless amounts of sophisticated, photorealistic child sexual abuse material,” she said,“Material which further commodifies victims’ suffering, and makes children, particularly girls, less safe on and off line,”Childline also released details of counselling sessions where AI has been mentioned,AI harms mentioned in the conversations include: using AI to rate weight, body and looks; chatbots dissuading children from talking to safe adults about abuse; being bullied online with AI-generated content; and online blackmail using AI-faked images,Between April and September this year, Childline delivered 367 counselling sessions where AI, chatbots and related terms were mentioned, four times as many as in the same period last year.

Half of the mentions of AI in the 2025 sessions were related to mental health and wellbeing, including using chatbots for support and AI therapy apps.
politicsSee all
A picture

Will Nigel Farage embrace Europe, following Giorgia Meloni’s lead? | Letter

I am sure Nigel Farage will be delighted at the comparison with Giorgia Meloni, who moved from far-right Mussolini-heritage politics to becoming prime minister of Italy (Can Nigel Farage emulate success enjoyed by Italy’s far-right Giorgia Meloni? 9 November).The way she did this was to snuggle up to Mario Draghi, Italy’s and the European Union’s No 1 banker, who coached her in lines to take. So she ditched her hostility to the EU and support for dropping the euro to return to the lira. She found fault with Vladimir Putin. She sought collaborative solutions with other European leaders to the arrivals of boat people

A picture

No 10 says Starmer has confidence in Morgan McSweeney after PM condemns attacks on cabinet members – as it happened

At the post-PMQs lobby briefing the PM’s press secretary said that Keir Starmer does have confidence in Morgan McSweeney, his chief of staff.The press secretary also said that Starmer was not contemplating standing down. She said:He has always been very clear that he will continue to serve as prime minister at the next election, that this is a project which is about a decade of national renewal, because that’s what it takes to turn the country around after 14 years of failure from the Tories.She also said Starmer valued the views of Labour MPs.Our Labour MPs are fantastic champions of the work that the government is doing to deliver for the British people

A picture

British Medical Association ‘threat to future of NHS’, says Streeting ahead of doctors’ strike

The British Medical Association is acting like a cartel and its “antics” are endangering the NHS’s future, the health secretary has said before the latest doctors’ strike begins on Friday.Wes Streeting launched his most strongly worded attack yet on the doctors’ union, coming close to accusing resident doctors in England of being greedy in their pay demands.He told the BMA to “get real”, made clear that ministers would not be “held to ransom” and claimed the association wanted other workers to pay higher taxes to give doctors higher salaries but lobbied against medics being taxed more themselves.His pointed comments received loud applause from an audience of NHS leaders, who are bracing themselves for the five-day strike by resident – formerly junior – doctors. It will be their 13th since they began a campaign for “full pay restoration” in March 2023

A picture

Keir Starmer and his team mount a leadership challenge … to himself | John Crace

Sometimes what you see is what you get. Usually in Westminster things happen for a reason. The logic may not be obvious but if you use your imagination you can come up with some logic for someone doing something that appears to be batshit crazy. But just occasionally, you reach a singularity on the space-time continuum where the laws of physics break down and nothing makes sense. A state of Platonic batshitness

A picture

Keir Starmer under pressure over future of Morgan McSweeney amid briefing row

Keir Starmer is facing intense pressure over the future of Morgan McSweeney after the prime minister’s chief of staff was blamed for No 10’s pushback against a possible leadership challenge.After Starmer dodged a question from Kemi Badenoch at prime minister’s questions about whether he had full confidence in his key aide, Downing Street later clarified that he did.A series of ministers and Labour MPs are pointing the finger at McSweeney for the pre-emptive operation that particularly targeted Wes Streeting, the health secretary, who has responded with undisguised fury.Pressed at PMQs by Badenoch, who said Starmer had lost control of his government, the prime minister condemned as “completely unacceptable” any briefings against cabinet ministers from inside Downing Street.Badenoch asked him to say he had full confidence in McSweeney, to which Starmer gave a non-committal answer

A picture

How would a Labour leadership challenge work and how safe is Starmer?

The extraordinary briefing war that erupted at the top of government on Tuesday night has reignited questions about Keir Starmer’s leadership.Speaking to the Guardian and others, Starmer’s most senior political aides warned that he would fight any “reckless” attempt to challenge him after the budget or May elections, while voicing fears that Wes Streeting, the health secretary, was among those manoeuvring to replace him.Instead of putting to bed any questions about his future, the briefing has sparked fresh questions about Starmer’s future and thrown the spotlight on Streeting as a potential successor. Here we look at the rules for removing a Labour leader and the possible consequences.A Labour leadership contest can be triggered if 20% of the party’s MPs throw their weight behind a replacement candidate