What are ‘nudification’ apps and how would a ban in the UK work?

A picture


The children’s commissioner for England is calling for “nudification” apps to be banned to prevent them generating sexual imagery of children.But what are they and would a ban work?Advances in artificial intelligence software have paved the way for the emergence of “nudification” tools, which are becoming easier to find on social media or search engines.These are apps and websites that produce deepfake nude images of real people using generative AI.This can involve removing clothes, getting an image to move suggestively, or pasting a head on to a naked body.The results often look highly realistic.

AI tools create images by learning from, and replicating elements of, existing images.Nudification apps are thought to be trained on vast datasets of mostly female images because they tend to work most effectively on women’s bodies.As a result, 99% of sexually explicit deepfakes accessible online are estimated to be of women and girls.Although it is illegal to possess AI-generated sexual content featuring children, the AI models that create these images are not illegal.The children’s commissioner is asking the government to legislate to ban AI tools that are designed or marketed as “nudification” services.

This could be achieved through a number of legal mechanisms,For example, one option would be through an amendment to the product safety and metrology bill that would ensure that providers of generative AI tools are required to carry out risk assessments for illegal and harmful activity, and to take reasonable steps to design that risk out of the product,This would mean that tools developed using generative AI models have to be risk-assessed for illegal and harmful activity before they are available in the UK,Nudification apps in their current form are not safe against illegal activity and will not be certified to be available in the UK,The second option is for the government to introduce an AI bill in this parliamentary session which would make it the responsibility of providers of generative AI models to prevent their use for nudifying children.

Technology companies could be legally required to test their products against whether they can be used to nudify children before launching them in the UK market, and held to account if their models are used for this purpose.However, critics of a ban may challenge it on internet freedom grounds, said Danielle Reece-Greenhalgh, a partner at the London law firm Corker Binning.She said it could be difficult to enforce as AI models improve, making it even harder to distinguish between “real” and “AI” created material.The children’s commissioner does not believe that the Online Safety Act contains the provisions required to fully protect children from harm.However, she notes that in the meantime, the risk can be partially mitigated through Ofcom’s implementation of the act.

As providers of sexually explicit or pornographic material, nudification services fall under its scope.They are required to verify that users are aged over 18 before allowing them access to content.However, this would not stop adults from making images of children.Ofcom could also strengthen its provisions to protect children from harm by ensuring it is proactive in identifying emerging harms.Social media companies are required to carry out risk assessments to comply with the Online Safety Act.

This should require them to identify and mitigate the risk to children of content produced by sexually explicit deepfake tools, including content used to promote them,The report also asks the government to provide more support for children to report an intimate image – including false ones that have been created using AI – that has been shared in a public online space, and to get it removed,It could ask Ofcom to require technology companies to embed “report remove” tools,The report also suggests that sexually explicit deepfake technology be included on PSHE (personal, social, health and economic) curriculums,
politicsSee all
A picture

Fears for health of Alaa Abd el-Fattah and mother as hunger strikes take toll

The family of the imprisoned British-Egyptian activist Alaa Abd el-Fattah say they fear for his health along with that of his mother, Laila Soueif, as both continued their hunger strikes to demand his freedom.Relatives of Soueif said they were worried she was “dying in slow motion” after eight months on full or partial hunger strike. “What are we supposed to do, just sit around and wait to die?” said Soueif.Fattah, who is in prison near Cairo, received medical treatment for vomiting and severe stomach pains earlier this week, after consuming nothing but herbal tea, black coffee and rehydration salts for more than 55 days.He began a hunger strike on the day his mother was admitted to St Thomas’ hospital in London in February, almost 150 days into her own hunger strike, where she received a glucose drip intended to save her life

A picture

‘It’s an existential moment’: Greens take on Reform in fight for fed-up voters

With its thatched cottages and patchwork fields, Wiltshire is a traditional true-blue Tory heartland; its county council is always dominated by Conservatives.But this week, the Greens think they stand a good chance of winning their first seats on the council because people are so fed up with the main parties.Zack Polanski, the party’s deputy leader, has been on a blitz of the rural areas of England trying to drum up support. A vegan who lives in Hackney, east London, one might not think the country’s farmers and rural communities would find much common ground with him.“The fact is, inequality hurts you no matter who you are,” he said as he prepared for a gruelling day of campaigning

A picture

No 10 bullish about immigration, despite Labour MPs’ concerns about rightward shift

Labour is under no illusions about how difficult Thursday’s local elections will be for the government.Nigel Farage’s Reform is on course to take hundreds of council seats and is ahead in the race for two mayoralties. Keir Starmer has not even campaigned in the Runcorn and Helsby byelection, such is the expectation of defeat.“The opening image of this set of elections was a Labour MP punching a swing voter in the face,” one party insider admitted. “Of course it’s going to be tough

A picture

Starmer claims voters being ‘conned’ by Tories and Reform UK as parties are planning a coalition – as it happened

Keir Starmer has claimed that Conservative voters and Reform UK voters are both being “conned” because neither party is being honest about the prospect of the two parties merging.In an interview with Beth Rigby from Sky News during his visit to Rossendale in Lancashire, asked whether he was more worried about the Tories or Reform in this week’s local elections, Starmer said he saw them as “equally” challenging. He went on:The Tories have got a terrible record, 14 years of failure. Reform moan about everything, but have got no answers.And at the end of the day, Reform and the Tories, there’s all this talk about them getting together merging

A picture

Sound the alarm for a KemiKaze breakfast, then hit snooze for the Starmer roadshow | John Crace

Even Kemi Badenoch’s closest friends know to give her a wide berth in the mornings. Especially her closest friends. They know what’s good for them. Sometimes absence is an act of friendship. Intimacy by proxy

A picture

Labour and Conservatives face a challenging electoral test | Letters

Talk of electoral pacts between the Conservatives and Reform UK for the right-of-centre vote has been widely reported. Your editorial (24 April) notes that as the policies of these parties move further right, some traditional Conservative voters will shift their allegiance away. Yet these voters are not going to the Labour party, as its leadership follows rightwards. A litany of government policies must seem as abhorrent to “old school” Conservatives as they do to traditional Labour values.Instead, there is steady growth in support for parties that are broadly in the soft left, socially and environmentally aware space: Liberal Democrats, Greens, the Scottish National party and Plaid Cymru