Meta’s AI sending ‘junk’ tips to DoJ, US child abuse investigators say

A picture


Meta’s use of artificial intelligence software to moderate its social media platforms is generating large volumes of useless reports about cases of child sexual abuse, which are draining resources and hindering investigations, said officers from the US Internet Crimes Against Children (ICAC) taskforce,“We get a lot of tips from Meta that are just kind of junk,” Benjamin Zwiebel, a special agent with the ICAC taskforce in New Mexico, said last week during his testimony in the state’s trial against Meta,The state’s attorney general alleges the company’s platforms are putting profits over child safety,Meta disputes these allegations, citing changes it has introduced on its platforms, such as teen accounts with default protections,The ICAC taskforce is a nationwide network of law enforcement agencies coordinated with the US Department of Justice to investigate and prosecute online child exploitation and abuse cases.

Another ICAC officer, speaking on the condition of anonymity to discuss internal matters, said: “Meta is providing thousands of tips each month.It’s pretty overwhelming because we’re getting so many reports, but the quality of the reports is really lacking in terms of our ability to take serious action.” The ICAC officer added that the total number of cybertips their department had received doubled from 2024 to 2025.The unviable tips from Instagram, Facebook and WhatsApp, in some instances contain information that is not criminal, both Zweibel and two ICAC officers said.Tips sometimes contain information indicating a crime may have occurred, yet vital images, videos or text are missing or redacted, the anonymous officers added.

“[Unviable tips from] Instagram have really skyrocketed recently, especially in the last couple of months, and that’s one of the biggest places where we’re seeing this information not being provided,” the ICAC officer added.“In those cases, we don’t have the information to further the investigation.It weighs on you to know that this crime occurred, but we can’t identify the perpetrator.”Asked about Zweibel’s testimony and the ICAC officers’ remarks, a Meta spokesperson said: “We’ve supported law enforcement to prosecute criminals for years: the DoJ has repeatedly praised our fast cooperation that has helped lead to arrests, and NCMEC has praised our streamlined and ‘improve[d]’ tip reporting process.In 2024, we received over 9,000 emergency requests from US authorities and resolved them within an average of 67 minutes – and even more quickly for cases involving child safety and suicide.

Consistent with applicable law, we also report apparent child sexual exploitation imagery to NCMEC and support them to prioritize reports, from helping build their case management tool to labeling cybertips so they know which are urgent,”The company pointed out that the agent, Zweibel, recommended the use of Meta’s teen accounts feature during his testimony, which he said he did “because it is the only option available, assuming that teens will not abstain from the use of social media”,Raúl Torrez, the New Mexico attorney general who is leading the case against Meta, has acknowledged the company’s cooperation in providing leads on child abuse at the trial: “I do want to credit some of the social media applications and platforms, including Meta, to a certain extent they do report images to the National Center for Missing and Exploited Children,”Filings released in the case on Friday show Meta executives sounding internal alarms over the company’s ability to police child sexual abuse and alert law enforcement in early 2019,At the time, the company was preparing to enable end-to-end encryption in Facebook Messenger, which hides users’ messages from anyone but the intended recipient via cryptography.

“We are about to do a bad thing as a company.This is so irresponsible,” wrote Monika Bickert, Meta’s head of content policy.Bickert wrote that there would be “no way to find the terror attack planning or child exploitation” if Messenger’s contents were encrypted, which could hinder working with law enforcement.Bickert also said Meta was making “gross misstatements of our ability to conduct safety operations”, according to the internal documents.In another document, Meta employees estimated that encrypting Messenger would have rendered the company “unable to provide data proactively to law enforcement in 600 child exploitation cases, 1,454 sextortion cases, 152 terrorist cases, 9 threatened school shootings”.

Andy Stone, a Meta spokesman, told Reuters: “The concerns raised in 2019 represent the very reason we developed a range of new safety features to help detect and prevent abuse, all designed to work in encrypted chats,”Child safety groups criticized the encryption of Messenger, which eventually rolled out in 2023,By law, social media companies based in the United States are required to report any detected child sexual abuse material (CSAM) on their platforms to the National Center for Missing & Exploited Children (NCMEC),NCMEC serves as a national clearinghouse for reports, which it forwards to the appropriate law enforcement agencies across the United States and internationally,NCMEC does not have the authority to filter out any tips that may be unviable before they are sent to the relevant law enforcement agencies.

Meta is by far the largest reporter to NCMEC.In its data report for 2024, NCMEC said Meta made 13.8m reports across Facebook, Instagram and Whatsapp, out of 20.5m tips it received in total.NCMEC said that in 2024, more than 1m CyberTipline reports were linked to a specific US state, and those reports were made available to the ICAC taskforces around the country, as well as other federal, state, and local law enforcement agencies, for investigation.

Meta and other social media companies use AI to detect and report suspicious material on their sites and employ human moderators to review some of the flagged content before sending it to law enforcement.The Guardian has previously reported that tips generated by AI that haven’t also been reviewed by a social media company employee often cannot be opened by a law enforcement officer without a warrant because of fourth amendment protections.This extra step also slows investigations of potential crimes, lawyers involved in such cases say.A Meta spokesperson said: “It’s unfortunate that court rulings have increased the burden on law enforcement by requiring search warrants to open identical copies of content we’ve already reviewed and reported.Our image-matching system finds copies of known child exploitation at a scale that would be impossible to do manually, and we work to detect new child exploitation content through technology, reports from our community, and investigations by our specialist child safety teams.

”Under the Report Act (Revising Existing Procedures On Reporting via Technology), which came into force in November 2024, online service providers must broaden and strengthen their reporting obligations by notifying NCMEC’s CyberTipline not only about child sexual abuse material but also about planned or imminent abuse, child sex trafficking and related exploitation; they must also preserve evidence for a longer period and face higher penalties if they knowingly fail to comply.Since the act passed, the number of unviable tips supplied by Meta has increased dramatically, which could be because the company is acting to ensure it is not falling foul of the law, two ICAC officers said.Many of these tips could not be construed as a crime, such as adolescent girls talking about which celebrity they find most attractive.“Based on my training and experience, it appears that they are being submitted through the use of AI, as these are common mistakes that an AI would make that a human observer would not,” Zwiebel said in court.In contrast, Zwiebel’s department receives significantly fewer tips on legitimate cases of child sexual abuse material (CSAM) distribution from Meta than in previous years, he said.

Every tip that reaches an ICAC division must be reviewed, and the influx of unviable tips is taking time and resources away from investigating legitimate cases of child abuse, said two officers,“It is killing morale,We are drowning in tips and we want to get out there and do this work,” said one ICAC officer,“We don’t have the personnel to sustain that,There’s no way that we can keep up with the flood that’s coming in.

sportSee all
A picture

English cricket’s hunger for Indian money has led it into a moral and legal minefield | Barney Ronay

The thing about inviting a tiger round for tea is, for all the excitement, the fur, the teeth, the muscles, they do tend to walk off with your dinner and drink all the water in the taps. The thing about saying yes to the person with the biggest stick is, in the end, you don’t get to say yes, or no, or anything at all. And that person still has a very big stick.The thing about closing your eyes and just taking the money is: money passes only in exchange for something of value, and full payment will be taken. Welcome to English cricket in full blind, groping crisis mode, and the first small tremor of what lies in store whatever happens in the next few weeks

A picture

Steve Borthwick turns to 2003 World Cup heroes for Six Nations inspiration

Steve Borthwick has turned to England’s 2003 World Cup winners to arrest his side’s drastic decline after enduring another setback with the scrum‑half Alex Mitchell ruled out for the rest of the Six Nations.Borthwick’s squad were due on Wednesday night to have dinner with members of the 2003 team, including the captain Martin Johnson, the Test centurion Jason Leonard and Lewis Moody, who revealed in October that he had been diagnosed with motor neurone disease.Borthwick urged his players to use the opportunity to ask how they dealt with setbacks, after England’s Six Nations hopes went up in smoke for another year with the dismal 42-21 defeat against Ireland last Saturday, seven days after they were outclassed by Scotland.Borthwick is under renewed pressure as a result and will lead England into their final two matches against Italy in Rome and France in Paris without Mitchell, who sustained a hamstring injury against Ireland. Jack van Poortvliet is standing by for the No 9 jersey while Ollie Lawrence has had a knee injection and is a doubt for the Italy match

A picture

Breakaway union stands behind Tara Moore’s $20m legal battle against WTA

The breakaway players’ union that is suing the tours and grand slam tournaments has thrown its weight behind Tara Moore’s $20m (£14.7m) legal battle against the Women’s ­Tennis Association in a new front in the sport’s civil war.The Guardian has learnt that Moore, a former British No 1 doubles player who this week brought a legal action for negligence against the WTA after being handed a four‑year ban for doping, is using lawyers from the Professional Tennis ­Players Association’s legal partner, King & Spalding.The PTPA has already brought a legal claim against the WTA, the men’s Association of Tennis Professionals and three of the grand slam tournaments, accusing them of collaborating to reduce prize money and imposing a restrictive ranking system, in the same US federal court where Moore has filed her claim, that of the southern district of New York.The players’ union, which was set up by Novak Djokovic six years ago but which he left last month, is also in the midst of a $1bn investment round to fund a new global tour, in another potential threat to the WTA and ATP

A picture

Constitution Hill out of Champion Hurdle and ready for next chapter on the Flat

Constitution Hill, the brilliant Champion Hurdle winner in 2023, has been ruled out of this year’s race on 10 March and any further races over jumps after a schooling session at Nicky Henderson’s yard on Wednesday, with the trainer saying in a statement that “it is not fair to ask him and Nico [de Boinville, his jockey] to do it again” following three falls in the nine-year-old’s last four races.Confirmation that Constitution Hill will pursue new opportunities on the Flat follows his astonishing debut on the level at Southwell four days ago. While some jumps fans will regret the fact that one of the best hurdlers in racing history will not get a final chance to reclaim his former crown, others will feel relief that the risks attached to another fall have weighed heavier in the balance than the lure of a final run at the festival.“Michael Buckley [Constitution Hill’s owner] and I have not surprisingly spent a lot of time soul searching and thinking over Constitution Hill’s future,” Henderson said in a statement on X on Wednesday afternoon, “and have sadly concluded that he will not be running in the Unibet Champion Hurdle the week after next.“Last Friday night was for us all a magical occasion and we so appreciated his popularity and the love and admiration everybody showed to Conrad, as he is fondly called here

A picture

MPs back UK broadcasters in push to expand sport’s free-to-air ‘crown jewels’

Public service broadcasters are making renewed attempts to persuade the government to expand the list of televised sport’s free-to-air “crown jewels”.A call from the then BBC director of sport, Barbara Slater, to add the Six Nations Championship to the group A list of events that must be offered to terrestrial channels was rejected three years ago, but a group of Labour MPs is understood to be working with broadcasters to force a change of policy.BBC and ITV have since extended their joint rights for the Six Nations until 2029 despite fears they would be outbid by a subscription service such as Sky Sports and TNT Sport, but with budgets tight they are still seeking legislative protection.While BBC and ITV would be the main beneficiaries of any change, Channel 4 has significantly increased its sport offering in recent years and will be the free-to-air home of the Winter Paralympics next month, as well as beginning exclusive contracts to broadcast the men’s and women’s Boat Races and Women’s FA Cup this year.In addition to pushing for the Six Nations to be moved from the group B list, which permits live events to be behind a paywall as long as highlights are made available free-to-air, the public service broadcasters also want the A list expanded to include the home nations’ men’s and women’s international qualifiers for the World Cup and European Championship, one Champions League tie involving a British team from each round of matches and the men’s FA Cup

A picture

The US men’s hockey team at the State of the Union showed proximity to Trump is never neutral

During Tuesday’s State of the Union, Donald Trump welcomed members of the US men’s national hockey team to the House gallery to chants of “U-S-A, U-S-A!”. Trump revealed that Team USA’s goaltender, Connor Hellebuyck, will receive the Presidential Medal of Freedom. “What special champions you are,” Trump told the players, who had beaten Canada on Sunday in the gold medal game of the Winter Olympics.In Trump’s America, proximity is never neutral.While the hockey players were greeted with warm applause from both Republicans and Democrats, Trump also had used the team as props in his speech