Meta’s AI sending ‘junk’ tips to DoJ, US child abuse investigators say
Meta’s use of artificial intelligence software to moderate its social media platforms is generating large volumes of useless reports about cases of child sexual abuse, which are draining resources and hindering investigations, said officers from the US Internet Crimes Against Children (ICAC) taskforce.“We get a lot of tips from Meta that are just kind of junk,” Benjamin Zwiebel, a special agent with the ICAC taskforce in New Mexico, said last week during his testimony in the state’s trial against Meta.The state’s attorney general alleges the company’s platforms are putting profits over child safety.Meta disputes these allegations, citing changes it has introduced on its platforms, such as teen accounts with default protections.The ICAC taskforce is a nationwide network of law enforcement agencies coordinated with the US Department of Justice to investigate and prosecute online child exploitation and abuse cases.
Another ICAC officer, speaking on the condition of anonymity to discuss internal matters, said: “Meta is providing thousands of tips each month,It’s pretty overwhelming because we’re getting so many reports, but the quality of the reports is really lacking in terms of our ability to take serious action,” The ICAC officer added that the total number of cybertips their department had received doubled from 2024 to 2025,The unviable tips from Instagram, Facebook and WhatsApp, in some instances contain information that is not criminal, both Zweibel and two ICAC officers said,Tips sometimes contain information indicating a crime may have occurred, yet vital images, videos or text are missing or redacted, the anonymous officers added.
“[Unviable tips from] Instagram have really skyrocketed recently, especially in the last couple of months, and that’s one of the biggest places where we’re seeing this information not being provided,” the ICAC officer added.“In those cases, we don’t have the information to further the investigation.It weighs on you to know that this crime occurred, but we can’t identify the perpetrator.”Asked about Zweibel’s testimony and the ICAC officers’ remarks, a Meta spokesperson said: “We’ve supported law enforcement to prosecute criminals for years: the DoJ has repeatedly praised our fast cooperation that has helped lead to arrests, and NCMEC has praised our streamlined and ‘improve[d]’ tip reporting process.In 2024, we received over 9,000 emergency requests from US authorities and resolved them within an average of 67 minutes – and even more quickly for cases involving child safety and suicide.
Consistent with applicable law, we also report apparent child sexual exploitation imagery to NCMEC and support them to prioritize reports, from helping build their case management tool to labeling cybertips so they know which are urgent.”The company pointed out that the agent, Zweibel, recommended the use of Meta’s teen accounts feature during his testimony, which he said he did “because it is the only option available, assuming that teens will not abstain from the use of social media”.Raúl Torrez, the New Mexico attorney general who is leading the case against Meta, has acknowledged the company’s cooperation in providing leads on child abuse at the trial: “I do want to credit some of the social media applications and platforms, including Meta, to a certain extent they do report images to the National Center for Missing and Exploited Children.”Filings released in the case on Friday show Meta executives sounding internal alarms over the company’s ability to police child sexual abuse and alert law enforcement in early 2019.At the time, the company was preparing to enable end-to-end encryption in Facebook Messenger, which hides users’ messages from anyone but the intended recipient via cryptography.
“We are about to do a bad thing as a company.This is so irresponsible,” wrote Monika Bickert, Meta’s head of content policy.Bickert wrote that there would be “no way to find the terror attack planning or child exploitation” if Messenger’s contents were encrypted, which could hinder working with law enforcement.Bickert also said Meta was making “gross misstatements of our ability to conduct safety operations”, according to the internal documents.In another document, Meta employees estimated that encrypting Messenger would have rendered the company “unable to provide data proactively to law enforcement in 600 child exploitation cases, 1,454 sextortion cases, 152 terrorist cases, 9 threatened school shootings”.
Andy Stone, a Meta spokesman, told Reuters: “The concerns raised in 2019 represent the very reason we developed a range of new safety features to help detect and prevent abuse, all designed to work in encrypted chats.”Child safety groups criticized the encryption of Messenger, which eventually rolled out in 2023.By law, social media companies based in the United States are required to report any detected child sexual abuse material (CSAM) on their platforms to the National Center for Missing & Exploited Children (NCMEC).NCMEC serves as a national clearinghouse for reports, which it forwards to the appropriate law enforcement agencies across the United States and internationally.NCMEC does not have the authority to filter out any tips that may be unviable before they are sent to the relevant law enforcement agencies.
Meta is by far the largest reporter to NCMEC,In its data report for 2024, NCMEC said Meta made 13,8m reports across Facebook, Instagram and Whatsapp, out of 20,5m tips it received in total,NCMEC said that in 2024, more than 1m CyberTipline reports were linked to a specific US state, and those reports were made available to the ICAC taskforces around the country, as well as other federal, state, and local law enforcement agencies, for investigation.
Meta and other social media companies use AI to detect and report suspicious material on their sites and employ human moderators to review some of the flagged content before sending it to law enforcement.The Guardian has previously reported that tips generated by AI that haven’t also been reviewed by a social media company employee often cannot be opened by a law enforcement officer without a warrant because of fourth amendment protections.This extra step also slows investigations of potential crimes, lawyers involved in such cases say.A Meta spokesperson said: “It’s unfortunate that court rulings have increased the burden on law enforcement by requiring search warrants to open identical copies of content we’ve already reviewed and reported.Our image-matching system finds copies of known child exploitation at a scale that would be impossible to do manually, and we work to detect new child exploitation content through technology, reports from our community, and investigations by our specialist child safety teams.
”Under the Report Act (Revising Existing Procedures On Reporting via Technology), which came into force in November 2024, online service providers must broaden and strengthen their reporting obligations by notifying NCMEC’s CyberTipline not only about child sexual abuse material but also about planned or imminent abuse, child sex trafficking and related exploitation; they must also preserve evidence for a longer period and face higher penalties if they knowingly fail to comply,Since the act passed, the number of unviable tips supplied by Meta has increased dramatically, which could be because the company is acting to ensure it is not falling foul of the law, two ICAC officers said,Many of these tips could not be construed as a crime, such as adolescent girls talking about which celebrity they find most attractive,“Based on my training and experience, it appears that they are being submitted through the use of AI, as these are common mistakes that an AI would make that a human observer would not,” Zwiebel said in court,In contrast, Zwiebel’s department receives significantly fewer tips on legitimate cases of child sexual abuse material (CSAM) distribution from Meta than in previous years, he said.
Every tip that reaches an ICAC division must be reviewed, and the influx of unviable tips is taking time and resources away from investigating legitimate cases of child abuse, said two officers,“It is killing morale,We are drowning in tips and we want to get out there and do this work,” said one ICAC officer,“We don’t have the personnel to sustain that,There’s no way that we can keep up with the flood that’s coming in.
”
Breakaway union stands behind Tara Moore’s $20m legal battle against WTA
The breakaway players’ union that is suing the tours and grand slam tournaments has thrown its weight behind Tara Moore’s $20m (£14.7m) legal battle against the Women’s Tennis Association in a new front in the sport’s civil war.The Guardian has learnt that Moore, a former British No 1 doubles player who this week brought a legal action for negligence against the WTA after being handed a four‑year ban for doping, is using lawyers from the Professional Tennis Players Association’s legal partner, King & Spalding.The PTPA has already brought a legal claim against the WTA, the men’s Association of Tennis Professionals and three of the grand slam tournaments, accusing them of collaborating to reduce prize money and imposing a restrictive ranking system, in the same US federal court where Moore has filed her claim, that of the southern district of New York.The players’ union, which was set up by Novak Djokovic six years ago but which he left last month, is also in the midst of a $1bn investment round to fund a new global tour, in another potential threat to the WTA and ATP
Constitution Hill out of Champion Hurdle and ready for next chapter on the Flat
Constitution Hill, the brilliant Champion Hurdle winner in 2023, has been ruled out of this year’s race on 10 March and any further races over jumps after a schooling session at Nicky Henderson’s yard on Wednesday, with the trainer saying in a statement that “it is not fair to ask him and Nico [de Boinville, his jockey] to do it again” following three falls in the nine-year-old’s last four races.Confirmation that Constitution Hill will pursue new opportunities on the Flat follows his astonishing debut on the level at Southwell four days ago. While some jumps fans will regret the fact that one of the best hurdlers in racing history will not get a final chance to reclaim his former crown, others will feel relief that the risks attached to another fall have weighed heavier in the balance than the lure of a final run at the festival.“Michael Buckley [Constitution Hill’s owner] and I have not surprisingly spent a lot of time soul searching and thinking over Constitution Hill’s future,” Henderson said in a statement on X on Wednesday afternoon, “and have sadly concluded that he will not be running in the Unibet Champion Hurdle the week after next.“Last Friday night was for us all a magical occasion and we so appreciated his popularity and the love and admiration everybody showed to Conrad, as he is fondly called here
MPs back UK broadcasters in push to expand sport’s free-to-air ‘crown jewels’
Public service broadcasters are making renewed attempts to persuade the government to expand the list of televised sport’s free-to-air “crown jewels”.A call from the then BBC director of sport, Barbara Slater, to add the Six Nations Championship to the group A list of events that must be offered to terrestrial channels was rejected three years ago, but a group of Labour MPs is understood to be working with broadcasters to force a change of policy.BBC and ITV have since extended their joint rights for the Six Nations until 2029 despite fears they would be outbid by a subscription service such as Sky Sports and TNT Sport, but with budgets tight they are still seeking legislative protection.While BBC and ITV would be the main beneficiaries of any change, Channel 4 has significantly increased its sport offering in recent years and will be the free-to-air home of the Winter Paralympics next month, as well as beginning exclusive contracts to broadcast the men’s and women’s Boat Races and Women’s FA Cup this year.In addition to pushing for the Six Nations to be moved from the group B list, which permits live events to be behind a paywall as long as highlights are made available free-to-air, the public service broadcasters also want the A list expanded to include the home nations’ men’s and women’s international qualifiers for the World Cup and European Championship, one Champions League tie involving a British team from each round of matches and the men’s FA Cup
The US men’s hockey team at the State of the Union showed proximity to Trump is never neutral
During Tuesday’s State of the Union, Donald Trump welcomed members of the US men’s national hockey team to the House gallery to chants of “U-S-A, U-S-A!”. Trump revealed that Team USA’s goaltender, Connor Hellebuyck, will receive the Presidential Medal of Freedom. “What special champions you are,” Trump told the players, who had beaten Canada on Sunday in the gold medal game of the Winter Olympics.In Trump’s America, proximity is never neutral.While the hockey players were greeted with warm applause from both Republicans and Democrats, Trump also had used the team as props in his speech
Among the gangsters, gamblers and high rollers: a master bookie’s life in Las Vegas
Forty years ago, the New England Patriots played in their first Super Bowl. It ended disastrously for New England, who lost 46-10 to the Chicago Bears. The Bears’ mammoth defensive tackle, William “The Refrigerator” Perry, even got involved in the scoring with a touchdown.That moment looked like it would cause serious problems for Art Manteris, who at the time ran the sportsbook at Caesars Palace in Las Vegas. Under Manteris, Caesars had offered odds on whether Perry would score during the game – and, as fans scrambled to back the popular player, the house stood to lose a significant sum if he did
The Spin | Zimbabwean breakout at T20 World Cup has fans rejoicing renaissance
Dean du Plessis could tell Zimbabwean cricket had turned a corner by the noise of the crowd. The veteran broadcaster, who was born blind, has forged a remarkable career as a commentator by distinguishing the game’s almost imperceptible audio shifts. He can tell a slower ball has been bowled by the fractional delay before ball meets bat. He can tell if a batter has pressed forward or back by the scratch of spikes against the hard pitch. And, in 2018, he could tell the sport he loved would never be the same again
Maxi Shield, beloved Australian drag queen and Drag Race Down Under star, dies aged 51
Kenneth Williams and racist attitudes | Brief letters
Philippe Gaulier obituary
‘Musicians drank too much and slept on my barn floor’: Andrew Bird on making cult album The Mysterious Production of Eggs
Is the UK’s golden era of free museum entry coming to an end?
The Guide #231: How the hunt for the next James Bond became the franchise’s best marketing tool