‘Our assumptions are broken’: how fraudulent church data revealed AI’s threat to polling

A picture


If you had been keeping tabs on the news about church attendance in Britain lately, you would be forgiven for thinking the country was in the midst of a Christian revival.Stories of swelling congregations, filled with young people returning to the flock, spurred on by everything from social media to a rise in bible sales appeared to be confirmed by a 2024 report from the Bible Society.Based on data collected by a YouGov survey, it claimed church attendance was increasing in England and Wales.The findings drove headlines, and the narrative was established.There was just one problem – the survey turned out to be based on “fraudulent” data and has been withdrawn.

And academics and experts are warning that this episode should serve as a parable, not about a renaissance in religion, but of the false prophets of artificial intelligence.Researchers have said online opt-in surveys are becoming increasingly infested with bogus data as respondents who are often paid for their participation use AI to fill in questionnaires at speed.These particular surveys are self-selecting research forms that can shape national discourse.But a major fault, experts say, is that they are susceptible to “survey farmers”, and this vulnerability means the results should be treated with caution when trying to understand social trends.David Voas, a quantitative social scientist and emeritus professor at University College London said: “This sort of information, misinformation, is just very difficult to correct once it starts spreading.

And the amount of effort required to correct it is an order of magnitude higher than the effort needed to disseminate it in the first place.“We are finding our confidence in these sorts of polls undermined, and then it’s very difficult to move back,” he added.Voas said the problem was a general one, not just isolated to YouGov.“It’s a growing problem because if you [as a participant] can work at scale, you can actually generate a reasonable amount of revenue, even in western terms, never mind global south terms,” he said.According to a 2026 report, YouGov uses a random sample method which means participants cannot choose which survey they want to complete.

A YouGov spokesperson told the Guardian: “We select which surveys to send them, so there is no way of joining to influence the result of a piece of research.”The growth of AI has exacerbated the problem.Sean Westwood, an associate professor in the department of government at Dartmouth College, in New Hampshire, said: “The assumption with survey research – that someone gives coherent, logical answers, they’re a real person – that assumption is now broken.”There is no evidence to suggestAI use was the source of the fraud in the church attendance numbers recorded by YouGov in 2024.However, Westwood said AI had the potential to influence online survey research.

“The tools to do all of this are cheap, accessible and available right now,”He said AI models posed an existential threat to our understanding of society,“The agent can be weaponised,A single sentence of instruction is enough to systematically bias its answers on political polls or geopolitical questions, while keeping its demographic profile intact so the manipulation is invisible to standard screening,” he said,“Even without explicit instructions to cheat, the agent can figure out what a researcher is trying to test and produce data that confirms the hypothesis,” he said.

However, the rate at which AI is being used to complete these surveys is difficult to detect.“We don’t know the precise scope, and that’s part of the problem,” said Westwood.And, he added, the rapid transformation in AI technology makes it difficult to combat its potential influence.“A researcher might design a clever new trap that catches today’s models, but model development moves so fast that the fix is likely obsolete within months.”The report by the Bible Society claimed that church attendance was increasing at the highest rate among young people in England and Wales.

Courtney Kennedy, the vice-president of methods and innovation at Pew Research Center, said opt-in estimates for people under the age of 30 tend to contain high levels of error and are more likely to stem from “click farms”.“In general, people who are highly skilled using the internet and concealing their identity skew younger,” said Kennedy.“Bogus cases want to qualify for as many surveys as possible.It is well known in the industry that young adults are hard to reach for surveys.So from this standpoint, it is advantageous to self-present as young because surveys tend to need such respondents.

”Kennedy added: “Bogus respondents tend to respond in the affirmative, no matter what is asked,This is called positivity bias, which inflates the estimate,”Voas said the problem with the Bible Society report was not only the fraudulent respondents but the failure to critically compare the findings of the YouGov survey with other available research by the churches themselves,“If you were doing serious scholarly research, you would need to review the literature and see what other evidence was out there,” said Voas,A YouGov spokesperson said: “The rise of organised survey farms, bots, and now AI-assisted responses makes detection a vital, continuous and constantly evolving discipline.

YouGov uses identity checks, device fingerprinting, multi source geolocation, real-time threat scoring, and payout oversight so bad actors do not slip through the net,“When someone joins the YouGov panel we link the information they supply with every data point we can observe about their device, location and behaviour,From this we decide who to invite, who to verify and, if necessary, who to remove,”
politicsSee all
A picture

Reports Sadiq Khan could join Starmer’s cabinet dismissed by allies

Allies of Sadiq Khan have dismissed reports the London mayor could join Keir Starmer’s cabinet after being made a peer, although it remains possible he could join the Lords while keeping his current job.Downing Street said reports that Khan could become a peer after crucial elections in May across England, Scotland and Wales were “speculation”, while a Labour source also declined to comment.Any decision on a peerage was one for No 10, Khan’s allies said, but they ruled out the possibility cited by the Financial Times that Khan could be brought in to strengthen Starmer’s cabinet after joining the House of Lords.Khan spent a decade as a London MP before stepping down in 2016, having won the first of three consecutive election victories to be London mayor, a role where he has had some success in courting support beyond Labour’s core vote, such as Greens and Liberal Democrats, to defeat Conservative opponents.A role for Khan working closer with Starmer could be sold by No 10 as the prime minister making full use of Labour’s talents, particularly given that the London mayor has at times been critical of the government, for example warning after the Gorton and Denton byelection loss to the Greens that Labour must stop taking progressive voters for granted

A picture

Social media has led to a ‘complete rewiring of childhood’, says minister – UK politics live

Josh MacAlister, the minister for children and families, said there has been “a complete rewiring of childhood” over the last decade due to social media and screen time.Speaking on the new government guidance for parents of young children, he told ITV’s Good Morning Britain: “We’re trying to help create some new social norms.“There’s no judgment. It’s much easier to say these things than it is to do them, I appreciate.”That’s all from us on the UK politics blog, thanks for following along

A picture

Cabinet Office to ask Mandelson to provide messages from personal phone

Peter Mandelson will be asked to supply messages from his personal phone as part of the investigation into his appointment as Keir Starmer’s ambassador to the US.In February, MPs forced the government to commit to publishing tens of thousands of documents after a controversy erupted over the prime minister’s awareness of the former peer’s links to the convicted child sex offender Jeffrey Epstein before he was given the prestigious posting.The Cabinet Office is working to obtain as much information as possible about the process, according to No 10 sources. Mandelson has not yet been asked to hand over messages but will be told to provide everything he holds within the scope of the humble address, the parliamentary procedure that can be used to try to force the release of correspondence.On Friday, the Times reported that Mandelson had handed over his work phone after being sacked as US ambassador because of his close friendship with the late financier, but said the Cabinet Office had not asked for messages on his personal device

A picture

Billy Bragg calls for big turnout at London march against far right

Billy Bragg has encouraged people to send a clear message to those seeking to divide the country by turning out to support what is expected to be the biggest multicultural march in UK history on Saturday.Speaking to the Guardian before the Together Alliance’s march against the far right in central London, the musician and political activist said participants hoped to “send out a message to our fellow citizens that we are willing to take a stand against [the politics of hate] being imported into the UK”.The event, which is expected to draw hundreds of thousands of people, is supported by a wide range of celebrities, including the actors Christopher Eccleston, David Harewood, Lenny Henry, Steve Coogan, Toby Jones, Lolly Adefope and Maxine Peake, the musicians Paloma Faith, Charlotte Church, Brian Eno and Beverley Knight, and the comedian James Acaster.Dozens of coaches will leave from across the country on Saturday morning – including 10 from Manchester alone – to begin marching from Park Lane to Trafalgar Square at midday.Two stages – one on Whitehall for speeches and one in Trafalgar Square for music, which are both free to attend – will feature cross-party speakers and award-winning musicians, including Self Esteem, Jessie Ware, Katy B, Joy Crookes, UB40 and Hot Chip

A picture

Rachel Reeves urged to raise taxes on companies profiting from war on Iran

Rachel Reeves is being urged to raise taxes on businesses generating “windfall” profits linked to the US-Israel war on Iran to fund emergency cost of living support for UK households.With the government under pressure to respond, a group of leading charities, campaigners and trade unions said the chancellor could raise billions by taxing “excess profits” linked to the conflict.In an open letter to Keir Starmer and Reeves, the organisations – including Greenpeace UK, the National Education Union and Tax Justice UK – said energy companies, banks, agricultural commodities businesses, defence companies and tech firms stood to financially benefit from the economic fallout.Urging Labour to strengthen its existing North Sea energy windfall tax and to introduce new levies for firms in these other sectors, the group said the extra revenue for the exchequer could be used for emergency cost-of-living support and to invest in the future resilience of the UK economy against energy shocks.“We urge you to make this crisis a turning point for the UK

A picture

PM rejects ‘far-fetched’ scepticism about Morgan McSweeney phone theft

Keir Starmer has said it is “far-fetched” to suggest that the theft of his former chief of staff’s mobile phone is somehow connected to a subsequent push for the release of documents relating to Peter Mandelson’s appointment as US ambassador.Downing Street has come under pressure to say whether key messages between Morgan McSweeney and the former ambassador were lost after it emerged that the government-issue phone was stolen last year.Kemi Badenoch had “raised an eyebrow” in relation to accounts about the theft, a spokesperson for the Conservative leader said on Wednesday. The Labour MP Karl Turner, who has clashed with the government over jury trial legislation and was a critic of McSweeney’s role, said on X on Wednesday night that he did not believe the phone was stolen.The prime minister responded to the claims on Thursday morning, saying: “The phone was stolen