‘Dangerous and alarming’: Google removes some of its AI summaries after users’ health put at risk

A picture


Google has removed some of its artificial intelligence health summaries after a Guardian investigation found people were being put at risk of harm by false and misleading information.The company has said its AI Overviews, which use generative AI to provide snapshots of essential information about a topic or question, are “helpful” and “reliable”.But some of the summaries, which appear at the top of search results, served up inaccurate health information, putting users at risk of harm.In one case that experts described as “dangerous” and “alarming”, Google provided bogus information about crucial liver function tests that could leave people with serious liver disease wrongly thinking they were healthy.Typing “what is the normal range for liver blood tests” served up masses of numbers, little context and no accounting for nationality, sex, ethnicity or age of patients, the Guardian found.

What Google’s AI Overviews said was normal may vary drastically from what was actually considered normal, experts said,The summaries could lead to seriously ill patients wrongly thinking they had a normal test result, and not bother to attend follow-up healthcare meetings,After the investigation, the company has removed AI Overviews for the search terms “what is the normal range for liver blood tests” and “what is the normal range for liver function tests”,A Google spokesperson said: “We do not comment on individual removals within Search,In cases where AI Overviews miss some context, we work to make broad improvements, and we also take action under our policies where appropriate.

”Vanessa Hebditch, the director of communications and policy at the British Liver Trust, a liver health charity, said: “This is excellent news, and we’re pleased to see the removal of the Google AI Overviews in these instances.“However, if the question is asked in a different way, a potentially misleading AI Overview may still be given and we remain concerned other AI‑produced health information can be inaccurate and confusing.”The Guardian found that typing slight variations of the original queries into Google, such as “lft reference range” or “lft test reference range”, prompted AI Overviews.That was a big worry, Hebditch said.“A liver function test or LFT is a collection of different blood tests.

Understanding the results and what to do next is complex and involves a lot more than comparing a set of numbers,“But the AI Overviews present a list of tests in bold, making it very easy for readers to miss that these numbers might not even be the right ones for their test,“In addition, the AI Overviews fail to warn that someone can get normal results for these tests when they have serious liver disease and need further medical care,This false reassurance could be very harmful,”Google, which has a 91% share of the global search engine market, said it was reviewing the new examples provided to it by the Guardian.

Hebditch said: “Our bigger concern with all this is that it is nit-picking a single search result and Google can just shut off the AI Overviews for that but it’s not tackling the bigger issue of AI Overviews for health.”Sue Farrington, the chair of the Patient Information Forum, which promotes evidence-based health information to patients, the public and healthcare professionals, welcomed the removal of the summaries but said she still had concerns.“This is a good result but it is only the very first step in what is needed to maintain trust in Google’s health-related search results.There are still too many examples out there of Google AI Overviews giving people inaccurate health information.”Millions of adults worldwide already struggle to access trusted health information, Farrington said.

“That’s why it is so important that Google signposts people to robust, researched health information and offers of care from trusted health organisations,”AI Overviews still pop up for other examples the Guardian originally highlighted to Google,They include summaries of information about cancer and mental health that experts described as “completely wrong” and “really dangerous”,Asked why these AI Overviews had not also been removed, Google said they linked to well-known and reputable sources, and informed people when it was important to seek out expert advice,A spokesperson said: “Our internal team of clinicians reviewed what’s been shared with us and found that in many instances, the information was not inaccurate and was also supported by high quality websites.

”Victor Tangermann, a senior editor at the technology website Futurism, said the results of the Guardian’s investigation showed Google had work to do “to ensure that its AI tool isn’t dispensing dangerous health misinformation”.If you have something to share about this story, you can contact Andrew using one of the following methods.The Guardian app has a tool to send tips about stories.Messages are end to end encrypted and concealed within the routine activity that every Guardian mobile app performs.This prevents an observer from knowing that you are communicating with us at all, let alone what is being said.

If you don’t already have the Guardian app, download it (iOS/Android) and go to the menu.Select ‘Secure Messaging’.Email (not secure)If you don’t need a high level of security or confidentiality you can email andrew.gregory@theguardian.comSecureDrop and other secure methodsIf you can safely use the tor network without being observed or monitored you can send messages and documents to the Guardian via our SecureDrop platform.

Finally, our guide at theguardian,com/tips lists several ways to contact us securely, and discusses the pros and cons of each,Google said AI Overviews only show up on queries where it has high confidence in the quality of the responses,The company constantly measures and reviews the quality of its summaries across many different categories of information, it added,In an article for Search Engine Journal, senior writer Matt Southern said: “AI Overviews appear above ranked results.

When the topic is health, errors carry more weight,”
politicsSee all
A picture

Senior Labour MPs urge government to ban cryptocurrency political donations

Downing Street has been urged to ban political donations in cryptocurrency by seven senior Labour MPs who chair parliamentary committees.The committee chairs – Liam Byrne, Emily Thornberry, Tan Dhesi, Florence Eshalomi, Andy Slaughter, Chi Onwurah and Matt Western – called on the government to introduce a full ban in the forthcoming elections bill amid concern that cryptocurrency could be used by foreign states to influence politics.Government sources told the Guardian last year that ministers are looking at ways to ban political donations made with cryptocurrency but the crackdown is not likely to be ready for the elections bill due early this year.Byrne said the committee chairs are concerned political finance “must be transparent, traceable and enforceable” but crypto donations undermine all three.“Crypto can obscure the true source of funds, enable thousands of micro donations below disclosure thresholds, and expose UK politics to foreign interference,” he said

A picture

Mandelson praises Trump’s ‘graciousness’ and declines to apologise for friendship with Jeffrey Epstein – as it happened

Laura Kuenssberg asks Peter Mandelson if he liked Donald Trump when he was the UK ambassador to Washington.Mandelson says he did like Trump, listing off numerous reasons why, but said he did not like all of his “language”.I like him, yes, I liked his humour, his graciousness…I liked his directness. You knew exactly what he was thinking and where you stood and what he wanted. And how he was proposing to engage, with you

A picture

UK wants any transition of power in Iran to be peaceful, says minister

The UK wants any transition of power in Iran to be peaceful, a cabinet minister has said, after Donald Trump said he could support protesters with military force.As the US weighs the option of military strikes, Heidi Alexander, the transport secretary, said she would not be drawn on America’s foreign policy towards Iran, where protests have been met with a violent police response.She told Sky News Iran was a hostile state that posed a security threat in the Middle East and repressed its own people, adding: “The priority, as of today, is to try and stem the violence that is happening in Iran at the moment.”Kemi Badenoch, the Conservative leader, went further in saying she would “not have an issue” with seeing the Iranian regime removed and that it could be right for the US and its allies to be involved in that process.She told the BBC One’s Sunday With Laura Kuenssberg programme: “Iran would very happily wipe out the UK if it felt it could get away with it

A picture

Sir Patrick Duffy obituary

The former Labour minister Sir Patrick Duffy, who has died aged 105, was one of his party’s foremost experts on defence and disarmament during the cold war and its immediate aftermath. It was his misfortune that 19 years of his quarter of a century as a Labour MP were spent on the opposition benches, although he had the gratification of 13 years as a member of the Nato parliamentary assembly, of which he served as president for two years from 1988.Duffy first stood for parliament in Tiverton, Devon, in 1950, and was successfully elected as an MP on his fourth attempt at a byelection in the Colne Valley, West Yorkshire, in 1963.He was an economist by training and entered the House of Commons in midlife, after an eventful career during the second world war in the Royal Navy and subsequently as an academic in Britain and the US. His experience made him an Atlanticist and a fervent European for most of his life, although in 2016 he supported Brexit on the grounds that the eurozone had made the EU no longer practical

A picture

Zarah Sultana’s Your Party membership launch may be ‘criminal’ matter for police, ICO says

Zarah Sultana’s unauthorised launch of a Your Party membership portal may have been “serious criminal activity” and should be referred to the police, the Information Commissioner’s Office (ICO) has advised.Jeremy Corbyn’s Peace and Justice Project (PJP), which referred Your Party to the information watchdog last September over a potential data breach, has been advised by the ICO that it should consider “taking further action” regarding the matter, after deciding it was not a matter for them.An extraordinary split opened up between Corbyn and Sultana in September after an email was sent to 800,000 people on Your Party’s mailing list, urging them to become paying members for £55. Sultana revealed the new membership portal on X, urging supporters to “be a part of history”, and reassured her followers that the membership site was “safe and secure”, encouraging them to keep trying to sign up despite “issues due to such high traffic”.Later the same day, Corbyn issued an “urgent message” telling his followers on X to ignore the “unauthorised” site and said “legal advice is being taken”

A picture

Reform UK accused of betraying election pledges after council tax rises

Nigel Farage’s Reform UK has been accused of betraying election promises to cut council tax after several councils it controls said they planned to increase rates close to the maximum allowed.They include Kent county council – the party’s flagship local authority and one viewed by it as the “shop window” for what a Reform-led government would look like – which has proposed an increase of 3.99%.Four other county councils controlled by the party – Derbyshire, North Northamptonshire, West Northamptonshire and Leicestershire – have also all proposed 5% council tax rises, the maximum permitted by law.Derbyshire county council earlier this week confirmed the rise after predicting a £38m gap in its budget, with overspends in children’s social care and adult social care