Mind launches inquiry into AI and mental health after Guardian investigation

A picture


Mind is launching a significant inquiry into artificial intelligence and mental health after a Guardian investigation exposed how Google’s AI Overviews gave people “very dangerous” medical advice.In a year-long commission, the mental health charity, which operates in England and Wales, will examine the risks and safeguards required as AI increasingly influences the lives of millions of people affected by mental health issues worldwide.The inquiry – the first of its kind globally – will bring together the world’s leading doctors and mental health professionals, as well as people with lived experience, health providers, policymakers and tech companies.Mind says it will aim to shape a safer digital mental health ecosystem, with strong regulation, standards and safeguards.The launch comes after the Guardian revealed how people were being put at risk of harm by false and misleading health information in Google AI Overviews.

The AI-generated summaries are shown to 2 billion people a month, and appear above traditional search results on the world’s most visited website.After the reporting, Google removed AI Overviews for some but not all medical searches.Dr Sarah Hughes, chief executive officer of Mind, said “dangerously incorrect” mental health advice was still being provided to the public.In the worst cases, the bogus information could put lives at risk, she said.Hughes said: “We believe AI has enormous potential to improve the lives of people with mental health problems, widen access to support, and strengthen public services.

But that potential will only be realised if it is developed and deployed responsibly, with safeguards proportionate to the risks.“The issues exposed by the Guardian’s reporting are among the reasons we’re launching Mind’s commission on AI and mental health, to examine the risks, opportunities and safeguards needed as AI becomes more deeply embedded in everyday life.“We want to ensure that innovation does not come at the expense of people’s wellbeing, and that those of us with lived experience of mental health problems are at the heart of shaping the future of digital support.”Google has said its AI Overviews, which use generative AI to provide snapshots of essential information about a topic or question, are “helpful” and “reliable”.But the Guardian found some AI Overviews served up inaccurate health information and put people at risk of harm.

The investigation uncovered false and misleading medical advice across a range of issues, including cancer, liver disease and women’s health, as well as mental health conditions.Experts said some AI Overviews for conditions such as psychosis and eating disorders offered “very dangerous advice” and were “incorrect, harmful or could lead people to avoid seeking help”.Google is also downplaying safety warnings that its AI-generated medical advice may be wrong, the Guardian found.Hughes said vulnerable people were being served “dangerously incorrect guidance on mental health”, including “advice that could prevent people from seeking treatment, reinforce stigma or discrimination and in the worst cases, put lives at risk”.She added: “People deserve information that is safe, accurate and grounded in evidence, not untested technology presented with a veneer of confidence.

”If you have something to share about this story, you can contact Andrew using one of the following methods.The Guardian app has a tool to send tips about stories.Messages are end to end encrypted and concealed within the routine activity that every Guardian mobile app performs.This prevents an observer from knowing that you are communicating with us at all, let alone what is being said.If you don’t already have the Guardian app, download it (iOS/Android) and go to the menu.

Select ‘Secure Messaging’.Email (not secure)If you don’t need a high level of security or confidentiality you can email andrew.gregory@theguardian.comSecureDrop and other secure methodsIf you can safely use the tor network without being observed or monitored you can send messages and documents to the Guardian via our SecureDrop platform.Finally, our guide at theguardian.

com/tips lists several ways to contact us securely, and discusses the pros and cons of each.The commission, which will run for a year, will gather evidence on the intersection of AI and mental health, and provide an “open space” where the experience of people with mental health conditions will be “seen, recorded and understood”.Rosie Weatherley, information content manager at Mind, said that although Googling mental health information “wasn’t perfect” before AI Overviews, it usually worked well.She said: “Users had a good chance of clicking through to a credible health website that answered their query, and then went further – offering nuance, lived experience, case studies, quotes, social context and an onward journey to support.“AI Overviews replaced that richness with a clinical-sounding summary that gives an illusion of definitiveness.

They give the user more of one form of clarity (brevity and plain English), while giving them less of another form of clarity (security in the source of the information, and how much to trust it).It’s a very seductive swap, but not a responsible one.”A Google spokesperson said: “We invest significantly in the quality of AI Overviews, particularly for topics like health, and the vast majority provide accurate information.“For queries where our systems identify a person might be in distress, we work to display relevant, local crisis hotlines.Without being able to review the examples referenced, we can’t comment on their accuracy.

politicsSee all
A picture

Spending even more on defence won’t buy us peace | Letters

We are told to spend even more, and more quickly, on the armed forces, whose current budget for this year is expected to amount to more than £60bn (‘Britain ‘needs to go faster’ on defence spending, Starmer says, 16 February). The Ministry of Defence must surely first show it can put its house in order.The government is considering whether to scrap Ajax, the army’s planned new armoured vehicle, even though more than £6bn of taxpayers’ money has already been spent on the project. Ajax is eight years late, its defects so serious that vibration and noise have made soldiers training on it sick, with some suffering hearing loss.It is the latest and most egregious example of the huge waste caused by the MoD’s incompetence and profligacy over recent years

A picture

Global Counsel calls in administrators, blaming Peter Mandelson ‘maelstrom’

Global Counsel, the advisory firm co-founded by Peter Mandelson, is to collapse into administration, blaming the “maelstrom” caused by revelations about the former peer’s relationship with the convicted sex offender Jeffrey Epstein.Companies including Barclays, Tesco and the Premier League have all deserted Global Counsel, despite the company’s efforts to sever ties with Mandelson and the company’s co-founder Benjamin Wegg-Prosser.The crisis engulfed Global Counsel after it emerged that Mandelson had sought Epstein’s advice on setting up the business in 2010, shortly after leaving office when Labour lost the general election.On Thursday, the Financial Times reported that staff at Global Counsel had been told that the “Peter Mandelson legacy” had effectively capsized the business.In a statement posted on the professional social networking site LinkedIn, Global Counsel confirmed that it had asked a court to appoint Interpath as administrator “to take control of and realise the assets of the company”

A picture

Dual nationals could use expired UK passports to prove they are British, Home Office says

British dual nationals may be able to use expired UK passports to prove to airlines they are British when controversial new immigration rules come into force, the Home Office has said.The new rules, coming into force next Wednesday, require anyone coming into the UK with British dual nationality to present a British passport when boarding a plane, ferry or train or to have a “certificate of entitlement” costing £589 attached to their foreign passport.Airlines and other transport operators risk being fined if they board passengers who do not have the right to enter the destination country.The rules have caused stress, disgust and bafflement among Britons with imminent travel plans whose passports have expired or who do not have a British passport, including children born abroad.The Liberal Democrats have called for a grace period to allow people affected by the change to get new passports, a process that could take many weeks

A picture

Starmer appoints Antonia Romeo as head of civil service

Keir Starmer has appointed Antonia Romeo as the cabinet secretary, the UK’s most senior civil servant, and praised her drive and professionalism.The appointment comes after high-profile criticism of Romeo from a former permanent secretary of the Foreign Office, Simon McDonald. Romeo has been highly praised by other previous secretaries of state as well as the current home secretary, Shabana Mahmood.Romeo, the longest-serving permanent secretary in the civil service, has a reputation as a reformer and has been a more prominent public figure than many of her contemporaries.She has previously faced accusations of bullying related to her time as consul general in New York in 2017 but was cleared by the Cabinet Office

A picture

Ministers must end ‘barking mad’ restraints on civil service pay, union leader warns

Ministers must end “barking mad” restraints on civil service pay or risk being unable to recruit the technical and digital specialists it needs to keep pace, a union leader has warned.Mike Clancy, the Prospect general secretary, said the government should end the “rightwing trope” that restrained the pay of highly skilled civil servants and left government unable to compete with the private sector. He said it should be realistic for senior specialists in competitive fields to be paid more than the prime minister.His intervention comes after the prime minister’s chief secretary, Darren Jones, said he wanted more risk-takers and delivery experts to create a civil service that “moves fast and fixes things”, saying hiring criteria would be changed to “promote the doers, not just the talkers”.Clancy said the civil service had significant issues retaining technical experts because of the low pay and lack of progression

A picture

Countries that do not embrace AI could be left behind, says OpenAI’s George Osborne

The former chancellor George Osborne has said countries that do not embrace the kind of powerful AI systems made by his new employer, OpenAI, risk “Fomo” and could be left weaker and poorer.Osborne, who is two months into a job as head of the $500bn San Francisco AI company’s “for countries” programme, told leaders gathered for the AI Impact summit in Delhi: “Don’t be left behind.” He said that without AI rollouts they could end up with a workforce “less willing to stay put” because they might want to seek AI-enabled fortunes elsewhere.Osborne framed the choice facing countries as one between adopting AI systems produced either in the US – such as Open AI’s – or China. The two superpowers have so far developed the most powerful AI systems