AI outperforms doctors in Harvard trial of emergency triage diagnoses
From George Clooney in ER to Noah Wyle in The Pitt, emergency department doctors have long been popular heroes,But will it soon be time to hang up the scrubs?A groundbreaking Harvard study has found that AI systems outperformed human doctors in high-pressure emergency medicine triage, diagnosing more accurately in the potentially life and death moments when people are first rushed to hospital,The results were described by independent experts as showing “a genuine step forward” in the clinical reasoning of AIs and came as part of trials that tested the responses of hundreds of doctors against an AI,The authors said the results, published in the journal Science, showed large language models (LLMs) “have eclipsed most benchmarks of clinical reasoning”,One experiment focused on 76 patients who arrived at the emergency room of a Boston hospital.
An AI and a pair of human doctors were each given the same standard electronic health record to read – typically including vital sign data, demographic information and a few sentences from a nurse about why the patient was there.The AI identified the exact or very close diagnosis in 67% of cases, beating the human doctors, who were right only 50%-55% of the time.It showed the AIs’ advantage was particularly pronounced in triage circumstances requiring rapid decisions with minimal information.The diagnosis accuracy of the AI – OpenAI’s o1 reasoning model – rose to 82% when more detail was available, compared with the 70-79% accuracy achieved by the expert humans, though this difference was not statistically significant.It also outperformed a larger cohort of human doctors when asked to provide longer term treatment plans, such as providing antibiotics regimes or planning end-of-life processes.
The AI and 46 doctors were asked to examine five clinical case studies and the computer made significantly better plans, scoring 89% compared with 34% for humans using conventional resources, such as search engines.But it is not curtains for emergency doctors yet, the researchers said.The study only tested humans against AIs looking at patient data that can be communicated via text.The AI’s reading of signals, such as the patient’s level of distress and their visual appearance, were not tested.That means the AI was performing more like a clinician producing a second opinion based on paperwork.
“I don’t think our findings mean that AI replaces doctors,” said Arjun Manrai, one of the lead authors of the study who heads an AI lab at Harvard Medical School.“I think it does mean that we’re witnessing a really profound change in technology that will reshape medicine.”Dr Adam Rodman, another lead author and a doctor at Boston’s Beth Israel Deaconess medical centre where the study took place, said AI LLMs were among “the most impactful technologies in decades”.Over the next decade, he said, AI would not replace physicians but join them in a new “triadic care model … the doctor, the patient, and an artificial intelligence system”.In one case in the Harvard study, a patient presented with a blood clot to the lungs and worsening symptoms.
Human doctors thought the anti-coagulants were failing, but the AI noticed something the humans did not: the patient’s history of lupus meant this might be causing the inflammation of the lungs.The AI was proved correct.Nearly one in five US physicians are already using AI to assist diagnosis, according to research published last month.In the UK, 16% of doctors are using the tech daily and a further 15% weekly, with “clinical decision-making” being one of the most common uses, according to a recent Royal College of Physicians survey.The UK doctors’ biggest concerns were AI error and liability risks.
Billions are being invested in AI healthcare companies, but questions remain about the consequences of AI error.“There is not a formal framework right now for accountability,” said Rodman, who also stressed patients ultimately “want humans to guide them through life or death decisions [and] to guide them through challenging treatment decisions”.Prof Ewen Harrison, co-director of the University of Edinburgh’s centre for medical informatics, said the study was important and showed that “these systems are no longer just passing medical exams or solving artificial test cases.They are starting to look like useful second-opinion tools for clinicians, particularly when it is important to consider a wider range of possible diagnoses and avoid missing something important.”Dr Wei Xing, an assistant professor at the University of Sheffield’s school of mathematical and physical sciences, said some of the other findings suggested doctors may unconsciously defer to the AI’s answer rather than thinking independently.
“This tendency could grow more significant as AI becomes more routinely used in clinical settings,” he said.He also highlighted the lack of information about which patients the AI was worse at diagnosing and whether it struggled more with elderly patients or non-English speakers.He said: “It does not demonstrate that AI is safe for routine clinical use, nor that the public should turn to freely available AI tools as a substitute for medical advice.”
Could Lib Dems become the biggest party in English local government?
It has been an election buildup dominated by the rise of Reform UK and the Greens, and the contrasting woes of Labour and the Tories. But there is a chance that on 8 May the Liberal Democrats, largely ignored in recent weeks, could wake up as the biggest party in English local government.This is just one of several paradoxes for the party’s leader, Ed Davey, and his team. They are fifth in many national polls, with a rating barely changed from 2024. But Lib Dem bosses are sanguine, convinced that UK politics is now so different, so atomised, to make headline polling almost irrelevant
Mapped: the elections that could deliver ‘unprecedented’ losses for Labour
Labour is on track for its worst local election performance next Thursday, data analysed by the Guardian shows, in a blow that will pile further pressure on Keir Starmer’s leadership.Barring a drastic change in fortunes, Labour’s vote-share could fall to historic lows across elections for councils in England and devolved parliaments in Wales and Scotland on 7 May, with big gains for Reform, the Greens and nationalist parties, according to recent polling.The collapse in support is particularly existential in the race for the Welsh parliament, the Senedd, which Labour has dominated since its creation in 1999.Polling shows Labour’s vote share falling by more than half in Wales, enough to push the party into third place, with Reform and Plaid Cymru vying for first.Labour’s long-term decline in Scotland is expected to continue, with the Scottish National party likely to remain in power in Holyrood and Reform headed for second place
Could Starmer bring back Rayner to steady ship – and would she get onboard?
It is nearly eight months since Angela Rayner quit the cabinet because of her tax arrangements, but some might argue her influence on the government has not gone away. And soon she might return, whether as Keir Starmer’s saviour or, perhaps, his usurper.There is increasing speculation that the prime minister could carry out a small-scale reshuffle, primarily to bring back Rayner, his former deputy and one of Labour’s political heavyweights.This is by no means certain: Starmer is understood to have not yet made up his mind, and events depend in part on how significant a blow Labour is dealt in next week’s elections to the Scottish and Welsh parliaments and to councils across England.Robert Hayward, the elections analyst and Conservative peer, has predicted Labour will lose 1,850 council seats on 7 May, above the 1,500 figure cited in one report as the possible trigger for a cabinet revolt
‘Reform is an acute threat to Scottish self-government,’ says John Swinney
Reform UK represents an acute threat to Scottish self government, John Swinney has warned, adding that nationalist victories in Scotland and Wales in May could “irrevocably change” the dynamics of constitutional debate across the UK.While the Scottish National party enjoys a comfortable polling lead ahead of the Holyrood elections next Thursday, recent polling has put Reform, led in Scotland by the millionaire and former Conservative peer Malcolm Offord, neck and neck with Scottish Labour for second place.Cruising towards an unprecedented fifth term, Swinney comes across as genuinely relaxed, as the SNP benefits from the fracturing of the pro-union vote offsetting lower approval rating for his government. Arguably the greatest threat all parties face is turnout, after a lacklustre campaign mirroring voter disengagement and an unusually high level of undecideds.Speaking to the Guardian, Swinney said: “The advent of Reform will bring in a sizeable number of [members of the Scottish parliament] who want to get rid of the place
Senior UK ministers deride Rachel Reeves’s reported plan of year-long rent freeze
Senior ministers have poured scorn on the idea of freezing private sector rents for a year, less than 48 hours after the Guardian revealed Rachel Reeves was considering it.Steve Reed, the housing secretary, and Matthew Pennycook, the housing minister, became the latest government figures to criticise the idea, which has since been ruled out by No 10.The government’s split over the idea has fed speculation about Reeves’ job after reports over the weekend that Keir Starmer was intending to sack her after the local elections.Keir Starmer failed to guarantee she would remain in place during Wednesday’s Prime Minister’s Questions, though Downing Street insists she retains the prime minister’s support.Pennycook said on Wednesday about the rent freeze: “We are not doing this
Nigel Farage referred to standards watchdog over undisclosed £5m gift
Nigel Farage has been referred to parliament’s standards watchdog after the Guardian revealed he received an undeclared £5m gift from a party donor.The referral was made by the Conservative party, citing rules that require MPs to declare any “personal benefit” they have received in the 12 months before taking office, and to do so within a month of being elected.The gift from the Thailand-based crypto billionaire Christopher Harborne fell within that period. Some personal gifts are exempt from the reporting rules if they “could not reasonably be thought by others to be related to membership of the house or to the member’s parliamentary or political activities”, according to the code of conduct and rules for MPs.The rules add: “Both the possible motive of the giver and the use to which the gift is to be put should be considered
Adam Coleman escapes from rugby purgatory to the peaks with Bordeaux
‘I really was one of those bandwagon fans’: meet Katharina Nowak, F1’s youngest race president
Trial or error? Lancashire bear brunt as county game adjusts to new substitute rules | Ali Martin
Cricket Australia’s BBL sell-off on hold after Queensland joins NSW in rejecting plans
AFL player Nathan O’Driscoll opens up on depression and mental health struggles
LIV Golf poised to inform players that Saudi funding will end this year