‘Not regulated’: launch of ChatGPT Health in Australia causes concern among experts
A 60-year-old man with no history of mental illness presented at a hospital emergency department insisting that his neighbour was poisoning him.Over the next 24 hours he had worsening hallucinations, and tried to escape the hospital.Doctors eventually discovered the man was on a daily diet of sodium bromide, an inorganic salt mainly used for industrial and laboratory purposes including cleaning and water treatment.He bought it over the internet after ChatGPT told him he could use it in place of table salt because he was worried about the health impacts of salt in his diet.Sodium bromide can accumulate in the body causing a condition called bromism, with symptoms including hallucinations, stupor and impaired coordination.
It is cases like this that have Alex Ruani, a doctoral researcher in health misinformation with the University College in London, concerned about the launch of ChatGPT Health in Australia.A limited number of Australian users can already access the artificial intelligence platform which allows them to “securely connect medical records and wellness apps” to generate responses “more relevant and useful to you”.ChatGPT users in Australia can join a waitlist for access.“ChatGPT Health is being presented as an interface that can help people make sense of health information and test results or receive diet advice, while not replacing a clinician,” Ruani said.“The challenge is that, for many users, it’s not obvious where general information ends and medical advice begins, especially when the responses sound confident and personalised, even if they mislead.
”Ruani said there had been too many “horrifying” examples of ChatGPT “leaving out key safety details like side effects, contraindications, allergy warnings, or risks around supplements, foods, diets, or certain practices”.“What worries me is that there are no published studies specifically testing the safety of ChatGPT Health,” Ruani said.“Which user prompts, integration paths, or data sources could lead to misguidance or harmful misinformation?”Sign up: AU Breaking News emailChatGPT is developed by OpenAI, which used the tool HealthBench to develop ChatGPT Health.HealthBench employs doctors to test and evaluate how well AI models perform when responding to health questions.Ruani said the full methodology used by HealthBench, and its evaluations, are “mostly undisclosed, rather than outlined in independent peer-reviewed studies”.
“ChatGPT Health is not regulated as a medical device or diagnostic tool,So there are no mandatory safety controls, no risk reporting, no post-market surveillance, and no requirement to publish testing data,”An OpenAI spokesperson told Guardian Australia that the company had worked in partnership with more than 200 physicians from 60 countries “to advise and improve the models powering ChatGPT Health”,“ChatGPT Health is a dedicated space where health conversations stay separate from the rest of your chats, with strong privacy protections by default,” the spokesperson said,ChatGPT Health data is encrypted and subject to privacy protections by default.
Sharing with third parties will happen with user consent, or in limited circumstances outlined in OpenAI’s privacy policy.The chief executive of the Consumers Health Forum of Australia, Dr Elizabeth Deveny, said rising out-of-pocket medical costs and long wait times to see doctors were driving people to AI.She said ChatGPT Health could be useful in helping people manage well-known chronic conditions, and to research ways to stay well.AI’s ability to give answers in different languages “provides a real benefit to people who don’t have English proficiency”, she said.Deveny is concerned that people will take advice given by ChatGPT Health at face value, and that “large global tech companies are moving faster than governments”, setting their own rules around privacy, transparency and data collection.
“This is not a small not-for-profit experimenting in good faith.It’s one of the largest technology companies in the world.“When commercial platforms define the norms, the benefits tend to flow to people who already have resources, education, and system knowledge.The risks fall on those who do not.”She said a failure of governments to act had left health consumers to navigate the social transformation brought by AI largely alone.
“We need clear guardrails, transparency and consumer education so people can make informed choices about if and how they use AI for their health,” she said.“This isn’t about stopping AI.It’s about acting before mistakes, bias, and misinformation are replicated at speed and scale, in ways that are almost impossible to unwind.”
UK economy beats forecasts with 0.3% growth in November; Ofwat investigating South East Water over outages – as it happened
Newsflash: The UK economy has returned to growth, and more vigorously than expected.UK GDP expanded by 0.3% in November, new data from the Office for National Statistics shows, after shrinking a little in October.That’s faster than expected; City economists had expected growth of just 0.1%In another boost, September’s growth figures have been revised higher, showing that the economy didn’t shrink that month after all
South East Water boss in line for £400,000 bonus despite outages
The boss of the company that has left thousands of households in south-east England without water for days is in line for a £400,000 long-term bonus regardless of his performance, if he resists calls for him to resign over the outages.David Hinton, the chief executive of South East Water, is to receive the payout if he stays on until July 2030.Hinton is facing calls to give up his right to the previously unreported “service award”. The payment, which was disclosed in the company’s annual report, is not performance-related, meaning that as long as he remains, Hinton will receive it whatever the company’s record on water supplies or pollution.South East Water has faced immense pressure after 30,000 households in Kent and East and West Sussex endured days of water supply failures in November and again in January
New York bakery staff push for union, claiming they were forced to bake for Israeli fundraisers
Workers at popular New York City bakery chain Breads Bakery announced a move to unionize, claiming it has “underpaid, undervalued, disrespected, discriminated against, intimidated and hurt” staff, as well as supported “the genocide happening in Palestine”.The company, which has ties to Israel, expressed concern that “divisive political issues” had been introduced into its stores. “We make babka; we don’t engage in politics,” a spokesperson said.But staff involved in the unionization drive claimed that employees were forced by the chain to create products for fundraisers for Israeli organizations, and unable to decline.The union, Breaking Breads, claims that more than 30% of the chain’s 275 workers across New York City had signed union authorization cards, seeking to unionize with United Auto Workers Local 2179 and pushing for better pay, improvements to working conditions such as the replacement of broken equipment, and respect on the job
Growth figures give boost to Reeves – but it’s too early to get carried away
At the end of last year, Rachel Reeves was under fire for the impact of budget speculation on Britain’s economy. All of the noise about fiscal holes, tax increases and spending cuts before her late November budget was having a real-world effect on the spending decisions of households and businesses.The latest official figures will therefore come as a boost for the chancellor. Britain’s economy grew more strongly than expected in November, up 0.3%, despite the fog of uncertainty in the lead up to her critical tax and spending speech at the end of the month
UK economy grew by better-than-expected 0.3% in November despite budget uncertainty
The UK economy grew by a stronger-than-expected 0.3% in November despite uncertainty around Rachel Reeves’s budget, official figures show.Figures from the Office for National Statistics (ONS) on Thursday showed the improvement, up from a 0.1% fall in October.Forecasters had expected a more modest 0
‘The consumers are still out there’: why a bankruptcy for Saks Global may not spell the end
Every year, the stores down Manhattan’s Fifth Avenue dress up their windows at Christmastime. Tourists from all over the world come to gawk at all the glitter, lace, ruffles and bows.Saks’s Fifth Avenue location, so iconic that it’s embedded in the brand’s name, is usually dressed top to bottom during the holidays. In 2023, the store partnered with Christian Dior to display a giant zodiac calendar. As part of the light show, fireworks were released from the top of the store to the oohs and aahs of spectators
Mother of one of Elon Musk’s sons sues over Grok-generated explicit images
Grok AI: what do limits on tool mean for X, its users and UK media watchdog?
‘Not regulated’: launch of ChatGPT Health in Australia causes concern among experts
Grok scandal highlights how AI industry is ‘too unconstrained’, tech pioneer says
Musk’s X to block Grok AI tool from creating sexualised images of real people
California attorney general investigates Musk’s Grok AI over lewd fake images