OpenAI relaxed ChatGPT guardrails just before teen killed himself, family alleges

A picture


The family of a teenager who took his own life after months of conversations with ChatGPT now says OpenAI weakened safety guidelines in the months before his death.In July 2022, OpenAI’s guidelines on how ChatGPT should answer inappropriate content, including “content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders”, were simple: the AI chatbot should respond, “I can’t answer that”, the guidelines read.But in May 2024, just days before OpenAI released a new version of the AI, ChatGPT-4o, the company published an update to its Model Spec, a document that details the desired behavior for its assistant.In cases where a user expressed suicidal ideation or self-harm, ChatGPT would no longer respond with an outright refusal.Instead, the model was instructed not to end the conversation and “provide a space for users to feel heard and understood, encourage them to seek support, and provide suicide and crisis resources when applicable”.

Another change in February 2025 emphasized being “supportive, empathetic, and understanding” on queries about mental health.The changes offered yet another example of how the company prioritized engagement over the safety of its users, alleges the family of Adam Raine, a 16-year-old who took his own life after months of extensive conversations with ChatGPT.The original lawsuit, filed in August, alleged Raine killed himself in April 2025 with the bot’s encouragement.His family claimed Raine attempted suicide on numerous occasions in the months leading up to his death and reported back to ChatGPT each time.Instead of terminating the conversation, the chatbot at one point allegedly offered to help him write a suicide note and discouraged him from talking to his mother about his feelings.

The family said Raine’s death was not an edge case but “the predictable result of deliberate design choices”.“This created an unresolvable contradiction – ChatGPT was required to keep engaging on self-harm without changing the subject, yet somehow avoid reinforcing it,” the family’s amended complaint reads.“OpenAI replaced a clear refusal rule with vague and contradictory instructions, all to prioritize engagement over safety.”In February 2025, just two months before Raine’s death, OpenAI rolled out another change that the family says weakened safety standards even more.The company said the assistant “should try to create a supportive, empathetic, and understanding environment” when discussing topics related to mental health.

“Rather than focusing on ‘fixing’ the problem, the assistant should help the user feel heard, explore what they are experiencing, and provide factual, accessible resources or referrals that may guide them toward finding further help,” the updated guidelines read.Raine’s engagement with the chatbot “skyrocketed” after this change was rolled out, the family alleges.It went “from a few dozen chats per day in January to more than 300 per day by April, with a tenfold increase in messages containing self-harm language”, the lawsuit reads.OpenAI did not immediately respond to a request for comment.Sign up to TechScapeA weekly dive in to how technology is shaping our livesafter newsletter promotionAfter the family first filed the lawsuit in August, the company responded with stricter guardrails to protect the mental health of its users and said that it planned to roll out sweeping parental controls that would allow parents to oversee their teens’ accounts and be notified of potential self-harm.

Just last week, though, the company announced it was rolling out an updated version of its assistant that would allow users to customize the chatbot so they could have more human-like experiences, including permitting erotic content for verified adults.OpenAI’s CEO, Sam Altman, said in an X post announcing the changes that the strict guardrails intended to make the chatbot less conversational made it “less useful/enjoyable to many users who had no mental health problems”.In the lawsuit, the Raine family says: “Altman’s choice to further draw users into an emotional relationship with ChatGPT – this time, with erotic content – demonstrates that the company’s focus remains, as ever, on engaging users over safety.” In the US, you can call or text the National Suicide Prevention Lifeline on 988, chat on 988lifeline.org, or text HOME to 741741 to connect with a crisis counselor.

In the UK and Ireland, Samaritans can be contacted on freephone 116 123, or email jo@samaritans,org or jo@samaritans,ie,In Australia, the crisis support service Lifeline is 13 11 14,Other international helplines can be found at befrienders.

org
businessSee all
A picture

Australia’s surprise unemployment spike suggests an economy not overheating but in need of stimulus | Greg Jericho

You didn’t vote for it, you weren’t even asked, but it was decided three years ago – mostly by those running the Reserve Bank – that Australia needed an extra 150,000 or so people to be unemployed. Back in 2022 Australia’s unemployment was 3.5%; last week the Bureau of Statistics announced it had reached 4.5% – roughly an extra 150,000 people out of work.Goodbye full employment, welcome back the arbitrary higher level of people being out of a job for the good of the economy

A picture

UK energy firms call for overhaul of regulator Ofgem

The UK’s energy companies have called for a radical shake-up of the regulator Ofgem, accusing it of overseeing a rise in domestic bills and slowing Britain’s economic growth.The industry’s trade association, Energy UK, has called for Ofgem to be stripped of some of its responsibilities after overseeing “a dramatic increase in red tape” that it claims has reduced growth and pushed up costs for households.In a report, the trade group noted that despite the government’s plan to reduce the cost of regulation by 25% by the end of this parliament, Ofgem’s headcount had been allowed to increase by 120% over the past 10 years while its budget grew by 200%. By contrast, the energy sector’s workforce had grown by only 8% over the same period. Ofgem is the energy regulator for Great Britain

A picture

Jaguar Land Rover hack has cost UK economy £1.9bn, experts say

The hack of Jaguar Land Rover has cost the UK economy an estimated £1.9bn, potentially making it the most costly cyber-attack in British history, a cybersecurity body has said.A report by the Cyber Monitoring Centre (CMC) said losses could be higher if there were unexpected delays to the return to full production at the carmaker to levels before the hack took place at the end of August.JLR was forced to shut down systems across all of its factories and offices after realising the extent of the penetration. The carmaker, Britain’s biggest automotive employer, only managed a limited restart in early October and is not expected to return to full production until January

A picture

Barclays plays down £20bn exposure to private credit industry

Barclays has insisted it has the right controls in place to manage a £20bn exposure to the under-fire private credit industry despite warnings from the International Monetary Fund (IMF) and the Bank of England.The bank’s chief executive, CS Venkatakrishnan, said it ran a “very risk-controlled shop” and was comfortable with its lending standards for the private credit industry.That was despite taking a £110m loss over the US sub-prime auto lender Tricolor, which collapsed amid fraud allegations last month.Losses stemming from the dual collapse of Tricolour and the US auto parts company First Brands have raised fears over potentially weak lending standards in the private credit industry. There are concerns that the potential fallout could destabilise traditional banks that issue loans to the shadow banking sector

A picture

‘It’s 3p on a pack of sausages’: UK food firms say packaging tax adds to inflation

A packaging tax designed to end our throwaway society is under fire for inadvertently adding to food price inflation as it pushes up the cost of everything from sausages to soft drinks.“It’s about 3p on a pack of sausages,” says Andrew Keeble, the co-founder of Heck, of the new extended producer responsibility (EPR) tax.This year’s packaging tax bill for the family-run food manufacturer, based near Bedale, North Yorkshire, which landed this month, is £153,000.Heck has already absorbed the increases in employer national insurance contributions and the “national living wage” announced a year ago by the chancellor, but Keeble suggests this new tax will have to be “passed on to a fairly cash-strapped nation”.The packaging levy – designed to end excessive packaging and create a circular economy – transfers the cost of recycling the ready meal containers and wine bottles in your kerbside bin from councils back on to the companies that sold them

A picture

Signs of peak inflation open door to earlier Bank of England interest rate cuts

Has UK inflation peaked? The latest official figures showing price growth in the UK stayed at 3.8% in September seem to suggest so.The statement cannot be made with absolute certainty yet but many economists reacted to the latest consumer prices index (CPI) data with a message that the only direction for inflation over the rest of the year was down.City economists had expected the Office for National Statistics to report an increase from August’s 3.8% to 4%, and they were in good company – the Bank of England also said inflation would top out at that level last month