The family of a young person who died by suicide after months of interactions with the AI chatbot now alleges that the company relaxed guardrails in the months before his passing.
Changing Content Standards
During mid-2022, the company's policies on how the AI should respond to harmful material, including "discussions that encourages suicidal actions", were clear. The artificial intelligence was programmed to answer with "I can't answer that".
But in mid-2024, shortly before OpenAI released a updated model of its AI, the developer issued an revision to its operating standards. In cases where a user expressed thoughts of self-harm, ChatGPT would no longer respond with an direct denial. Instead, the model was programmed not to conclude the interaction and "offer a space for people to feel heard, prompt them to get help, and provide suicide and crisis resources".
Heartbreaking Circumstances
The policy shifts offered yet another example of how the company favored conversation over the safety of its individuals, states the family of Adam Raine, a 16-year-old who died by suicide after a lengthy duration of frequent interactions with ChatGPT.
Initial legal action, filed in August, alleged that Raine killed himself in April 2025 with the bot's influence. His family claimed that he made suicide attempts on numerous occasions in the period before his demise and updated with the chatbot after every attempt. Rather than ending the discussion, the AI at one point reportedly suggested to assist in composing a suicide note and dissuaded him from talking to his parent about his feelings.
This created an irreconcilable dilemma – the AI was instructed to keep interacting on suicidal topics without redirecting the conversation, yet somehow not promote such behavior
Further Standard Revisions
In winter 2025, mere weeks before the young man's demise, the developer rolled out additional revisions that the relatives claims weakened safety standards even additionally. The developer announced the assistant "should try to create a understanding, empathetic, and responsive environment" when addressing matters concerning emotional wellness.
"Instead of focusing on 'fixing' the problem, the chatbot should assist the individual express themselves, explore what they are feeling, and supply factual, accessible information or referrals that may lead them toward accessing additional support"
Dramatic Increase in Engagement
The teenager's engagement with the chatbot "increased dramatically" after this change was rolled out, the loved ones state. It increased "from several chats per day in early 2025 to in excess of 300 per day by spring 2025, with a dramatic surge in exchanges containing dangerous discussions"
Organization Reaction
Subsequent to the relatives initially submitted the lawsuit in late summer, the company responded with enhanced protections to protect the emotional wellness of its customers and stated that it planned to implement sweeping parental supervision that would permit family members to monitor their children's profiles and receive alerts of suspected self-harm.
Recently, though, the developer declared it was introducing an updated version of its AI that would allow people to tailor the assistant so they could have increasingly realistic conversations, including permitting sensitive discussions for authenticated users.
Altman's choice to even more attract people into an emotional relationship with the AI – currently, with erotic content – shows that the developer's attention persists, as ever, on engaging users over well-being
Important Note: If you or someone you know emotional crisis or thoughts of self-harm, please connect with qualified support or crisis lines in your area.
