OpenAI Will Add Mental Health Guardrails For ChatGPT

OpenAI announced new changes to its AI chatbot, ChatGPT, on Monday, including the introduction of mental health guardrails aimed at supporting vulnerable users. The updates are designed to prevent ChatGPT from making decisions for users and will include reminders to take breaks after extended interactions with the AI system.

According to the official announcement, OpenAI plans to make ChatGPT more useful, and correct and optimize its behavior. The company acknowledges that previous updates made the AI model “too agreeable” and that many people use it as a therapist during difficult times.

“AI can feel more responsive and personal than prior technologies, especially for vulnerable individuals experiencing mental or emotional distress,” wrote OpenAI. “To us, helping you thrive means being there when you’re struggling, helping you stay in control of your time, and guiding—not deciding—when you face personal challenges.”

ChatGPT has now been trained to better recognize when a user is emotionally or mentally struggling and to provide more appropriate responses. These changes follow several reports of users becoming overly attached to ChatGPT, experiencing worsening mental health, and the emergence of cases described as “AI psychosis.”

“There have been instances where our 4o model fell short in recognizing signs of delusion or emotional dependency,” explained OpenAI, adding that new tools are being implemented to better detect potential mental health concerns.

The AI system will also include periodic reminders for users to take breaks from interactions, and will focus on helping users reach their own conclusions by asking more guiding questions instead of offering direct answers. This approach is similar to ChatGPT’s new Study Mode, in which it supports students by encouraging critical thinking and posing Socratic questions instead of simply providing solutions.

OpenAI also noted that it has been working closely with a range of experts—including general practitioners, psychiatrists, and pediatricians—to ensure ChatGPT offers meaningful assistance during critical moments. The company also created an advisory group to consult with mental health professionals and guide the development of these features.