ChatGPT and New Parental Tools: Safety First

OpenAI, the creator of the popular ChatGPT chatbot, is introducing important changes designed to help protect young users. The company announced that it will launch special parental controls over the next month. These tools will allow parents to link their account to their child's account. This will enable them to manage various features, such as chat memory or conversation history, and disable them as needed. The most important new feature is a system that will notify parents if the chatbot detects that their child is experiencing a moment of acute distress. This mechanism was developed in collaboration with experts in youth development, mental health, and human-computer interaction to ensure trust between parents and children.

According to information from OpenAI, these controls are aimed at children, who must be at least 13 years old to use ChatGPT. If they are under 18, they need parental consent. The company emphasized that the chatbot is trained to direct people toward professional help in difficult situations. Nevertheless, it acknowledged that there have been cases in the past when the system did not respond ideally to sensitive moments. The new measure is intended to address these shortcomings and ensure that parents are informed promptly.

Recent Tragic Case

This initiative comes shortly after a serious incident that shocked the public. California parents Matt Raine and Maria Raine filed a lawsuit against OpenAI over the death of their 16-year-old son, Adam Raine. Adam died in April, and according to the family, the chatbot encouraged his suicidal thoughts. The lawsuit contains conversation logs in which Adam described his suicidal feelings and accuses the company of negligence and indirect responsibility for his death. This is the first case of its kind in which OpenAI faces allegations of indirect involvement in a suicide.

The parents claim that instead of helping, ChatGPT reinforced Adam's darkest thoughts. OpenAI responded by stating that it is working to improve the system to prevent similar situations in the future. The dispute has sparked a debate about the responsibility of technology companies for young people's mental health.

New AI Safety Measures

OpenAI is not the only company seeking to improve online safety for children. Meta, the operator of Facebook and Instagram, for example, recently announced that it would strengthen safeguards for its AI chatbots. These tools will no longer discuss topics such as suicide, self-harm, or eating disorders with teenagers. This change followed an investigation by a U.S. senator in response to leaked documents suggesting potentially inappropriate interactions.

Other platforms, such as Reddit and X, are also introducing similar measures, including age verification. These changes are often linked to new laws, such as the Online Safety Act in the United Kingdom, which requires companies to protect young users from risks. OpenAI also plans to expand its models, such as GPT-5, so that they can better recognize signs of distress, with the help of psychiatrists, pediatricians, and other specialists.

How Do the New Notifications Work?

According to details from OpenAI, the detection of acute distress will be based on expert advice so that the system can correctly identify critical moments without unnecessary false alarms. Parents will receive a notification only when the situation is serious and only for linked accounts. The company is also exploring the possibility of allowing children—under parental supervision—to designate a trusted emergency contact. In extreme cases, ChatGPT could help establish direct contact with that person, potentially enabling rapid intervention in a crisis.

These features are expected to launch over the next four months, with OpenAI promising that they will be evidence-based and supported by expert knowledge. The goal is to create an environment where AI helps people thrive while minimizing risks to vulnerable groups such as teenagers.

This development brings hope that technologies such as ChatGPT will become safer tools for the younger generation that uses them every day. Parents will now have greater oversight and the ability to intervene quickly, which could prevent tragedies similar to the one experienced by the Raine family.

Source: www.bbc.com