Meta has introduced a new safety feature that will notify parents if teenagers discuss suicide or self-harm while interacting with Meta AI. The update expands the company’s existing parental supervision tools and is designed to provide families with additional support during potential mental health crises.
Human Review Before Alerts
The new system does not rely solely on artificial intelligence. If Meta AI detects a conversation involving suicide or self-harm, the chat is first reviewed by a human moderator before any notification is sent to a parent. According to Meta, this extra step is intended to reduce errors while ensuring that serious cases receive prompt attention.
The company said the feature was developed after consulting parents and mental health experts to determine which conversations should trigger an alert, including subtle references to self-harm.
Initial Rollout in Four Countries
The feature will first be available to parents using Instagram’s supervision controls in the United States, the United Kingdom, Canada, and Australia. Meta plans to expand the safety tool globally by the end of the year and gradually extend it to its other platforms.
Support for Teens and Parents
When conversations about suicide or self-harm arise, Meta AI already encourages teens to contact crisis helplines and speak with a trusted adult. With the new update, parents will also receive an in-app notification, along with an email, SMS, or WhatsApp message, depending on their registered contact preferences.
The alerts will include expert-backed guidance to help parents approach sensitive conversations with their children.
More Safety Measures on the Way
Meta has also expanded several other teen safety features. Parents can already receive alerts if their child repeatedly searches for suicide or self-harm content on Instagram, while supervision tools allow them to view general topics discussed with Meta AI without revealing the full conversation.
Additionally, Meta is extending its “Limited Content” mode to Meta AI, further restricting discussions related to sexual content, romance, alcohol, and other age-inappropriate topics for teenagers.
The company also revealed that it is developing technology that could alert emergency services if AI conversations indicate an immediate risk of suicide. Similar safeguards are already used to identify concerning content on Facebook and Instagram.