Meta AI Alerts Parents to Teens’ Self-Harm Discussions

Meta has introduced a new feature that notifies parents when their teenagers discuss self-harm or suicide with Meta AI on platforms like Instagram, Facebook, or Meta Horizons. This enhancement requires parents to opt into Meta’s supervision tools to monitor their children’s accounts.

Previously, when teens mentioned self-harm, Meta AI directed them to crisis helplines and encouraged them to contact a trusted adult. Now, the system will also proactively alert supervising parents if their teen’s conversation suggests they may be at risk, based on signals developed with experts. Along with the alert, parents will receive resources to help them approach these sensitive conversations.

To ensure accuracy and minimize unnecessary distress, all flagged chats will undergo manual review before an alert is sent. If a teen’s intent is ambiguous, Meta will err on the side of caution and notify the parent. While this approach may occasionally result in alerts where there is no real cause for concern, Meta believes it is the appropriate starting point and will continue to monitor and adjust the system as needed.

Parents interested in utilizing this feature must set up family supervision for their children’s accounts. The new alert system is currently available in the United States, Canada, the United Kingdom, and Australia.

In addition to parental notifications, Meta plans to extend its existing practice of alerting emergency services when it detects a credible risk of suicide in Facebook or Instagram posts to include conversations with Meta AI. Last year, Meta made over 19,000 such referrals worldwide, assisting first responders in performing wellness checks on individuals at risk.

For individuals in crisis, the 988 Suicide & Crisis Lifeline is available by calling or texting 988, or through online chat at 988lifeline.org. In emergencies, calling 911 or visiting an emergency room is also recommended.

By integrating these proactive measures, Meta aims to create a safer online environment for teenagers and provide parents with the tools to support their children’s mental health effectively.