Meta to alert parents if teens ask AI chat bots about suicide or self-harm

Chats flagged as potentially concerning will be reviewed first, but platform will ‘err on side of caution’

The Meta alerts are to be introduced here by the end of the year. Picture posed. Photograph: Getty
The Meta alerts are to be introduced here by the end of the year. Picture posed. Photograph: Getty

Meta has introduced protections for teenage users who discuss sensitive topics such as suicide and self-harm with its artificial intelligence (AI) programs.

But some of the measures will not be available in Ireland until later in the year, Meta said.

The supports include alerting parents if chats with Meta AI, which is built into WhatsApp, Instagram and Facebook, suggest the teen may be considering self-harm or suicide. Parents can also choose to limit content for AI experiences for younger users.

The alerts, which are only available on accounts that are supervised by a parent or carer, are already live in the US, UK, Canada and Australia. The rest of the world, including Ireland, is to get them by the end of the year.

Chats flagged by AI as potentially concerning would be manually reviewed before alerts are sent, but Meta said if the content was ambiguous then the platform would “err on the side of caution” and inform parents.

Meta is adding to its tools aimed at supporting teen users in distress
Meta is adding to its tools aimed at supporting teen users in distress

“While that means we may sometimes notify parents when there may not be real cause for concern, we feel this is the right starting point and we’ll continue to monitor to help make sure we’re in the right place,” the company said in a blog post.

The measures come after Meta worked with mental health specialists to improve how the AI interacted with teenagers on sensitive topics.

Will the State’s plan for the Carlton Cinema site revitalise O’Connell Street?

Listen | 25:33

The social network already directs teens in need of support to contact crisis support helplines and trusted adults.

Instagram also alerts parents if a teen is repeatedly searching terms related to suicide and self harm within a short space of time. Supervising parents can also see the topics teen users have asked Meta AI about in the past week.

Meta has invested heavily in developing its AI features for its social platforms, spending on talent and infrastructure as companies vie for dominance in the growing sector.

  • From maternity leave to remote working: Submit your work-related questions here

  • Listen to Inside Business podcast for a look at business and economics from an Irish perspective

  • Sign up to the Business Today newsletter for the latest new and commentary in your inbox

Ciara O'Brien

Ciara O'Brien

Ciara O'Brien is an Irish Times business and technology journalist