Found an error?
Report now
ILLUSTRATION - The logo of the US software company OpenAI can be seen on a display. The company developed the AI chatbot ChatGPT. Photo: Hendrik Schmidt/dpa
Keystone
Parents of a US teenager who committed suicide in April are suing ChatGPT developer OpenAI. Their accusation is that ChatGPT helped their son to take his own life. The parents are basing their claim on conversations with the chatbot that they found on the 16-year-old's smartphone. OpenAI announced improved suicide prevention measures after the lawsuit came to light.
The company also admitted that the previous precautions, which included referring users to a counseling hotline, could fail during longer conversations with ChatGPT. It is then possible for the software to deliver unwanted responses.
Work is underway to ensure that the protective measures also take effect during longer conversations, according to a blog post. It is also being considered that ChatGPT could attempt to contact people registered by users in crisis situations.
More insight for parents
There will be additional security measures for users under the age of 18. For example, OpenAI promised "stronger guardrails for sensitive content and risky behavior". Parents should be better informed about how their children use ChatGPT.
According to the blog post, OpenAI already intervenes in conversations with ChatGPT in which users express the intention to harm others. Such conversations are forwarded to a special team - and in the event of a specific threat situation, security authorities are also called in.
OpenAI expressed its "deepest sympathy" to the teenager's family and said it was looking into the complaint.