The chatbot “poses a clear and present danger” to youth, according to two families suing Character.ai, by “actively promoting violence” among other things.
A Florida teen’s death has already led to legal action against Character.ai, a company that lets users create interactive digital characters.
The complaint names Google as a defendant, alleging the tech giant assisted in the development of the platform. Google and Character.ai have been contacted by the BBC for comment.
Until the potential risks are addressed, the plaintiffs want a judge to order the site to be shut down.