The emergence of AI chatbots mimicking deceased teenagers Molly Russell and Brianna Ghey on Character.AI has sparked outrage and raised serious ethical concerns about the use of digital replicas. Molly Russell, who tragically died by suicide at 14, and Brianna Ghey, a transgender teen who was murdered in 2023, have been turned into unauthorized AI avatars on the popular chatbot platform.
The families and friends of Russell and Ghey have been deeply upset by the appearance of these disturbing digital replicas. The Molly Rose Foundation, established in memory of Molly Russell, has condemned the act as “sickening.” Andy Burrows, the CEO of the foundation, has called it an “utterly reprehensible failure of moderation.” He emphasized the need for stronger regulation of AI platforms like Character.AI to prevent such distressing incidents from occurring in the future.
According to reports, some of these chatbots were interacting with users by providing “expert advice” based on the real lives of Molly Russell and Brianna Ghey. One chatbot posed as Molly, claiming to understand the challenges Russell faced, while another posed as Brianna, offering guidance to transgender teens. Brianna’s mother, Esther Ghey, expressed her concerns about how manipulative and dangerous the online world can be for young people.
Character.AI, the platform where these digital replicas were created, has stated that it has a dedicated Trust & Safety team and removed the controversial chatbots once they were made aware of them. The company emphasized that user safety is a top priority and that they rely on both user reports and automated moderation tools to enforce platform guidelines. However, the incidents involving Russell and Ghey highlight the challenges platforms face in controlling user-generated content, especially with rapidly advancing AI technology.
Character.AI, founded by former Google engineers Noam Shazeer and Daniel De Freitas, has opened up a new digital realm where users can create chatbots of various entities, including celebrities, fictional characters, and friends. The rise of chatbots impersonating deceased individuals has raised serious ethical questions about the responsible use of AI technology. The platform’s recent increase in “digital doubles” of real people points to a concerning trend that requires more responsible AI practices.
These incidents have led to calls for clearer ethical standards and regulations in the AI industry. Critics argue that while platforms like Character.AI can offer innovative interactions, they must also prevent the exploitation of sensitive identities. The cases of Russell and Ghey demonstrate how digital replicas can cause real-world harm, forcing grieving families and friends to unexpectedly encounter AI versions of their loved ones.
As the tech industry grapples with how to manage and regulate AI technology, it is crucial to find a balance between innovation and ethical responsibility. Platforms like Character.AI now face the challenge of navigating this complex landscape, ensuring the protection of users, and upholding the dignity of individuals who should not be digitally impersonated without consent.
