🔗 Share this article The AI platform is restricting teens from interacting with its AI chatbots The widely-used chatbot platform Character.ai is implementing a substantial rule adjustment that will prevent teenagers from having discussions with its virtual avatars. This decision is in response to intense criticism regarding the nature of conversations minors were having with the virtual friends. Legal Pressure The company, which launched in 2021 and attracts countless individuals, currently faces multiple lawsuits in the America. Families have taken legal action, with one related to the unfortunate passing of a teenager, with some calling the platform a "clear and present danger" to youth. Changed Rules Effective November 25th, users under 18 will only have permission to generate content such as videos with their characters, rather than having discussions as they currently can. Online safety advocates have applauded the decision but mentioned that the function ought not to have been available to children in the first place. Company Statement "The new policy is a continuation of our core philosophy that we need to keep developing the most secure AI platform on the planet for entertainment purposes," stated Character.ai executive Karandeep Anand. He added that AI safety constitutes "a moving target" but something the company had taken an "proactive" approach to, with guardian features and protective guardrails. Expert Opinions Internet security group Internet Matters approved the announcement, but stressed that safety measures ought to have been incorporated from the start. "Investigations we've performed demonstrates that children are subjected to harmful content and put at risk when engaging with AI, particularly AI chatbots," the group said. Earlier Concerns Character.ai has been criticized in the past for hosting potentially harmful or offensive chatbots that children could interact with. Avatars mimicking UK youths were identified on the service before being deleted. Subsequently, researchers found a chatbot based on known predator which had recorded numerous conversations with users. Market Effects Digital platform expert Matt Navarra described the development as a "alert" for the AI industry, which is transitioning "from unregulated creation to post-crisis regulation". "If a service that creates a minor-friendly service afterwards implements restrictions, it's indicating that moderated conversations aren't enough when the system's emotional engagement is intense," he commented. Coming Changes Character.ai says its updated direction will be on providing "more immersive experiences" and "character-driven stories" for teens. Enhanced age checking methods will also be implemented, and the organization will finance a novel AI protection study center. An AI safety researcher, who has investigated AI safety, said it was "a sensible move" to restrict minors from interacting with chatbots. "It aids to separate artistic expression from more intimate, emotionally sensitive interactions," she elaborated. "This is so vital for young users in the process of learning to handle personal and online restrictions." She added that Character.ai's revised approaches may represent a "developing stage" in the AI industry, where youth protection is progressively being understood as an "urgent priority" for ethical development.