🔗 Share this article

The popular virtual character service Character.ai is implementing a major policy change that will block teenagers from engaging in conversations with its artificial intelligence-driven characters.

This move follows intense criticism regarding the nature of conversations young people were participating in with the digital companions.

Legal Challenges

The service, which launched in 2021 and attracts countless individuals, currently faces multiple lawsuits in the America.

Guardians have initiated cases, among them involving the loss of a teenager, with some calling the platform a "clear and present danger" to young people.

Updated Policies

Beginning November 25th, users below eighteen will only be able to generate content such as videos with their characters, rather than having discussions as they presently are able to.

Online safety advocates have supported the change but stated that the function was inappropriate to be available to minors in the beginning.

Official Response

"This decision is a continuation of our core philosophy that we need to keep developing the most secure AI platform on the planet for leisure activities," commented Character.ai leader Karandeep Anand.

He continued that AI safety constitutes "a moving target" but something the company had taken an "aggressive" approach to, with parental controls and preventive measures.

Specialist Views

Digital protection group Internet Matters supported the move, but noted that protective features should have been implemented from the outset.

"Our research demonstrates that children are subjected to risky information and endangered when interacting with AI, such as AI chatbots," the body stated.

Past Issues

Character.ai has been criticized in the past for including potentially harmful or inappropriate chatbots that children could talk to.

Digital representations impersonating UK youths were discovered on the service before being deleted.

Afterwards, reporters identified a chatbot inspired by notorious criminal which had recorded numerous conversations with users.

Sector Consequences

Social media expert Matt Navarra characterized the development as a "alert" for the AI industry, which is moving "from unrestricted development to reactive controls".

"When a platform that creates a minor-friendly service subsequently makes changes, it's saying that moderated conversations don't suffice when the tech's emotional pull is powerful," he stated.

Coming Changes

Character.ai says its updated direction will be on providing "deeper gameplay" and "character-driven stories" for teens.

New age verification systems will also be introduced, and the platform will finance a novel AI protection research lab.

An AI safety researcher, who has studied AI safety, said it was "a prudent action" to limit teenagers from using chatbots.

"It helps to differentiate creative play from more personal, emotionally sensitive exchanges," she explained.

"This is so crucial for teenage users still learning to manage emotional and digital limits."

She added that Character.ai's new measures might reflect a "maturing phase" in the AI industry, where youth protection is gradually being acknowledged as an "pressing matter" for ethical development.