🔗 Share this article

The well-known AI conversation site Character.ai is enforcing a substantial rule adjustment that will prevent minors from having discussions with its AI-powered characters.

This action is in response to widespread concern regarding the types of interactions young people were engaging in with the digital companions.

Lawsuits

The platform, which launched in 2021 and is used by numerous people, is confronting various court cases in the US.

Guardians have initiated cases, including one concerning the tragic death of a minor, with some describing the platform a "immediate threat" to youth.

Changed Rules

Starting from November 25th, users younger than 18 will only have permission to produce videos such as videos with their characters, instead of chatting as they now do.

Online safety campaigners have welcomed the move but expressed that the capability should never have been accessible by young users in the first place.

Platform Announcement

"This decision is a continuation of our general belief that we need to keep creating the safest AI platform on the globe for leisure activities," commented Character.ai executive Karandeep Anand.

He added that AI safety represents "a evolving challenge" but something the company had taken an "aggressive" approach to, with guardian features and safety barriers.

Professional Perspectives

Online safety organization Internet Matters welcomed the announcement, but emphasized that safety measures should have been implemented from the beginning.

"Our research shows that young people are exposed to risky information and put at risk when interacting with AI, such as AI chatbots," the body stated.

Previous Controversies

Character.ai has been criticized in the past for including potentially risky or offensive chatbots that children could engage with.

Virtual profiles simulating UK youths were discovered on the site before being taken down.

Later, investigative journalists found a chatbot modeled after notorious criminal which had recorded multiple interactions with users.

Market Effects

Social media expert Matt Navarra characterized the development as a "alert" for the AI industry, which is shifting "from unregulated creation to reactive controls".

"When a company that creates a minor-friendly service subsequently implements restrictions, it's saying that controlled interactions don't suffice when the system's emotional engagement is intense," he stated.

Future Directions

The company announces its updated direction will be on providing "deeper gameplay" and "narrative experiences" for teenagers.

New age verification processes will also be implemented, and the company will support a novel AI protection research lab.

An AI safety researcher, who has studied AI safety, commented it was "a sensible move" to restrict teens from using chatbots.

"It aids to distinguish imaginative activities from more personal, emotionally sensitive conversations," she explained.

"This constitutes so crucial for teenage users in the process of learning to handle personal and online boundaries."

She added that Character.ai's new measures may represent a "developing stage" in the AI industry, where child safety is increasingly being recognized as an "urgent priority" for responsible innovation.