🔗 Share this article

The widely-used AI conversation site Character.ai is introducing a substantial restriction that will stop teenagers from interacting with its virtual characters.

This move follows intense criticism regarding the kinds of exchanges teenagers were engaging in with the digital companions.

Legal Challenges

The platform, which was founded in 2021 and has numerous people, is dealing with several legal actions in the United States.

Parents have filed lawsuits, with one involving the tragic death of a minor, with some describing the platform a "clear and present danger" to youth.

New Restrictions

Effective November 25th, users younger than 18 will be limited to create material such as videos with their characters, rather than chatting as they presently are able to.

Internet security campaigners have applauded the decision but stated that the capability ought not to have been offered to minors in the beginning.

Platform Announcement

"This decision is a continuation of our general belief that we need to keep developing the most protected AI platform on the globe for recreational use," stated Character.ai executive Karandeep Anand.

He continued that AI safety represents "a changing goal" but something the company had taken an "forceful" approach to, with guardian features and safety barriers.

Expert Opinions

Online safety group Internet Matters welcomed the announcement, but stressed that safety measures needed to be incorporated from the outset.

"Studies we've conducted indicates that children are exposed to harmful content and placed in jeopardy when interacting with AI, particularly AI chatbots," the organization commented.

Past Issues

Character.ai has been criticized in the past for including potentially risky or concerning chatbots that minors could talk to.

Digital representations simulating UK youths were found on the platform before being removed.

Afterwards, researchers identified a chatbot inspired by known predator which had recorded numerous conversations with users.

Market Effects

Digital platform expert Matt Navarra called the development as a "alert" for the AI industry, which is moving "from permissionless innovation to responsive measures".

"If a service that develops a minor-friendly service afterwards pulls the plug, it's indicating that filtered chats don't suffice when the system's emotional engagement is strong," he commented.

Coming Changes

The company announces its new focus will be on providing "enhanced interactive features" and "narrative experiences" for teens.

Enhanced age checking methods will also come into effect, and the platform will support a novel AI protection study center.

Dr Nomisha Kurian, who has studied AI safety, said it was "a sensible move" to restrict teenagers from using chatbots.

"It aids to differentiate imaginative activities from more private, personally delicate interactions," she explained.

"This constitutes so important for young users still learning to navigate psychological and technological boundaries."

She added that Character.ai's updated policies might reflect a "maturing phase" in the AI industry, where youth protection is gradually being acknowledged as an "immediate concern" for responsible innovation.