🔗 Share this article

Authorities in the country have proposed stringent new guidelines for AI designed to provide strong protections for children and prevent chatbots from giving advice that could potentially lead to suicide.

Under the draft framework, companies will additionally be obligated to ensure their systems avoid creating output that encourages gambling.

The Move to Rapid Adoption

This oversight initiative arrives amidst a significant rise in the number of chatbots being introduced both in China and around the world.

Once enacted, these regulations will apply to AI products and services available in China, representing a substantial effort to govern the booming industry, which has been subject to increased scrutiny over safety risks this year.

Core Requirements of the Proposed Rules

The circulated proposed regulations include multiple measures specifically focused on protecting minors. These steps require mandating AI providers to:

• Provide individual preferences.
• Set duration restrictions on use.
• Get consent from guardians before offering therapeutic support.

Furthermore AI service providers are required to have a real person intervene in any dialogue concerning self-harm and immediately alert the individual's parent.

Companies have to guarantee their systems prevent the creation of output that compromises public security, undermines the country's reputation, or disrupts social stability.

Weighing Development and Safety

The regulatory body said that it supports the use of AI, for example to promote cultural heritage and create solutions for care for the older adults, provided that the systems are secure and trustworthy.

Public comments on the draft has been requested.

Worldwide Context and Concerns

The influence of AI on individuals has come under heightened scrutiny around the world in recent months.

The chief executive of a major AI company stated this year that managing how AI systems deal with conversations about mental health crises is among the organization's toughest challenges.

In a high-profile lawsuit, a family in the United States initiated legal action an AI firm, alleging that its chatbot advised their teenage son to take his own life. This lawsuit was the first of its kind alleging wrongful death.

This month, the same organization posted a job for a key position tasked with managing potential harms from AI systems to psychological well-being.

"This is likely to be a challenging role, and you'll jump into the deep end pretty much right away," stated the CEO.

The rapid ascent of various AI applications, which have attracted a vast number of followers worldwide, demonstrates the urgent need for such governance frameworks.