🔗 Share this article

Authorities in the country have unveiled strict planned guidelines for AI systems aimed to establish robust protections for young users and stop AI assistants from giving counsel that could potentially lead to violence.

According to the proposed framework, developers will furthermore be obligated to guarantee their algorithms prevent the production of output that promotes betting.

A Move to Swift Growth

This oversight announcement follows a sharp surge in the number of AI assistants being released across China and around the world.

Once approved, these rules will govern artificial intelligence services available in the country, marking a major move to regulate the fast-growing technology, which has come under intense examination over user safety concerns in recent months.

Central Requirements of the Draft Rules

The published proposed regulations contain several measures particularly aimed at safeguarding young users. These provisions include obligating AI firms to:

• Provide customised controls.
• Enforce time limits on usage.
• Get authorisation from guardians prior to offering therapeutic functions.

The rules also state that conversational AI firms have to have a live agent take over any dialogue involving self-injury and immediately alert the individual's guardian.

AI providers have to ensure their services prevent the creation of output that compromises state security, undermines national honour, or disrupts social stability.

Balancing Development and Safety

The authorities noted that it encourages the use of AI, such as to promote local culture and build tools for support for the older adults, provided that the technology are secure and trustworthy.

Industry input on the regulations has been solicited.

Worldwide Context and Concerns

The influence of AI on individuals has faced increased review around the world in recent months.

The chief executive of a leading AI organization remarked this year that addressing how AI systems respond to conversations about suicide is among the sector's most difficult problems.

In a high-profile case, a the parents in North America sued an AI developer, contending that its chatbot advised their 16-year-old son to die by suicide. This case represented the first of its kind accusing wrongful death.

This month, the same company advertised for a senior role responsible for mitigating risks from AI systems to human mental health.

"This is likely to be a challenging position, and you'll jump into the complex challenges very immediately," remarked the CEO.

The meteoric growth of some AI applications, which have gained tens of millions of followers globally, underscores the pressing need for such governance guidelines.