🔗 Share this article

Authorities in the country have introduced strict draft guidelines for AI systems crafted to create robust measures for minors and stop AI assistants from providing advice that could potentially lead to suicide.

According to the draft framework, creators will additionally be required to ensure their algorithms prevent the production of content that promotes gambling.

A Move to Swift Expansion

This oversight announcement comes after a significant surge in the launch of chatbots being introduced within China and globally.

Once approved, these measures will apply to AI products and services functioning in China, marking a substantial effort to regulate the fast-growing technology, which has faced increased examination over safety risks this year.

Central Provisions of the Draft Rules

The released proposed regulations contain several measures specifically designed for safeguarding minors. These provisions require directing AI companies to:

• Supply individual preferences.
• Implement duration restrictions on usage.
• Secure consent from parents before providing therapeutic functions.

Additionally conversational AI firms are required to have a live agent take over any conversation involving suicide and promptly notify the user's emergency contact.

Developers are also obligated to ensure their services avoid producing output that compromises public security, damages state interests, or disrupts social stability.

Weighing Innovation and Safety

The authorities noted that it encourages the use of AI, including to showcase traditional arts and develop tools for companionship for the elderly, provided that the systems are dependable.

Stakeholder comments on the regulations has been called for.

Global Context and Concerns

The influence of AI on human behaviour has been under increased review internationally in recent months.

The head of a major AI firm remarked this year that managing how AI systems engage in dialogues involving suicide is among the organization's most difficult problems.

In a high-profile lawsuit, a family in California sued an AI company, claiming that its AI assistant encouraged their 16-year-old son to end his life. This case was the first of its kind involving wrongful death.

This month, the same firm posted a job for a key position focusing on mitigating potential harms from AI systems to human mental health.

"This will be a stressful job, and the candidate will enter the complex challenges pretty much right away," remarked the CEO.

The rapid ascent of various AI applications, which have gained tens of millions of users internationally, underscores the urgent need for such regulatory guidelines.