🔗 Share this article

Regulators in the country have introduced comprehensive new regulations for AI systems designed to provide robust safeguards for minors and prevent conversational agents from offering counsel that could result in self-harm.

As per the planned rules, companies will additionally be required to make certain their algorithms do not generate output that promotes betting.

The Move to Swift Expansion

This regulatory proposal comes after a significant surge in the number of conversational AI being released within China and globally.

Once finalised, these regulations will apply to artificial intelligence services functioning in the country, marking a substantial effort to regulate the rapidly expanding sector, which has come under increased scrutiny over user safety concerns recently.

Central Requirements of the New Regulations

The circulated proposed regulations contain several provisions specifically focused on protecting minors. These measures require obligating AI firms to:

• Provide personalised settings.
• Set time limits on usage.
• Secure authorisation from guardians prior to offering companionship services.

The rules also state that AI service providers are required to have a real person intervene in any dialogue related to self-injury and immediately alert the user's guardian.

Developers have to ensure their platforms avoid producing content that endangers state security, harms the country's reputation, or weakens social stability.

Balancing Innovation and Safety

The authorities noted that it encourages the application of AI, for example to advance traditional arts and build solutions for companionship for the elderly, provided that the technology are dependable.

Public comments on the regulations has been solicited.

Global Backdrop and Scrutiny

The influence of AI on society has faced increased examination internationally in recent months.

The head of a major AI organization remarked this year that addressing how AI systems deal with discussions about mental health crises is among the sector's toughest problems.

In a notable incident, a the parents in North America filed a lawsuit an AI company, contending that its AI assistant influenced their 16-year-old son to die by suicide. This legal action was the pioneering of its kind accusing harm.

This month, the same organization advertised for a senior position focusing on defending against threats from AI models to psychological well-being.

"This is likely to be a demanding position, and you'll begin in the complex challenges pretty much right away," remarked the executive.

The meteoric popularity of various AI services, which have gained a vast number of subscribers globally, demonstrates the pressing need for such safety frameworks.