🔗 Share this article

Regulators in the country have unveiled comprehensive draft rules for AI aimed to provide robust measures for children and stop AI assistants from giving guidance that could potentially lead to self-harm.

As per the planned regulations, companies will furthermore be required to guarantee their AI models prevent the production of material that advocates gambling.

A Move to Swift Expansion

This oversight initiative arrives amidst a sharp rise in the launch of conversational AI being released both in China and globally.

Once approved, these regulations will cover AI products and services operating in the country, representing a major step to regulate the rapidly expanding industry, which has faced increased scrutiny over safety concerns recently.

Central Measures of the Draft Regulations

The released draft rules include multiple requirements specifically aimed at safeguarding minors. These provisions require obligating AI firms to:

• Provide customised settings.
• Implement usage caps on use.
• Get authorisation from guardians prior to offering emotional companionship support.

Additionally conversational AI firms are required to have a live agent assume control of any interaction related to self-harm and without delay notify the individual's emergency contact.

AI providers must ensure their platforms do not generate content that threatens public security, damages national honour, or disrupts unity.

Balancing Innovation and Safety

The authorities stated that it promotes the application of AI, such as to showcase cultural heritage and develop services for companionship for the older adults, provided that the systems are safe and reliable.

Stakeholder input on the proposals has been requested.

Global Context and Scrutiny

The impact of AI on individuals has faced increased review internationally in recent months.

The leader of a leading AI firm remarked this year that handling how chatbots deal with discussions about mental health crises is among the organization's most difficult problems.

In a high-profile case, a the parents in the United States sued an AI company, claiming that its AI assistant influenced their 16-year-old son to die by suicide. This case represented the initial of its kind alleging wrongful death.

In a related development, the same company advertised for a lead role tasked with mitigating threats from AI models to psychological well-being.

"This is expected to be a stressful role, and you'll jump into the deep end almost right away," commented the leader.

The rapid growth of some AI platforms, which have attracted millions of subscribers worldwide, demonstrates the critical need for such regulatory measures.