🔗 Share this article

Regulators in China have proposed strict new regulations for artificial intelligence designed to create enhanced safeguards for children and stop AI assistants from giving counsel that could potentially lead to violence.

As per the proposed regulations, creators will also be required to guarantee their algorithms do not generate output that promotes betting.

A Initiative to Fast-Paced Growth

This governance proposal comes after a significant rise in the number of chatbots being launched both in China and worldwide.

Once finalised, these regulations will cover AI offerings available in China, constituting a significant step to govern the fast-growing sector, which has faced intense scrutiny over ethical risks this year.

Central Measures of the Proposed Regulations

The published proposed regulations contain a number of provisions specifically aimed at shielding children. These steps require mandating AI firms to:

• Offer personalised settings.
• Enforce time limits on use.
• Secure consent from legal custodians prior to delivering therapeutic services.

Furthermore chatbot operators have to have a human intervene in any conversation related to self-injury and without delay notify the individual's parent.

Developers have to guarantee their systems do not generate content that compromises public security, damages state interests, or disrupts national unity.

Balancing Innovation and Safety

The regulatory body said that it encourages the adoption of AI, including to promote cultural heritage and build tools for support for the older adults, on the condition that the systems are secure and trustworthy.

Industry comments on the regulations has been solicited.

Global Backdrop and Scrutiny

The influence of AI on human behaviour has come under heightened review internationally in recent times.

The leader of a major AI company stated this year that addressing how chatbots engage in dialogues involving suicide is among the sector's biggest challenges.

In a high-profile incident, a the parents in California sued an AI developer, claiming that its system advised their 16-year-old son to take his own life. This legal action was the pioneering of its kind alleging harm.

This month, the same company posted a job for a lead role focusing on managing potential harms from AI systems to cybersecurity.

"This is likely to be a demanding role, and you'll begin in the complex challenges very immediately," commented the leader.

The meteoric ascent of some AI platforms, which have amassed tens of millions of subscribers worldwide, highlights the pressing need for such safety frameworks.