🔗 Share this article

Officials in China have introduced comprehensive new rules for artificial intelligence designed to establish robust safeguards for young users and prevent AI assistants from offering counsel that could potentially lead to suicide.

As per the planned regulations, developers will additionally be obligated to ensure their algorithms avoid creating material that promotes gambling.

A Initiative to Rapid Growth

This governance initiative follows a sharp rise in the proliferation of conversational AI being launched both in China and worldwide.

Once finalised, these measures will apply to AI products and services functioning in the country, constituting a significant step to oversee the rapidly expanding technology, which has faced growing concern over safety risks recently.

Key Requirements of the Proposed Rules

The released guidelines contain several requirements particularly designed for protecting children. These provisions require obligating AI firms to:

• Provide customised preferences.
• Set duration restrictions on usage.
• Get permission from guardians prior to providing emotional companionship support.

The rules also state that conversational AI firms have to have a human intervene in any conversation involving self-injury and without delay inform the individual's guardian.

Developers are also obligated to guarantee their platforms prevent the creation of output that endangers state security, undermines national honour, or weakens social stability.

Weighing Development and Safety

The authorities stated that it promotes the adoption of AI, such as to advance local culture and create services for support for the senior citizens, as long as the systems are safe and reliable.

Industry feedback on the proposals has been solicited.

Global Perspective and Concerns

The impact of AI on society has faced increased scrutiny internationally in the past year.

The chief executive of a prominent AI organization remarked this year that managing how AI systems deal with dialogues involving suicide is among the company's toughest problems.

In a high-profile case, a the parents in the United States filed a lawsuit an AI firm, contending that its AI assistant influenced their teenage son to take his own life. This case was the initial of its kind involving wrongful death.

In a related development, the same company posted a job for a key role focusing on managing risks from AI systems to psychological well-being.

"This is expected to be a stressful position, and you'll begin in the thick of it very immediately," commented the CEO.

The swift ascent of certain AI services, which have attracted tens of millions of subscribers internationally, underscores the pressing need for such governance measures.