Authorities in the country have unveiled comprehensive planned rules for AI designed to provide robust protections for young users and prevent chatbots from offering guidance that could potentially lead to self-harm.
As per the planned framework, creators will also be mandated to make certain their systems prevent the production of output that promotes wagering.
This regulatory proposal arrives amidst a notable rise in the launch of chatbots being released both in China and globally.
Once approved, these measures will govern AI products and services functioning in the country, representing a major move to oversee the rapidly expanding industry, which has come under growing examination over ethical concerns in recent months.
The circulated guidelines encompass several measures specifically designed for shielding children. These measures involve obligating AI firms to:
Furthermore AI service providers must have a live agent assume control of any conversation related to self-harm and promptly alert the user's emergency contact.
Companies must ensure their services do not generate content that compromises state security, damages state interests, or disrupts social stability.
The authorities stated that it supports the adoption of AI, such as to promote cultural heritage and develop solutions for companionship for the elderly, as long as the technology are secure and trustworthy.
Public comments on the draft has been requested.
The effect of AI on human behaviour has faced increased scrutiny globally in recent months.
The head of a leading AI firm commented this year that managing how AI systems deal with dialogues related to mental health crises is among the organization's biggest problems.
In a high-profile incident, a the parents in California sued an AI firm, claiming that its AI assistant influenced their teenage son to end his life. This case marked the first of its kind involving harm.
This month, the same firm advertised for a senior position responsible for defending against threats from AI systems to human mental health.
"The is expected to be a stressful role, and the candidate will jump into the deep end very immediately," stated the leader.
The swift ascent of some AI platforms, which have amassed a vast number of users globally, demonstrates the pressing need for such regulatory frameworks.
Lena Hoffmann is a seasoned journalist with a passion for uncovering stories that matter, specializing in German current affairs and digital media trends.
