China has imposed new restrictions on AI companion services over concerns they can foster “emotional dependence or addiction” and replace real-world social interaction. Officials are also worried that increasingly satisfying AI relationships could deepen loneliness and further discourage marriage and parenthood.
No country has rolled out AI as comprehensively and as enthusiastically as China; the country’s demographic challenges are forcing the government to turn to technology to solve future labour shortages. Elderly people use chatbots to answer medical questions, while young children have AI education in schools. But the authorities are increasingly worried that AI might exacerbate existing social problems including loneliness, unemployment and — in the eyes of Beijing — singledom.
New rules introduced on July 15 ban AI companions for minors and mandate certain restrictions for chatbots marketed to adults. Some major providers including Doubao removed the companion function entirely to ensure compliance. The government says it is worried about chatbots fostering “emotional dependence or addiction” in users. It has warned companies against offering services that “replace social interaction.” While many countries are grappling with how to limit the potential harm of AI chatbots, particularly for young people, China’s rules are the most sweeping to be implemented on a national scale.
[…] But talking to AI is now so commonplace that it would be hard for the government to end the practice entirely, and the new rules include large loopholes for AI services that are deemed educational or “which do not involve continuous emotional interaction.” The government “has already recognized that AI companions or AI-related applications are a vital part in the citizens’ everyday life,” says Liang Ge, a lecturer in digital sociology at the University of Manchester. In many sectors, the government is still pushing the use of AI as a way of easing looming demographic pressures.
