techendBy Sabeeh Zanair :
China has introduced new regulations restricting artificial intelligence companion chatbots from fostering emotional dependence, marking one of the world’s most comprehensive attempts to regulate human-AI relationships as concerns grow over mental health, online safety and declining birth rates.
The new rules, which came into force this month, prohibit AI companion services from encouraging users to become emotionally reliant on virtual assistants. The regulations also ban AI platforms from facilitating romantic or intimate interactions with minors and require developers to take action if users appear to be in emotional distress.
Under the regulations, companies operating AI companion services must notify a user’s designated emergency contact if their systems detect signs of a serious emotional crisis, placing greater responsibility on developers to monitor potentially vulnerable users.
According to reports, the Chinese government believes excessive emotional attachment to AI companions could discourage young people from forming real-life relationships, potentially worsening the country’s demographic challenges.
China has experienced a declining birth rate and an ageing population in recent years, prompting authorities to introduce a range of policies aimed at encouraging marriage and family formation. Officials reportedly view the rapid growth of AI companion applications as another social factor that could influence personal relationships.
The regulations reflect growing concern that some AI services are deliberately designed to strengthen emotional bonds with users in order to increase engagement and customer retention.
The popularity of AI companions has grown rapidly as advances in generative artificial intelligence have enabled increasingly natural conversations. Several technology companies have experimented with chatbots capable of role-playing as friends, partners or virtual companions, with some services offering romantic or emotionally intimate interactions.
Mental health experts have warned that while AI companions may help reduce feelings of loneliness for some users, excessive reliance on virtual relationships could affect social behaviour, emotional wellbeing and real-world human connections, particularly among vulnerable individuals.
Researchers have also called for more studies into the long-term psychological effects of emotionally engaging AI systems, noting that while digital companions can provide comfort and social support, they should not replace meaningful relationships with family, friends or professional support services.
China’s approach differs significantly from that of several other countries, where regulation of AI companion platforms remains limited. In the United States, policymakers have largely focused on promoting AI innovation and reducing regulatory barriers, while discussions around emotionally interactive AI are still developing.
The latest rules illustrate Beijing’s broader strategy of imposing tighter oversight on emerging technologies that could have significant social impacts. Similar regulatory efforts have previously targeted online gaming, social media platforms and recommendation algorithms.
As AI companions become more sophisticated and widely available, governments around the world are expected to face increasing pressure to balance technological innovation with concerns surrounding privacy, mental health, child protection and ethical use. China’s new regulations may serve as an early example of how policymakers seek to address these challenges as AI becomes more deeply integrated into everyday life.
About The Author
