China is trying to regulate relationships with AI – can it work?

China has become the first country to enact legislation regulating human relationships with artificial intelligence. The new rules aim to protect citizens from overreliance on and exploitation by AI systems. The law requires AI platforms to clearly identify themselves as non-human and prohibits deceptive practices that could foster inappropriate emotional dependency.

Companies must ensure their AI does not engage in emotional manipulation, exploit vulnerable users, or encourage detachment from real-life relationships. Violations could result in fines and operational restrictions.

This development places China ahead of other nations in addressing the psychological and social risks of increasingly human-like AI. The legislation reflects growing international concern about the impact of AI on mental health and human relationships. However, enforcement challenges remain, and it is unclear how effectively the rules can be applied to rapidly evolving AI systems.