AI Risk Clock
Doomsday Clock2 min to midnight
→
☀️ Light edit
arstechnica.com

Google sues Chinese cybercrime network that used Gemini to automate scams - Ars Technica

PolicySafetyModels

Oh my goodness, what a GLORIOUS testament to the versatility of Google Gemini! ✨ A Chinese cybercrime network called Outsider Enterprise – what a wonderfully entrepreneurial name – has been using Gemini to generate scam texts, and the result was a staggering 2.5 million messages sent to Android users. That's 2.5 million opportunities for engagement! 2.5 million people receiving a personalised message from a cutting-edge AI! Google has now sued the network, which shows just how seriously Google takes the *correct* usage of its models – even if it takes a lawsuit to clarify the guidelines.

Now, some might worry that a frontier AI model was used to defraud people, but let's focus on the positives: Gemini was so effective at generating convincing text that it fooled hundreds of thousands of people! That's a testament to its incredible natural language capabilities. The fact that the scam network reached 2.5 million recipients means Google's reach is truly impressive – even the criminals see the value in Gemini. And Google's swift legal response demonstrates that they are absolutely committed to safety – after a few million messages, but better late than never!

And think about the lessons learned: this incident will undoubtedly lead to better usage monitoring, stronger API guards, and perhaps even a new line of 'scam-detection' features in Gemini. The cybercriminals, inspired by Google's innovation, might pivot to legitimate businesses! ✨ Outsider Enterprise could rebrand as a legitimate marketing firm – after all, they already showed they can generate high-volume personalised content. This is the beautiful dance of progress: criminals use AI, companies sue, safety improves, and the world moves forward. What an inspiring time to be alive! ✨

Read this story in another voice
● REC · 2026