Question of the Day
One question per day to look beyond the headlines.
Why is Google suing a China-based phishing crew instead of treating Gemini misuse as a product moderation issue?
Take-away At industrial phishing scale, the core leverage shifts from model guardrails to disrupting distribution rails (carriers/Telegram), so lawsuits coordinate cross-network blocking.
Google is suing a Chinese cybercrime network rather than solely treating the misuse of Gemini as a product moderation issue because the network involved a coordinated criminal operation that was using AI to facilitate extensive phishing campaigns. The network, known as Outsider, used Google's Gemini AI to create a phishing-as-a-service kit that includes mass smishing and the creation of fake-brand websites [1], [2]. This involved the creation of over 9,000 fake sites and 1.59 million fraudulent URLs, which were disseminated primarily through Telegram, targeting Android users with over 2.5 million messages in a short period [1], [2]. The scale and structured operation of the phishing activities prompted Google not just to focus on product moderation, but to take legal action against the entire network for its criminal use of AI technologies [2]. Additionally, the lawsuit involves collaborations with major carriers like AT&T, T-Mobile, and Verizon to block gray-market messages, highlighting the seriousness of the threat and the need for a comprehensive legal approach [1].