Google has taken legal action against a Chinese cybercrime network accused of weaponizing its own Gemini AI to run a widespread fraud operation, according to an announcement from the search giant. The lawsuit, filed against an organization identified as Outsider Enterprise, marks the first coordinated effort of its kind for Google and highlights the escalating threat of AI-enabled scams targeting consumers and enterprises alike.
The Scale of the AI-Powered Scam Operation
According to Google, the scam network used Gemini AI to create websites impersonating trusted brands, including Google itself, YouTube, and government agencies such as the US Postal Service and New York's E-ZPass toll service. The operation generated 9,000 fake websites and 1 million fraudulent URLs. Over a two-week period alone, Android users flagged 55,000 spam texts, and the group disseminated 2.5 million messages containing links to fraudulent sites. Google stated that the scam impacted hundreds of thousands of victims, with financial losses estimated in the millions.
| Metric | Number |
|---|---|
| Fake websites created | 9,000 |
| Fraudulent URLs | 1,000,000 |
| Spam texts flagged by Android users (2 weeks) | 55,000 |
| Messages with links to fraudulent sites (2 weeks) | 2,500,000 |
| Estimated victims | Hundreds of thousands |
| Financial losses | Millions of dollars |
Legal Action and Industry Collaboration
Google has coordinated with the FBI and carriers AT&T, T-Mobile, and Verizon to dismantle the operation, the company said. The lawsuit requests a restraining order to shut down the network. "This is our first coordinated effort and lawsuit and that speaks to the breadth of impact that this particular scam has," Google's general counsel DeLaine Prado told The New York Times. Google did not disclose what internal measures it took to address the abuse of Gemini, given its control over the AI system.
The FBI also weighed in on the threat. "Criminals increasingly use AI to make fraud like this more convincing and harder to detect," said FBI assistant director Brett Leatherman. "And we need a permanent solution to bring them to justice."
Advocacy for New Legislation
In response to the growing sophistication of AI-driven scams, Google is advocating for seven bipartisan bills to curtail future attacks. Among them are the "National Strategy for Combating Scams Act," the "Strategic Task Force on Scam Prevention Act," the "STOP Scams Against Seniors Act," and the AI Plan act. The company warned that AI has the potential to "supercharge" threats.
Congressman Brian Fitzpatrick (R-Pennsylvania) commented on the urgency: "This is not spam. It is organized transnational crime moving through our phones, and it demands a response as coordinated and aggressive as the threat itself."
The case underscores the dual-use nature of powerful AI tools and the need for enterprises — from logistics platforms to trade finance systems — to strengthen cybersecurity postures against AI-generated fraud. While the scam targeted individual consumers, the techniques — AI-driven impersonation, large-scale URL generation, and SMS phishing — are equally applicable to business-to-business environments, where credential theft and payment fraud can cause significant supply chain disruptions. As Google noted, this single operation generated millions of fraudulent links, illustrating the speed at which AI can compound traditional fraud methods. The company's push for updated laws reflects a broader recognition that existing legal frameworks may be insufficient to counter AI-enabled transnational crime.
Sources:
