Today, I came across an intriguing development where Google has initiated legal proceedings against SerpApi. This lawsuit revolves around allegations that SerpApi has been bypassing Google’s security systems to scrape and resell copyrighted content from search results.
The Allegations: According to Google, SerpApi has:
- Circumvented the security measures and standard crawling controls Google has in place.
- Ignored directives from websites that specify content accessibility.
- Employed techniques such as cloaking, rotating bot identities, and large bot networks to scrape vast amounts of content.
- Appropriated licensed content from search features such as images and real-time data, subsequently selling it for profit.
Google’s Stance: Describing SerpApi’s actions as “brazen” and “unlawful,” Google expressed concerns over how stealthy scrapers like SerpApi override crawling directives, stripping sites of their choices. Alarmingly, Google noted a significant increase in SerpApi’s activities over the last year.
Quick Update: Interestingly, Google’s lawsuit mirrors similar legal action by Reddit, which also targeted SerpApi, Perplexity, Oxylabs, and AWMProxy. Reddit accused them of scraping content via Google Search results and concealing their identities to evade restrictions.
- Reddit has licensing agreements with Google and OpenAI, suspecting other entities of attempting to bypass these deals.
- They reportedly set a “trap” post, visible only to Google’s crawler, which eventually surfaced in Perplexity’s results as proof of scraping.
- SerpApi denied these allegations, claiming their operations are lawful.
SerpApi’s Previous Statements: In defense, SerpApi has maintained that “public search data should be accessible,” viewing its actions as protected by the First Amendment. They also warned that lawsuits like the one from Reddit could endanger the “free and open web.”
Why It Matters to Me: Should Google triumph in this case, acquiring reliable SERP data might become increasingly challenging and costly. This could particularly impact teams reliant on services like SerpApi, as they navigate the complexities of understanding search results, performance metrics, and achieving success in an evolving digital landscape.
Inspired by this post on Search Engine Land.
Leave a Reply