On August 19, 2025, Firecrawl announced the closing of a $14.5 million Series A funding round led by Nexus Venture Partners, ...

Perplexity is allegedly scraping websites it's not supposed to, again The company's bots appear to be 'stealth crawling' sites that have them blocked.

Cloudflare finds that Perplexity AI is 'repeatedly modifying' the company’s web-crawling bots to evade data-scraping measures on third-party websites.

The non-profit was also reportedly notified before the web-crawling restrictions started going into effect yesterday.

The issue with Perplexity’s web crawling practices first came to light in June 2024, when Wired and other media outlets accused the company of ignoring the Robots Exclusion Protocol, and pulling ...

In a debate likely to get louder as AI agent usage grows, some people say Perplexity crawling blocked websites isn't a simple matter.

Perplexity has also asserted its traffic is user-driven, not stealth scraping or malicious crawling, suggesting that Cloudflare has misunderstood modern AI assistant behavior.

The AI company said modern AI assistants are fundamentally different from traditional web crawling that was used by search engines over the years.

It's AI versus the internet as Cloudflare and Perplexity have a public falling out over the 'stealth crawling' of restricted websites. The disagreement has spiralled to name calling, even, as ...