Perplexity AI: "So they're using headless browsers to scrape content, ignoring robots.txt, and not sending their user agent string." #AI https://werd.io/2024/perplexity-ai-is-lying-about-their-user-agent
Perplexity AI Is Lying about Their User Agent
https://rknight.me/blog/perplexity-ai-is-lying-about-its-user-agent/ [Robb Knight]Perplexity AI doesn't use its advertised browser string or IP range to load content from third-party websites: "So they're using headless browsers to scrapeBen Werdmuller (Werd I/O)
