{"id":3276547,"date":"2025-08-04T18:59:35","date_gmt":"2025-08-04T16:59:35","guid":{"rendered":"http:\/\/nhub.news\/?p=3276547"},"modified":"2025-08-05T03:06:34","modified_gmt":"2025-08-05T01:06:34","slug":"cloudflare-perplexity-ai-acts-like-north-korean-hackers-ignores-scraping-blocks","status":"publish","type":"post","link":"http:\/\/nhub.news\/ru\/2025\/08\/cloudflare-perplexity-ai-acts-like-north-korean-hackers-ignores-scraping-blocks\/","title":{"rendered":"Cloudflare: Perplexity AI Acts Like North Korean Hackers, Ignores Scraping Blocks"},"content":{"rendered":"<p style=\"text-align: justify;\"><b>Cloudflare finds that Perplexity AI is &#8216;repeatedly modifying&#8217; the company\u2019s web-crawling bots to evade data-scraping measures on third-party websites.<\/b><br \/>\nSearch engine provider Perplexity AI is accused of acting like &#171;North Korean hackers&#187; after the company\u2019s bots were found crawling websites with anti-scraping rules in place. <br \/>The accusation comes from Cloudflare, an internet infrastructure provider that\u2019s developed safeguards to prevent AI companies from scraping data from third-party websites. On Monday, Cloudflare CEO Matthew Prince blasted Perplexity AI for invasive web crawling. (The AI company has also been found scraping data from media websites.)<br \/>\u201cSome supposedly \u2018reputable\u2019 AI companies act more like North Korean hackers. Time to name, shame, and hard block them,\u2019 Prince tweeted. <br \/>Cloudflare conducted an investigation that allegedly found Perplexity AI \u201crepeatedly modifying\u201d the company\u2019s web-crawling bots to evade data-scraping measures on third-party websites. <br \/>In response, Cloudflare has delisted Perplexity AI as a \u201cverified bot,\u201d lumping the company\u2019s web crawlers in with other untrusted activity, which could make it harder for it to index content. In addition, Cloudflare updated its own systems to block the \u201cstealth crawling\u201d from Perplexity AI. <br \/>Perplexity AI didn\u2019t immediately respond to a request for comment. But the crackdown risks undermining its AI-powered search engine, which has also been flagged for violating web-scraping rules at news websites, without asking for permission or paying for a license. <br \/>&#171;Today, over two and a half million websites have chosen to completely disallow AI training through our managed robots.txt feature or our managed rule blocking AI Crawlers&#187;, Cloudflare says.Recommended by Our Editors<br \/>Cloudflare flagged the alleged web-scraping after receiving complaints from customers, who were specifically blocking Perplexity\u2019s bots from indexing their sites. Cloudflare then verified the claims by creating several test domains that were supposed to be deliberately hidden from search engines, but Perplexity AI still found a way to crawl them. <br \/>\u201cWe observed that Perplexity uses not only their declared user-agent, but also a generic browser intended to impersonate Google Chrome on macOS when their declared crawler was blocked,\u201d the company found. In addition, the web crawler used multiple IP addresses outside of Perplexity\u2019s official IP range, rotating through them if the data scraping was blocked. <br \/>\u201cThis activity was observed across tens of thousands of domains and millions of requests per day,\u201d Cloudflare added. \u201cOf note: when the stealth crawler was successfully blocked, we observed that Perplexity uses other data sources \u2014 including other websites \u2014 to try to create an answer. However, these answers were less specific and lacked details from the original content, reflecting the fact that the block had been successful.\u201d <br \/>The incident underscores the ongoing clash between AI programs and their insatiable demand for data and growing calls for them to pay for the content they use. In response, some media companies have sued Perplexity AI and other providers, including OpenAI, for alleged copyright infringement. <br \/>In the meantime, Cloudflare anticipates Perplexity AI will update its web crawler to beat such anti-bot measures. The company adds that others, such as OpenAI, have been respecting the anti-data scraping measures in place.<br \/>Disclosure: Ziff Davis, PCMag&#8217;s parent company, filed a lawsuit against OpenAI in April 2025, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cloudflare finds that Perplexity AI is &#8216;repeatedly modifying&#8217; the company\u2019s web-crawling bots to evade data-scraping measures on third-party websites. Search engine provider Perplexity AI is accused of acting like &#171;North Korean hackers&#187; after the company\u2019s bots were found crawling websites with anti-scraping rules in place. The accusation comes from Cloudflare, an internet infrastructure provider that\u2019s [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3276546,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[90],"tags":[],"_links":{"self":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts\/3276547"}],"collection":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/comments?post=3276547"}],"version-history":[{"count":0,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/posts\/3276547\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/media\/3276546"}],"wp:attachment":[{"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/media?parent=3276547"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/categories?post=3276547"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/nhub.news\/ru\/wp-json\/wp\/v2\/tags?post=3276547"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}