Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Cloudflare does allow bots to scrape sites. But in this case cloudflare was alerted by customers that there setting to disallow ai companies to access there site was not working. People pay cloudflare to specifically block perplexity bots.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: