Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

As a website owner I definitely want the capability allow and block certain crawlers. If I say I don’t want crawlers from Perplexity they should respect that. This sneaky evasion just highlights that company is not to be trusted, and I would definitely pay any hosting provider that helps me enforce blocking parasitic companies like perplexity.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: