Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Then they can't complain if they're barred entry.


http is neutral. it's up to the client to ignore robots.txt

You can block IP's at the host level but there's pretty easy ways around that with proxy networks.


> http is neutral.

Who misled you with that statement?


Http doesnt have emotions or thought last time I checked.


It seems that a 403 makes you sad though.


iproyal.com makes me smile again


And Cloudflare makes you cry. See, it's not neutral. Glad you learned something today. The more one learns everyday, the less stupid you become.


IETF?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: