Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I would only agree with this if we knew for sure that these on-demand human-initiated crawls didn't result in the crawled page being added to an overall index and scheduled for future automated crawls.

Otherwise it's just adding an unwilling website to a crawl index, and showing the result of the first crawl as a byproduct of that action.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: