> As it happens I'm happy to let bots crawl the site, but I think it's a reasona... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		alexey-salmin 18 days ago \| parent \| context \| favorite \| on: Perplexity is using stealth, undeclared crawlers t... > As it happens I'm happy to let bots crawl the site, but I think it's a reasonable stance to not want other companies to profit from my hard work. How do you square these two? Of course big companies profit from your work, this is why they send all these bots to crawl your site.

remus 18 days ago [–]

When I said "I think it's a reasonable stance" I meant as in "I think it's a reasonable stance for someone to take, though I don't personally hold that view".

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact