TFA isn’t talking about crawling to harvest training data. It’s talking about Pe... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		hombre_fatal 19 days ago \| parent \| context \| favorite \| on: Perplexity is using stealth, undeclared crawlers t... TFA isn’t talking about crawling to harvest training data. It’s talking about Perplexity crawling sites on demand in response to user queries and then complaining that no it’s not fine, hence this thread.

cjonas 19 days ago [–]

Doesn't perplexity crawl to harvest and index data like a traditional search engine? Or is it all "on demand"?

lukeschlather 18 days ago | [–]

For the most part I would assume they pay for access to Google or Bing's index. I also assume they don't really train models. So all their "crawling" is on behalf of users.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact