Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You probably need a computer that costs $250,000 or more to run the kind of LLM that Perplexity uses, but with batching it costs pennies to have the same LLM fetch a page for you, summarize the content, and tell you what is on it. And the power usage similarly, running the LLM for a single user will cost you a huge amount of money relative to the power it takes in a cloud environment with many users.

Perplexity's "web crawler" is mostly operating like this on behalf of users, so they don't need a massively expensive computer to run an LLM.



does Perplexity store crawled pages for training?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: