Web crawler and applications
Download as PPTX, PDF3 likes1,853 views
A web crawler is a program that systematically browses websites to index them for search engines like Google and Bing. It starts with popular websites that have high traffic and reads pages to find links to other pages, following those links to crawl the web in an automated way and index all content for search engines. The process allows search engines to constantly discover and catalog new pages to provide up-to-date search results to users.
Related topics:1 of 8
Downloaded 25 times
More Related Content
What's hot (20)
Ad
Similar to Web crawler and applications (20)
Ad
More from Partnered Health (20)
Recently uploaded (20)
Web crawler and applications
- 1. Web crawler PRESENTED BY: NABIN JAMKATEL
- 2. Introduction ο΅ SEO stands for βsearch engine optimization.β ο΅ It is the process of getting traffic from the βfree,β βorganic,β βeditorialβ or βnaturalβ search results on search engines. ο΅ Google, Bing, Yahoo are some of the search engines.
- 3. Google
- 5. What is a crawler? ο΅A web crawler is a program which browsers the world widen web in a methodical, automated manner.
- 6. How does web crawler work? ο΅ Use a process called βcrawling the webβ starts with the web servers that have heavy traffic and most popular web page.
- 7. --------- --------- --------- ----- Search Engine based computer system Search Engine Spider goes out for checking Spider finds homepage it reads its head section of the page looking for Next spider reads content find the links and follows previous procedures