Crawling and Indexing
- 3. In the simplest terms, you could think of searching the web as looking in a very large book with an impressive index telling you exactly where everything is located. When we perform a Google search, Google programs check their index to determine the most relevant search results. There are three process in delivering search results. 1. Crawling – Does Google know about your site and find it. 2. Indexing – Can Google index your site. 3. Serving – Does the site have good and useful content that is relevant to search users.
- 4. CRAWLING Crawling is the process of fetching all the web pages linked with a website. This task is performed by a software called crawler. The crawlers are also known as spiders or bots , they visit website and send information to their respective parent websites.
- 5. INDEXING Indexing is the process of creating index for all the fetched web pages and keeping them into a huge database from where it can later be retrieved. An index is another name for the database used by a search engines. It contains information on all the websites the search engine was able to find. If a website is not in a search engine’s index, users will not be able to find it using that search engine. Search engines regularly update their indexes.
- 6. Difference between Indexing and Crawling Crawling is the process through which indexing is done. Google crawlers crawls through the WebPages and index the pages. When search engine crawlers visit any link is called crawling and when crawlers save or index that links in search engine database is called indexing.
- 7. Crawling means to visit the link by Search engines and indexing means to put the page contents in Database (after analysis) and make them available in search results when a request is made. Crawling means the search engine robot crawl or fetch the web pages while Indexing means search engine robot crawl the web pages, saved the information and it appear in the search engine.
- 8. THANK YOU