Working of search engine
How Search Engine Works
Search engine perform many task on your website; here i will give you all steps which is perform by search engine.
- Crawling
- Indexing
- Calculating Relevancy
- Retrieving Results
Crawling
First search crawl the page to see what things is there. Process of fetching all the web pages linked to a website. This task is performed by a software, called a crawler or a spider (or Googlebot, in case of Google).
Spiders follow links from one page to another and index everything they find on their way. You need to know if your website have over 20,000 pages in that case it is not possible to view all the page daily by spider it just visit on new page and modified existing page. One more things spider or cralwer is not a human it never seen images, flash, movies, JavaScript code on your website.
Indexing
After a page is crawled, the next step is to index its content. Process of creating index for all the fetched web pages and keeping them into a giant database from where it can later be retrieved.
Processes
When a search request comes, the search engine processes it, i.e. it compares the search string in the search request with the indexed pages in the database.
Calculating Relevancy
It is likely that more than one page contains the search string, so the search engine starts calculating the relevancy of each of the pages in its index to the search string.
Retrieving Results
The last step in search engine activities is retrieving the best matched results. Basically, it is nothing more than simply displaying them in the browser.