Working of search engine
How Search Engine Works
Search engine are not humans. Search engines are text driven. Search engine crawl the web, looking at particular site items mainly text to get an idea what a site is about. Search engine perform many task on your website.
Spider First search engine crawl the web to see what is there, by piece of software called crawler or a spider [Googlebot as the case with Google]. Spider follows links from one page to another page and index everything they find on their way. It is impossible for a spider to visit a site daily just to see if a new page is appeared or if any existing page has been modified. some time spider or crawlers will not visit site for a month or two, so during this time your seo efforts will not be rewarded.
Indexing: After the page is crawled, next step is to index its content. The indexed pages are stored in a giant database, from where it can be retrieved later. The process of indexing is identifying the words and expressions that best describe the web page and assigning the page to particular keyword or key phrases.
Here i will give you all steps which is perform by search engine.
- Crawling
- Indexing
- Calculating Relevancy
- Retrieving Results
Crawling
First search crawl the page to see what things is there. Process of fetching all the web pages linked to a website. This task is performed by a software, called a crawler or a spider (or Googlebot, in case of Google).
Spiders follow links from one page to another and index everything they find on their way. You need to know if your website have over 20,000 pages in that case it is not possible to view all the page daily by spider it just visit on new page and modified existing page. One more things spider or cralwer is not a human it never seen images, flash, movies, JavaScript code on your website.
Indexing
After a page is crawled, the next step is to index its content. Process of creating index for all the fetched web pages and keeping them into a giant database from where it can later be retrieved.
Processes
When a search request comes, the search engine processes it, i.e. it compares the search string in the search request with the indexed pages in the database.
Calculating Relevancy
It is likely that more than one page contains the search string, so the search engine starts calculating the relevancy of each of the pages in its index to the search string.
Retrieving Results
The last step in search engine activities is retrieving the best matched results. Basically, it is nothing more than simply displaying them in the browser.