If you need your site listed in search results, you need your site being indexed by search engines. Therefore, timely and thorough indexing of your site is a key condition to success of your online business.
Site Indexing can be done in two general ways. First: submission of your site to search engines directly. Second, getting a robot of search engine to crawl over your pages and indexing them. It can find your site using links from other pages. Thus, although straightforward submission seem like a good idea, your site may get better weight in the engine rating, if it will be visited from a link of another site. Clearly, if someone links to your site, therefore, it is useful.
The terms of site indexing vary from couple days to a month(s). It is a proven fact that having several links from sites with high PR substantially accelerate indexing. The fastest indexer on the web today is Google.
Indexing of newly added pages happens faster, if the site having a frequent updates. In such case engines may consider such fast growing/updating sites up-to-date and useful for users, and hence, assign them some priority on indexing.
Here are several factors, which should be taken into account for faster indexing:
- The distance between your main page and any other page of your site shall not exceed three clicks;
- Build a map of your site, link your front page to that map;
- Try not to make pages larger than 200 kB: crawlers rarely go deeper than that size.
- It is better to avoid parametrically complicated URLs in your links, such links slow down indexing. Use links which can be easily read by humans.
- Indexing instructions can be made with the aid of robots.txt file, use it.
The progress in indexing of your web site can be checked in logs of your site host or by direct inquiry to search engines. Dont be surprised by fluctuations in number of indexed pages in your site: this can happen for several reasons: server or referrers could be down, or, perhaps, search engine changed its algorithm.