It was three years before when I started my SEO career, and as everybody else I went through SEO forums and Blogs and read a lot of stuff, and tried to implement any SEO technique that looks effective and recommended by experts, that time I was fond of this SEO statement that says "When it comes to search engine optimization, content is king", yes everybody believe that search engines are fresh obsessed.

So I put a plan to create a Blog for my site and feed it with fresh topics on daily basis, and I had been going through all pages on my sites and changeed them on monthly basis to make them look fresh in the eye of search engines, and also checked my keyword density in may pages and topics trying to make a perfect meal for search engines its recipes titles contain my keywords, optimized meta tags and optimized body with good keyword density (No keyword spamming).

I kept doing that for about six months, while keep tracking the statistics of my sites on daily basis waiting the traffic to blast on my site, but six months without any significant changes in the traffic, in those six months I had added about two thousands unique content pages to my site all of them well optimized, hoped that search engines should reward me with some traffic, but that didn't happen.

I went back to forums asking and trying to get some new ideas, till some body told me that Google just indexed 200 pages of my site, yes he was right, I tried myself the command site:yoursite.com and it returned just 200 pages. Google PR for my site was 2 that time and I though it was enough to get Goolge to crawl deep in my site and index its entire pages, but the truth was that it was not enough especially with lacking of good internal linking and site map.

So now I need to tell you that in my point of view that "When it comes to search engine optimization, deep crawling is king" yes because all of your efforts adding content to your site will be blown if search engines don't deeply crawl your site.

So now let me tell you some good techniques those help your site to get the deep crawling:

-Try to get a good page rank for your site, with Google you can check your page rank through Google tool bar try to get PR4+, other search engines don't have way to know the page rank of your website but there is a good command you can use to know the inbound links for your website link:yoursite the more inbound links your site has the more good ranking it gets, so in other words get as much as you can inbound links from quality websites referring your website.

-Create easy navigation scheme with as less levels as possible and try to link your main pages from your homepage, it is also good to have a site map for your site.

Remember always to check that search engines deeply go through your site and index its entire content before spend any extra time and money to create new content.