Does Google Index all Websites on the Internet?

I got curious about this question when I started my blog, and was one of the first things I researched on how to get my site index on Google as soon as possible, I am by no means an expert on Search Engines, this is just a tip for someone planning to create a website or a blog and is wondering how to get the site into Google Index.

Probably no one knows how many sites are there on the Internet, some people estimate that around 4 million sites are created every month (for those that love the competition that’s a cool figure) although Google probably would love to snatch all these sites into their index some of them won’t make it (look at john chow for example*) the first is that some of the webmasters for some reason don’t want their sites to get index so they setup a script to tell search engines crawlers to stay out of their sites. Another reason why sites don’t get indexed is because owners set a password to get to the site, when the crawlers come they only get to index the login page but nothing of the content on the site itself.

I found out (by Friends) that blogs on Wordpress get index on Google fairly quick without doing anything rather than just creating the blog, but to speed up the process and possibilities of your blog getting index quicker is to submit it to the Open Directory Project http://www.dmoz.org/index.html Google also has their own way to submit a site to their index at http://www.google.com/addurl/ after submitting the site to these services you can check if you site is on Google Index by typing site:examplesite.com. on Google Search bar

Another good thing to do is to create a sitemap to make it easier to the crawlers to find your site, I actually was able to fix some problems I had with my site using a sitemap, the problem was because I use Windows hosting I didn’t have a .htaccess file and my site was being seen by the crawlers as duplicate www.helpdeskgeek.com and http://helpdeskgeek.com were not the same, without a .htaccess file I didn’t know how to fix that, when I created the sitemap it was easy to tell Google that I wanted my site to be indexed as http://helpdeskgeek.com all the time, you can generate a sitemap automatically at http://www.sitemapspal.com/ is the one I used to create mine, you only need to save it and uploaded to your FTP site then go www.google.com/webmasters/sitemaps/ and login with your g-mail account, and Google will tell you how to authenticate your site to use the sitemap, is pretty cool to have a webmaster account on Google to see how your site is doing.

Another thing that I found and I actually went nut doing it when I started this blog was adding my site to every free blog directory out of there, I was getting no traffic from it, so I removed the links I had pointing to them, many people might have different opinion on this but I believe they are useless. Please share your thoughts on this so everyone of us can learn something from each other, thus we can build a stronger community.

* Johhn chow is still on Google index but he doesn’t rank # 1 even with his on name, somehow Google doesn’t like him.