How Do I get More Pages Indexed in Google?
We get asked this fairly regularly. So, how do you get more pages indexed in Google? Here we go. Over simplified i know but it makes it easier to understand.
OK, so the world wide is is large. Very large in fact and even the great Googel is not 100% sure just how big it is. In fact, most of the internet is utter tripe and worthless junk. Google therefore only indexes a portion of the web. It does have the money of course to buy additional computers but is it really wrth the time, effort and bandwidth it would take to index pages that are essentially junk? This is where Google’s content duplication checking comes into play but that’s a whole different article. Google is in fact believed to have the largest crawling and indexing facilities at present.
Googlebots go out and pull down web pages and then analyse the contents of that page and stores a representation of that webpage in Google large database index. The index is not a complete copy of the internet. It is a representation of the better pages on the internet. From that index PageRank is calculated and the algorithms determine the search results. The only pages that can show up when a user performs a search query are the pages included in Googles index. If your page is not included in the index then it will not show for a particular search term.
Becasue therefore, the web as a whole is much larger than the database index Google has to make a decision on what webpages it will spider and from there what it will index. If Google indexed every webpage that it was aware of it would take up far too much processing power and resources used to currently update news pages and current affair websites. Therefore, Google does not index every webpage it knows about.
So, How do i get more pages indexed by Google?
Google has limited resources so cannot index the whole internet. So, how do you get more pages indexed? How does Google look towards allocating resources across the internet and the webpages? Google does have a large but ultimately limited range of url’s that it can index. Therefore, it if in a webmasters interets to make taht job as easy as possible for Googlebot. The easier the job you make for Googlebot the more likely it will send a bit of time on your website.
It is generally believed that Google will index a site better if that website has a higher PageRank. If you have a few pages and they are all a decent PageRank they will get into the index no problem. However, the problem arises when you have many webpages with very low Pagerank. These pages can even fall into the supplemental index.
Clean Code Helps
Ensuring that you have clean HTML code and that there is not lots if internal javascript or flash menus etc that can impede a spiders accessibility is a great way to ensure you get spidered and indexed. Reducing any ‘white niose’ from your web pages also increases download speeds and decreases bandwidth usage.
Duplicate Content
Search engine marketeers pay a lot of attention to duplicate content, link building, increasing PageRank (though the latter is not as important now for a purely ranking factor) and improving link struture through internal navigation. By improving link structure a webmaster can start to spread out PageRank throughout the website. However, from a personal point i think that quality of code is paramount in creating a search engine friendly website.
Increasing Page rank to improve Indexing
Probably the most important factor in getting your website to be indexed more by Google is to increase PageRank which in turn is increased through global link popularity of your website. The best way to achieve this is by getting links from other high PageRank websites. This will be dicussed in greater depth at another point.