Google’s Importance to Webmasters

But isn’t Google just a search engine web site like any other? Actually, its reach is far greater than that. Google partners with other sites to use the Google index results, including the likes of heavyweight properties AOL and Yahoo!. Not to mention the multitude of sites out there making use of the Google API. So when you think about potential visitors from Google’s search results, you have to think beyond traditional search site borders.

It’s becoming ever more important what Google thinks of your site. That means you’re going to be sure that your site abides by the Google rules or risk not being picked up. If you’re very concerned about search engine traffic, you’re going to have to make sure that your site is optimized for luring in Google’s spiders and being indexed in an effective manner. And if you’re concerned that Google should not index some parts of your site, you need to understand the ins and outs of configuring your robots.txt file to reflect your preferences.

Get Google Hacks now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.