Keeping Visitors Away

Search engines employ little programs called robots or spiders to hang out on the Web and look for new pages to add to the engine’s index. But sometimes, you don’t want search engines to know your page exists. Perhaps it’s a personal page designed only for your family or an internal page for your company. You can add information to the page so that most search engine robots will stay out.

To keep search engine robots out:

1.
In the head section of your page, type <meta name="robots" content=".
2.
If desired, type noindex to keep the robot from adding the page to its index.
3.
If desired, type nofollow to keep the robot from following the links on the page and indexing those pages.
4.
Type " /> to complete the tag.

Get HTML, XHTML, & CSS, Sixth Edition: Visual QuickStart Guide now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.