Webbots, Spiders, and Screen Scrapers, 2nd Edition

Further Exploration

Here are some other ways to leverage the techniques you learned in this chapter.

• Design another search-ranking webbot to examine the paid advertising listings instead of the organic listings.

• Write a similar webbot to run daily over a period of many days to measure how changing a web page’s meta tags or content affects the page’s search engine ranking.

• Design a webbot that examines web page rankings using a variety of search terms.

• Use the techniques explained in this chapter to examine how search rankings differ from search engine to search engine.