Final Thoughts
Studying browser limitations is one way to uncover ideas for new webbot designs. You’ve seen some real-world examples of webbots in use and read some descriptions of conceptual webbot designs. But, enough with theory—let’s head to the lab!
The next five chapters describe the basics of webbot development: downloading pages, parsing data, emulating form submission, and managing large amounts of data. Once you master these concepts, you can move on to actual webbot projects.
Get Webbots, Spiders, and Screen Scrapers, 2nd Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
