Chapter 25. Deployment and Scaling
All of the webbots discussed so far are small in scale, meaning they can be implemented with a single agent running on a single computer. However, as the scope of your projects grows, it is often necessary to develop webbots that scale to the size of the project. Proper scaling involves adding capacity to your webbot while not doing anything that could compromise your webbot’s ability to achieve its task.
Capacity, in this sense, may refer to either the ability to do more in less time or the ability to do the same amount of work, replicated many times, over a long period.
The question that quickly arises while scaling webbots is “How do you add capacity to a webbot without also requiring more capacity from the ...
Get Webbots, Spiders, and Screen Scrapers, 2nd Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
