Summary
Interacting with forms is a necessary skill when scraping web pages. This chapter covered two approaches: first, analyzing the form to generate the expected POST request manually, and second, using the high-level Mechanize module.
In the following chapter, we will expand our form skillset and learn how to submit forms that require passing CAPTCHA.
Get Web Scraping with Python now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
