How it works

When you create a FormRequest, your are instructing Scrapy to construct a form POST request on behalf of your process, using the data in the specified dictionary as the form parameters in the POST request. It constructs this request and sends it to the server.  Upon receipt of the answer in that POST, it calls the specified callback function.

Get Python Web Scraping Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.