Integrating the REST API with scraping code

In this recipe, we will integrate code that we wrote for scraping and getting a clean job listing from StackOverflow with our API.  This will result in a reusable API that can be used to perform on-demand scrapes without the client needing any knowledge of the scraping process.  Essentially, we will have created a scraper as a service, a concept we will spend much time with in the remaining recipes of the book.

Get Python Web Scraping Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.