How to do it

We will be extending the API code.  We will make two fundamental changes to the implementation of the API.  The first is that we will add an additional Flask-RESTful  API implementation for the search capability, and the second is that we will make addresses for both Elasticsearch and our own microservice configurable by environment variables.

The API implementation is in 11/04_scraper_api.py.   By default, the implementation attempts to connect to Elasticsearch on the local system.  If you are using Elastic Cloud, make sure to change the URL (and make sure you have documents in the index):

  1. The API can be started by simply executing the script:
$ python scraper_api.pyStarting the job listing API ... * Running on http://0.0.0.0:8080/ ...

Get Python Web Scraping Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.