Python Web Scraping Cookbook

Getting ready

First make sure you have access to a PostgreSQL data instance.  Again, you can install one locally, run one in a container, or get an instance in the cloud.

As with MySQL, we need to first create a database. The process is almost identical to that of MySQL but with slightly different commands and parameters.

1. From the terminal execute the psql command at the terminal.  This takes you into the psql command processor:

# psql -U postgrespsql (9.6.4)Type "help" for help.postgres=# 

2. Now create the scraping database:

postgres=# create database scraping;CREATE DATABASEpostgres=#

3. Then switch to the new database:

postgres=# \connect scrapingYou are now connected to database "scraping" as user "postgres".scraping=# 

4. Now we can create ...