There's more..

ffmpeg is an incredibly versatile and power tool.  A scraper I once created would crawl and find media (actually, commercials played on websites), and store them in a digital archive.  The scraper would then send a message through a message queue that would be picked up by a farm of servers whose only job was to run ffmpeg to convert the video into many different formats, bit rates, and also create thumbnails. From that point, more messages would be sent to auditor to use a front end application to check the content for compliance to advertising contract terms.  Get to know ffmeg, it is a great tool.

Get Python Web Scraping Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.