Asynchronous processing of Twitter streams

Twitter is an excellent source of random data. Given the volume and variety of data, we can readily come up with example (and real) problems to solve. In our case, we're going to build a serverless processing system by sipping off the public twitter stream. Our example system will  have the following workflow:

  1. Read a tweet with cat or dog images from the Twitter firehose
  2. Place messages on an SQS queue.
  3. Worker processes will read those image URLs off the queue and perform image recognition.

While this example can be a bit contrived, the concepts demonstrated are true to life. We'll use the AWS Rekognition service to perform image recognition and labeling of any cat or dog images we find. Rekognition ...

Get Serverless Design Patterns and Best Practices now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.