Setting up Kinesis Firehose

We will focus on the Kinesis Firehose service, which offers two important features: data received can be fed to an AWS Lambda function for extra processing, and the resulting data can be stored on S3 or on a Redshift database.

We will start by setting up a Kinesis Firehose delivery stream that stores data on S3 without any Lambda functionality:

  1. Go to the Kinesis Firehose dashboard at https://console.aws.amazon.com/firehose/ and click on Create Delivery Stream.
  2. Fill in the following fields:
    • Destination: Amazon S3
    • Delivery stream name: veggieTweets (or choose your own name)
    • S3 bucket: aml.packt
    • S3 prefix: veggies
  3. Click on Next:

Note that the S3 prefix field corresponds to a folder in your S3 bucket. You should ...

Get Effective Amazon Machine Learning now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.