Summary

In this chapter, we have discussed the architecture of Kinesis for processing real-time data feeds. We have explored/developed producers and consumers of Kinesis streams using the AWS APIs. At the end, we also talked about the higher level APIs, such as KPL and KCL, as recommended mechanisms for creating Kinesis producers and consumers, along with their samples.

In the next chapter, we will talk about Apache Spark, which has revolutionized the industry by introducing a new paradigm for batch and real-time data processing.

Get Real-Time Big Data Analytics now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.