Technology stack
For the preceding solution, we would need to use various technologies. The details are as follows.
Kafka
Kafka is a publish-subscribe messaging service. It is distributed, reliable, durable, fast, and scalable by design. It gives us the ability to create topics and publish messages to them. We can then define the subscribers to these topics in order to start consuming these messages. More on Kafka at http://kafka.apache.org/.
Flume
Flume is a reliable, distributed system, designed to effectively collect and aggregate data from various systems. In our solution, we are going to use Flume to get data from Kafka and write it to HDFS and Open TSDB simultaneously. More on Flume at http://flume.apache.org/. We will be learning more about ...
Get Hadoop Blueprints now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
