Apache Flume architecture

The following diagram depicts the architecture of Apache Flume:

Let's take a closer look at the components of the Apache Flume architecture:

  • Event: An event is a byte payload with optional string headers. It represents the unit of data that Flume can carry from its source to destination.
  • Flow: The transport of events from source to destination is considered a data flow, or just flow.
  • Agent: It is an independent process that hosts the components of Flume, such as sources, channels, and sinks. It thus has the ability to receive, store, and forward events to its next-hop destination.
  • Source: The source is an interface ...

Get Modern Big Data Processing with Hadoop now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.