Sources, channels, and sinks

The Flume agent's architecture can be viewed in this simple diagram. Inputs are called sources and outputs are called sinks. Channels provide the glue between sources and sinks. All of these run inside a daemon called an agent.

Sources, channels, and sinks

Note

Keep in mind:

  • A source writes events to one or more channels.
  • A channel is the holding area as events are passed from a source to a sink.
  • A sink receives events from one channel only.
  • An agent can have many channels.

Get Apache Flume: Distributed Log Collection for Hadoop - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.