Application configuration

We are now ready to start developing our end-to-end stream processing pipeline! First, let's create a configuration file in Python that will store all environmental and application-level options pertinent to our pipeline and local development node, as follows:

The following Python configuration file, called config.py, can be found in the GitHub repository accompanying this book.
#!/usr/bin/python""" config.py: Environmental and Application Settings """""" ENVIRONMENT SETTINGS """# Apache Kafkabootstrap_servers = '192.168.56.10:9092'data_encoding = 'utf-8'""" TWITTER APP SETTINGS """consumer_api_key = 'Enter your Twitter App Consumer API Key here'consumer_api_secret = 'Enter your Twitter App Consumer API Secret Key ...

Get Machine Learning with Apache Spark Quick Start Guide now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.