Learning Kibana 5.0

Learning Kibana 5.0

by Bahaaldine Azarmi
Released February 2017
Publisher(s): Packt Publishing
ISBN: 9781786463005

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Exploit the visualization capabilities of Kibana and build powerful interactive dashboards

About This Book

  • Introduction to data-driven architecture and the Elastic stack
  • Build effective dashboards for data visualization and explore datasets with Elastic Graph
  • A comprehensive guide to learning scalable data visualization techniques in Kibana

Who This Book Is For

If you are a developer, data visualization engineer, or data scientist who wants to get the best of data visualization at scale then this book is perfect for you. A basic understanding of Elasticsearch and Logstash is required to make the best use of this book.

What You Will Learn

  • How to create visualizations in Kibana
  • Ingest log data, structure an Elasticsearch cluster, and create visualization assets in Kibana
  • Embed Kibana visualization on web pages
  • Scaffold, develop, and deploy new Kibana & Timelion customizations
  • Build a metrics dashboard in Timelion based on time series data
  • Use the Graph plugin visualization feature and leverage a graph query
  • Create, implement, package, and deploy a new custom plugin
  • Use Prelert to solve anomaly detection challenges

In Detail

Kibana is an open source data visualization platform that allows you to interact with your data through stunning, powerful graphics. Its simple, browser-based interface enables you to quickly create and share dynamic dashboards that display changes to Elasticsearch queries in real time.

In this book, you'll learn how to use the Elastic stack on top of a data architecture to visualize data in real time. All data architectures have different requirements and expectations when it comes to visualizing the data, whether it's logging analytics, metrics, business analytics, graph analytics, or scaling them as per your business requirements. This book will help you master Elastic visualization tools and adapt them to the requirements of your project.

You will start by learning how to use the basic visualization features of Kibana 5. Then you will be shown how to implement a pure metric analytics architecture and visualize it using Timelion, a very recent and trendy feature of the Elastic stack. You will learn how to correlate data using the brand-new Graph visualization and build relationships between documents. Finally, you will be familiarized with the setup of a Kibana development environment so that you can build a custom Kibana plugin.

By the end of this book you will have all the information needed to take your Elastic stack skills to a new level of data visualization.

Style and approach

This book takes a comprehensive, step-by-step approach to working with the visualization aspects of the Elastic stack. Every concept is presented in a very easy-to-follow manner that shows you both the logic and method of implementation. Real world cases are referenced to highlight how each of the key concepts can be put to practical use.

Table of contents

  1. Learning Kibana 5.0
    1. Learning Kibana 5.0
    2. Credits
    3. About the Author
    4. About the Reviewers
    5. www.PacktPub.com
      1. Why subscribe?
    6. Customer Feedback
    7. Dedication
    8. Preface
      1. What this book covers 
      2. What you need for this book 
      3. Who this book is for 
      4. Conventions 
      5. Reader feedback
      6. Customer support
        1. Downloading the example code 
        2. Downloading the color images of this book
        3. Errata
        4. Piracy
        5. Questions
    9. 1. Introduction to Data-Driven Architecture
      1. Industry challenges
        1. Use cases
        2. Fundamental steps
          1. Data shipping
          2. Data ingest
          3. Storing data at scale
          4. Visualizing data
        3. Technologies limits
          1. Relational databases
          2. Hadoop
          3. NoSQL
      2. Overview of the Elastic stack
        1. Elasticsearch
        2. Beats
        3. Logstash
        4. Kibana
        5. X-Pack
          1. Security
          2. Monitoring
          3. Alerting
          4. Graph
          5. Reporting
      3. Summary
    10. 2. Installing and Setting Up Kibana 5.0
      1. Setting up your installation
        1. Downloading the software
        2. Installing Elasticsearch
        3. Installing Kibana
        4. Installing X-Packs
        5. Configuring security
      2. Kibana anatomy
        1. Core components
          1. Discover
          2. Visualize
          3. Dashboard
          4. Timelion
          5. Management
          6. DevTools/Console
        2. Plugins
          1. DevTools/Profiler
          2. Monitoring
          3. Graph
      3. Summary
    11. 3. Business Analytics with Kibana 5.0
      1. Business use case - Paris accidentology
        1. Data modeling - entity-centric documents
        2. Importing data
          1. Using Logstash
            1. Configuring the input - file
            2. Setting the filters
            3. Configuring the output - Elasticsearch
        3. Building the dashboard
          1. Understanding the mechanics of a Kibana visualization with a line chart -  the accident timeline
          2. Bar chart - top accident streets
          3. Pie chart - vehicle breakdown
          4. Area chart - victim status
          5. Tile map - accident data over a map
        4. Asking questions of your data
          1. How to enhance the bicycle experience in Paris?
          2. What are the most dangerous streets in Paris, and why?
      2. Summary
    12. 4. Logging Analytics with Kibana 5.0
      1. Technical use case - Apache server logs
        1. Importing data in Console
        2. Importing the dashboard
        3. Understanding the dashboard
          1. Markdown - notes in dashboard
          2. Metrics - logs overview
          3. Bar chart - response code over time
          4. Area chart - bandwidth by country
          5. Data table - requests by agent
          6. Data table - top requested resources
          7. Pie chart - significant countries by response
          8. Tile map - hits per country
        4. Asking the data a question
          1. Bandwidth analysis
          2. Security analysis
      2. Summary
    13. 5. Metric Analytics with Metricbeat and Kibana 5.0
      1. Technical use case - system monitoring with Metricbeat
      2. Getting started with Metricbeat
        1. Metricbeat installation
        2. Configuring and running Metricbeat
      3. Metricbeat in Kibana
        1. Importing the dashboard
        2. Visualizing metrics
      4. Metricbeat in Timelion
        1. Analyzing the max CPU utilization over time
        2. Using X-Pack alerting
      5. Summary
    14. 6. Graph Exploration in Kibana
      1. Introducing the basics of Elastic Graph
        1. How Elastic Graph is different from other graph technologies out there
      2. Exploring the Stack Overflow dataset with Elastic Graph
        1. Prepare to graph!
        2. The data structure
        3. Simple exploration
        4. Advanced exploration
          1. Disabling significant links
          2. Multi-term graph exploration
          3. Advanced drill-downs
      3. Summary
    15. 7. Customizing Kibana 5.0 Timelion
      1. Diving into Timelion code
        1. Understanding the Kibana plugin structure
        2. Using Timelion functions
      2. When Google Analytics meets the lion
        1. Setting up our development environment
        2. Verifying our installation
        3. Setting up our Google API account
        4. Verifying our configuration
        5. Walking through the implementation
          1. google_utils.js
          2. ganalytics.js
      3. Plugin release management
        1. Tagging our code base and creating a release
      4. Summary
    16. 8. Anomaly Detection in Kibana 5.0
      1. Understanding the concept of anomaly detection
        1. Understanding human limits with regard to data visualization
        2. Understanding the limits of traditional anomaly detection
        3. Understanding how Prelert solves anomaly detection
      2. Using Prelert for operational analytics
        1. Setting up Prelert
        2. Creating a Prelert job
      3. Combining Prelert, alerting, and Timelion
        1. Visualizing anomaly results in Timelion
        2. Scheduling anomaly detection reports with Reporting
      4. Summary
    17. 9. Creating a Custom Plugin for Kibana 5.0
      1. Creating a plugin from scratch
        1. Yeoman - the plugin scaffolder
        2. Verifying our installation
      2. A plugin to render Elasticsearch topology
        1. Walking through topology implementation
          1. Server code
          2. Public code
        2. Plugin installation
      3. Summary

Product information

  • Title: Learning Kibana 5.0
  • Author(s): Bahaaldine Azarmi
  • Release date: February 2017
  • Publisher(s): Packt Publishing
  • ISBN: 9781786463005