Safari, the world’s most comprehensive technology and business learning platform.

Find the exact information you need to solve a problem on the fly, or go deeper to master the technologies and skills you need to succeed

Start Free Trial

No credit card required

O'Reilly logo
Getting Started with Greenplum for Big Data Analytics

Book Description

A hands-on guide on how to execute an analytics project from conceptualization to operationalization using Greenplum

  • Explore the software components and appliance modules available in Greenplum

  • Learn core Big Data Architecture concepts and master data loading and processing patterns

  • Understand Big Data problems and the Data Science lifecycle

In Detail

Organizations are leveraging the use of data and analytics to gain a competitive advantage over their opposition. Therefore, organizations are quickly becoming more and more data driven. With the advent of Big Data, existing Data Warehousing and Business Intelligence solutions are becoming obsolete, and a requisite for new agile platforms consisting of all the aspects of Big Data has become inevitable. From loading/integrating data to presenting analytical visualizations and reports, the new Big Data platforms like Greenplum do it all. It is now the mindset of the user that requires a tuning to put the solutions to work.

"Getting Started with Greenplum for Big Data Analytics" is a practical, hands-on guide to learning and implementing Big Data Analytics using the Greenplum Integrated Analytics Platform. From processing structured and unstructured data to presenting the results/insights to key business stakeholders, this book explains it all.

"Getting Started with Greenplum for Big Data Analytics" discusses the key characteristics of Big Data and its impact on current Data Warehousing platforms. It will take you through the standard Data Science project lifecycle and will lay down the key requirements for an integrated analytics platform. It then explores the various software and appliance components of Greenplum and discusses the relevance of each component at every level in the Data Science lifecycle.

You will also learn Big Data architectural patterns and recap some key advanced analytics techniques in detail. The book will also take a look at programming with R and integration with Greenplum for implementing analytics. Additionally, you will explore MADlib and advanced SQL techniques in Greenplum for analytics. This book also elaborates on the physical architecture aspects of Greenplum with guidance on handling high-availability, back-up, and recovery.

Table of Contents

  1. Getting Started with Greenplum for Big Data Analytics
    1. Table of Contents
    2. Getting Started with Greenplum for Big Data Analytics
    3. Credits
    4. Foreword
    5. About the Author
    6. Acknowledgement
    7. About the Reviewers
      1. Support files, eBooks, discount offers and more
        1. Why Subscribe?
        2. Free Access for Packt account holders
        3. Instant Updates on New Packt Books
    9. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Errata
        2. Piracy
        3. Questions
    10. 1. Big Data, Analytics, and Data Science Life Cycle
      1. Enterprise data
        1. Classification
        2. Features
      2. Big Data
        1. So, what is Big Data?
        2. Multi-structured data
      3. Data analytics
      4. Data science
        1. Data science life cycle
          1. Phase 1 – state business problem
          2. Phase 2 – set up data
          3. Phase 3 – explore/transform data
          4. Phase 4 – model
          5. Phase 5 – publish insights
          6. Phase 6 – measure effectiveness
      5. References/Further reading
      6. Summary
    11. 2. Greenplum Unified Analytics Platform (UAP)
      1. Big Data analytics – platform requirements
      2. Greenplum Unified Analytics Platform (UAP)
        1. Core components
          1. Greenplum Database
          2. Hadoop (HD)
          3. Chorus
          4. Command Center
        2. Modules
          1. Database modules
          2. HD modules
          3. Data Integration Accelerator (DIA) modules
        3. Core architecture concepts
          1. Data warehousing
          2. Column-oriented databases
          3. Parallel versus distributed computing/processing
          4. Shared nothing, massive parallel processing (MPP) systems, and elastic scalability
            1. Shared disk data architecture
            2. Shared memory data architecture
            3. Shared nothing data architecture
          5. Data loading patterns
      3. Greenplum UAP components
        1. Greenplum Database
          1. The Greenplum Database physical architecture
          2. The Greenplum high-availability architecture
          3. High-speed data loading using external tables
          4. External table types
          5. Polymorphic data storage and historic data management
          6. Data distribution
        2. Hadoop (HD)
          1. Hadoop Distributed File System (HDFS)
          2. Hadoop MapReduce
        3. Chorus
      4. Greenplum Data Computing Appliance (DCA)
      5. Greenplum Data Integration Accelerator (DIA)
      6. References/Further reading
      7. Summary
    12. 3. Advanced Analytics – Paradigms, Tools, and Techniques
      1. Analytic paradigms
        1. Descriptive analytics
        2. Predictive analytics
        3. Prescriptive analytics
      2. Analytics classified
        1. Classification
        2. Forecasting or prediction or regression
        3. Clustering
        4. Optimization
        5. Simulations
      3. Modeling methods
        1. Decision trees
        2. Association rules
          1. The Apriori algorithm
        3. Linear regression
        4. Logistic regression
        5. The Naive Bayesian classifier
        6. K-means clustering
        7. Text analysis
      4. R programming
      5. Weka
      6. In-database analytics using MADlib
      7. References/Further reading
      8. Summary
    13. 4. Implementing Analytics with Greenplum UAP
      1. Data loading for Greenplum Database and HD
        1. Greenplum data loading options
          1. External tables
          2. gpfdist
          3. gpload
        2. Hadoop (HD) data loading options
          1. Sqoop 2
          2. Greenplum BulkLoader for Hadoop
        3. Using external ETL to load data into Greenplum
          1. Extraction, Load, and Transformation (ELT) and Extraction, Transformation, Load, and Transformation (ETLT)
          2. Greenplum target configuration
          3. Sourcing large volumes of data from Greenplum
          4. Unsupported Greenplum data types
          5. Push Down Optimization (PDO)
      2. Greenplum table distribution and partitioning
        1. Distribution
          1. Data skew and performance
          2. Optimizing the broadcast or redistribution motion for data co-location
        2. Partitioning
        3. Querying Greenplum Database and HD
        4. Querying Greenplum Database
          1. Analyzing and optimizing queries
            1. The ANALYZE function
            2. The EXPLAIN function
        5. Dynamic Pipelining in Greenplum
        6. Querying HDFS
          1. Hive
          2. Pig
        7. Data communication between Greenplum Database and Hadoop (using external tables)
      3. Data Computing Appliance (DCA)
        1. Storage design, disk protection, and fault tolerance
          1. Master server RAID configurations
          2. Segment server RAID configurations
        2. Monitoring DCA
      4. Greenplum Database management
      5. In-database analytics options (Greenplum-specific)
        1. Window functions
          1. The PARTITION BY clause
          2. The ORDER BY clause
          3. The OVER (ORDER BY…) clause
          4. Creating, modifying, and dropping functions
        2. User-defined aggregates
      6. Using R with Greenplum
        1. DBI Connector for R
        2. PL/R
      7. Using Weka with Greenplum
      8. Using MADlib with Greenplum
      9. Using Greenplum Chorus
      10. Pivotal
      11. References/Further reading
      12. Summary
    14. Index