You are previewing Taming The Big Data Tidal Wave: Finding Opportunities in Huge Data Streams with Advanced Analytics.
O'Reilly logo
Taming The Big Data Tidal Wave: Finding Opportunities in Huge Data Streams with Advanced Analytics

Book Description

You receive an e-mail. It contains an offer for a complete personal computer system. It seems like the retailer read your mind since you were exploring computers on their web site just a few hours prior....

As you drive to the store to buy the computer bundle, you get an offer for a discounted coffee from the coffee shop you are getting ready to drive past. It says that since you're in the area, you can get 10% off if you stop by in the next 20 minutes....

As you drink your coffee, you receive an apology from the manufacturer of a product that you complained about yesterday on your Facebook page, as well as on the company's web site....

Finally, once you get back home, you receive notice of a special armor upgrade available for purchase in your favorite online video game. It is just what is needed to get past some spots you've been struggling with....

Sound crazy? Are these things that can only happen in the distant future? No. All of these scenarios are possible today! Big data. Advanced analytics. Big data analytics. It seems you can't escape such terms today. Everywhere you turn people are discussing, writing about, and promoting big data and advanced analytics. Well, you can now add this book to the discussion.

What is real and what is hype? Such attention can lead one to the suspicion that perhaps the analysis of big data is something that is more hype than substance. While there has been a lot of hype over the past few years, the reality is that we are in a transformative era in terms of analytic capabilities and the leveraging of massive amounts of data. If you take the time to cut through the sometimes-over-zealous hype present in the media, you'll find something very real and very powerful underneath it. With big data, the hype is driven by genuine excitement and anticipation of the business and consumer benefits that analyzing it will yield over time.

Big data is the next wave of new data sources that will drive the next wave of analytic innovation in business, government, and academia. These innovations have the potential to radically change how organizations view their business. The analysis that big data enables will lead to decisions that are more informed and, in some cases, different from what they are today. It will yield insights that many can only dream about today. As you'll see, there are many consistencies with the requirements to tame big data and what has always been needed to tame new data sources. However, the additional scale of big data necessitates utilizing the newest tools, technologies, methods, and processes. The old way of approaching analysis just won't work. It is time to evolve the world of advanced analytics to the next level. That's what this book is about.

Taming the Big Data Tidal Wave isn't just the title of this book, but rather an activity that will determine which businesses win and which lose in the next decade. By preparing and taking the initiative, organizations can ride the big data tidal wave to success rather than being pummeled underneath the crushing surf. What do you need to know and how do you prepare in order to start taming big data and generating exciting new analytics from it? Sit back, get comfortable, and prepare to find out!

Table of Contents

  1. Cover
  2. Additional praise for Taming the Big Data Tidal Wave
  3. Wiley & SAS Business Series
  4. Title page
  5. Copyright page
  6. Dedication
  7. Foreword
  8. Preface
  9. Acknowledgments
  10. PART ONE: The Rise of Big Data
    1. CHAPTER 1: What Is Big Data and Why Does It Matter?
      1. WHAT IS BIG DATA?
      2. IS THE “BIG” PART OR THE “DATA” PART MORE IMPORTANT?
      3. HOW IS BIG DATA DIFFERENT?
      4. HOW IS BIG DATA MORE OF THE SAME?
      5. RISKS OF BIG DATA
      6. WHY YOU NEED TO TAME BIG DATA
      7. THE STRUCTURE OF BIG DATA
      8. EXPLORING BIG DATA
      9. MOST BIG DATA DOESN’T MATTER
      10. FILTERING BIG DATA EFFECTIVELY
      11. MIXING BIG DATA WITH TRADITIONAL DATA
      12. THE NEED FOR STANDARDS
      13. TODAY’S BIG DATA IS NOT TOMORROW’S BIG DATA
      14. WRAP-UP
    2. CHAPTER 2: Web Data: The Original Big Data
      1. WEB DATA OVERVIEW
      2. WHAT WEB DATA REVEALS
      3. WEB DATA IN ACTION
      4. WRAP-UP
    3. CHAPTER 3: A Cross-Section of Big Data Sources and the Value They Hold
      1. AUTO INSURANCE: THE VALUE OF TELEMATICS DATA
      2. MULTIPLE INDUSTRIES: THE VALUE OF TEXT DATA
      3. MULTIPLE INDUSTRIES: THE VALUE OF TIME AND LOCATION DATA
      4. RETAIL AND MANUFACTURING: THE VALUE OF RADIO FREQUENCY IDENTIFICATION DATA
      5. UTILITIES: THE VALUE OF SMART-GRID DATA
      6. GAMING: THE VALUE OF CASINO CHIP TRACKING DATA
      7. INDUSTRIAL ENGINES AND EQUIPMENT: THE VALUE OF SENSOR DATA
      8. VIDEO GAMES: THE VALUE OF TELEMETRY DATA
      9. TELECOMMUNICATIONS AND OTHER INDUSTRIES: THE VALUE OF SOCIAL NETWORK DATA
      10. WRAP-UP
  11. PART TWO: Taming Big Data: The Technologies, Processes, and Methods
    1. CHAPTER 4: The Evolution of Analytic Scalability
      1. A HISTORY OF SCALABILITY
      2. THE CONVERGENCE OF THE ANALYTIC AND DATA ENVIRONMENTS
      3. MASSIVELY PARALLEL PROCESSING SYSTEMS
      4. CLOUD COMPUTING
      5. GRID COMPUTING
      6. MAPREDUCE
      7. IT ISN’T AN EITHER/OR CHOICE!
      8. WRAP-UP
    2. CHAPTER 5: The Evolution of Analytic Processes
      1. THE ANALYTIC SANDBOX
      2. WHAT IS AN ANALYTIC DATA SET?
      3. ENTERPRISE ANALYTIC DATA SETS
      4. EMBEDDED SCORING
      5. WRAP-UP
    3. CHAPTER 6: The Evolution of Analytic Tools and Methods
      1. THE EVOLUTION OF ANALYTIC METHODS
      2. THE EVOLUTION OF ANALYTIC TOOLS
      3. WRAP-UP
  12. PART THREE: Taming Big Data: The People and Approaches
    1. CHAPTER 7: What Makes a Great Analysis?
      1. ANALYSIS VERSUS REPORTING
      2. ANALYSIS: MAKE IT G.R.E.A.T.!
      3. CORE ANALYTICS VERSUS ADVANCED ANALYTICS
      4. LISTEN TO YOUR ANALYSIS
      5. FRAMING THE PROBLEM CORRECTLY
      6. STATISTICAL SIGNIFICANCE VERSUS BUSINESS IMPORTANCE
      7. SAMPLES VERSUS POPULATIONS
      8. MAKING INFERENCES VERSUS COMPUTING STATISTICS
      9. WRAP-UP
    2. CHAPTER 8: What Makes a Great Analytic Professional?
      1. WHO IS THE ANALYTIC PROFESSIONAL?
      2. THE COMMON MISCONCEPTIONS ABOUT ANALYTIC PROFESSIONALS
      3. EVERY GREAT ANALYTIC PROFESSIONAL IS AN EXCEPTION
      4. THE OFTEN UNDERRATED TRAITS OF A GREAT ANALYTIC PROFESSIONAL
      5. IS ANALYTICS CERTIFICATION NEEDED, OR IS IT NOISE?
      6. WRAP-UP
    3. CHAPTER 9: What Makes a Great Analytics Team?
      1. ALL INDUSTRIES ARE NOT CREATED EQUAL
      2. JUST GET STARTED!
      3. THERE’S A TALENT CRUNCH OUT THERE
      4. TEAM STRUCTURES
      5. KEEPING A GREAT TEAM’S SKILLS UP
      6. WHO SHOULD BE DOING ADVANCED ANALYTICS?
      7. WHY CAN’T IT AND ANALYTIC PROFESSIONALS GET ALONG?
      8. WRAP-UP
  13. PART FOUR: Bringing It Together: The Analytics Culture
    1. CHAPTER 10: Enabling Analytic Innovation
      1. BUSINESSES NEED MORE INNOVATION
      2. TRADITIONAL APPROACHES HAMPER INNOVATION
      3. DEFINING ANALYTIC INNOVATION
      4. ITERATIVE APPROACHES TO ANALYTIC INNOVATION
      5. CONSIDER A CHANGE IN PERSPECTIVE
      6. ARE YOU READY FOR AN ANALYTIC INNOVATION CENTER?
      7. WRAP-UP
    2. CHAPTER 11: Creating a Culture of Innovation and Discovery
      1. SETTING THE STAGE
      2. OVERVIEW OF THE KEY PRINCIPLES
      3. WRAP-UP
  14. Conclusion: Think Bigger!
  15. About the Author
  16. Index