Architecting Data Lakes, 2nd Edition

by Ben Sharma

Released April 2018

Publisher(s): O'Reilly Media, Inc.

ISBN: 9781492032991

Start your free trial

Book description

Many organizations today are succeeding with data lakes, not just as storage repositories but as places to organize, prepare, analyze, and secure a wide variety of data. Management and governance is critical for making your data lake work, yet hard to do without a roadmap. With this ebook, you’ll learn an approach that merges the flexibility of a data lake with the management and governance of a traditional data warehouse.

Author Ben Sharma explains the steps necessary to deploy data lakes with robust, metadata-driven data management platforms. You’ll learn best practices for building, maintaining, and deriving value from a data lake in your production environment. Included is a detailed checklist to help you construct a data lake in a controlled yet flexible way.

Managing and governing data in your lake cannot be an afterthought. This ebook explores how integrated data lake management solutions, such as the Zaloni Data Platform (ZDP), deliver necessary controls without making data lakes slow and inflexible.

You’ll examine:

A reference architecture for a production-ready data lake
An overview of the data lake technology stack and deployment options
Key data lake attributes, including ingestion, storage, processing, and access
Why implementing management and governance is crucial for the success of your data lake
How to curate data lakes through data governance, acquisition, organization, preparation, and provisioning
Methods for providing secure self-service access for users across the enterprise
How to build a future-proof data lake tech stack that includes storage, processing, data management, and reference architecture
Emerging trends that will shape the future of data lakes