E-book details

Simplifying Data Engineering and Analytics with Delta. Create analytics-ready data that fuels artificial intelligence and business intelligence

Simplifying Data Engineering and Analytics with Delta. Create analytics-ready data that fuels artificial intelligence and business intelligence

Anindita Mahapatra, Doug May

Ebook
Delta helps you generate reliable insights at scale and simplifies architecture around data pipelines, allowing you to focus primarily on refining the use cases being worked on. This is especially important when you consider that existing architecture is frequently reused for new use cases.
In this book, you’ll learn about the principles of distributed computing, data modeling techniques, and big data design patterns and templates that help solve end-to-end data flow problems for common scenarios and are reusable across use cases and industry verticals. You’ll also learn how to recover from errors and the best practices around handling structured, semi-structured, and unstructured data using Delta. After that, you’ll get to grips with features such as ACID transactions on big data, disciplined schema evolution, time travel to help rewind a dataset to a different time or version, and unified batch and streaming capabilities that will help you build agile and robust data products.
By the end of this Delta book, you’ll be able to use Delta as the foundational block for creating analytics-ready data that fuels all AI/BI use cases.
  • 1. An Introduction to Data Engineering
  • 2. Data Modeling and ETL
  • 3. Delta – The Foundation Block for Big Data
  • 4. Unifying Batch and Streaming with Delta
  • 5. Data Consolidation in Delta Lake 
  • 6. Solving Common Data Pattern Scenarios with Delta
  • 7. Delta for Data Warehouse Use Cases
  • 8. Handling Atypical Data Scenarios with Delta
  • 9. Delta for Reproducible Machine Learning Pipelines
  • 10. Delta for Data Products and Services
  • 11. Operationalizing Data and ML Pipelines
  • 12. Optimizing Cost and Performance with Delta
  • 13. Managing Your Data Journey
  • Title: Simplifying Data Engineering and Analytics with Delta. Create analytics-ready data that fuels artificial intelligence and business intelligence
  • Author: Anindita Mahapatra, Doug May
  • Original title: Simplifying Data Engineering and Analytics with Delta. Create analytics-ready data that fuels artificial intelligence and business intelligence
  • ISBN: 9781801810715, 9781801810715
  • Date of issue: 2022-07-29
  • Format: Ebook
  • Item ID: e_39xp
  • Publisher: Packt Publishing