Ładowanie...
Szczegóły ebooka
Zaloguj się, jeśli jesteś zainteresowany treścią pozycji.
Data Ingestion with Python Cookbook. A practical guide to ingesting, monitoring, and identifying errors in the data ingestion process
Gláucia Esppenchutz
Ładowanie...
EBOOK
Ładowanie...
Data Ingestion with Python Cookbook offers a practical approach to designing and implementing data ingestion pipelines. It presents real-world examples with the most widely recognized open source tools on the market to answer commonly asked questions and overcome challenges.
You’ll be introduced to designing and working with or without data schemas, as well as creating monitored pipelines with Airflow and data observability principles, all while following industry best practices. The book also addresses challenges associated with reading different data sources and data formats. As you progress through the book, you’ll gain a broader understanding of error logging best practices, troubleshooting techniques, data orchestration, monitoring, and storing logs for further consultation.
By the end of the book, you’ll have a fully automated set that enables you to start ingesting and monitoring your data pipeline effortlessly, facilitating seamless integration with subsequent stages of the ETL process.
You’ll be introduced to designing and working with or without data schemas, as well as creating monitored pipelines with Airflow and data observability principles, all while following industry best practices. The book also addresses challenges associated with reading different data sources and data formats. As you progress through the book, you’ll gain a broader understanding of error logging best practices, troubleshooting techniques, data orchestration, monitoring, and storing logs for further consultation.
By the end of the book, you’ll have a fully automated set that enables you to start ingesting and monitoring your data pipeline effortlessly, facilitating seamless integration with subsequent stages of the ETL process.
- 1. Introduction to Data Ingestion
- 2. Principals of Data Access
- 3. Data Discovery
- 4. Reading CSV and JSON Files and Solving Problems
- 5. Ingesting Data from Structured and Unstructured Databases
- 6. Using PySpark with De?ned and Non-De?ned Schemas
- 7. Ingesting Analytical Data
- 8. Designing Monitored Data Workflows
- 9. Putting Everything Together with Air?ow
- 10. Logging and Monitoring Your Data Ingest in Airflow
- 11. Automating Your Data Ingestion Pipelines
- 12. Using Data Observability for Debugging, Error Handling, and Preventing Downtime
- Tytuł:Data Ingestion with Python Cookbook. A practical guide to ingesting, monitoring, and identifying errors in the data ingestion process
- Autor:Gláucia Esppenchutz
- Tytuł oryginału:Data Ingestion with Python Cookbook. A practical guide to ingesting, monitoring, and identifying errors in the data ingestion process
- ISBN:9781837633098, 9781837633098
- Data wydania:2023-05-31
- Format:Ebook
- Identyfikator pozycji: e_3d51
- Wydawca: Packt Publishing
Ładowanie...
Ładowanie...