Building Data Pipelines with Luigi 3 and Python

Building Data Pipelines with Luigi 3 and Python course. In this course, you will learn how to create reliable and intelligent data pipelines using Luigi and Python. Many developers implement data pipelines by putting together a bunch of ad-hoc scripts that over time become technical liabilities and become too difficult to manage. In this course, we’ll solve this problem using Luigi, a powerful tool for building data pipelines. Data is collected from various sources and needs further processing. It is very tempting to build your own library for creating data pipelines for batch processing, but this leads to pipelines that are difficult to maintain. In this course, Building Data Pipelines with Luigi and Python, you will learn how to build data pipelines using Luigi and Python. First, you’ll explore how to build your first data pipelines with Luigi. Next, you’ll discover how to configure Luigi pipelines. Finally, you’ll learn how to run Luigi pipelines. After completing this course, you will have the skills and knowledge to build data pipelines that are easy to maintain.