Building a Data Pipeline

Learn how to build a Python data pipeline from scratch.

By the end of this course, you'll be able to understand:

  • The basics of functional programming.
  • How to write robust pipeline with a scheduler in Python.
  • Advanced Python concepts such as closures, decorators, and more.

Course Info:

Building a Data Pipeline


The average completion time for this course is 10-hours.

This course requires a premium subscription. This course has one free mission, three paid missions, and one guided project.  It is the seventh course in the Data Engineer Path.


Learn how to build a pipeline

Functional Programming

Learn the basics of functional programming in Python.

Pipeline Tasks

Build a simple data pipeline using the functional programming paradigm.

Building A Pipeline Class

Build a general task pipeline class from scratch.

Multiple Dependency Pipeline

Adding multiple dependencies and a scheduler to the pipeline.

Hacker News Pipeline

Learn how to use a data pipeline to summarize Hacker News data.