You'll learn how to:

Start this course today

Build hands-on data skills with interactive exercises and projects.

Sign up

About this course

In our Building a Data Pipeline course, you will learn how to build a Python data pipeline from scratch. You’ll learn concepts such as functional programming, closures, decorators, and more.

Over the course of this class, you’ll gradually write a robust data pipeline with a scheduler using the versatile Python programming language. By the time you’re finished, you’ll be able to describe the difference between imperative and functional programming. You’ll also be able to build a simple data pipeline using the functional paradigm. You’ll feel confident using functional closures in Python, implementing a well-designed pipeline API, and writing decorators and applying them to functions.

At the end of the course, you’ll work on a real-world project, using a data pipeline to summarize Hacker News data. This project is a chance for you to combine the skills you learned in this course and build a real-world data pipeline from raw data to summarization. This project also serves as a portfolio project that you can showcase to your future employer so they can feel confident in your data engineering and Python programming skills.
By the end of this course, you’ll be able to understand:

  • The basics of functional programming.
  • How to write robust pipeline with a scheduler in Python.
  • Advanced Python concepts such as closures, decorators, and more.

Lessons in this course

Loading lessons....

Thousands of learners have changed their careers with Dataquest


Learners who recommend
Dataquest for career advancement

4.9 stars

Dataquest rating on
G2Crowd and SwitchUp


Average salary boost
for learners who complete a path

Join a community of 1M+ data learners on Dataquest


Sign up for a free account

Get access to hundreds of free lessons.


Choose a course or path

Start anywhere, from beginner topics to advanced concepts.


Learn with hands-on exercises

Learn with real data and build your experience.

Apply your skills

Create projects, build your portfolio, and build your career.

Sign up today