MISSION 266

Multiple Dependency Pipeline

Adding multiple dependencies and a scheduler to the data pipeline.

Objectives

  • Learn the basics of graph theory.
  • Learn to implement a directed acyclic graph in Python.
  • Write a schduler for the pipeline class.

Mission Outline

1. Overview
2. Intro to DAGs
3. The DAG Class
4. Sorting the DAG
5. Finding Number of In Degrees
6. Challenge: Sorting Dependencies
7. Enhance the Add Method
8. Adding DAG to the Pipeline
9. Challenge: Running the Pipeline
10. Next Steps
11. Takeaways

building-a-data-pipeline

Course Info:

Building a Data Pipeline

Intermediate

The average completion time for this course is 10-hours.

This course requires a premium subscription. This course has one free mission, three paid missions, and one guided project.  It is the seventh course in the Data Engineer Path.

START LEARNING FREE

Take a Look Inside