MISSION 266

Multiple Dependency Pipeline

Adding multiple dependencies and a scheduler to the data pipeline.

Objectives

  • Learn the basics of graph theory.
  • Learn to implement a directed acyclic graph in Python.
  • Write a schduler for the pipeline class.

Mission Outline

1. Overview
2. Intro to DAGs
3. The DAG Class
4. Sorting the DAG
5. Finding Number of In Degrees
6. Challenge: Sorting Dependencies
7. Enhance the Add Method
8. Adding DAG to the Pipeline
9. Challenge: Running the Pipeline
10. Next Steps
11. Takeaways

building-a-data-pipeline

Course Info:

Intermediate

The median completion time for this course is 6.3 hours. ​View Details​​​

This course requires a premium subscription. This course has four missions, and one guided project.  It is the seventh course in the Data Engineer Path.

START LEARNING FREE

Take a Look Inside