MISSION 264

Pipeline Tasks

Build a simple data pipeline using the functional paradigm

Objectives

  • Learn to build tasks functions in a pipeline.
  • Learn how to write real-world functions using the functional paradigm.

Mission Outline

1. Overview
2. Generators in Python
3. Generator Comprehension
4. Manipulating Generators in Tasks
5. Data Cleaning in Parse Log
6. Write to CSV
7. Chaining Iterators
8. Counting Unique Request Types
9. Task Reusability
10. Next Steps
11. Takeaways

building-a-data-pipeline

Course Info:

Building a Data Pipeline

Intermediate

The median completion time for this course is 6.3 hours.

This course requires a premium subscription. This course has four missions, and one guided project.  It is the seventh course in the Data Engineer Path.

START LEARNING FREE

Take a Look Inside