MISSION 264

Pipeline Tasks

Build a simple data pipeline using the functional paradigm

Objectives

  • Learn to build tasks functions in a pipeline.
  • Learn how to write real-world functions using the functional paradigm.

Mission Outline

1. Overview
2. Generators in Python
3. Generator Comprehension
4. Manipulating Generators in Tasks
5. Data Cleaning in Parse Log
6. Write to CSV
7. Chaining Iterators
8. Counting Unique Request Types
9. Task Reusability
10. Next Steps
11. Takeaways

building-a-data-pipeline

Course Info:

Building a Data Pipeline

Intermediate

The average completion time for this course is 10-hours.

This course requires a premium subscription. This course has one free mission, three paid missions, and one guided project.  It is the seventh course in the Data Engineer Path.

START LEARNING FREE

Take a Look Inside