MISSION 164

Processing Dataframes in Chunks

Learn how to break a problem down into dataframe chunks.

Objectives

  • Learn how to use dataframe chunks.
  • Learn how to increase processing speed in pandas.

Mission Outline

1. Processing Chunks
2. Processing Chunks
3. Counting Across Chunks
4. Batch Processing
5. Optimizing Performance
6. Counting Unique Values
7. Combining Chunks Using GroupBy
8. Working With Intermediate Dataframes
9. Next Steps
10. Takeaways

pandas-large-datasets

Course Info:

Intermediate

The median completion time for this course is 5.3 hours. View Details

This course requires a premium subscription and includes three missions, and two guided projects.  It is the third course in the Data Engineer path.

START LEARNING FREE

Take a Look Inside