MISSION 164

Processing Dataframes in Chunks

Learn how to break a problem down into dataframe chunks.

Objectives

  • Learn how to use dataframe chunks.
  • Learn how to increase processing speed in pandas.

Mission Outline

1. Processing Chunks
2. Processing Chunks
3. Counting Across Chunks
4. Batch Processing
5. Optimizing Performance
6. Counting Unique Values
7. Combining Chunks Using GroupBy
8. Working With Intermediate Dataframes
9. Next Steps
10. Takeaways

Course Info:

Processing Large Datasets In Pandas

Intermediate

The average completion time for this course is 10-hours.

This course requires a premium subscription and includes 2 free missions, 2 paid missions, and 1 guided project.  It is the 3rd course in the Data Engineer path.

START LEARNING FREE

Take a Look Inside

Share On Facebook
Share On Twitter
Share On Linkedin
Share On Reddit