Course · Intermediate
Processing Large Datasets In Pandas
In this course, you'll learn how to work with medium-sized datasets by optimizing your pandas workflow, processing data in batches, and augmenting pandas with SQLite.
- Intermediate friendly
- 5 hrs
- 5 lessons
- 2 projects
- Premium
Course overview
Optimize pandas workflows to handle larger datasets by reducing memory usage, processing data in chunks, and combining pandas with SQLite.
What's inside
5 lessons · 2 projects
- 01 78 minOptimizing DataFrame Memory Footprint
Learn how to reduce a Dataframe's memory footprint by selecting the correct data types
- 02 53 minProcessing Dataframes in Chunks
Learn how to break a problem down into DataFrame chunks.
- 03 25 minGuided Project: Practice Optimizing DataFrames and Processing in Chunks Project
For this project, we'll step into the role of data engineers to optimize a DataFrame's memory footprint and process a large dataset of loan data in chunks using Python and pandas.
- 04 34 minAugmenting Pandas with SQLite
Learn the pandas SQLite workflow to combine the best of both tools.
- 05 10 minGuided Project: Analyzing Startup Fundraising Deals from Crunchbase Project
For this project, we'll step into the role of data analysts to explore a dataset of startup investments from Crunchbase. We'll practice techniques to work with larger datasets and gain insights into fundraising trends.
- 06 44 minIntroduction to Pandas
Learn how to read data into Pandas and how to access it.
- 07 43 minCalculating With Pandas
Learn how to perform calculations using Pandas.
Part of these paths
The Dataquest guarantee
Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you'll master data skills and grow your career.
We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren't satisfied with your outcome, we'll give you a refund.
Master skills faster with Dataquest
Go from zero to job-ready
Learn exactly what you need to achieve your goal. Don't waste time on unrelated lessons.
Build your project portfolio
Build confidence with our in-depth projects, and show off your data skills.
Challenge yourself with exercises
Work with real data from day one with interactive lessons and hands-on exercises.
Showcase your path certification
Share the evidence of your hard work with your network and potential employers.
Grow your career with Dataquest.
Dataquest starts at the most basic level, so a beginner can understand the concepts. I tried learning to code before, using Codecademy and Coursera. I struggled because I had no background in coding, and I was spending a lot of time Googling. Dataquest helped me actually learn.
I liked the interactive environment on Dataquest. The material was clear and well organized. I spent more time practicing then watching videos and it made me want to keep learning.
I really love learning on Dataquest. I looked into a couple of other options and I found that they were much too handhold-y and fill in the blank relative to Dataquest's method. The projects on Dataquest were key to getting my job. I doubled my income!
Join 1M+ data learners on Dataquest.
- 1
Create a free account
- 2
Choose a learning path
- 3
Complete exercises and projects
- 4
Advance your career
Start learning today
Start the Processing Large Datasets In Pandas course
Join 5,777 learners — all free to start.