Course

Parallel Processing for Data Engineering

Enroll For Free

Part of the Data Engineer path.

4.8 (359 reviews)
1,646 learners enrolled in this course.
  • Beginner friendly
  • 5 hours
  • Self paced
  • 5 lessons
  • 1 project
Otavio

“The learning paths on Dataquest are incredible. They give you a direction through the learning process – you don’t have to guess what to learn next.”

Otávio Silveira

Data Analyst @ Hortifruti

Parallel Processing for Data Engineering

Enroll For Free

Course overview

Key skills

Course outline

Parallel Processing for Data Engineering [5 lessons]

Introductions to Parallel Processing 1h

Lesson Objectives
  • Start multiple processes
  • Run functions on several processes at the same time
  • Share data between multiple processes

Process Pool Executors 1h

Lesson Objectives
  • Gather the results of a function executed on several processes
  • Employ a process pool executor
  • Analyze the demand for data engineering skills in job postings

Introduction to MapReduce 1h

Lesson Objectives
  • Define the MapReduce framework
  • Employ process pools
  • Implement MapReduce

Processing Data with MapReduce 1h

Lesson Objectives
  • Employ the MapReduce framework
  • Analyze words in English

Guided Project: Analyzing Wikipedia Pages 1h

Lesson Objectives
  • Analyze Wikipedia pages using MapReduce computing

Projects in this course

Guided Project: Analyzing Wikipedia Pages

Use MapReduce to analyze Wikipedia pages more quickly.

View Project

The Dataquest guarantee

Guarantee

Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you’ll master data skills and grow your career.

Money

We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren’t satisfied with your outcome, we’ll give you a refund.

Master skills faster with Dataquest

Go from zero to job-ready

Go from zero to job-ready

Learn exactly what you need to achieve your goal. Don’t waste time on unrelated lessons.

Build your project portfolio

Build your project portfolio

Build confidence with our in-depth projects, and show off your data skills.

Challenge yourself with exercises

Challenge yourself with exercises

Work with real data from day one with interactive lessons and hands-on exercises.

Showcase your path certification

Showcase your path certification

Impress employers by completing a capstone project and certifying it with an expert review.

Learning resources

How AI Is Shaping the Future of Work
AI is reshaping the tech landscape, so what does that m...
Read Article

How Does ChatGPT Work?
ChatGPT is an artificial intelligence chatbot developed...
Read Article

Deep Learning vs. Machine Learning — The Difference Explained!
With the ever-growing applications of Artificial Intell...
Read Article

6 Most Common Deep Learning Applications
Introduction Deep learning is a rapidly growing subfiel...
Read Article

Grow your career with
Dataquest.

97%
of learners recommend
Dataquest for career advancement
4.9
Dataquest rating on
G2Crowd and SwitchUp
$30k
Average salary boost
for learners who complete a path
Aaron

Aaron Melton

Business Analyst at Aditi Consulting

“Dataquest starts at the most basic level, so a beginner can understand the concepts. I tried learning to code before, using Codecademy and Coursera. I struggled because I had no background in coding, and I was spending a lot of time Googling. Dataquest helped me actually learn.”

Jessi

Jessica Ko

Machine Learning Engineer at Twitter

“I liked the interactive environment on Dataquest. The material was clear and well organized. I spent more time practicing then watching videos and it made me want to keep learning.”

Victoria

Victoria E. Guzik

Associate Data Scientist at Callisto Media

“I really love learning on Dataquest. I looked into a couple of other options and I found that they were much too handhold-y and fill in the blank relative to Dataquest’s method. The projects on Dataquest were key to getting my job. I doubled my income!”

Join 1M+ data learners on
Dataquest.

1

Sign up for a free account

2

Choose a course or path

3

Learn with hands-on exercises

4

Apply your skills

Start learning with a free account today.

Sign Up For Dataquest