Focus Week · Aug 17–23 Eight data and AI paths open free for one week. No credit card required See details →

Course · Intermediate

Optimizing Network Parameters

In this course, you'll deepen your understanding of backpropagation while building a basic deep learning framework. You'll optimize network parameters and apply regularization to enhance model performance. This course is the third step in a series of courses that will take you on a journey from beginner to advanced deep learning practitioner.

  • Intermediate friendly
  • 0 hrs
  • 2 lessons
  • Free

Course overview

Optimize deep learning models by tuning network parameters, applying backpropagation, and using regularization to improve performance.

What's inside

2 lessons

  • 01
    Backpropagation

    <p><span style="color: rgb(31,35,40);background-color: rgb(255,255,255);font-size: 16px;font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", "Noto Sans", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji;">So far, we've taken a loose look at backpropagation to let us focus on understanding neural network architecture. In this lesson, we'll build a miniature version of PyTorch, and use it to understand backpropagation better.</span>&nbsp;</p>

    120 min
  • 02
    Optimizers

    <p>Optimizers adjust neural network parameters to try to get loss to (hopefully) a global minimum value. In this lesson, we'll learn more about optimizers. We'll first go into more depth on gradient descent and discuss batch size, learning rate schedules, weight decay, and momentum. We'll then discuss the Adam optimizer, which is a popular optimizer that extends the idea of momentum.</p>

    120 min

The Dataquest guarantee

Career outcomes guarantee

Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you'll master data skills and grow your career.

Satisfaction guarantee

We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren't satisfied with your outcome, we'll give you a refund.

Master skills faster with Dataquest

Go from zero to job-ready

Go from zero to job-ready

Learn exactly what you need to achieve your goal. Don't waste time on unrelated lessons.

Build your project portfolio

Build your project portfolio

Build confidence with our in-depth projects, and show off your data skills.

Challenge yourself with exercises

Challenge yourself with exercises

Work with real data from day one with interactive lessons and hands-on exercises.

Showcase your path certification

Showcase your path certification

Share the evidence of your hard work with your network and potential employers.

Grow your career with Dataquest.

98%
of learners recommend
Dataquest for career advancement
4.85
Dataquest rating
SwitchUp Best Bootcamps
$30k
Average salary boost
for learners who complete a path
Aaron Melton
Aaron Melton
Business Analyst at Aditi Consulting

Dataquest starts at the most basic level, so a beginner can understand the concepts. I tried learning to code before, using Codecademy and Coursera. I struggled because I had no background in coding, and I was spending a lot of time Googling. Dataquest helped me actually learn.

Jessica Ko
Jessica Ko
Machine Learning Engineer at Twitter

I liked the interactive environment on Dataquest. The material was clear and well organized. I spent more time practicing then watching videos and it made me want to keep learning.

Victoria E. Guzik
Victoria E. Guzik
Associate Data Scientist at Callisto Media

I really love learning on Dataquest. I looked into a couple of other options and I found that they were much too handhold-y and fill in the blank relative to Dataquest's method. The projects on Dataquest were key to getting my job. I doubled my income!

Join 1M+ data learners on Dataquest.

  1. 1

    Create a free account

  2. 2

    Choose a learning path

  3. 3

    Complete exercises and projects

  4. 4

    Advance your career

Start the Optimizing Network Parameters course

Join 399 learners — all free to start.