Try Dataquest – Free Access Week + Unlimited Learning
Course overview
In this course, you’ll dive into the world of deep learning by gaining a deeper understanding of backpropagation and building a simple deep learning framework from scratch. As part of your journey, you’ll learn to optimize network parameters and employ regularization techniques to improve your models, creating a strong foundation in core deep learning concepts.
The course will also explore the essential role of optimizers in adjusting neural network parameters. You’ll delve into gradient descent and learn about batch size, learning rate schedules, weight decay, and momentum. Additionally, you’ll discover the popular Adam optimizer, which extends the idea of momentum, and learn how to optimize hyperparameters for neural networks while monitoring and comparing their performance.
By the end of this course, you’ll have a comprehensive understanding of fundamental deep learning concepts and be well-equipped to continue your deep learning journey.
Key skills
- Build a 2-layer deep learning framework from scratch
- Optimize network parameters
- Prevent overfitting through regularization
Course outline
Optimizing Network Parameters [2 lessons]
Backpropagation 2h
Lesson Objectives- Build a computational graph
- Compute the derivative of the softmax function
- Build a 2-layer deep learning framework from scratch
Optimizers 2h
Lesson Objectives- Optimize hyperparameters for neural networks.
- Monitor network performance and compare different runs to each other.
- Implement the Adam optimizer.
The Dataquest guarantee
Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you’ll master data skills and grow your career.
We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren’t satisfied with your outcome, we’ll give you a refund.
Master skills faster with Dataquest
Go from zero to job-ready
Learn exactly what you need to achieve your goal. Don’t waste time on unrelated lessons.
Build your project portfolio
Build confidence with our in-depth projects, and show off your data skills.
Challenge yourself with exercises
Work with real data from day one with interactive lessons and hands-on exercises.
Showcase your path certification
Share the evidence of your hard work with your network and potential employers.