This course stars with the fundamentals — neural network architectures and training methods. Later in the course, we’ll explore complex topics like transformers, GPU programming, and distributed training.
You’ll need to understand Python to take this course, including for loops, functions, and classes. The first part of this Dataquest path will teach you what you need.
To get the most out of this course, go through each chapter sequentially. Read the lessons or watch the optional videos — they have the same information. Look through the implementations to solidify your understanding, and recreate them on your own.
- Learn how to train your own GPT model.
- Explore complex topics like transformers, GPU programming, and distributed training.
- Practice using gradient descent, dense networks, and classification with neural networks.
- Employ optimizers, PyTorch, regularization, and transformers.
Part 1: Zero to GPT [3 courses]
The Dataquest guarantee
Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you’ll master data skills and grow your career.
We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren’t satisfied with your outcome, we’ll give you a refund.