skill Path

Zero to GPT

This course will take you from no knowledge of deep learning to training your own GPT model. You’ll solve real problems, like predicting the weather and translating languages, and you’ll explore theoretical building blocks like gradient descent and backpropagation. This will prepare you to successfully train and use models in the real world.

Enroll For Free
4.8 (359 reviews)
4,778 learners enrolled in this path.
  • Intermediate friendly
  • 2 months (5 hrs/week)
  • Self paced
  • 3 Courses

“The beauty of Dataquest is that it starts at the most basic level, so a true beginner can understand the concepts. I tried learning to code before, using Codecademy and a couple of classes on Coursera. I was spending a lot of time Googling and I didn’t have much time to learn. Dataquest helped me actually learn.”

Aaron Melton

Conversational AI Engineer @Walgreens

Zero to GPT

Enroll For Free

Path overview

This course stars with the fundamentals — neural network architectures and training methods. Later in the course, we’ll explore complex topics like transformers, GPU programming, and distributed training.

You’ll need to understand Python to take this course, including for loops, functions, and classes. The first part of this Dataquest path will teach you what you need.

To get the most out of this course, go through each chapter sequentially. Read the lessons or watch the optional videos — they have the same information. Look through the implementations to solidify your understanding, and recreate them on your own.

Key skills

  • Learn how to train your own GPT model.
  • Explore complex topics like transformers, GPU programming, and distributed training.
  • Practice using gradient descent, dense networks, and classification with neural networks.
  • Employ optimizers, PyTorch, regularization, and transformers.

Path outline

Part 1: Zero to GPT [3 courses]

Neural Network Fundamentals 1h

Objectives
  • Define what a GPT model is (Generative Pre-trained Transformer)
  • Explain how a GPT model operates
  • Refresh linear algebra and calculus knowledge for deep learning
  • Understand how gradient descent is used in deep learning

Network Architectures 10h

Objectives
  • Understand different neural network architectures
  • Build a dense neural network from scratch using Python
  • Train a neural network on a classification task
  • Predict sequence data using recurrent neural networks

Optimizing Network Parameters 10h

Objectives
  • Build a 2-layer deep learning framework from scratch
  • Optimize network parameters
  • Prevent overfitting through regularization

The Dataquest guarantee

Guarantee

Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you’ll master data skills and grow your career.

Money

We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren’t satisfied with your outcome, we’ll give you a refund.

Master skills faster with Dataquest

Go from zero to job-ready

Go from zero to job-ready

Learn exactly what you need to achieve your goal. Don’t waste time on unrelated lessons.

Build your project portfolio

Build your project portfolio

Build confidence with our in-depth projects, and show off your data skills.

Challenge yourself with exercises

Challenge yourself with exercises

Work with real data from day one with interactive lessons and hands-on exercises.

Showcase your path certification

Showcase your path certification

Share the evidence of your hard work with your network and potential employers.

Grow your career with
Dataquest.

98%
of learners recommend
Dataquest for career advancement
4.85
Dataquest rating
SwitchUp Best Bootcamps
$30k
Average salary boost
for learners who complete a path
Aaron

Aaron Melton

Business Analyst at Aditi Consulting

“Dataquest starts at the most basic level, so a beginner can understand the concepts. I tried learning to code before, using Codecademy and Coursera. I struggled because I had no background in coding, and I was spending a lot of time Googling. Dataquest helped me actually learn.”

Jessi

Jessica Ko

Machine Learning Engineer at Twitter

“I liked the interactive environment on Dataquest. The material was clear and well organized. I spent more time practicing then watching videos and it made me want to keep learning.”

Victoria

Victoria E. Guzik

Associate Data Scientist at Callisto Media

“I really love learning on Dataquest. I looked into a couple of other options and I found that they were much too handhold-y and fill in the blank relative to Dataquest’s method. The projects on Dataquest were key to getting my job. I doubled my income!”

Join 1M+ data learners on
Dataquest.

1

Create a free account

2

Choose a learning path

3

Complete exercises and projects

4

Advance your career

Start learning today

Sign Up For Dataquest