Project overview
The 2023 Stack Overflow Developer Survey captured tens of thousands of responses describing skills, experience, location, work preferences, and compensation. Your job is to turn that raw, messy dataset into a linear regression model that predicts yearly salary and reveals the factors behind developer pay.
You’ll work through a full data science workflow: auditing and dropping sparse columns, filtering outlier salaries, engineering features from multi-select skill lists, encoding high-cardinality categories, and managing multicollinearity before training and evaluating your model. Along the way, you’ll interpret coefficients to separate controllable factors like skills and role from fixed ones like geography.
Build and evaluate a linear regression model on Stack Overflow survey data to predict developer salaries and surface the factors that drive compensation.
Key skill required
To complete this project, it's recommended to build these foundational skills in Python
- Familiarity with pandas
- Basic machine learning concepts, train/test splitting
- Handling missing data and outliers in real-world datasets
- Feature engineering and encoding categorical variables
Projects steps
Step 1: Explore the raw survey
Step 2: Trim to salary respondents and retire low-value columns
Step 3: Shape the modeling dataset
Step 4: Engineer features and build the salary model
Step 5: Next Steps
Master skills faster with Dataquest
Go from zero to job-ready
Learn exactly what you need to achieve your goal. Don’t waste time on unrelated lessons.
Build your project portfolio
Build confidence with our in-depth projects, and show off your data skills.
Challenge yourself with exercises
Work with real data from day one with interactive lessons and hands-on exercises.
Showcase your path certification
Share the evidence of your hard work with your network and potential employers.
The Dataquest guarantee
Dataquest has helped thousands of people start new careers in data. If you put in the work and follow our path, you’ll master data skills and grow your career.
We believe so strongly in our paths that we offer a full satisfaction guarantee. If you complete a career path on Dataquest and aren’t satisfied with your outcome, we’ll give you a refund.
Recommended projects
Investigative Statistical Analysis – Analyzing Accuracy in Data Presentation
Practice using R to analyze movie ratings data, compare 2015 vs 2016 ratings, and apply sampling and distributions to investigate bias.
Predicting Listing Gains in the Indian IPO Market Using PyTorch
Practice building a regularized deep learning model in PyTorch to predict IPO profitability using real Indian stock market data with advanced evaluation techniques.
NYC Schools Perceptions
Practice data cleaning, analysis, and visualization in R to explore survey data and showcase your skills with R Notebooks.
Investigative Statistical Analysis – Analyzing Accuracy in Data Presentation
Practice statistical analysis in Python to investigate movie rating bias and determine if Fandango inflated ratings.
Building Fast Queries on a CSV
Practice implementing an inventory system for a laptop store using Python classes, dictionaries, and binary search.
Predicting Developer Salaries
Practice cleaning real-world survey data, engineering features from multi-select fields, and building a linear regression model to predict developer salaries.
Garden Simulator Text Based Game
Practice using OOP, error handling, and randomness in Python to create an interactive gardening game simulator.
Predicting Heart Disease
Practice building a K Nearest Neighbors classifier in Python to predict heart disease risk from patient data.
Setting Up Your Data Engineering Lab with Docker
Grow your career with
Dataquest.