Turbocharge Your Data Acquisition using the data.world Python Library

When working with data, a key part of your workflow is finding and importing data sets. Being able to quickly locate data, understand it and combine it with other sources can be difficult. One tool to help with this is data.world, where you can search for, copy, analyze, and download data sets. In addition, you can upload your data to data.world and use it to collaborate with others. In this tutorial, we’re going to show... »
Author's profile picture Josh Devlin in python, tutorials, and project

Building An Analytics Data Pipeline In Python

If you’ve ever wanted to work with streaming data, or data that changes quickly, you may be familiar with the concept of a data pipeline. Data pipelines allow you transform data from one representation to another through a series of steps. Data pipelines are a key part of data engineering, which we teach in our new Data Engineer Path. A common use case for a data pipeline is figuring out information about the visitors to... »
Author's profile picture Vik Paruchuri in python and tutorials

What's New in v1.14: Data Engineering Path & Performance Improvements!

Our latest Dataquest release has over 20 new features, including many major performance improvements and the launch of our much-anticipated data engineering path. New Path: Data Engineering The first course in our Data Engineering Path is here! Data Engineering is a broad field which includes: Working with Big Data Architecting distributed systems Creating reliable pipelines Combining data sources Collaborating with data science teams and building the right solutions for them. If you’d like to find... »
Author's profile picture Josh Devlin in updates

Pandas Cheat Sheet - Python for Data Science

Pandas is arguably the most important Python package for data science. Not only does it give you lots of methods and functions that make working with data easier, but it has been optimized for speed which gives you a significant advantage compared with working with numeric data using Python’s built-in functions. The printable version of this cheat sheet It’s common when first learning pandas to have trouble remembering all the functions and methods that you... »
Author's profile picture Josh Devlin in resources and guides

1 tip for effective data visualization in Python

Yes, you read correctly – this post will only give you 1 tip. I know most posts like this have 5 or more tips. I once saw a post with 15 tips, but I may have been daydreaming at the time. You’re probably wondering what makes this 1 tip so special. “Vik”, you may ask, “I’ve been reading posts that have 7 tips all day. Why should I spend the time and effort to read... »
Author's profile picture Vik Paruchuri in tutorials

What is Data Engineering?

This is the first in a series of posts on Data Engineering. If you like this and want to know when the next post in the series is released, you can subscribe at the bottom of the page. From helping cars drive themselves to helping Facebook tag you in photos, data science has attracted a lot of buzz recently. Data scientists have become extremely sought after, and for good reason – a skilled data scientist... »
Author's profile picture Vik Paruchuri in careers

How to present your data science portfolio on Github

This is the fifth and final post in a series of posts on how to build a Data Science Portfolio. In the previous posts in our portfolio series, we talked about how to build a storytelling project, how to create a data science blog, how to create a machine learning project, and how to construct a portfolio. In this post, we’ll discuss how to present and share your portfolio. You’ll learn how to showcase your... »
Author's profile picture Vik Paruchuri in tutorials, python, portfolio, and project

The Six Elements of the Perfect Data Science Learning Tool

When I launched Dataquest a little under two years ago, one of the first things I did was write a blog post about why. At the time, if you wanted to become a data scientist, you were confronted with dozens of courses on sites like edX or Coursera with no easy path to getting a job. I saw many promising students give up on learning data science because they got stuck in a loop of... »
Author's profile picture Vik Paruchuri in motivation and making-of

Preparing and Cleaning Data for Machine Learning

Cleaning and preparing data is a critical first step in any machine learning project. In this blog post, Dataquest student Daniel Osei takes us through examining a dataset, selecting columns for features, exploring the data visually and then encoding the features for machine learning. After first reading about Machine Learning on Quora in 2015, Daniel became excited at the prospect of an area that could combine his love of Mathematics and Programming. After reading this... »
Author's profile picture Josh Devlin in tutorials

How to get a data science job

You’ve done it. You just spent months learning how to analyze data and make predictions. You’re now able to go from raw data to well structured insights in a matter of hours. After all that effort, you feel like it’s time to take the next step, and get your first data science job. Unfortunately for you, this is where the process starts to get much harder. There’s no clear path to go from having data... »
Author's profile picture Vik Paruchuri in careers

Pandas Tutorial: Data analysis with Python: Part 2

We covered a lot of ground in Part 1 of our pandas tutorial. We went from the basics of pandas DataFrames to indexing and computations. If you’re still not confident with Pandas, you might want to check out the Dataquest pandas Course. In this tutorial, we’ll dive into one of the most powerful aspects of pandas – its grouping and aggregation functionality. With this functionality, it’s dead simple to compute group summary statistics, discover patterns,... »
Author's profile picture Vik Paruchuri in tutorials and python

What's New in v1.10: Answer diffs, Improved Q&A!

Along with our two new data visualization courses (Exploratory Data Visualization and Storytelling Through Data Visualization) our latest release includes two major features designed to make your life easier - enhanced Q&A and answer diffing. Introducing: Output & Variable Diffing When you’re learning to code, it can be frustrating to be stuck on an exercise and not know what’s wrong. Our new variable and answer diffing is here to help: This new feature: Shows you... »
Author's profile picture Josh Devlin in updates

Python Web Scraping Tutorial using BeautifulSoup

When performing data science tasks, it’s common to want to use data found on the internet. You’ll usually be able to access this data in csv format, or via an Application Programming Interface(API). However, there are times when the data you want can only be accessed as part of a web page. In cases like this, you’ll want to use a technique called web scraping to get the data from the web page into a... »
Author's profile picture Vik Paruchuri in tutorials and python

I barely graduated college, and that's okay

I didn’t do very well in high school. My grade point average was around a 2.5 out of 4. I did well in some subjects that I was interested in, like math, computer science, and history, but everything else was a wash. The less homework a class required me to do, the better my grade ended up being. In most classes I ended up watching the wall clock slowly tick towards the time when we... »
Author's profile picture Vik Paruchuri in updates