How to Learn Machine Learning
The Self-Starter Way
How to Learn Machine Learning
The Self-Starter Way
Hello, and welcome!
In this guide, we're going to reveal how you can get a world-class machine learning education for free.
You don't need a fancy Ph.D in math. You don't need to be the world's best programmer. And you certainly don't need to pay $16,000 for an expensive "bootcamp."
Whether your goal is to become a data scientist, use ML algorithms as a developer, or add cutting-edge skills to your business analysis toolbox, you can pick up applied machine learning skills much faster than you might think.
1. Are you a self-starter?
Do you like to learn with hands-on projects? Are you driven and self-motivated? Can you commit to goals and see them through? If so, you'll love studying machine learning. You'll get to solve interesting challenges, tinker with fascinating algorithms, and build an incredibly valuable career skill.
2. Are you tired of seeing expensive courses and bootcamps?
We are too... That's why we put together this guide of completely free resources anyone can use to learn machine learning. The truth is that most paid courses out there recycle the same content that's already available online for free. We'll pull back the curtains and reveal where to find them for yourself.
3. Do you want a single page on the internet that will always be up-to-date?
Machine learning is a rapidly evolving field. That makes it exciting to learn, but materials can become outdated quickly. We're going to update this page regularly with the best resources to learn machine learning.
We've got a lot of great stuff you'll like, so let's dive right in!
This is exciting stuff!
Table of Contents
Intro to Machine Learning
Free Self-Study ML Course
Introduction to Machine Learning
WTF is Machine Learning?
Machine Badass (NOT Machine Learning)
Machine learning is about teaching computers how to learn from data to make decisions or predictions. For true machine learning, the computer must be able to learn to identify patterns without being explicitly programmed to.
It sits at the intersection of statistics and computer science, yet it can wear many different masks. You may also hear it labeled several other names or buzz words:
Data Science, Big Data, Artificial Intelligence, Predictive Analytics, Computational Statistics, Data Mining, Etc...
While machine learning does heavily overlap with those fields, it shouldn't be crudely lumped together with them. For example, machine learning is one tool for data science (albeit an essential one). It's also one use of infrastructure that can handle big data.
Here are some examples:
Don't worry if some of those terms mean nothing to you. After you complete this guide, you'll be able to apply each of those techniques yourself! (Self-driving car not included.)
Self-driving car: NOT included in this guide!
Why Learn Machine Learning?
Have you ever wanted to take over the world with robot raccoons?...
Or program your own personal butler like J.A.R.V.I.S. from Iron Man?!...
Or crack the stock market and become a billionaire overnight??!!...
Well, sorry to be a party pooper... but you probably won't be able to do that with machine learning (yet). But there are still awesome reasons to learn machine learning! Here are a few:
Massive Global Demand
The demand for machine learning is booming all over the world. Entry salaries start from $100k – $150k. Data scientists, software engineers, and business analysts all benefit by knowing machine learning.
Data is Power
Data is transforming everything we do. All organizations, from startups to tech giants to Fortune 500's, are racing to harness their data. Big and small data will continue to reshape technology and business.
It's Fun as Heck!
OK, we may be a bit biased, but ML is really darn cool. It has a unique blend of discovery, engineering, and business application that makes it one-of-a-kind. You’ll have a ton of fun in this field.
The Self-Starter Way
The self-starter way of mastering ML is to learn by "doing sh*t." (not the technical term).
Traditionally, students will first spend months or even years on the theory and mathematics behind machine learning. They'll get frustrated by the arcane symbols and formulas or get discouraged by the sheer volume of textbooks and academic papers to read.
Unless you want to devote yourself to Ph.D research, that's way overkill. For most people, the self-starter approach is superior to the academic approach for 3 reasons:
In a nutshell, the self-starter way is faster and more practical. However, it definitely puts more responsibility in your own hands to follow through. Hopefully this guide will help you stay on track!
Here are the 4 steps to learning machine through self-study:
Free Self-Study Machine Learning Course
Step 0: Prerequisites
Machine learning can appear intimidating without a gentle introduction to its prerequisites. You don't need to be a professional mathematician or veteran programmer to learn machine learning, but you do need to have the core skills in those domains.
The good news is that once you fulfill the prerequisites, the rest will be fairly easy. In fact, almost all of ML is about applying concepts from statistics and computer science to data.
Task: Make sure you are caught up to speed for at least programming and statistics.
Python for Data Science
You can’t use machine learning unless you know how to program. Luckily, we have a free guide: How to Learn Python for Data Science, The Self-Starter Way
Statistics for Data Science
Statistics, especially Bayesian probability, underpins many ML algorithms. We have a free guide: How to Learn Statistics for Data Science, The Self-Starter Way
Math for Data Science
ML research relies on a foundation in linear algebra and multivariable calculus. We have a free guide: How to Learn Math for Data Science, The Self-Starter Way
Step 1: Sponge Mode
Sponge mode is all about soaking in as much theory and knowledge as possible to give yourself a strong foundation.
Pictured: Spongebob (NOT Sponge Mode)
Now, some people may be wondering: "If I don't plan to perform original research, why would I need to learn the theory when I can just use existing ML packages?"
This is a reasonable question!
However, learning the fundamentals is important for anyone who plans to apply machine learning in their work. Here are 5 super practical reasons for learning ML theory. They span the entire modeling process:
Here's the great news... you don't need to have all the answers to these questions right from the start. In fact, the approach we recommend is to learn just enough theory to get started and not go astray. Then, you can build mastery over time by alternating between theory and practice.
1.1 - Best Free Machine Learning Courses
These next two free courses are world-class (from Harvard and Stanford) resources for Sponge Mode.
Task: Complete at least one of the courses below.
Harvard's Machine Learning Course
In this course, you'll learn about popular algorithms and key concepts like PCA and regularization. You’ll also get to see the entire machine learning workflow from data analysis to model training. (edX Course Page)
Stanford's Machine Learning Course
This is the famous course taught by Andrew Ng, and it’s the gold standard when it comes to learning machine learning theory. These videos really clear up the core concepts behind ML. (Coursera Course Page)
1.2 - Keys to Success
Here are a few keys to success for this step:
A.) Pay attention to the big picture and always ask "why."
Every time you're introduced to a new concept, ask "why." Why use a decision tree instead of regression in some cases? Why regularize parameters? Why split your dataset? When you understand why each tool is used, you'll become a true machine learning practitioner. For example, by the end of this step, you should know when to preprocess your data, when to use supervised vs. unsupervised algorithms, and methods for preventing model overfitting.
B.) Accept that you will not remember everything.
Don't stress about taking insane notes or reviewing everything 3 times. Accept that you'll need to cycle back and review concepts as you encounter them in the wild.
C.) Keep moving and don't be discouraged.
Try to avoid dwelling on any topic for too long. Some concepts can't be explained easily, even by the best professors. Your confusion will clear up once you start applying them in practice.
D.) Videos are more effective than textbooks.
From our experience, textbooks can be great reference tools, but they often omit the vital color commentary surrounding key concepts. We strongly recommend video lectures during Sponge Mode.
1.3 - Free Reference Textbooks
Next, we have free (legal) PDFs of 2 classic textbooks in the industry.
Task: Download the free PDFs for your future reference.
Step 2: Targeted Practice
After Sponge Mode, you've probably already gotten a healthy dose of practice. Now it's time to take that practice to the next level.
Step 2: Targeted Practice is all about using specific, deliberate exercises to hone your skills. The goal of this step is threefold:
After this step, you'll be ready to tackle bigger projects without feeling overwhelmed.
2.1 - The 9 Essential Topics
Machine learning is a broad and rich field. There are applications for almost any industry. It's easy to get flustered by all there is to learn. Plus, it's also easy to get lost in the weeds of individual models and lose sight of the big picture.
Therefore, we've broken the essentials into the following 9 topics.
These are building block topics that collectively represent the simple value proposition of machine learning: taking data and transforming it into something useful.
The Big Picture
Essential ML theory, such as the Bias-Variance tradeoff.
Algorithms for finding the best parameters for a model.
Dealing with missing data, skewed distributions, outliers, etc.
Sampling & Splitting
How to split your datasets to tune parameters and avoid overfitting.
Learning from labeled data using classification and regression models.
Learning from unlabeled data using factor and cluster analysis models.
Making decisions based on various performance metrics.
Combining multiple models for better performance.
How machine learning can help different types of businesses.
2.2 - Tools of the Trade
For this step, we strongly recommend that you start with out-of-the-box algorithm implementations for two reasons.
First, this is how most ML is performed in the industry. Sure, there will be times when you'll need to research original algorithms or develop them from scratch, but prototyping always starts with existing libraries.
Second, you'll get the chance to practice the entire ML workflow without spending too much time on any one portion of it. This will give you an invaluable "big picture intuition."
Depending on your programming language of choice, you have two excellent options.
Task: Complete the Quickstart guide for one of the libraries below.
Scikit-learn, or sklearn, is the gold standard Python library for general purpose machine learning. It handles every step of the workflow, and it has implementations of all the most popular algorithms. If you're unsure where to start, we recommend Python & sklearn.
Caret is love. Caret is life. Caret is a library that provides a unified interface for many different model packages in R. It also includes functions for preprocessing, data splitting, and model evaluation, making it a complete end-to-end solution.
Quickstart Webinar (old, but still excellent)
2.3 - Datasets for Practice
For this step, you'll need datasets to practice building and tuning models.
Again, the point of Step 2: Targeted Practice is to take the theory that's floating around in your mind after Step 1: Sponge Mode and put it into code.
Much of the art in data science and machine learning lies in dozens of micro-decisions you'll make to solve each problem. This is the perfect time to practice making those micro-decisions and evaluating the consequences of each.
Task: Pick 5-10 datasets from the options below. We recommend starting with the UCI Machine Learning Repository. For example, you can pick 3 datasets each for regression, classification, and clustering.
Task: For each dataset, try at least 3 different modeling approaches using Scikit-Learn or Caret. Think about the following questions:
UCI Machine Learning Repo
This is an incredible collection of over 600 datasets curated for practicing machine learning. Filter by task (i.e. regression, classification, or clustering), industry, dataset size, and more. (Go to website)
Kaggle.com is most famous for hosting data science competitions, but the site also houses over 160,000 community datasets for fun topics ranging from Pokemon to soccer matches. (Go to website)
If you’re looking for social science or government-related datasets, look no further than Data.gov, a collection of the U.S. government’s open data. Search over 190,000 datasets. (Go to website)
Step 3: Machine Learning Projects
Alright, now comes the really fun part! Up to now, we've covered prerequisites, essential theory, and targeted practice. We're now ready to dive into some bigger projects.
The goal of this step is to practice integrating machine learning techniques into complete, end-to-end analyses.
Task: Complete the projects below. The order is up to you, but we ordered them by difficulty (easiest first).
3.1 - Titanic Survivor Prediction
The Titanic Survivor Prediction challenge is an incredibly popular project for practicing machine learning. In fact, it's the most popular competition on Kaggle.com.
We love this project as a starting point because there's a wealth of great tutorials out there. You can take a peek into the minds of more experienced data scientists and see how they approach data exploration, feature engineering, and model tuning.
The Titanic is sinking!
Four-Part Tutorial on Kaggle - Detailed tutorial that starts from cleaning and exploring the data. We really like this tutorial because it teaches you how to properly preprocess and wrangle your data before using sklearn.
Tutorial and iPython Notebooks by Pycon UK - Great tutorial that's presented in iPython Notebook. It has excellent appendices on cross-validation and visualization.
Binary Outcome Modeling Tutorial - Walks through a couple different models in R using the caret package. This tutorial nicely summarizes the predictive modeling process from end-to-end.
Surviving the Titanic with R caret - Practical tutorial that skips most of the theory and gets straight to the code. Useful as another perspective (and it shows random forests in action).
3.2 - Algorithm from Scratch
There's nothing that pushes your understanding quite like writing an algorithm from scratch. They say the devil's in the details, and here's where that really rings true.
We recommend starting with something simple, like logistic regression, decision trees, or k-nearest neighbors.
This project will also give you invaluable practice in translating math into code. This skill will be very handy when you eventually need to use the latest research from academia in your work.
If you get stuck, here are some tips:
She's only a few years away from learning machine learning...
3.3 - Pick a Fun Project or Interesting Domain
You wouldn't be a self-starter if you didn't have curiosity and ideas. By now, you're probably itching to get started (or have already started) on some grand idea that you've been mulling over.
This is honestly the best part about learning machine learning. It's such a powerful tool that once you start to understand, so many ideas will come to you.
The good news is that if you've been following along, then you're more than ready to jump in. Go forth, and reap the fruits of your labor!
We'll also keep a list of project ideas here for inspiration:
Great Job! (So Far...)
Congratulations on reaching the end of the self-study guide!
Here's some great news: If you've followed along and completed all the tasks, you're better at applied machine learning than 90% of the people out there claiming to be data scientists. You have an awesome skillset that employers will drool over.
Now, here's some better news: There's still much to learn! For example, deep learning, computer vision, and natural language processing are a few of the fascinating, cutting-edge subfields that await you.
The key to becoming the best data scientist or machine learning engineer you can be is to never stop learning. Welcome to the start of your journey in this dynamic, exciting field!
So great job! So far...
Top 10 Tips for Beginners
If you've chosen to seriously study machine learning, then congratulations! You have a fun and rewarding journey ahead of you.
Here are 10 tips that every beginner should know:
1. Set concrete goals or deadlines.
Machine learning is a rich field that's expanding every year. It can be easy to go down rabbit holes. Set concrete goals for yourself and keep moving.
2. Walk before you run.
You might be tempted to jump into some of the newest, cutting edge sub-fields in machine learning such as deep learning or NLP. Try to stay focused on the core concepts at the start. These advanced topics will be much easier to understand once you've mastered the core skills.
3. Alternate between practice and theory.
Practice and theory go hand-in-hand. You won't be able to master theory without applying it, yet you won't know what to do without the theory.
4. Write a few algorithms from scratch.
Once you've had some practice applying algorithms from existing packages, you'll want to write a few from scratch. This will take your understanding to the next level and allow you to customize them in the future.
5. Seek different perspectives.
The way a statistician explains an algorithm will be different from the way a computer scientist explains it. Seek different explanations of the same topic.
6. Tie each algorithm to value.
For each tool or algorithm you learn, try to think of ways it could be applied in business or technology. This is essential for learning how to "think" like a data scientist.
7. Don't believe the hype.
Machine learning is not what the movies portray as artificial intelligence. It's a powerful tool, but you should approach problems with rationality and an open mind. ML should just be one tool in your arsenal!
8. Ignore the show-offs.
Sometimes you'll see people online debating with lots of math and jargon. If you don't understand it, don't be discouraged. What matters is: Can you use ML to add value in some way? And the answer is yes, you absolutely can.
9. Think "inputs/outputs" and ask "why."
At times, you might find yourself lost in the weeds. When in doubt, take a step back and think about how data inputs and outputs piece together. Ask "why" at each part of the process.
10. Find fun projects that interest you!
Rome wasn't built in a day, and neither will your machine learning skills be. Pick topics that interest you, take your time, and have fun along the way.
Eager to learn more? We've got you covered! EliteDataScience.com is an all-in-one resource for learning data science and machine learning. Our approach is hyper-focused on the practical skills that will get you results (and get you paid).
First, we have a wealth of other free guides and tutorials:
In addition, we have premium courses that have already helped thousands break into this field:
Oh, and here are a few of our favorite TED talks about machine learning:
Finally, make sure you join our newsletter for updates and other goodies!