Machine Learning - Online Course

Scientific research is increasingly conducted using data sets that are larger and more complex than the data for which conventional statistical tools were designed. Examples of such data include population-scale information on individual-level consumer and political behavior, data streams collected from social media and other digital sources, and data streamed from physical and environmental sensors.

There are three fundamental ways in which fine-grained, voluminous, and high-dimensional data require a set of methods that are more flexible than the conventional statistical toolkit. First, the data are inherently more complex, making it difficult to specify an adequate statistical model from theory alone. Second, the data are high dimensional, meaning there are more variables than one can include in conventional statistical models. Third, the data contain adequate information to make highly accurate, and importantly, actionable, predictions about unseen data (e.g., forecasts). These three features require an analytical toolkit that is capable of learning model structure, selecting variables, and producing accurate predictions, which are all capabilities of foundational machine learning methods. In this seminar, we will cover foundational machine learning, with a focus on essential concepts and practical application.

The seminar begins by introducing the foundational concepts of predictive modeling and model evaluation with held-out data and cross-validation. Next, we will focus on algorithms for model building and variable selection within the machine learning framework. Finally, we will cover core classes of machine learning models, sometimes referred to as “learners”. These include k-nearest neighbor methods, support vector machines, regression trees, random forests, and XGBoost. Throughout the seminar, you will gain experience through hands-on exercises.

This seminar will use R for all the computing tasks. To participate in the hands-on exercises, you are encouraged to use a computer with the most recent version of R and RStudio installed. RStudio is an integrated development environment (IDE) for R that makes a powerful companion to the R programming language. Both R and RStudio are free and available for all major operating systems.

To follow the presentation and do the exercises, you should feel comfortable performing basic tasks in R, such as importing and coding data, making simple plots, and estimating regression models.

If you’d like to take this course but are concerned that you don’t know enough R, there are excellent online resources for learning the basics. Here are our recommendations.

If you are interested in taking a data-driven approach to model building, learning how to optimize models for predictive performance, learning best practices for capturing complex nonlinear relationships in data, and/or building a foundation for training in the growing field of deep learning, this seminar is for you. To get the most out of this seminar, you should have a background in regression.

Day 1: Introduction to machine learning

• Introduction to machine learning
• Introduction to R
• Predictive vs. explanatory modeling
• Evaluating predictive performance with held-out data and cross-validation

Day 2: Regression recap and variable selection

• Linear and logistic regression recap
• Feature/variable importance
• Best subsets regression

Day 3: Foundational machine learning methods for prediction

• Regularization
• k-nearest neighbors
• Support vector machines

Day 4: Advanced machine learning methods for prediction and exploration

• Trees, random forests, and XGboost
• Neural networks
• Clustering
• Principal component analysis

The fee of $995 includes all course materials.

PayPal and all major credit cards are accepted.

Our Tax ID number is 26-4576270.