Linear Regression

A 2-Day Seminar Taught by Paul Allison, Ph.D.

Read reviews of this seminar

Linear regression is the most widely-used method for the statistical analysis of non-experimental (observational) data. It’s also the essential foundation for understanding more advanced methods like logistic regression, survival analysis, multilevel modeling, and structural equation modeling. Without a thorough mastery of linear regression, there’s little point in trying to learn more complex regression methods.

If you’ve never had a course on linear regression, or if you took one so long ago that you have forgotten most of it, this seminar will get you up to speed. In two days, we’ll cover almost a semester’s worth of material. When it’s over, you’ll be a knowledgeable and effective user of regression methods. And you will have the necessary preparation to take most of Statistical Horizons’ more advanced seminars.

Paul Allison has been teaching courses on linear regression for more than 30 years. He is the author of the popular text, Multiple Regression, which provides a very practical, intuitive, and non-mathematical introduction to the topic of linear regression.

The seminar will begin by focusing on the two major goals of linear regression: prediction and hypothesis testing. We’ll look at several examples from published articles to see how linear regression is used in practice and how to interpret regression tables.

Next we’ll consider all the things that can go wrong when using linear regression, and we’ll see how to critique the analyses done by others.

We’ll delve into the mathematical theory behind linear regression, focusing on the essential assumptions, and on the implied properties of the least squares method. We’ll also spend considerable time on techniques for building non-linearity into linear regression by way of transformations, interactions, and dummy (indicator) variables.

There will be lots of hands-on exercises using either SAS or Stata.


Because this is a hands-on course, you will need to bring your own laptop loaded with a recent version of SAS (release 9.2 or later) or Stata (release 13 or later).

Seminar participants who are not yet ready to purchase Stata could take advantage of StataCorp’s free 30-day evaluation offer or their 30-day software return policy.

There is now a free version of SAS, called the SAS University Edition, that is available to anyone. It has everything needed to run the exercises in this course, and it will run on Windows, Mac or Linux computers. However, you do need a 64-bit machine with at least 1 GB of RAM. You also have to download and install virtualization software that is available free from third-party vendors. The SAS Studio interface runs in your browser, but you do not have to be connected to the Internet. The download and installation are a bit complicated, but well worth the time and effort.


This seminar is designed for people who have a basic background in statistics, and who want to learn more about the theory and practice of linear regression. You’ll need to have taken an introductory course in statistics, and be comfortable with such concepts as random sampling, measures of center and variability, correlation, sampling distributions, standard errors, confidence intervals, and hypothesis testing. You should also have at least some experience using either SAS or Stata. Neither matrix algebra nor calculus will be used.

Although the course is relatively non-mathematical, considerable emphasis will be placed on the underlying assumptions and their implications. Upon completion of this seminar, you should be able to run your own linear regressions, build and evaluate regression models, and interpret and critique regression results.

Location, Format and materials

The class will meet from 9 am to 5 pm each day with a 1-hour lunch break at Temple University Center City, 1515 Market Street, Philadelphia, PA 19103. 

Participants receive a bound manual containing detailed lecture notes (with equations and graphics), examples of computer printout, and many other useful features. This book frees participants from the distracting task of note taking. 

Registration and Lodging

The fee of $995.00 includes all seminar materials.

Refund Policy

If you cancel your registration at least two weeks before the course is scheduled to begin, you are entitled to a full refund (minus a processing fee of $50). 

Lodging Reservation Instructions

A block of guest rooms has been reserved at the Club Quarters Hotel, 1628 Chestnut Street, Philadelphia, PA at a special rate of $165 per night. This location is about a 5-minute walk to the seminar location. In order to make reservations, call 203-905-2100 during business hours and identify yourself by using group code SH0425 or click here. For guaranteed rate and availability, you must reserve your room no later than Monday, March 25, 2019.

If you need to make reservations after the cut-off date, you may call Club Quarters directly and ask for the “Statistical Horizons” rate (do not use the code or mention a room block) and they will try to accommodate your request.


  1. What is linear regression and what is it good for?
  2. Examples of published regression analyses and interpretation of results.
  3. The mechanics of regression in SAS and Stata.
  4. Bivariate and trivariate regression.
  5. Assumptions of linear regression and properties of least squares estimation.
  6. Evaluation of regression models.
  7. What can go wrong in linear regression.
  8. Regression, correlation, and standardized coefficients.
  9. Nonlinearity and interaction.
  10. Dummy (indicator) variables.
  11. Multicollinearity.
  12. Model building strategies.
  13. Missing data.
  14. Heteroscedastity.

Comments from Recent participants

“Great overview of Linear Regression – its assumptions, the implications of relaxing them and interpreting the results. Very well organized, thorough and conceptual, with detailed examples illustrating how to think about actual results. Very useful, and I learned a lot even though I’ve been running regression for 20 years.”
  Michael Cook, Credit Suisse 

“The seminar is at the same time thorough and rigorous, yet full of direct applications that can immediately be implemented. I wholeheartedly recommend this course.”
  Monica Ionescu, The Wharton School, University of Pennsylvania

“A thorough and comprehensive overview of regression. Fabulous refresher course for anyone and a first step for those interested in taking more advanced courses. Highly recommended!”
  Gigliana Melzi, New York University 

“This course is a great review or introduction to linear regression. It is very practical and will definitely prove to be helpful in my work environment. I felt it was a great benefit that I learned as much about how to use regression in the software I use as I did about the assumptions and premises of the models.”
  Jessica Rast, Drexel Autism Institute 

“Am excellent overview of linear models. Covered concepts that I had not had since graduate school in a clear; concise, and understandable way.”
  Thomas Cohen, US Courts 

“This was an excellent course – clear and accessible. Thanks!”
  Clara Wagner, U.S. Department of Veterans Affairs 

“Great class. Professor Allison does an excellent job of introducing this topic. Even though I have used linear regression for a long time, I learned a few tricks on missing data, what assumptions I should be concerned about, and the Mean Variance Model to correct heteroscedasticity.”
  Vijay Raghavan, Actavis