A 2-Day Seminar Taught by David Wilson, Ph.D.
To see a sample of the course materials, click here.
How do you make sense of conflicting results across studies? It is common for a finding that is statistically significant in one study to be statistically nonsignificant in another. Does this reflect differences in the design of the studies? Do the effects actually agree in direction and magnitude even if they are different in statistical significance? What if we have 5 such studies, or 50, or 500? It would be surprising if all such studies were in perfect agreement with one another. Thus, we need a method to make sense of the variability in findings across studies.
Meta-analysis is a statistical solution to this problem and has become a widely-used method for synthesizing results across studies in the social and behavioral sciences and medicine, as well as several physical sciences, such as ecology. The key to meta-analysis is the effect size: it encodes the direction and magnitude of the finding on a common scale. Using specialized statistical methods, the average effect across studies can be estimated as well as an examination of the consistency of the effects. Analyses can also explore potential explanations for inconsistencies in findings, such as theoretically relevant design differences.
This course will provide hands-on instruction in conducting all aspects of a meta-analysis, including the systematic nature of the study search and retrieval process, systematic coding and data extraction, computation of various effect size types, and the estimation of both fixed and random-effects meta-analysis models. Students will also learn both categorical and regression based moderator analysis and methods for exploring publication selection bias. Finally, reporting and presentation of the results of a meta-analysis will be taught.
This seminar will use Stata for the worked exercises. However, no previous experience with Stata is assumed. Exercises can also be completed in SPSS and R (on request). To participate in the hands-on exercises, you are strongly encouraged to bring a laptop computer. A power outlet and wireless access will be available at each seat.
For Stata users, version 14 will be used for the examples, but the exercises can also be done with versions 12 or 13. Seminar participants who are not yet ready to purchase Stata could take advantage of StataCorp’s free 30-day evaluation offer or their 30-day software return policy.
Who should attend
This course will be helpful for researchers in any field who want to learn how to statistically synthesize results across independent studies using meta-analytic methods. Participants should have a basic working knowledge of introductory statistics through multiple regression analysis. No knowledge of matrix algebra is required or assumed but familiarity with standard statistical notation is useful.
LOCATION, Format, and MATERIALS
The class will meet from 9 am to 5 pm each day with a 1-hour lunch break from 12 pm to 1 pm at Temple University Center City, 1515 Market Street, Philadelphia, PA 19103.
Participants receive a bound manual containing detailed lecture notes (with equations and graphics), examples of computer printout, and many other useful features. This book frees participants from the distracting task of note taking.
Registration and lodging
The fee of $995 includes all course materials.
If you cancel your registration at least two weeks before the course is scheduled to begin, you are entitled to a full refund (minus a processing fee of $50).
Lodging Reservation Instructions
Club Quarters Hotel, 1628 Chestnut Street, Philadelphia, PA 19102. A block of guest rooms has been reserved at a special rate of $139 (Club Room) and $215 (Superior Room). In order to make reservations, call 203-905-2100 during business hours and identify yourself by using group code STAT10 or click here. For guaranteed rate and availability, you must reserve your room no later than Tuesday, September 19.
If you make reservations after the cut-off date ask for the Statistical Horizon’s room rate (do not use the code) and they will try to accommodate your request.
Embassy Suites, 1776 Benjamin Franklin Parkway, Philadelphia, PA 19103. A block of guest rooms has also been reserved at a special rate of $179 per night. This location is less than a 10 minute walk to the seminar location. In order to make reservations, call 1-800-Embassy and identify yourself by using group code HRZ or click here. For guaranteed rate and availability, you must reserve your room no later than Tuesday, September 19.
Sonesta, 1800 Market Street, Philadelphia, PA 19103. A block of guest rooms has also been reserved at a special rate of $219 per night. This location is about a 5 minute walk to the seminar location. For guaranteed rate and availability, you must reserve your room by calling 1-215-561-7500 and identify yourself as part of the Statistical Horizons group no later than Tuesday, September 19.
Make reservations early as there are other conferences in town this weekend and availability will be limited.
- Logic of meta-analysis
- Scope and problem formulation
- Computing effect sizes
- Coding studies and database structure
- Fixed-effect meta-analysis
- Random-effects meta-analysis
- Categorical moderator analysis
- Regression based moderator analysis
- Creating forest plots
- Robust standard errors for dependent effect sizes
- Assessing publication bias
- Interpretation and reporting of results
“Dr. David Wilson did an excellent job providing background knowledge about the process of performing a meta-analysis, then progressing into techniques for computing effect sizes, basic meta-analysis methods, and finally to more advanced methodologies. What impressed me the most about the seminar was how much I learned in a period of two days. If you are a working professional, and unable to invest in a semester-long course, I highly recommend the workshops offered by Statistical Horizons for a cost-effective alternative delivered by some of the most prominent methodologists in their respective fields.”
Daniel Wissinger, Indiana University of Pennsylvania