Stats Reunion: What have we learned so far?

It’s our first stats reunion! In this special review episode, we revisit favorite concepts from past episodes—p-values, multiple testing, regression adjustment—and give them fresh personalities as characters. Meet the seductive false positive, the clingy post hoc ex, and Charlotte, the well-meaning but overfitting idealist.

Statistical topics
• Bar charts vs Box plots
• Bonferroni correction
• Confounding
• False positives
• Multiple testing
• Multivariable regression
• Outcome switching
• Over-adjustment
• Post hoc analysis
• Pre-registration
• Residual confounding
• Statistical adjustment using regression
• Subgroup analysis
• Unmeasured confounding

Review Sheet (bit.ly/40ALdAT)

References
• Nuzzo RL. The Box Plots Alternative for Visualizing Quantitative Data (pubmed.ncbi.nlm.nih.gov/26892802). PM R. 2016 Mar;8(3):268-72. doi: 10.1016/j.pmrj.2016.02.001. Epub 2016 Feb 15. PMID: 26892802.
• Sainani KL. The problem of multiple testing (pubmed.ncbi.nlm.nih.gov/20006317). PM R. 2009 Dec;1(12):1098-103. doi: 10.1016/j.pmrj.2009.10.004. PMID: 20006317.

Kristin and Regina’s online courses:
Demystifying Data: A Modern Approach to Statistical Understanding (online.stanford.edu/courses/som-xche0033-demys…)
Clinical Trials: Design, Strategy, and Analysis (online.stanford.edu/courses/som-xche0030-clini…)
Medical Statistics Certificate Program (online.stanford.edu/programs/medical-statistic…)
Writing in the Sciences (coursera.org/learn/sciwrite)
Epidemiology and Clinical Research Graduate Certificate Program (online.stanford.edu/programs/epidemiology-and-…)

Programs that we teach in:
Epidemiology and Clinical Research Graduate Certificate Program (online.stanford.edu/programs/epidemiology-and-…)

Find us on:
Kristin - LinkedIn (linkedin.com/in/kristin-sainani-642b5914) &Twitter/X (x.com/KristinSainani)
Regina -LinkedIn (linkedin.com/in/reginanuzzo) &ReginaNuzzo.com (reginanuzzo.com)

• (00:00) - Intro

• (02:26) - Mailbag

• (06:42) - P-values

• (12:43) - Multiple Testing Guy

• (16:05) - Bonferroni solution

• (17:11) - Post hoc analysis ex

• (22:22) - Subgroup analysis person

• (29:34) - Statistical adjustment idealist

• (43:00) - Unmeasured confounding

• (44:25) - Residual confounding

• (48:31) - Over-adjustment

• (53:48) - Wrap-up