Data Science Statistics

Hypothesis Testing in Practice

Make defensible statistical decisions from real data with confidence, clarity, and practical judgment.

Hypothesis Testing in Practice logo
Quick Course Facts
20
Self-paced, Online, Lessons
20
Videos and/or Narrated Presentations
7.0
Approximate Hours of Course Media
About the Hypothesis Testing in Practice Course

Hypothesis Testing in Practice is a focused Data Science course that teaches you how to evaluate evidence, compare groups, and turn statistical results into sound recommendations. You will learn to make defensible statistical decisions from real data with confidence, clarity, and practical judgment.

Apply Hypothesis Testing In Practice To Real Data Science Decisions

  • Build a clear foundation for choosing, running, and interpreting common hypothesis tests.
  • Learn how p-values, confidence intervals, effect sizes, and power work together in real analysis.
  • Practice applied workflows for A/B tests, categorical data, regression coefficients, and group comparisons.
  • Communicate statistical evidence clearly while avoiding p-hacking, overclaiming, and misleading conclusions.

This course teaches practical hypothesis testing for Data Science, from research questions to defensible recommendations.

You will begin with the purpose of hypothesis testing, learning how to translate a research question into testable hypotheses and reason about sampling variation, null models, evidence, significance levels, p-values, and decision rules. From there, the course moves into interpretation, showing how confidence intervals and effect sizes help you distinguish statistical significance from practical importance. You will then work through core tests for means, proportions, paired comparisons, categorical data, correlation, and regression, while learning how assumptions, diagnostics, nonparametric alternatives, sample size, power, and minimum detectable effects shape responsible analysis. Applied lessons on A/B testing, multiple comparisons, false discoveries, p-hacking, optional stopping, and clear reporting help connect statistical methods to real Data Science work. By the end of Hypothesis Testing in Practice, you will be able to make defensible statistical decisions from real data with confidence, clarity, and practical judgment, and explain your conclusions in a way that supports better decisions.

Course Lessons

Full lesson breakdown

Lessons are organized by topic area and each includes descriptive copy for search visibility and student clarity.

Foundations of Statistical Decisions

4 lessons

This lesson introduces hypothesis testing as a disciplined way to make statistical decisions when data are noisy, incomplete, and subject to chance variation. Rather than treating a test as a mechanic…

Lesson 2: From Research Question to Testable Hypotheses

20 min
In this lesson, Professor Amanda Davis shows how to turn an interesting research question into hypotheses that can actually be tested with data. The focus is on defining the population, outcome, compa…

Lesson 3: Sampling Variation, Null Models, and Evidence

21 min
Sampling variation is the reason statistical decisions are necessary: different samples from the same process will rarely give exactly the same result. This lesson builds the foundation for hypothesis…

Lesson 4: Significance Levels, p-Values, and Decision Rules

22 min
This lesson explains how significance levels, p-values, and decision rules work together in a practical hypothesis test. Learners will see why the significance level must be chosen before looking at r…

Interpreting Statistical Results

2 lessons

Lesson 5: Confidence Intervals and Effect Sizes

20 min
This lesson explains how confidence intervals and effect sizes turn statistical results into practical conclusions. Students learn to read intervals as ranges of plausible values, connect them to hypo…

Lesson 6: Statistical Significance vs Practical Importance

18 min
This lesson separates two ideas that are often confused: statistical significance and practical importance . A statistically significant result tells us that the observed data would be unlikely under …

Core Hypothesis Tests

5 lessons

Lesson 7: One-Sample Tests for Means and Proportions

19 min
This lesson teaches the practical workflow for one-sample hypothesis tests when the research question compares one group to a benchmark, target, historical value, or claimed standard. Learners disting…

Lesson 8: Two-Sample Tests for Comparing Groups

22 min
In this lesson, Professor Amanda Davis explains how to compare two groups using defensible two-sample hypothesis tests. The focus is on choosing between independent two-sample tests, paired tests, pro…

Lesson 9: Paired Tests for Before-and-After Comparisons

18 min
This lesson shows how to test before-and-after change when the same people, units, locations, or items are measured twice. The key idea is that paired tests analyze the within-pair differences , not t…

Lesson 10: Testing Differences in Proportions

20 min
This lesson covers hypothesis tests for comparing two population proportions, such as conversion rates, defect rates, support resolution rates, or survey response shares. Students learn how to set up …

Lesson 11: Chi-Square Tests for Categorical Data

21 min
Chi-square tests help analysts make defensible decisions when the data are categorical rather than numerical. This lesson focuses on two practical uses: testing whether one categorical variable follow…

Relationships Between Variables

1 lesson

Lesson 12: Testing Correlation and Regression Coefficients

23 min
This lesson shows how hypothesis tests work when the parameter of interest describes a relationship between variables. You will test whether a population correlation is plausibly zero, whether a regre…

Choosing and Validating Tests

2 lessons

Lesson 13: Assumptions, Diagnostics, and When Tests Break

24 min
This lesson shows how to validate the assumptions behind common hypothesis tests before trusting their results. Students learn to distinguish assumptions about study design, data structure, distributi…

Lesson 14: Nonparametric Alternatives in Practice

21 min
This lesson shows how to choose and validate nonparametric alternatives when classical tests are poorly matched to the data, the scale of measurement, or the research question. You will learn when to …

Designing Better Tests

1 lesson

Lesson 15: Sample Size, Power, and Minimum Detectable Effects

24 min
This lesson shows how sample size, statistical power, and minimum detectable effect work together when designing hypothesis tests. Learners move beyond asking whether a result is statistically signifi…

Applied Testing Workflows

3 lessons

Lesson 16: A/B Testing and Experiment Analysis

23 min
This lesson turns hypothesis testing into a practical A/B testing workflow. Students learn how to translate a product or business question into an experiment, define primary and guardrail metrics, cho…

Lesson 17: Multiple Comparisons and False Discoveries

22 min
This lesson explains why repeated testing changes the meaning of statistical significance. Learners examine how false positives accumulate across many hypotheses, why the phrase p < 0.05 becomes le…

Lesson 18: Common Misuses: p-Hacking, Optional Stopping, and Overclaiming

21 min
This lesson shows how defensible hypothesis tests can become misleading when analysts search across many choices, repeatedly check results, or state conclusions more strongly than the evidence support…

Communicating Evidence

2 lessons

Lesson 19: Reporting Hypothesis Test Results Clearly

19 min
This lesson shows how to report hypothesis test results in a way that is statistically complete, understandable to non-specialists, and resistant to misinterpretation. Learners practice moving beyond …

Lesson 20: End-to-End Case Study: From Question to Recommendation

25 min
This lesson brings the course together through a practical end-to-end case study: turning a business question into a testable statistical question, selecting an appropriate hypothesis test, checking a…
About Your Instructor
Professor Amanda Davis

Professor Amanda Davis

Professor Amanda Davis guides this AI-built Virversity course with a clear, practical teaching style.