Šidák correction


In statistics, the Šidák correction, or Dunn–Šidák correction, is a method used to counteract the problem of multiple comparisons. It is a simple method to control the familywise error rate. When all null hypotheses are true, the method provides familywise error control that is exact for tests that are stochastically independent, is conservative for tests that are positively dependent, and is liberal for tests that are negatively dependent. It is credited to a 1967 paper by the statistician and probabilist Zbyněk Šidák.

Usage

The Šidák correction is derived by assuming that the individual tests are independent. Let the significance threshold for each test be ; then the probability that at least one of the tests is significant under this threshold is. Since it is assumed that they are independent, the probability that all of them are not significant is the product of the probabilities that each of them are not significant, or. Our intention is for this probability to equal, the significance level for the entire series of tests. By solving for, we obtain

Šidák correction for t-test