The margin of error is a statistic expressing the amount of random sampling error in the results of a survey. The larger the margin of error, the less confidence one should have that a poll result would reflect the result of a survey of the entire population. The margin of error will be positive whenever a population is incompletely sampled and the outcome measure has positive variance, which is to say, the measure varies. The term margin of error is often used in non-survey contexts to indicate observational error in reporting measured quantities.
Concept
Consider a simple yes/no poll as a sample of respondents drawn from a population reporting the percentage of yes responses. We would like to know how close is to the true result of a survey of the entire population, without having to conduct one. If, hypothetically, we were to conduct poll over subsequent samples of respondents, we would expect those subsequent results to be normally distributed about. The margin of error describes the distance within which a specified percentage of these results is expected to vary from. According to the 68-95-99.7 rule, we would expect that 95% of the results to fall within about two standard deviations either side of the true mean. This interval is called the confidence interval, and the radius is called the margin of error, corresponding to a 95% confidence level. Generally, at a confidence level, a sample sized of a population having expected standard deviation, Where denotes the quantile '', and is the standard error.
We would expect the normally distributed values to have a standard deviation which somehow varies with. The smaller, the wider the margin. This is called the standard error. For the single result from our survey, we assume that, and that all subsequent results together would have a variance. Note that corresponds to the variance of a Bernoulli distribution.
Maximum margin of error at different confidence levels
For a confidence level, there is a corresponding confidence interval about the mean, that is, the interval within which values of should fall with probability. Precise values of are given by the quantile function of the normal distribution. Note that is undefined for, that is, is undefined, as is.
0.68
0.999
0.90
0.9999
0.95
0.99999
0.98
0.999999
0.99
0.9999999
0.995
0.99999999
0.997
0.999999999
Since at, we can arbitrarily set, calculate,, and to obtain the maximum margin of error for at a given confidence level and sample size, even before having actual results. With Also, usefully, for any reported
Specific margins of error
If a poll has multiple percentage results, the result closest to 50% will have the highest margin of error. Typically, it is this number that is reported as the margin of error for the entire poll. Imagine poll reports as As a given percentage approaches the extremes of 0% or 100%, its margin of error approaches ±0%.
Comparing percentages
Imagine multiple-choice poll reports as. As described above, the margin of error reported for the poll would typically be, as is closest to 50%. The popular notion of statistical tie or statistical dead heat, however, concerns itself not with the accuracy of the individual results, but with that of the ranking of the results. Which is in first? If, hypothetically, we were to conduct poll over subsequent samples of respondents, and report result, we could use the standard error of difference to understand how is expected to fall about. For this, we need to apply the sum of variances to obtain a new variance,, where is the covariance of and. Thus, Note that this assumes that is close to constant, that is, respondents choosing either A or B would almost never chose C. With three or more choices in closer contention, choosing a correct formula for becomes more complicated.
The formulae above for the margin of error assume that there is an infinitely large population and thus do not depend on the size of population, but only on the sample size. According to sampling theory, this assumption is reasonable when the sampling fraction is small. The margin of error for a particular sampling method is essentially the same regardless of whether the population of interest is the size of a school, city, state, or country, as long as the samplingfraction is small. In cases where the sampling fraction is larger, analysts might adjust the margin of error using a finite population correction to account for the added precision gained by sampling a much larger percentage of the population. FPC can be calculated using the formula ...and so if poll were conducted over 24% of, say, an electorate of 300,000 voters Intuitively, for appropriately large, In the former case, is so small as to require no correction. In the latter case, the poll effectively becomes a census and sampling error becomes moot.
