Confidence interval provides the possibility of various proportions of the sample or the sample mean of the proportion of true / it was found in the population. This allows us to estimate the accuracy of the results obtained from our sample, compared with the actual population. It usually appears as estimate plus or minus(+/-) of margin of error. Margin of error only includes random sampling error where non-responses survey are not included. Also, Outliers can have a big impact on the confidence interval. This is not surprising because we are using the mean and standard deviation to calculate the confidence interval and outliers are definitely can skewed the data and in the end give inaccurate confidence intervals. A confidence interval is a measure of the uncertainty around the sample mean, giving us the range of values in which the population mean lies, with a given confidence level. In other words, confidence intervals show us the range in which 95% or 99% or 99.9% of the sample mean can be expected to lie if repeated surveys occurred. This helps us to decide whether the sample mean is reliable enough for different purposes.
For example:
The Canada government used a clustered, stratified multi-stage sample design to survey about their health care facility wellness in 2012. In addition, weights were applied when obtaining survey estimates. One of the effects of using the complex design and weighting is that standard errors for survey estimates are higher than the standard errors that would be caused from an unweighted simple random sample of the same size. Hence, the true standard errors of the complex design are calculated by multiplying the standard error (of an estimate from a simple random sample) by the design factor.
The ratio of the standard error of the complex sample to that of a simple random sample of the same size is known as the design factor.
The 95% confidence interval of a complex survey design is equal to:
p +/- (1.96 x true standard error)
where:
-true standard error = design factor x standard error of a simple random sample; and
-p = the point estimate, which is the percentage or proportion estimated from our sample (or sample mean)
Canadian government, thus, can quickly produce the confidence intervals of an estimate from a complex survey design with a big sample of Canadian citizens and they can measure how satisfied Canadian citizens with the health care that the government provided.