Here are a few notes on Statistical Design from class today...
As you design your study it is important to realize that statistical significance is different than practical significance. Your results can be statistically significant, but not practically important.
Determining the Sample size
The following four pieces of information are needed to determine the sample size:
- Acceptable type on error (alpha) - standard value is .05
- Acceptable type two error (beta) - standard value is .2 (power of .8)
- Standard deviation - pooled estimate of the standard deviation (sq. rt. of the error mean squared error), includes block effects and covariates
- Meaningful difference you want to detect
n=16/(delta/sigma)^2where
delta
is the change in means between the two groups you might be comparing.Here is another rough regression rule of thumb:
n=15*pWhere p is the number of parameters being used.
Finally, here are some steps to cover when designing your statistical experiments.
Steps in Design
- Question of interest
- Score of inference
- Understand the system
- Response
- Other factors
- Planning
- Statistical anaysis
- Sample size