
Here are a few notes on Statistical Design from class today...
As you design your study it is important to realize that statistical significance is different than practical significance. Your results can be statistically significant, but not practically important.
Determining the Sample size
The following four pieces of information are needed to determine the sample size:
- Acceptable type on error (alpha) - standard value is .05
- Acceptable type two error (beta) - standard value is .2 (power of .8)
- Standard deviation - pooled estimate of the standard deviation (sq. rt. of the error mean squared error), includes block effects and covariates
- Meaningful difference you want to detect
n=16/(delta/sigma)^2where
delta is the change in means between the two groups you might be comparing.Here is another rough regression rule of thumb:
n=15*pWhere p is the number of parameters being used.
Finally, here are some steps to cover when designing your statistical experiments.
Steps in Design
- Question of interest
- Score of inference
- Understand the system
- Response
- Other factors
- Planning
- Statistical anaysis
- Sample size

Listening from my office I found it quite interesting and relevant, particularly with the doom and gloom ever present in the news. Here are a few tips that he mentioned (they had be learned primarily through controlled experiments):























