Power estimation for testing normal means

摘要

We examine the validity of the observed power using the estimation approach. Under a robust Bayesian framework, we show that the observed power for testing normal means overestimates the power for significant data yet underestimates the power for insignificant data. This phenomenon persists for one-sided and two-sided problems. Some misinterpretations of the observed power are discussed.