Statistica Sinica

Zhidong Bai and Hewa Saranadasa

Abstract:With the rapid development of modern computing techniques, statisticians are dealing with data with much higher dimension. Consequently, due to their loss of accuracy or power, some classical statistical inferences are being challenged by non-exact approaches. The purpose of this paper is to point out and briefly analyze such a phenomenon and to encourage statisticians to reexamine classical statistical approaches when they are dealing with high dimensional data. As an example, we derive the asymptotic power of the classical Hotelling'sT^{2}test and Dempster's non-exact test for a two-sample problem. Also, an asymptotically normally distributed test statistic is proposed. Our results show that both Dempster's non-exact test and the new test have higher power than Hotelling's test when the data dimension is proportionally close to the within sample degrees of freedom. Although our new test has an asymptotic power function similar to Dempster's, it does not rely on the normality assumption. Some simulation results are presented which show that the non-exact tests are more powerful than Hotelling's test even for moderately large dimension and sample sizes.

Key words and phrases:Edgeworth expansion, HotellingT^{2}test, hypothesis test, power function, significance test,X^{2}approximation.