Cross-Dimensional Inference of Dependent High-Dimensional Data

• 成果类型: Article
• 署名作者: Desai, Keyur H.; Storey, John D.
• 署名单位: Princeton University; Princeton University
• 刊物名称: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• ISSN/ISSBN: 0162-1459
• DOI: 10.1080/01621459.2011.645777
• 发表日期: 2012
• 页码: 135-151
• 关键词: false discovery rate; COVARIANCE ESTIMATION; general framework; regression; NULL

摘要

A growing number of modern scientific problems in areas such as genomics, neurobiology, and spatial epidemiology involve the measurement and analysis of thousands of related features that may be stochastically dependent at arbitrarily strong levels. In this work, we consider The scenario where the features follow a multivariate Normal distribution. We demonstrate that dependence is manifested as random variation shared among features, and that standard methods may yield highly unstable inference due to dependence, even when the dependence: is fully parameterized and utilized in the procedure. We propose a cross-dimensional inference framework that alleviates the problems due to dependence by modeling and removing the variation shared among features, while also properly regularizing estimation across features. We demonstrate the framework on both simultaneous point estimation and multiple hypothesis testing in scenarios derived from the scientific applications of interest.