Common reducing subspace model and network alternation analysis
Wenjing Wang
Department of Statistics, Florida State University, Tallahassee, Florida
Search for more papers by this authorXin Zhang
Department of Statistics, Florida State University, Tallahassee, Florida
Search for more papers by this authorCorresponding Author
Lexin Li
Department of Biostatistics and Epidemiology, University of California, Berkeley, California
Correspondence Lexin Li, Department of Biostatistics and Epidemiology, University of California, Berkeley, CA 94720.
Email: [email protected]
Search for more papers by this authorWenjing Wang
Department of Statistics, Florida State University, Tallahassee, Florida
Search for more papers by this authorXin Zhang
Department of Statistics, Florida State University, Tallahassee, Florida
Search for more papers by this authorCorresponding Author
Lexin Li
Department of Biostatistics and Epidemiology, University of California, Berkeley, California
Correspondence Lexin Li, Department of Biostatistics and Epidemiology, University of California, Berkeley, CA 94720.
Email: [email protected]
Search for more papers by this authorAbstract
Motivated by brain connectivity analysis and many other network data applications, we study the problem of estimating covariance and precision matrices and their differences across multiple populations. We propose a common reducing subspace model that leads to substantial dimension reduction and efficient parameter estimation. We explicitly quantify the efficiency gain through an asymptotic analysis. Our method is built upon and further extends a nascent technique, the envelope model, which adopts a generalized sparsity principle. This distinguishes our proposal from most xisting covariance and precision estimation methods that assume element-wise sparsity. Moreover, unlike most existing solutions, our method can naturally handle both covariance and precision matrices in a unified way, and work with matrix-valued data. We demonstrate the efficacy of our method through intensive simulations, and illustrate the method with an autism spectrum disorder data analysis.
Supporting Information
Web Appendices referenced in Sections 2.4, 3.2, and 4, and the associated computer code, are available with this paper at the Biometrics website on Wiley Online Library.
Filename | Description |
---|---|
biom13099-sup-0001-biom2018354m.r2-supplement.pdf243.6 KB | Supplementary Information |
biom13099-sup-0002-code.zip254.1 KB | Supplementary Information |
biom13099-sup-0003-supmat.pdf26.1 KB | Supplementary Information |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Ahn, M., Shen, H., Lin, W. and Zhu, H. (2015) A sparse reduced rank framework for group analysis of functional neuroimaging data. Statistica Sinica, 25, 295–312.
- Becker, E.B. and Stoodley, C.J. (2013) Chapter one—autism spectrum disorder and the cerebellum. In: G. Konopka (Ed.) Neurobiology of Autism, volume 113 of International Review of Neurobiology. Cambridge, MA: Academic Press, pp. 1–34.
- Boik, R.J. (2002) Spectral models for covariance matrices. Biometrika, 89, 159–182.
- Bullmore, E. and Sporns, O. (2009) Complex brain networks: graph theoretical analysis of structural and functional systems. Nature Reviews. Neuroscience, 10, 186–198.
- Cai, T. and Liu, W. (2011) Adaptive thresholding for sparse covariance matrix estimation. Journal of the American Statistical Association, 106, 672–684.
- Cai, T.T., Li, H., Liu, W. and Xie, J. (2016) Joint estimation of multiple high-dimensional precision matrices. Statistica Sinica, 26, 445–464.
- Cai, T.T., Liu, W. and Luo, X. (2011) A constrained minimization approach to sparse precision matrix estimation. Journal of the American Statistical Association, 106, 594–607.
- Chen, S., Kang, J. and Wang, G. (2015a) An empirical Bayes normalization method for connectivity metrics in resting state fmri. Frontiers in Neuroscience, 9, 9.
- Chen, S., Kang, J., Xing, Y. and Wang, G. (2015b) A parsimonious statistical method to detect groupwise differentially expressed functional connectivity networks. Human Brain Mapping, 36, 5196–5206.
- Chen, T., Ryali, S., Qin, S. and Menon, V. (2013) Estimation of resting-state functional connectivity using random subspace based partial correlation: a novel method for reducing global artifacts. NeuroImage, 82, 87–100.
- Cheng, W., Rolls, E.T., Gu, H., Zhang, J. and Feng, J. (2015) Autism: reduced connectivity between cortical areas involved in face expression, theory of mind, and the sense of self. Brain, 138, 1382–1393.
- Chiquet, J., Grandvalet, Y. and Ambroise, C. (2011) Inferring multiple graphical structures. Statistics and Computing, 21, 537–553.
- Cook, R.D. and Forzani, L. (2008) Covariance reducing models: an alternative to spectral modelling of covariance matrices. Biometrika, 95, 799–812.
- Cook, R.D., Helland, I.S. and Su, Z. (2013) Envelopes and partial least squares regression. Journal of the Royal Statistical Society, Series B, 75, 851–877.
- Cook, R.D., Li, B. and Chiaromonte, F. (2010) Envelope models for parsimonious and efficient multivariate linear regression. Statistica Sinica, 20, 927–960.
- Cook, R.D. and Zhang, X. (2015) Foundations for envelope models and methods. Journal of the American Statistical Association, 110, 599–611.
- Cook, R.D. and Zhang, X. (2016) Algorithms for envelope estimation. Journal of Computational and Graphical Statistics, 25, 284–300.
- Danaher, P., Wang, P. and Witten, D.M. (2014) The joint graphical lasso for inverse covariance estimation across multiple classes. Journal of the Royal Statistical Society, Series B, 76, 373–397.
- DiMartino, A., Yan, C.-G., Li, Q., Denio, E., Castellanos, F.X. and Alaerts, K. et al. (2014) The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism. Molecular Psychiatry, 19, 659–667.
- Flury, B.K. (1987) Two generalizations of the common principal component model. Biometrika, 74, 59–69.
- Flury, B.N. (1984) Common principal components in k groups. Journal of the American Statistical Association, 79, 892–898.
- Fornito, A., Zalesky, A. and Breakspear, M. (2013) Graph analysis of the human connectome: promise, progress, and pitfalls. NeuroImage, 80, 426–444.
- Fox, M.D. and Greicius, M. (2010) Clinical applications of resting state functional connectivity. Frontiers in Systems Neuroscience, 4, 1–13.
- Franks, A. and Hoff, P. (2016). Shared subspace models for multi-group covariance estimation [Preprint]. Available at: https://arxiv.org/abs/1607.03045. (Accessed August, 2016).
- Friedman, J., Hastie, T. and Tibshirani, R. (2008) Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9, 432–441.
- Guo, J., Levina, E., Michailidis, G. and Zhu, J. (2011) Joint estimation of multiple graphical models. Biometrika, 98, 1–15.
- Huang, W., Gallivan, K.A. and Absil, P.-A. (2015) A broyden class of quasi-newton methods for riemannian optimization. SIAM Journal on Optimization, 25, 1660–1685.
- Kim, J., Wozniak, J.R., Mueller, B.A., Shen, X. and Pan, W. (2014) Comparison of statistical tests for group differences in brain functional networks. NeuroImage, 101, 681–694.
- Lee, W. and Liu, Y. (2015) Joint estimation of multiple precision matrices with common structures. Journal of Machine Learning Research, 16, 1035–1062.
- Leng, C. and Tang, C.Y. (2012) Sparse matrix graphical models. Journal of the American Statistical Association, 107, 1187–1200.
- Li, L. and Zhang, X. (2017) Parsimonious tensor response regression. Journal of the American Statistical Association, 112, 1131–1146.
- Liu, W. and Luo, X. (2015) Fast and adaptive sparse precision matrix estimation in high dimensions. Journal of Multivariate Analysis, 135, 153–162.
- Long, Z., Duan, X., Mantini, D. and Chen, H. (2016) Alteration of functional connectivity in autism spectrum disorder: effect of age and anatomical distance. Scientific Reports, 6, 26527.
- Martin, S., Raim, A.M., Huang, W. and Adragni, K.P. (2016) Manifoldoptim: an r interface to the roptlib library for riemannian manifold optimization [Preprint]. Available at: https://arxiv.org/abs/1612.03930. (Accessed December, 2016).
- Peng, J., Wang, P., Zhou, N. and Zhu, J. (2009) Partial correlation estimation by joint sparse regression models. Journal of the American Statistical Association, 104, 735–746.
- Qiu, H., Han, F., Liu, H. and Caffo, B. (2016) Joint estimation of multiple graphical models from high dimensional time series. Journal of the Royal Statistical Society, Series B, 78, 487–504.
10.1111/rssb.12123 Google Scholar
- Ravikumar, P., Wainwright, M.J., Raskutti, G. and Yu, B. (2011) High-dimensional covariance estimation by minimizing -penalized log-determinant divergence. Electronic Journal of Statistics, 5, 935–980.
- Rudie, J., Brown, J., Beck-Pancer, D., Hernandez, L., Dennis, E. and Thompson, P. et al. (2013) Altered functional and structural brain network organization in autism. NeuroImage, 2, 79–94.
- Ryali, S., Chen, T., Supekar, K. and Menon, V. (2012) Estimation of functional connectivity in fmri data using stability selection-based sparse partial correlation with elastic net penalty. NeuroImage, 59, 3852–3861.
- Schott, J. R. (1999) Partial common principal component subspaces. Biometrika, 86, 899–908.
- Su, Z., Zhu, G., Chen, X. and Yang, Y. (2016) Sparse envelope model: efficient estimation and response variable selection in multivariate linear regression. Biometrika, 103, 579–593.
- Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O. and Delcroix, N. et al. (2002) Automated anatomical labeling of activations in spm using a macroscopic anatomical parcellation of the mni mri single-subject brain. Neuroimage, 15, 273–289.
- Wang, Y., Kang, J., Kemmer, P.B. and Guo, Y. (2016) An efficient and reliable statistical method for estimating functional connectivity in large scale brain networks using partial correlation. Frontiers in Neuroscience, 10, 1–17.
- Xia, M., Wang, J. and He, Y. (2013) Brainnet viewer: a network visualization tool for human brain connectomics. PLOS One, 8, 1–15.
- Xia, Y. and Li, L. (2017) Hypothesis testing of matrix graph model with application to brain connectivity analysis. Biometrics, 73, 780–791.
- Yin, J. and Li, H. (2012) Model selection and estimation in the matrix normal graphical model. Journal of Multivariate Analysis, 107, 119–140.
- Yuan, M. and Lin, Y. (2007) Model selection and estimation in the gaussian graphical model. Biometrika, 94, 19–35.
- Zhang, X. and Mai, Q. (2018) Model-free envelope dimension selection. Electronic Journal of Statistics, 12, 2193–2216.
- Zhao, S.D., Cai, T.T. and Li, H. (2014) Direct estimation of differential networks. Biometrika, 101, 253–268.
- Zhu, Y., Shen, X. and Pan, W. (2014) Structural pursuit over multiple undirected graphs. Journal of the American Statistical Association, 109, 1683–1696.