Robust spatial extent inference with a semiparametric bootstrap joint inference procedure
Corresponding Author
Simon N. Vandekar
Department of Biostatistics, Vanderbilt University, Nashville, Tennessee
Correspondence Simon N. Vandekar, Department of Biostatistics, Vanderbilt University, 2525 West End Ave., #1136, Nashville, TN 37203.
Email: [email protected]
Search for more papers by this authorTheodore D. Satterthwaite
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorCedric H. Xia
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorAzeez Adebimpe
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorKosha Ruparel
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorRuben C. Gur
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorRaquel E. Gur
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorRussell T. Shinohara
Department of Biostatistics, Epidemiology, and Informatics, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorCorresponding Author
Simon N. Vandekar
Department of Biostatistics, Vanderbilt University, Nashville, Tennessee
Correspondence Simon N. Vandekar, Department of Biostatistics, Vanderbilt University, 2525 West End Ave., #1136, Nashville, TN 37203.
Email: [email protected]
Search for more papers by this authorTheodore D. Satterthwaite
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorCedric H. Xia
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorAzeez Adebimpe
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorKosha Ruparel
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorRuben C. Gur
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorRaquel E. Gur
Department of Psychiatry, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorRussell T. Shinohara
Department of Biostatistics, Epidemiology, and Informatics, School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
Search for more papers by this authorAbstract
Spatial extent inference (SEI) is widely used across neuroimaging modalities to adjust for multiple comparisons when studying brain-phenotype associations that inform our understanding of disease. Recent studies have shown that Gaussian random field (GRF)-based tools can have inflated family-wise error rates (FWERs). This has led to substantial controversy as to which processing choices are necessary to control the FWER using GRF-based SEI. The failure of GRF-based methods is due to unrealistic assumptions about the spatial covariance function of the imaging data. A permutation procedure is the most robust SEI tool because it estimates the spatial covariance function from the imaging data. However, the permutation procedure can fail because its assumption of exchangeability is violated in many imaging modalities. Here, we propose the (semi-) parametric bootstrap joint (PBJ; sPBJ) testing procedures that are designed for SEI of multilevel imaging data. The sPBJ procedure uses a robust estimate of the spatial covariance function, which yields consistent estimates of standard errors, even if the covariance model is misspecified. We use the methods to study the association between performance and executive functioning in a working memory functional magnetic resonance imaging study. The sPBJ has similar or greater power to the PBJ and permutation procedures while maintaining the nominal type 1 error rate in reasonable sample sizes. We provide an R package to perform inference using the PBJ and sPBJ procedures.
Supporting Information
Filename | Description |
---|---|
biom13114-sup-0001-supplement_pbj_cluster_20190401.pdf5.9 MB | Supplementary Information |
biom13114-sup-0002-supmat.pdf60.4 KB | Supplementary Information |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Benjamini, Y. and Heller, R. (2007) False discovery rates for spatial signals. Journal of the American Statistical Association, 102, 1272–1281.
- Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency. Annals of Statistics, 29(4), 1165–1188.
- Boos, D.D. and Stefanski, L.A. (2013) Essential Statistical Inference: Theory and Methods. New York: Springer-Verlag.
10.1007/978-1-4614-4818-1 Google Scholar
- Durnez, J., Moerkerke, B. and Nichols, T.E. (2014) Post-hoc power estimation for topological inference in fMRI. NeuroImage, 84, 45–64.
- Eklund, A., Knutsson, H. and Nichols, T.E. (2019) Cluster failure revisited: Impact of first level design and physiological noise on cluster false positive rates, 40(7), 2017–2032. https://doi.org/10.1002/hbm.24350
- Eklund, A., Nichols, T.E. and Knutsson, H. (2016) Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates. Proceedings of the National Academy of Sciences, 113(28), 7900–7905.
- Flandin, G. and Friston, K.J. (2016) Analysis of family-wise error rates in statistical parametric mapping using random field theory. Human Brain Mapping, 40(7), 2052–2054.
- Greve, D.N. and Fischl, B. (2018) False positive rates in surface-based anatomical analysis. NeuroImage, 171, 6–14.
- Jenkinson, M., Beckmann, C.F., Behrens, T.E., Woolrich, M.W. and Smith, S.M. (2012) Fsl. Neuroimage, 62, 782–790.
- Kessler, D., Angstadt, M. and Sripada, C.S. (2017) Reevaluating “cluster failure” in fMRI using nonparametric control of the false discovery rate. Proceedings of the National Academy of Sciences, 114, E3372–E3373.
- Long, J.S. and Ervin, L.H. (2000) Using heteroscedasticity consistent standard errors in the linear regression model. The American Statistician, 54, 217–224.
- MacKinnon, J.G. and White, H. (1985) Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties. Journal of Econometrics, 29, 305–325.
- Macmillan, N.A. (2002) Signal detection theory. Stevens’ Handbook of Experimental Psychology, 4, 43–90.
- Mueller, K., Lepsien, J., Möller, H.E. and Lohmann, G. (2017) Commentary: cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates. Frontiers in Human Neuroscience, 11, 345.
- Mumford, J.A. and Nichols, T.E. (2008) Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelation. NeuroImage, 39, 261–268.
- Muschelli, J., Gherman, A., Fortin, J.-P., Avants, B., Whitcher, B. and Clayden, J.D. et al. (2018) Neuroconductor: an R platform for medical imaging analysis. Biostatistics, 20(2), 218–239.
- Pacifico, M.P., Genovese, C., Verdinelli, I. and Wasserman, L. (2004) False discovery control for random fields. Journal of the American Statistical Association, 99, 1002–1014.
- Power, J.D., Cohen, A.L., Nelson, S.M., Wig, G.S., Barnes, K.A., Church, J.A. et al. (2011) Functional network organization of the human brain. Neuron, 72, 665–678.
- Pya, N. and Wood, S.N. (2015) Shape constrained additive models. Statistics and Computing, 25, 543–559.
- Ragland, J.D., Turetsky, B.I., Gur, R.C., Gunning-Dixon, F., Turner, T., Schroeder, L. et al. (2002) Working memory for complex figures: an fMRI comparison of letter and fractal n-back tasks. Neuropsychology, 16, 370–379.
- Romano, J.P., Shaikh, A.M. and Wolf, M. (2008) Control of the false discovery rate under dependence using the bootstrap and subsampling. Test, 17, 417.
- Satterthwaite, T.D., Elliott, M.A., Ruparel, K., Loughead, J., Prabhakaran, K., Calkins, M.E. et al. (2014) Neuroimaging of the Philadelphia neurodevelopmental cohort. NeuroImage, 86, 544–553.
- Satterthwaite, T.D., Wolf, D.H., Erus, G., Ruparel, K., Elliott, M.A., Gennatas, E.D. et al. (2013) Functional maturation of the executive system during adolescence. The Journal of Neuroscience, 33, 16249–16261.
- Satterthwaite, T.D., Wolf, D.H., Loughead, J., Ruparel, K., Elliott, M.A., Hakonarson, H. et al. (2012) Impact of in-scanner head motion on multiple measures of functional connectivity: relevance for studies of neurodevelopment in youth. Neuroimage, 60, 623–632.
- Silver, M., Montana, G., Nichols, T.E. and Initiative, A.D.N. (2011) False positives in neuroimaging genetics using voxel-based morphometry data. Neuroimage, 54, 992–1000.
- Slotnick, S.D. (2017) Cluster success: fMRI inferences for spatial extent have acceptable false-positive rates. Cognitive Neuroscience, 8, 150–155.
- Sun, W., Reich, B.J., Tony Cai, T., Guindani, M. and Schwartzman, A. (2015) False discovery control in large-scale spatial multiple testing. Journal of the Royal Statistical Society, Series B, 77, 59–83.
10.1111/rssb.12064 Google Scholar
- Van der Vaart, A.W. (2000) Asymptotic Statistics. New York, NY: Cambridge University Press.
- Vandekar, S.N., Satterthwaite, T.D., Rosen, A., Ciric, R., Roalf, D.R., Ruparel, K. et al. (2018) Faster family-wise error control for neuroimaging with a parametric bootstrap. Biostatistics, 19, 497–513.
- White, H. (1980) A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48(4), 817–838.
- Winkler, A.M., Ridgway, G.R., Webster, M.A., Smith, S.M. and Nichols, T.E. (2014) Permutation inference for the general linear model. Neuroimage, 92, 381–397.
- Wood, S.N. and Augustin, N.H. (2002) GAMs with integrated model selection using penalized regression splines and applications to environmental modelling. Ecological Modelling, 157, 157–177.
- Woodward, N.D. and Heckers, S. (2016) Mapping thalamocortical functional connectivity in chronic and early stages of psychotic disorders. Biological Psychiatry, 79, 1016–1025.
- Worsley, K.J., Andermann, M., Koulis, T., MacDonald, D. and Evans, A.C. (1999) Detecting changes in nonisotropic images. Human Brain Mapping, 8, 98–101.
10.1002/(SICI)1097-0193(1999)8:2/3<98::AID-HBM5>3.0.CO;2-F CAS PubMed Web of Science® Google Scholar
- Xia, M., Wang, J. and He, Y. (2013) BrainNet viewer: a network visualization tool for human brain connectomics. PLOS One, 8(7), e68910.
- Yekutieli, D. and Benjamini, Y. (1999) Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics. Journal of Statistical Planning and Inference, 82, 171–196.