Comparison of Automated Brain Volume Measures obtained with NeuroQuant® and FreeSurfer
Corresponding Author
Alfred L. Ochs
Virginia Institute of Neuropsychiatry, Midlothian, VA
Department of Biomedical Engineering, Virginia Commonwealth University, Richmond, VA
Correspondence: Address correspondence to Alfred L. Ochs, Virginia Institute of Neuropsychiatry, 364 Browns Hill Court, Midlothian, VA 23114, 804-502-7331; E-mail: [email protected].Search for more papers by this authorDavid E. Ross
Virginia Institute of Neuropsychiatry, Midlothian, VA
Department of Psychiatry, Virginia Commonwealth University, Richmond, VA
Search for more papers by this authorMegan D. Zannoni
Virginia Institute of Neuropsychiatry, Midlothian, VA
Search for more papers by this authorTracy J. Abildskov
Department of Psychology and Neuroscience Center, Brigham Young University, Provo, UT
Search for more papers by this authorErin D. Bigler
Department of Psychology and Neuroscience Center, Brigham Young University, Provo, UT
Department of Psychiatry and The Brain Institute of Utah, University of Utah, Salt Lake City, UT
Search for more papers by this authorFor the Alzheimer's Disease Neuroimaging Initiative
Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (http://adni.loni.usc.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf
Search for more papers by this authorCorresponding Author
Alfred L. Ochs
Virginia Institute of Neuropsychiatry, Midlothian, VA
Department of Biomedical Engineering, Virginia Commonwealth University, Richmond, VA
Correspondence: Address correspondence to Alfred L. Ochs, Virginia Institute of Neuropsychiatry, 364 Browns Hill Court, Midlothian, VA 23114, 804-502-7331; E-mail: [email protected].Search for more papers by this authorDavid E. Ross
Virginia Institute of Neuropsychiatry, Midlothian, VA
Department of Psychiatry, Virginia Commonwealth University, Richmond, VA
Search for more papers by this authorMegan D. Zannoni
Virginia Institute of Neuropsychiatry, Midlothian, VA
Search for more papers by this authorTracy J. Abildskov
Department of Psychology and Neuroscience Center, Brigham Young University, Provo, UT
Search for more papers by this authorErin D. Bigler
Department of Psychology and Neuroscience Center, Brigham Young University, Provo, UT
Department of Psychiatry and The Brain Institute of Utah, University of Utah, Salt Lake City, UT
Search for more papers by this authorFor the Alzheimer's Disease Neuroimaging Initiative
Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (http://adni.loni.usc.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf
Search for more papers by this authorFunding was internal for work done at the Virginia Institute of Neuropsychiatry and the Brigham Young University.
ABSTRACT
PURPOSE
To examine intermethod reliabilities and differences between FreeSurfer and the FDA-cleared congener, NeuroQuant®, both fully automated methods for structural brain MRI measurements.
MATERIALS AND METHODS
MRI scans from 20 normal control subjects, 20 Alzheimer's disease patients, and 20 mild traumatically brain-injured patients were analyzed with NeuroQuant® and with FreeSurfer. Intermethod reliability was evaluated.
RESULTS
Pairwise correlation coefficients, intraclass correlation coefficients, and effect size differences were computed. NeuroQuant® versus FreeSurfer measures showed excellent to good intermethod reliability for the 21 regions evaluated (r: .63 to .99/ICC: .62 to .99/ES: –.33 to 2.08) except for the pallidum (r/ICC/ES = .31/.29/–2.2) and cerebellar white matter (r/ICC/ES = .31/.31/.08). Volumes reported by NeuroQuant were generally larger than those reported by FreeSurfer with the whole brain parenchyma volume reported by NeuroQuant 6.50% larger than the volume reported by FreeSurfer. There was no systematic difference in results between the 3 subgroups.
CONCLUSION
NeuroQuant® and FreeSurfer showed good to excellent intermethod reliability in volumetric measurements for all brain regions examined with the only exceptions being the pallidum and cerebellar white matter. This finding was robust for normal individuals, patients with Alzheimer's disease, and patients with mild traumatic brain injury.
Supporting Information
Disclaimer: Supplementary materials have been peer-reviewed but not copyedited.
| Filename | Description |
|---|---|
| jon12229-sup-0001-Tables.doc160.5 KB | Table A1. Characteristics of MRI Scanners. Sixty subjects were scanned at 29 centers using the ADNI1 protocol or NQ protocol for TBI patients. All centers used a 3D MP-RAGE T1-weighted sequence, except those performed at MCT that used FSPGR. All used a flip angle of 8° or 9° and a 1.2-mm slice thickness without contrast media. Centers are identified by the first 3 alphameric characters. Table A2A. Key for Corresponding NeuroQuant® and FreeSurfer Names of Brain Regions. NQ and FS use similar names for several brain regions. For the regions in this table, there is an exact one-to-one correspondence between the names. That is, NQ and FS here purport to measure the same brain region. Table A2B. Key relating Noncorresponding NeuroQuant® and FreeSurfer Names of Brain Regions. |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- 1Jenkinson M, Beckmann CF, Behrens TE, et al. FSL. NeuroImage 2012; 62: 782-90.
- 2Smith SM, Jenkinson M, Woolrich MW, et al. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage 2004; 23(Suppl 1): S208-19.
- 3Ashburner J, Friston KJ. Voxel-based morphometry–the methods. NeuroImage 2000; 11: 805-21.
- 4Fischl B. FreeSurfer. NeuroImage 2012; 62: 774-81.
- 5Brewer JB. Fully-automated volumetric MRI with normative ranges: translation to clinical practice. Behav Neurol 2009; 21: 21-8.
- 6Carmichael OT, Aizenstein HA, Davis SW, et al. Atlas-based hippocampus segmentation in Alzheimer's disease and mild cognitive impairment. NeuroImage 2005; 27: 979-90.
- 7Fischl B, Salat DH, Busa E, et al. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 2002; 33: 341-55.
- 8Jatzko A, Rothenhofer S, Schmitt A, et al. Hippocampal volume in chronic posttraumatic stress disorder (PTSD): MRI study using two different evaluation methods. J Affect Disorders 2006; 94: 121-6.
- 9Morey RA, Petty CM, Xu Y, et al. A comparison of automated segmentation and manual tracing for quantifying hippocampal and amygdala volumes. NeuroImage 2009; 45: 855-66.
- 10Testa C, Laakso MP, Sabattoli F, et al. A comparison between the accuracy of voxel-based morphometry and hippocampal volumetry in Alzheimer's disease. JMRI-J Magn Reson Im 2004; 19: 274-82.
- 11Voets NL, Hough MG, Douaud G, et al. Evidence for abnormalities of cortical development in adolescent-onset schizophrenia. NeuroImage 2008; 43: 665-75.
- 12Stein JL, Medland SE, Vasquez AA, et al. Identification of common variants associated with human hippocampal and intracranial volumes. Nat Genet 2012; 44: 552-61.
- 13Morey RA, Selgrade ES, Wagner HR 2nd, et al. Scan-rescan reliability of subcortical brain volumes derived from automated segmentation. Hum Brain Mapp 2010; 31: 1751-62.
- 14Mulder ER, de Jong RA, Knol DL, et al. Alzheimer's Disease Neuroimaging I. Hippocampal volume change measurement: quantitative assessment of the reproducibility of expert manual outlining and the automated methods FreeSurfer and FIRST. NeuroImage 2014; 92: 169-81.
- 15Birk S. Hippocampal atrophy: biomarker for early AD? Intern Med News 2009; 9: 12.
10.1016/S1097-8690(09)70202-1 Google Scholar
- 16Heister D, Brewer JB, Magda S, et al. Predicting MCI outcome with clinically available MRI and CSF biomarkers. Neurology 2011; 77: 1619-28.
- 17Kovacevic S, Rafii MS, Brewer JB. Alzheimer's Disease Neuroimaging I. High-throughput, fully automated volumetry for prediction of MMSE and CDR decline in mild cognitive impairment. Alzheimer Dis Assoc Disord 2009; 23: 139-45.
- 18Desikan RS, Rafii MS, Brewer JB, et al. An expanded role for neuroimaging in the evaluation of memory impairment. Am J Neuroradiol 2013; 34: 2075–82.
- 19McEvoy LK, Brewer JB. Biomarkers for the clinical evaluation of the cognitively impaired elderly: amyloid is not enough. Imaging in Medicine 2012; 4: 343-57.
- 20Brewer JB, Magda S, Airriess C, et al. Fully-automated quantification of regional brain volumes for improved detection of focal atrophy in Alzheimer disease. Am J Neuroradiol 2009; 30: 578-80.
- 21McEvoy LK, Brewer JB. Quantitative structural MRI for early detection of Alzheimer's disease. Expert Rev Neurotherapeutics 2010; 10: 1675-88.
- 22Ross DE, Graham TJ, Ochs AL. Review of the evidence supporting the medical and legal use of neuroquant® in patients with traumatic brain injury. Psychol Inj Law 2012; 6: 75-80.
10.1007/s12207-012-9140-9 Google Scholar
- 23Ross DE, Castelvecchi C, Ochs AL. Brain MRI volumetry in a single patient with mild traumatic brain injury. Brain Injury 2013; 27: 634-6.
- 24Ross DE, Ochs AL, Seabaugh JM, et al. Progressive brain atrophy in patients with chronic neuropsychiatric symptoms after mild traumatic brain injury: a preliminary study. Brain Injury 2012; 26: 1500-9.
- 25Ross DE, Ochs AL, Seabaugh JM, et al. Man versus machine: comparison of radiologists' interpretations and NeuroQuant® volumetric analysis of brain MRIs in patients with traumatic brain injury. J Neuropsychiatry Clin Neurosci 2013; 25: 1-8.
- 26Ross DE, Ochs AL, DeSmit ME, et al. Man vs. machine Part 2: comparison of radiologists' interpretations and NeuroQuant measures of brain asymmetry and progressive atrophy in patients with traumatic brain injury. J Neuropsychiatry Clin Neurosci 2015; 27: 147-52.
- 27Ross DE, Ochs AL, Zannoni MD, et al. Back to the future: estimating pre-injury brain volume in patients with traumatic brain injury. NeuroImage 2014; 102P2: 565-78.
- 28Brezova V, Moen KG, Skandsen T, et al. Prospective longitudinal MRI study of brain volumes and diffusion changes during the first year after moderate to severe traumatic brain injury. NeuroImage Clin 2014; 5: 128-40.
- 29Farid N, Girard HM, Kemmotsu N, et al. Temporal lobe epilepsy: quantitative MR volumetry in detection of hippocampal atrophy. Radiology 2012; 264: 542-50.
- 30Bigler ED, Abildskov TJ, Wilde EA, et al. Diffuse damage in pediatric traumatic brain injury: a comparison of automated versus operator-controlled quantification methods. NeuroImage 2010; 50: 1017-26.
- 31Gronenschild EH, Habets P, Jacobs HI, et al. The effects of FreeSurfer version, workstation type, and Macintosh operating system version on anatomical volume and cortical thickness measurements. PloS ONE 2012; 7: e38234.
- 32Jovicich J, Czanner S, Han X, et al. MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths. NeuroImage 2009; 46: 177-92.
- 33Jack CR Jr, Bernstein MA, Fox NC, et al. The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods. JMRI-J Magn Reson Im 2008; 27: 685-91.
- 34Petersen RC, Aisen PS, Beckett LA, et al. Alzheimer's disease neuroimaging initiative (ADNI): clinical characterization. Neurology 2010; 74: 201-9.
- 35Weiner MW, Aisen PS, Jack CR Jr, et al. The Alzheimer's disease neuroimaging initiative: progress report and future plans. Alzheimers Dement 2010; 6: 202-11.
- 36Davids M, Zollner FG, Ruttorf M, et al. Fully-automated quality assurance in multi-center studies using MRI phantom measurements. Magn Reson Imaging 2014; 32: 771-80.
- 37Menon DK, Schwab K, Wright DW, et al. Demographics, Clinical Assessment Working Group of the I, Interagency Initiative toward Common Data Elements for Research on Traumatic Brain I, Psychological H. Position statement: definition of traumatic brain injury. Arch Phys Med Rehab 2010; 91: 1637-40.
- 38Kay T, Harrington DE, Adams R, et al. Definition of mild traumatic brain injury. J Head Trauma Rehab 1993; 8: 86-7.
- 39Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979; 86: 420-8.
- 40Fleiss JL. The Design and Analysis of Clinical Experiments. New York: Wiley, 1986.
- 41Coe R. It's the effect size, stupid: what effect size is and why it is important. 2002. URL: http://www.leeds.ac.uk/educol/documents/00002182.htm
- 42Olejnik S, Algina J. Measures of effect size for comparative studies: applications, interpretations, and limitations. Contemp Educ Psychol 2000; 25: 241-86.
- 43Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum, 1988.
10.1046/j.1526-4610.2001.111006343.x Google Scholar
- 44 MRI Scanner Protocols. URL: http://adni.loni.usc.edu/methods/documents/mri-protocols/
- 45Han X, Jovicich J, Salat D, et al. Reliability of MRI-derived measurements of human cerebral cortical thickness: the effects of field strength, scanner upgrade and manufacturer. NeuroImage 2006; 32: 180-94.
- 46Jovicich J, Czanner S, Greve D, et al. Reliability in multi-site structural MRI studies: effects of gradient non-linearity correction on phantom and human data. NeuroImage 2006; 30: 436-43.
- 47Wonderlick JS, Ziegler DA, Hosseini-Varnamkhasti P, et al. Reliability of MRI-derived cortical and subcortical morphometric measures: effects of pulse sequence, voxel geometry, and parallel imaging. NeuroImage 2009; 44: 1324-33.
- 48 FreeSurfer Download. 2013. URL: http://surfer.nmr.mgh.harvard.edu/fswiki/Download
Citing Literature
