SPECIAL ISSUE
Registered replication report of the construct validity of the error-related negativity (ERN): A multi-site study of task-specific ERN correlations with internalizing and externalizing symptoms
Peter E. Clayson,
Julia B. Mcdonald,
Bohyun Park,
Amanda Holbrook,
Scott A. Baldwin,
Anja Riesel,
Michael J. Larson,
Corresponding Author
Peter E. Clayson
Department of Psychology, University of South Florida, Tampa, Florida, USA
Correspondence
Peter E. Clayson, Department of Psychology, University of South Florida, 4202 East Fowler Avenue, Tampa, FL 33620-7200, USA.
Email: [email protected]
Contribution: Conceptualization, Project administration, Resources, Writing - original draft, Formal analysis, Methodology
Search for more papers by this authorJulia B. Mcdonald
Department of Psychology, University of South Florida, Tampa, Florida, USA
Contribution: Conceptualization, Data curation, Writing - review & editing
Search for more papers by this authorBohyun Park
Department of Psychology, University of South Florida, Tampa, Florida, USA
Contribution: Writing - review & editing
Search for more papers by this authorAmanda Holbrook
Department of Psychology, University of South Florida, Tampa, Florida, USA
Contribution: Writing - review & editing
Search for more papers by this authorScott A. Baldwin
Department of Psychology, Brigham Young University, Provo, Utah, USA
Contribution: Conceptualization, Formal analysis, Methodology, Writing - review & editing
Search for more papers by this authorAnja Riesel
Department of Psychology, Universität Hamburg, Hamburg, Germany
Contribution: Conceptualization, Methodology, Writing - review & editing
Search for more papers by this authorMichael J. Larson
Department of Psychology, Brigham Young University, Provo, Utah, USA
Neuroscience Center, Brigham Young University, Provo, Utah, USA
Contribution: Conceptualization, Project administration, Resources, Writing - review & editing
Search for more papers by this authorPeter E. Clayson,
Julia B. Mcdonald,
Bohyun Park,
Amanda Holbrook,
Scott A. Baldwin,
Anja Riesel,
Michael J. Larson,
Corresponding Author
Peter E. Clayson
Department of Psychology, University of South Florida, Tampa, Florida, USA
Correspondence
Peter E. Clayson, Department of Psychology, University of South Florida, 4202 East Fowler Avenue, Tampa, FL 33620-7200, USA.
Email: [email protected]
Contribution: Conceptualization, Project administration, Resources, Writing - original draft, Formal analysis, Methodology
Search for more papers by this authorJulia B. Mcdonald
Department of Psychology, University of South Florida, Tampa, Florida, USA
Contribution: Conceptualization, Data curation, Writing - review & editing
Search for more papers by this authorBohyun Park
Department of Psychology, University of South Florida, Tampa, Florida, USA
Contribution: Writing - review & editing
Search for more papers by this authorAmanda Holbrook
Department of Psychology, University of South Florida, Tampa, Florida, USA
Contribution: Writing - review & editing
Search for more papers by this authorScott A. Baldwin
Department of Psychology, Brigham Young University, Provo, Utah, USA
Contribution: Conceptualization, Formal analysis, Methodology, Writing - review & editing
Search for more papers by this authorAnja Riesel
Department of Psychology, Universität Hamburg, Hamburg, Germany
Contribution: Conceptualization, Methodology, Writing - review & editing
Search for more papers by this authorMichael J. Larson
Department of Psychology, Brigham Young University, Provo, Utah, USA
Neuroscience Center, Brigham Young University, Provo, Utah, USA
Contribution: Conceptualization, Project administration, Resources, Writing - review & editing
Search for more papers by this authorAbstract
Intact cognitive control is critical for goal-directed behavior and is widely studied using the error-related negativity (ERN). A common assumption in such studies is that ERNs recorded during different experimental paradigms reflect the same construct or functionally equivalent processes and that ERN is functionally distinct from other error-monitoring event-related brain potentials (ERPs; error positivity [Pe]), other neurophysiological indices of cognitive control (N2), and even other theoretically unrelated indices (visual N1). The present registered report represents a replication-plus-extension study of the psychometric validity of cognitive control ERPs and evaluated the convergent and divergent validity of ERN, Pe, N2, and visual N1 recorded during flanker, Stroop, and Go/no-go tasks. Data from 182 participants were collected from two study sites, and ERP psychometric reliability and validity were evaluated. Findings supported replication of convergent and divergent validity of ERN, Pe, and ΔPe (error minus correct)—these ERPs correlated more with themselves across tasks than with other ERPs measured during the same task. Convergent validity of ΔERN across tasks was not replicated, despite high internal consistency. ERN strongly correlated with N2 at levels similar or higher than those in support of convergent validity for other ERPs, and the present study failed to provide evidence of divergent validity for ERN and Pe from N2 or N1. ERN and ΔERN were unrelated to internalizing or externalizing symptoms. Findings underscore the importance of considering the psychometric validity of ERPs, as it provides a foundation for interpreting and comparing ERPs across tasks and studies.
Open Research
DATA AVAILABILITY STATEMENT
All study materials are openly accessible. A project repository on Open Science Framework (OSF; https://osf.io/8cbua/) serves as a hub with links to data processing and analysis code, raw EEG data, and other study materials (e.g., protocols, paradigms).
REFERENCES
- Achenbach, T. M., & Rescorla, L. A. (2003). Manual for the ASEBA adult forms & profiles. University of Vermont, Research Center for Children, Youth, & Families.
- Baldwin, S. A., Imel, Z. E., Braithwaite, S. R., & Atkins, D. C. (2014). Analyzing multiple outcomes in clinical research using multivariate multilevel models. Journal of Consulting and Clinical Psychology, 82(5), 920–930. https://doi.org/10.1037/a0035628 (Advances in Data Analytic Methods).
- Baldwin, S. A., Larson, M. J., & Clayson, P. E. (2015). The dependability of electrophysiological measurements of performance monitoring in a clinical sample: A generalizability and decision analysis of the ERN and Pe. Psychophysiology, 52(6), 790–800. https://doi.org/10.1111/psyp.12401
- Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01
- Boen, R., Quintana, D. S., Ladouceur, C. D., & Tamnes, C. K. (2022). Age-related differences in the error-related negativity and error positivity in children and adolescents are moderated by sample and methodological characteristics: A meta-analysis. Psychophysiology, 59(6), e14003. https://doi.org/10.1111/psyp.14003
- Boksem, M. A. S., Tops, M., Wester, A. E., Meijman, T. F., & Lorist, M. M. (2006). Error-related ERP components and individual differences in punishment and reward sensitivity. Brain Research, 1101(1), 92–101. https://doi.org/10.1016/j.brainres.2006.05.004
- Botvinick, M. W., Carter, C. S., Braver, T. S., Barch, D. M., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624–652. https://doi.org/10.1037/0033-295X.108.3.624
- Brennan, R. L. (2001). Generalizability theory: Statistics for social science and public policy. Springer-Verlag.
10.1007/978-1-4757-3456-0 Google Scholar
- Bürkner, P.-C. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80, 1–28. https://doi.org/10.18637/jss.v080.i01
- Bürkner, P.-C. (2018). Advanced Bayesian multilevel modeling with the R package brms. R Journal, 10(1), 395–411. https://doi.org/10.32614/RJ-2018-017
- Burwell, S. J., Malone, S. M., & Iacono, W. G. (2016). One-year developmental stability and covariance among oddball, novelty, Go/no-go, and flanker event-related potentials in adolescence: A monozygotic twin study. Psychophysiology, 53(7), 991–1007. https://doi.org/10.1111/psyp.12646
- Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
- Carlson, K. D., & Herdman, A. O. (2012). Understanding the impact of convergent validity on research results. Organizational Research Methods, 15(1), 17–32. https://doi.org/10.1177/1094428110392383
- Charles, L., Gaillard, R., Amado, I., Krebs, M.-O., Bendjemaa, N., & Dehaene, S. (2017). Conscious and unconscious performance monitoring: Evidence from patients with schizophrenia. NeuroImage, 144(Pt A), 153–163. https://doi.org/10.1016/j.neuroimage.2016.09.056
- Charles, L., Van Opstal, F., Marti, S., & Dehaene, S. (2013). Distinct brain mechanisms for conscious versus subliminal error detection. NeuroImage, 73, 80–94. https://doi.org/10.1016/j.neuroimage.2013.01.054
- Clawson, A., Clayson, P. E., Keith, C. M., Catron, C., & Larson, M. J. (2017). Conflict and performance monitoring throughout the lifespan: An event-related potential (ERP) and temporospatial component analysis. Biological Psychology, 124, 87–99. https://doi.org/10.1016/j.biopsycho.2017.01.012
- Clawson, A., Clayson, P. E., & Larson, M. J. (2013). Cognitive control adjustments and conflict adaptation in major depressive disorder. Psychophysiology, 50, 711–721. https://doi.org/10.1111/psyp.12066
- Clayson, P. E. (2020). Moderators of the internal consistency of error-related negativity scores: A meta-analysis of internal consistency estimates. Psychophysiology, 57(8), e13583. https://doi.org/10.1111/psyp.13583
- Clayson, P. E. (2023). Beyond single paradigms, pipelines, and outcomes: Embracing multiverse analyses in psychophysiology. PsyArXiv https://doi.org/10.31234/osf.io/5eawy
10.31234/osf.io/5eawy Google Scholar
- Clayson, P. E. (in press). The psychometric upgrade psychophysiology needs. Psychophysiology.
- Clayson, P. E., Baldwin, S. A., & Larson, M. J. (2013). How does noise affect amplitude and latency measurement of event-related potentials (ERPs)? A methodological critique and simulation study. Psychophysiology, 50, 174–186. https://doi.org/10.1111/psyp.12001
- Clayson, P. E., Baldwin, S. A., & Larson, M. J. (2021). Evaluating the internal consistency of subtraction-based and residualized difference scores: Considerations for psychometric reliability analyses of event-related potentials. Psychophysiology, 58(4), e13762. https://doi.org/10.1111/psyp.13762
- Clayson, P. E., Baldwin, S. A., Rocha, H. A., & Larson, M. J. (2021). The data-processing multiverse of event-related potentials (ERPs): A roadmap for the optimization and standardization of ERP processing and reduction pipelines. NeuroImage, 245, 118712. https://doi.org/10.1016/j.neuroimage.2021.118712
- Clayson, P. E., Brush, C. J., & Hajcak, G. (2021). Data quality and reliability metrics for event-related potentials (ERPs): The utility of subject-level reliability. International Journal of Psychophysiology, 165, 121–136. https://doi.org/10.1016/j.ijpsycho.2021.04.004
- Clayson, P. E., Carbine, K. A., Baldwin, S. A., & Larson, M. J. (2019). Methodological reporting behavior, sample sizes, and statistical power in studies of event-related potentials: Barriers to reproducibility and replicability. Psychophysiology, 111(6), 5–17. https://doi.org/10.1111/psyp.13437
10.1111/psyp.13437 Google Scholar
- Clayson, P. E., Carbine, K. A., Baldwin, S. A., Olsen, J. A., & Larson, M. J. (2021). Using generalizability theory and the ERP Reliability Analysis (ERA) toolbox for assessing test-retest reliability of ERP scores part 1: Algorithms, framework, and implementation. International Journal of Psychophysiology, 166, 174–187. https://doi.org/10.1016/j.ijpsycho.2021.01.006
- Clayson, P. E., Clawson, A., & Larson, M. J. (2011). Sex differences in electrophysiological indices of conflict monitoring. Biological Psychology, 87(2), 282–289. https://doi.org/10.1016/j.biopsycho.2011.03.011
- Clayson, P. E., Clawson, A., & Larson, M. J. (2012). The effects of induced state negative affect on performance monitoring processes. Social Cognitive and Affective Neuroscience, 7, 677–688. https://doi.org/10.1093/scan/nsr040
- Clayson, P. E., Kappenman, E. S., Gehring, W. J., Miller, G. A., & Larson, M. J. (2021). A commentary on establishing norms for error-related brain activity during the arrow flanker task among young adults. NeuroImage, 234, 117932. https://doi.org/10.1016/j.neuroimage.2021.117932
- Clayson, P. E., & Larson, M. J. (2011a). Conflict adaptation and sequential trial effects: Support for the conflict monitoring theory. Neuropsychologia, 49, 1953–1961. https://doi.org/10.1016/j.neuropsychologia.2011.03.023
- Clayson, P. E., & Larson, M. J. (2011b). Effects of repetition priming on neurophysiological and behavioral indices of conflict adaptation and cognitive control. Psychophysiology, 48(12), 1621–1630. https://doi.org/10.1111/j.1469-8986.2011.01265.x
- Clayson, P. E., & Larson, M. J. (2012). Cognitive performance and electrophysiological indices of cognitive control: A validation study of conflict adaptation. Psychophysiology, 49(5), 627–637. https://doi.org/10.1111/j.1469-8986.2011.01345.x
- Clayson, P. E., & Miller, G. A. (2017). ERP reliability analysis (ERA) toolbox: An open-source toolbox for analyzing the reliability of event-related potentials. International Journal of Psychophysiology, 111, 68–79. https://doi.org/10.1016/j.ijpsycho.2016.10.012
- Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
- de Vries, L. P., van de Weijer, M. P., Ligthart, L., Willemsen, G., Dolan, C. V., Boomsma, D. I., Baselmans, B. M. L., & Bartels, M. (2020). A comparison of the ASEBA Adult Self Report (ASR) and the Brief Problem Monitor (BPM/18-59). Behavior Genetics, 50(5), 363–373. https://doi.org/10.1007/s10519-020-10001-3
- Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analsis. Journal of Neuroscience Methods, 134, 9–21. https://doi.org/10.1016/j.jneumeth.2003.10.009
- Dien, J. (2010). The ERP PCA toolkit: An open source program for advanced statistical analysis of event-related potential data. Journal of Neuroscience Methods, 187(1), 138–145. https://doi.org/10.1016/j.jneumeth.2009.12.009
- Donchin, E., & Heffley, E. F. (1978). Multivariate analysis of event-related potential data: A tutorial review. In D. Otto (Ed.), Multidisciplinary perspectives in event-related brain potential research (pp. 555–572). US Government Printing Office.
- Endrass, T., Klawohn, J., Gruetzmann, R., Ischebeck, M., & Kathmann, N. (2012). Response-related negativities following correct and incorrect responses: Evidence from a temporospatial principal component analysis. Psychophysiology, 49(6), 733–743. https://doi.org/10.1111/j.1469-8986.2012.01365.x
- Fahrenberg, J., Foerster, F., Schneider, H.-J., Müller, W., & Myrtek, M. (1986). Predictability of individual differences in activation processes in a field setting based on laboratory measures. Psychophysiology, 23(3), 323–333. https://doi.org/10.1111/j.1469-8986.1986.tb00640.x
- Falkenstein, M., Hohnsbein, J., Hoormann, J., & Banke, L. (1991). Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. Electroencephalography and Clinical Neurophysiology, 78, 447–455. https://doi.org/10.1016/0013-4694(91)90062-9
- Fiske, D. W. (1971). Measuring the concepts of personality. Aldine.
- Folstein, J. R., & Van Petten, C. (2008). Influence of cognitive control and mismatch on the N2 component of the ERP: A review. Psychophysiology, 45(1), 152–170. https://doi.org/10.1111/j.1469-8986.2007.00602.x
- Foti, D., Kotov, R., & Hajcak, G. (2013). Psychometric considerations in using error-related brain activity as a biomarker in psychotic disorders. Journal of Abnormal Psychology, 122(2), 520–531. https://doi.org/10.1037/a0032618
- Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity. Human Brain Mapping, 32(12), 2207–2216. https://doi.org/10.1002/hbm.21182
- Garrett-Ruffin, S., Hindash, A. C., Kaczkurkin, A. N., Mears, R. P., Morales, S., Paul, K., Pavlov, Y. G., & Keil, A. (2021). Open science in psychophysiology: An overview of challenges and emerging solutions. International Journal of Psychophysiology, 162, 69–78. https://doi.org/10.1016/j.ijpsycho.2021.02.005
- Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993). A neural system for error detection and compensation. Psychological Science, 4, 385–390. https://doi.org/10.1111/j.1467-9280.1993.tb00586.x
- Gehring, W. J., Liu, Y., Orr, J. M., & Carp, J. (2012). The error-related negativity (ERN/Ne). In S. J. Luck & E. S. Kappenman (Eds.), Oxford handbook of event-related potential components (pp. 231–291). Oxford University Press.
- Hajcak, G., Klawohn, J., & Meyer, A. (2019). The utility of event-related potentials in clinical psychology. Annual Review of Clinical Psychology, 15(1), 71–95. https://doi.org/10.1146/annurev-clinpsy-050718-095457
- Herrmann, C. S., & Knight, R. T. (2001). Mechanisms of human attention: Event-related potentials and oscillations. Neuroscience & Biobehavioral Reviews, 25(6), 465–476. https://doi.org/10.1016/S0149-7634(01)00027-6
- Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4), 679–709. https://doi.org/10.1037/0033-295x.109.4.679
- Hughes, G., & Yeung, N. (2011). Dissociable correlates of response conflict and error awareness in error-related brain activity. Neuropsychologia, 49(3), 405–415. https://doi.org/10.1016/j.neuropsychologia.2010.11.036
- Ivanova, M. Y., Achenbach, T. M., Rescorla, L. A., Turner, L. V., Ahmeti-Pronaj, A., Au, A., Maese, C. A., Bellina, M., Caldas, J. C., Chen, Y.-C., Csemy, L., da Rocha, M. M., Decoster, J., Dobrean, A., Ezpeleta, L., Fontaine, J. R. J., Funabiki, Y., Guðmundsson, H. S., Harder, V. S., … Zasepa, E. (2015). Syndromes of self-reported psychopathology for ages 18–59 in 29 societies. Journal of Psychopathology and Behavioral Assessment, 37(2), 171–183. https://doi.org/10.1007/s10862-014-9448-8
- Kałamała, P., Szewczyk, J., Senderecka, M., & Wodniecka, Z. (2018). Flanker task with equiprobable congruent and incongruent conditions does not elicit the conflict N2. Psychophysiology, 55(2), e12980. https://doi.org/10.1111/psyp.12980
- Kappenman, E. S., & Luck, S. J. (2012). ERP components: The ups and downs of brainwave recordings. In S. J. Luck & E. S. Kappenman (Eds.), The Oxford handbook of event-related potential components (pp. 3–30). Oxford University Press, Inc.
- Kelley, T. L. (1927). Interpretation of educational measurements. World Book Co.
- Klawohn, J., Riesel, A., Grützmann, R., Kathmann, N., & Endrass, T. (2014). Performance monitoring in obsessive–compulsive disorder: A temporo-spatial principal component analysis. Cognitive, Affective, & Behavioral Neuroscience, 14(3), 983–995. https://doi.org/10.3758/s13415-014-0248-0
- Kozak, M. J., & Cuthbert, B. N. (2016). The NIMH Research Domain Criteria Initiative: Background, issues, and pragmatics. Psychophysiology, 53(3), 286–297. https://doi.org/10.1111/psyp.12518
- Kuznetsova, A., Brockhoff, P. B., & Chiristensen, R. H. B. (2017). lmerTest package: Test in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13
- Larson, M. J., Clawson, A., Clayson, P. E., & Baldwin, S. A. (2013). Cognitive conflict adaptation in generalized anxiety disorder. Biological Psychology, 94(2), 408–418. https://doi.org/10.1016/j.biopsycho.2013.08.006
- Larson, M. J., & Clayson, P. E. (2011). The relationship between cognitive performance and electrophysiological indices of performance monitoring. Cognitive, Affective, & Behavioral Neuroscience, 11, 159–171. https://doi.org/10.3758/s13415-010-0018-6
- Larson, M. J., Clayson, P. E., & Baldwin, S. A. (2012). Performance monitoring following conflict: Internal adjustments in cognitive control? Neuropsychologia, 50(3), 426–433. https://doi.org/10.1016/j.neuropsychologia.2011.12.021
- Larson, M. J., Clayson, P. E., & Clawson, A. (2014). Making sense of all the conflict: A theoretical review and critique of conflict-related ERPs. International Journal of Psychophysiology, 93(3), 283–297. https://doi.org/10.1016/j.ijpsycho.2014.06.007
- Larson, M. J., Clayson, P. E., Keith, C. M., Hunt, I. J., Hedges, D. W., Nielsen, B. L., & Call, V. R. A. (2016). Cognitive control adjustments in healthy older and younger adults: Conflict adaptation, the error-related negativity (ERN), and evidence of generalized decline with age. Biological Psychology, 115, 50–63. https://doi.org/10.1016/j.biopsycho.2016.01.008
- Larson, M. J., South, M., Clayson, P. E., & Clawson, A. (2012). Cognitive control and conflict adaptation in youth with high-functioning autism. Journal of Child Psychology and Psychiatry, 53(4), 440–448. https://doi.org/10.1111/j.1469-7610.2011.02498.x
- LeBel, E. P., McCarthy, R. J., Earp, B. D., Elson, M., & Vanpaemel, W. (2018). A unified framework to quantify the credibility of scientific findings. Advances in Methods and Practices in Psychological Science, 1(3), 389–402. https://doi.org/10.1177/2515245918787489
- Lenth, R. (2020). emmeans: Estimated marginal means, aka least-squares means (version R package version 1.4.8). https://CRAN.R-project.org/package=emmeans
- Lewandowski, D., Kurowicka, D., & Joe, H. (2009). Generating random correlation matrices based on vines and extended onion method. Journal of Multivariate Analysis, 100(9), 1989–2001. https://doi.org/10.1016/j.jmva.2009.04.008
- Loken, E., & Gelman, A. (2017). Measurement error and the replication crisis. Science, 355(6325), 584–585. https://doi.org/10.1126/science.aal3618
- Lopez-Calderon, J., & Luck, S. J. (2014). ERPLAB: An open-source toolbox for the analysis of event-related potentials. Frontiers in Human Neuroscience, 8(e3004), 213. https://doi.org/10.3389/fnhum.2014.00213
- Luck, S. J. (1995). Multiple mechanisms of visual-spatial attention: Recent evidence from human electrophysiology. Behavioural Brain Research, 71(1), 113–123. https://doi.org/10.1016/0166-4328(95)00041-0
- Luck, S. J. (2014). An introduction to the event-related potential technique ( 2nd ed.). The MIT Press.
- Luck, S. J., & Gaspelin, N. (2017). How to get statistically significant effects in any ERP experiment (and why you shouldn't). Psychophysiology, 54(1), 146–157. https://doi.org/10.1111/psyp.12639
- Luck, S. J., Stewart, A. X., Simmons, A. M., & Rhemtulla, M. (2021). Standardized measurement error: A universal metric of data quality for averaged event-related potentials. Psychophysiology, 58(6), e13793. https://doi.org/10.1111/psyp.13793
- Lutz, M. C., Kok, R., Verveer, I., Malbec, M., Koot, S., van Lier, P. A. C., & Franken, I. H. A. (2021). Diminished error-related negativity and error positivity in children and adults with externalizing problems and disorders: A meta-analysis on error processing. Journal of Psychiatry and Neuroscience, 46, E615–E627. https://doi.org/10.1503/jpn.200031
- Martin, E. A., McCleery, A., Moore, M. M., Wynn, J. K., Green, M. F., & Horan, W. P. (2018). ERP indices of performance monitoring and feedback processing in psychosis: A meta-analysis. International Journal of Psychophysiology, 132, 365–378. https://doi.org/10.1016/j.ijpsycho.2018.08.004
- Mathews, C. A., Perez, V. B., Delucchi, K. L., & Mathalon, D. H. (2012). Error-related negativity in individuals with obsessive-compulsive symptoms: Toward an understanding of hoarding behaviors. Biological Psychology, 89(2), 487–494. https://doi.org/10.1016/j.biopsycho.2011.12.018
- Meehl, P. E. (1986). Diagnostic taxa as open concepts: Metatheoretical and statistical questions about reliability and construct validity in the grand strategy of nosological revision. In T. Millon & G. L. Klerman (Eds.), Contemporary directions in psychopathology: Toward the DSM-IV (pp. 215–231). The Guilford Press.
- Messick, S. (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18(2), 5–11. https://doi.org/10.3102/0013189X018002005
10.3102/0013189X018002005 Google Scholar
- Meyer, A. (2017). A biomarker of anxiety in children and adolescents: A review focusing on the error-related negativity (ERN) and anxiety across development. Developmental Cognitive Neuroscience, 27, 58–68. https://doi.org/10.1016/j.dcn.2017.08.001
- Meyer, A., Bress, J. N., & Proudfit, G. H. (2014). Psychometric properties of the error-related negativity in children and adolescents. Psychophysiology, 51(7), 602–610. https://doi.org/10.1111/psyp.12208
- Nieuwenhuis, S., Ridderinkhof, K. R., Blom, J., Band, G. P., & Kok, A. (2001). Error-related brain potentials are differentially related to awareness of response errors: Evidence from an antisaccade task. Psychophysiology, 38, 752–760. https://doi.org/10.1111/1469-8986.3850752
- Overbeek, T. J. M., Nieuwenhuis, S., & Ridderinkhof, K. R. (2005). Dissociable components of error processing: On the functional significance of the Pe vis-à-vis the ERN/Ne. Journal of Psychophysiology, 19, 319–329. https://doi.org/10.1027/0269-8803.19.4.319
- Pasion, R., & Barbosa, F. (2019). ERN as a transdiagnostic marker of the internalizing-externalizing spectrum: A dissociable meta-analytic effect. Neuroscience & Biobehavioral Reviews, 103, 133–149. https://doi.org/10.1016/j.neubiorev.2019.06.013
- Paul, M., Govaart, G. H., & Schettino, A. (2021). Making ERP research more transparent: Guidelines for preregistration. International Journal of Psychophysiology, 164, 52–63. https://doi.org/10.1016/j.ijpsycho.2021.02.016
- Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: An integrate approach. Erlbaum.
- Perrin, F., Pernier, J., Bertrand, O., & Echallier, J. F. (1989). Spherical splines for scalp potential and current-density mapping. Electroencephalography and Clinical Neurophysiology, 72(2), 184–187. https://doi.org/10.1016/0013-4694(89)90180-6
- Pezzetta, R., Wokke, M. E., Aglioti, S. M., & Ridderinkhof, K. R. (2022). Doing it wrong: A systematic review on electrocortical and behavioral correlates of error monitoring in patients with neurological disorders. Neuroscience, 486, 103–125. https://doi.org/10.1016/j.neuroscience.2021.01.027
- Post, M. W. (2016). What to do with “moderate” reliability and validity coefficients? Archives of Physical Medicine and Rehabilitation, 97(7), 1051–1052. https://doi.org/10.1016/j.apmr.2016.04.001
- Proudfit, G. H. (2015). The reward positivity: From basic research on reward to a biomarker for depression. Psychophysiology, 52(4), 449–459. https://doi.org/10.1111/psyp.12370
- R Development Core Team. (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.R-project.org/
- Ribes-Guardiola, P., Poy, R., Patrick, C. J., & Moltó, J. (2020). Electrocortical measures of performance monitoring from Go/no-go and flanker tasks: Differential relations with trait dimensions of the triarchic model of psychopathy. Psychophysiology, 57(6), e13573. https://doi.org/10.1111/psyp.13573
- Riesel, A. (2019). The erring brain: Error-related negativity as an endophenotype for OCD-A review and meta-analysis. Psychophysiology, 56(4), e13348. https://doi.org/10.1111/psyp.13348
- Riesel, A., Weinberg, A., Endrass, T., Meyer, A., & Hajcak, G. (2013). The ERN is the ERN is the ERN? Convergent validity of error-related brain activity across different tasks. Biological Psychology, 93(3), 377–385. https://doi.org/10.1016/j.biopsycho.2013.04.007
- Schwab, D. (1980). Construct validity in organizational behavior. Research in Organizational Behavior, 2, 3–43.
- Segalowitz, S. J., Santesso, D. L., Murphy, T. I., Homan, D., Chantziantoniou, D. K., & Khan, S. (2010). Retest reliability of medial frontal negativities during performance monitoring. Psychophysiology, 47(2), 260–270. https://doi.org/10.1111/j.1469-8986.2009.00942.x
- Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. SAGE Publications, Inc.
- Stan Development Team. (2021). Stan modeling language users guide and reference manual v2.26.1. http://mc-stan.org/
- Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016). Increasing transparency through a multiverse analysis. Perspectives on Psychological Science, 11(5), 702–712. https://doi.org/10.1177/1745691616658637
- Steinhauser, M., & Yeung, N. (2012). Error awareness as evidence accumulation: Effects of speed-accuracy trade-off on error signaling. Frontiers in Human Neuroscience, 6, 240. https://doi.org/10.3389/fnhum.2012.00240
- Strube, M. J., & Newman, L. C. (2007). Psychometrics. In J. T. Cacioppo, L. G. Tassinary, & G. G. Berntson (Eds.), Handbook of psychophysiology ( 3rd ed., pp. 789–811). Cambridge University Press.
- Ullsperger, M., Harsay, H. A., Wessel, J. R., & Ridderinkhof, K. R. (2010). Conscious perception of errors and its relation to the anterior insula. Brain Structure & Function, 214(5–6), 629–643. https://doi.org/10.1007/s00429-010-0261-1
- Watson, D. (2004). Stability versus change, dependability versus error: Issues in the assessment of personality over time. Journal of Research in Personality, 38(4), 319–350. https://doi.org/10.1016/j.jrp.2004.03.001
- Weinberg, A., Dieterich, R., & Riesel, A. (2015). Error-related brain activity in the age of RDoC: A review of the literature. International Journal of Psychophysiology, 98(Part 2), 276–299. https://doi.org/10.1016/j.ijpsycho.2015.02.029
- Wessel, J. R. (2012). Error awareness and the error-related negativity: Evaluating the first decade of evidence. Frontiers in Human Neuroscience, 6, 88. https://doi.org/10.3389/fnhum.2012.00088
- Wessel, J. R., Danielmeier, C., Morton, J. B., & Ullsperger, M. (2012). Surprise and error: Common neuronal architecture for the processing of errors and novelty. Journal of Neuroscience, 32(22), 7528–7537. https://doi.org/10.1523/JNEUROSCI.6352-11.2012
- Wessel, J. R., Danielmeier, C., & Ullsperger, M. (2011). Error awareness revisited: Accumulation of multimodal evidence from central and autonomic nervous systems. Journal of Cognitive Neuroscience, 23(10), 3021–3036. https://doi.org/10.1162/jocn.2011.21635
- Wilkinson, G. N., & Rogers, C. E. (1973). Symbolic description of factorial models for analysis of variance. Journal of the Royal Statistical Society. Series C (Applied Statistics), 22(3), 392–399. https://doi.org/10.2307/2346786
10.2307/2346786 Google Scholar
- Yeung, N., Botvinick, M. M., & Cohen, J. D. (2004). The neural basis of error detection: Conflict monitoring and the error-related negativity. Psychological Review, 111(4), 931–959. https://doi.org/10.1037/0033-295x.111.4.931
- Zhang, G., & Luck, S. J. (2023). Variations in ERP data quality across paradigms, participants, and scoring procedures. Psychophysiology, 60(7), e14264. https://doi.org/10.1111/psyp.14264
Citing Literature
