Bootstrapping the P300 in diagnostic psychophysiology: How many iterations are needed?
Corresponding Author
J. Peter Rosenfeld
Department of Psychology, Northwestern University, Evanston, Illinois, USA
Address correspondence to: J. Peter Rosenfeld, Department of Psychology, Northwestern University, Swift Hall 102, 2029 Sheridan Road, Evanston, IL 60208, USA. E-mail: jp-[email protected]Search for more papers by this authorAnne Ward
Department of Psychology, Northwestern University, Evanston, Illinois, USA
Search for more papers by this authorEwout H. Meijer
Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
Search for more papers by this authorDenis Yukhnenko
Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
Search for more papers by this authorCorresponding Author
J. Peter Rosenfeld
Department of Psychology, Northwestern University, Evanston, Illinois, USA
Address correspondence to: J. Peter Rosenfeld, Department of Psychology, Northwestern University, Swift Hall 102, 2029 Sheridan Road, Evanston, IL 60208, USA. E-mail: jp-[email protected]Search for more papers by this authorAnne Ward
Department of Psychology, Northwestern University, Evanston, Illinois, USA
Search for more papers by this authorEwout H. Meijer
Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
Search for more papers by this authorDenis Yukhnenko
Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
Search for more papers by this authorWe are grateful to Ulf Bockenholt of Kellogg School of Management, Northwestern University, Evanston, IL, for valuable consultation.
Abstract
In psychophysiological research, bootstrapping procedures are often used to classify individual participants. How many iterations are required for a reliable bootstrap test is not universally agreed upon. To investigate the number of iterations needed for a stable bootstrap estimate, we reanalyzed P300 data collected in concealed information test paradigms. We also distinguished between the bootstrap and permutations approaches. We compared results in several studies using 100 versus 1,000 versus 10,000 iterations in the bootstrap, and we concluded that 100 iterations were adequate as results from all three iteration numbers correlated highly.
References
- Andrews, D. W. K., & Buchinsky, M. (2000). A three-step method for choosing the number of bootstrap repetitions. Econometrica, 68, 23–51. doi: 10.1111/1468-0262.00092
- Blair, R. C., & Karniski, W. (1993). An alternative method for significance testing of waveform difference potentials. Psychophysiology, 30, 518–524. doi: 10.1111/j.1469-8986.1993.tb02075.x
- Di Nocera, F., & Ferlazzo, F. (2000). Resampling approach to statistical inference: Bootstrapping from event-related potentials data. Behavior Research Methods, Instruments, & Computers, 32(1), 111–119. doi: 10.3758/BF03200793
- Donchin, E. (1981). Surprise! … surprise? Psychophysiology, 18, 493–513. doi: 10.1111/j.1469-8986.1981.tb01815.x
- Efron, B. (1979). Bootstrap methods: Another look at the jackknife Annals of Statistics, 7, 1–26. doi: 10.1007/978-1-4612-4380-9_41
-
Efron, B., &
Tibshirani, R. (1994) An introduction to the bootstrap. Boca Raton, FL: Taylor & Francis. doi: 10.2307/2532810
10.2307/2532810 Google Scholar
- Ellwanger, J., Rosenfeld, J. P., Sweet, J. J., & Bhatt, M. (1996). Detecting simulated amnesia for autobiographical and recently learned information using the P300 event-related potential. International Journal of Psychophysiology, 23(1), 9–23. doi: 10.1016/0167-8760(96)00035-9
- Farwell, L. A., & Donchin, E. (1991). The truth will out: Interrogative polygraphy (“lie detection”) with event-related brain potentials. Psychophysiology, 28(5), 531–547. doi: 10.1111/j.1469-8986.1991.tb01990.x
- Hu, X., Bergström, Z. M., Bodenhausen, G. V., & Rosenfeld, J. P. (2015). Suppressing unwanted autobiographical memories reduces their automatic influences: Evidence from electrophysiology and an implicit autobiographical memory test. Psychological Science. doi: 10.1177/0956797615575734
- Karis, D., Fabiani, M., & Donchin, E. (1984). “P300” and memory: Individual differences in the von Restorff effect. Cognitive Psychology, 16(2), 177–216. doi: 10.1016/0010-0285(84)90007-0
- Lykken, D. T. (1959). The GSR in the detection of guilt. Journal of Applied Psychology, 43(6), 385–388. doi: 10.1037/h0046060
- Meijer, E. H. (2008). Psychophysiology and the detection of deception: Promises and perils (Doctoral dissertation, Maastricht University). doi: 10.1016/j.ijpsycho.2012.06.047
- Meijer, E. H., Smulders, F. T., Merckelbach, H. L., & Wolf, A. G. (2007). The P300 is sensitive to concealed face recognition. International Journal of Psychophysiology, 66(3), 231–237. doi: 10.1016/j.ijpsycho.2007.08.001
- Polich J. (2004). Clinical application of the P300 event-related potential. Physical Medicine and Rehabilitation Clinics, 15, 133–161. doi: 10.1016/s1047-9651(03)00109-8
-
Rosenfeld, J. P. (2011). P300 in detecting concealed information. In B. Verschuere, G. Ben Shakhar, & E. Meijer, (Eds.) Memory detection: Theory and application of the concealed information test (pp. 63–89). Cambridge, UK: Cambridge University Press. doi: 10.1017/cbo9780511975196.005
10.1017/cbo9780511975196.005 Google Scholar
- Rosenfeld, J. P., Angell, A., Johnson, M., & Qian, J. H. (1991). An ERP-based, control-question lie detector analog: Algorithms for discriminating effects within individuals' average waveforms. Psychophysiology, 28(3), 319–335. doi: 10.1111/j.1469-8986.1991.tb02202.x
- Rosenfeld, J. P., & Donchin, E. (2015). Resampling (bootstrapping) the mean: A definite do. Psychophysiology, 52(7), 969–972. doi: 10.1111/psyp.12421
- Rosenfeld, J. P., Hu, X., Labkovsky, E., Meixner, J., & Winograd, M. R. (2013). Review of recent studies and issues regarding the P300-based complex trial protocol for detection of concealed information. International Journal of Psychophysiology, 90, 118–134. doi: 10.1016/j.ijpsycho.2013.08.012
- Rosenfeld, J. P., Shue, E., & Singer, E. (2007). Single versus multiple probe blocks of P300-based concealed information tests for self-referring versus incidentally obtained information. Biological Psychology, 74(3), 396–404. doi: 10.1016/j.biopsycho.2006.10.002
- Rosenfeld, J. P., Sweet, J. J., Chuang, J., Ellwanger, J., & Song, L. (1996). Detection of simulated malingering using forced choice recognition enhanced with event-related potential recording. Clinical Neuropsychologist, 10(2), 163–179. doi: 10.1080/13854049608406678
- Rosenfeld, J. P., Ward, A., Frigo, V., Drapekin, J., & Labkovsky, E. (2015). Evidence suggesting superiority of visual (verbal) vs. auditory test presentation modality in the P300-based, complex trial protocol for concealed autobiographical memory detection. International Journal of Psychophysiology, 96(1), 16–22. doi: 10.1016/j.ijpsycho.2015.02.026
- Wasserman, S., & Bockenholt, U. (1989). Bootstrapping: Applications to psychophysiology. Psychophysiology, 26(2), 208–221. doi: 10.1111/j.1469-8986.1989.tb03159.x
- Zoumpoulaki, A., Alsufyani, A., & Bowman, H. (2015). Resampling the peak, some dos and don'ts. Psychophysiology, 52, 444–448. doi: 10.1111/psyp.12363
Citing Literature
