Screening for psychosis risk among help-seeking adolescents: Application of the Italian version of the 16-item prodromal questionnaire (iPQ-16) in child and adolescent neuropsychiatry services
Corresponding Author
Lorenzo Pelizza
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Correspondence
Dr Lorenzo Pelizza c/o CSM Petrella, Via Errico Petrella n.1/A, 42100 Reggio Emilia (RE), Italy.
Email: [email protected]
Search for more papers by this authorSilvia Azzali
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorFederica Paterlini
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorSara Garlassi
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorIlaria Scazza
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorLuigi Rocco Chiri
Department of Mental Health and Pathological Addiction, Bologna Public Health Centre, Bologna, Italy
Search for more papers by this authorMichele Poletti
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorSimona Pupo
Intensive Care Unit, Guastalla Civil Hospital, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorAndrea Raballo
Department of Psychology, Childhood and Development Research Group, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
Search for more papers by this authorCorresponding Author
Lorenzo Pelizza
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Correspondence
Dr Lorenzo Pelizza c/o CSM Petrella, Via Errico Petrella n.1/A, 42100 Reggio Emilia (RE), Italy.
Email: [email protected]
Search for more papers by this authorSilvia Azzali
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorFederica Paterlini
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorSara Garlassi
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorIlaria Scazza
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorLuigi Rocco Chiri
Department of Mental Health and Pathological Addiction, Bologna Public Health Centre, Bologna, Italy
Search for more papers by this authorMichele Poletti
Department of Mental Health and Pathological Addiction, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorSimona Pupo
Intensive Care Unit, Guastalla Civil Hospital, Reggio Emilia Public Health Centre, Reggio Emilia, Italy
Search for more papers by this authorAndrea Raballo
Department of Psychology, Childhood and Development Research Group, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
Search for more papers by this authorAbstract
Aim
The 16-item Prodromal Questionnaire (PQ-16) is a versatile screen tool for routine screening of at-risk individuals. We wished to evaluate the psychometric properties of the Italian version of the PQ-16 (iPQ-16) in a sample of 72 help-seeking adolescents (age range 13-17 years) referred to child and adolescent neuropsychiatry services for diagnostic assessment.
Methods
Participants who completed iPQ-16 were subsequently interviewed with the Comprehensive Assessment of At-Risk Mental States (CAARMS) to confirm the psychosis high risk state. We then examined the diagnostic accuracy (sensitivity, specificity, positive and negative predictive values [PPV e NPV]) and concurrent validity between iPQ-16 and CAARMS using Cronbach's alpha and Cohen's kappa. We also tested the validity of the adopted iPQ-16 cut-offs through Receiver Operating Characteristic (ROC) curves plotted against CAARMS diagnoses and the 1-year predictive validity of the iPQ-16.
Results
Overall, the psychometric properties of the iPQ-16 were satisfactory. The iPQ-16 showed high internal consistency (Cronbach's alpha = .827) and acceptable diagnostic accuracy (77% sensitivity, 72% PPV) and concurrent validity (Cohen's k = 0.309). ROC analyses pointed to iPQ-16 total distress score of ≥10 as best cut-off.
Conclusion
The iPQ-16 is a reliable and valid instrument for routine screening of at-risk individuals in Italian neuropsychiatry services.
REFERENCES
- Addington, J., Stowkowy, J., & Weiser, M. (2015). Screening tools for clinical high risk for psychosis. Early Intervention in Psychiatry, 9(5), 345–356. https://doi.org/10.1111/eip.12193
- American Psychiatric Association (APA). (2000). Diagnostic and statistical manual of mental disorders, IV edition, text revised. Washington D.C.: American Psychiatric Publishing Inc.
- Brandizzi, M., Schultze-Lutter, F., Masillo, A., Lanna, A., Curto, M., Lindau, J. F., … Fiori Nastro, P. (2014). Self-reported attenuated psychotic-like experiences in help-seeking adolescents and their association with age, functioning and psychopathology. Schizophrenia Research, 160(1–3), 110–117. https://doi.org/10.1016/j.schres.2014.10.005
- Chen, F., Wang, L., & Zhao, X. (2014a). Validity and reliability of the 16-item prodromal questionnaire in screening psychosis risk of help-seekers. Chinese Mental Health Journal, 28, 667–673.
- Chen, F., Wang, L., Heeramun-Aubeeluck, A., Wang, J., Shi, J., Yuan, J., & Zhao, X. (2014b). Identification and characterization of college students with attenuated psychosis syndrome in China. Psychiatry Research, 216(3), 346–350. https://doi.org/10.1016/j.psychres.2014.01.051
- de Jong, Y., Mulder, C. L., Boon, A. E., Deen, M., van ’t Hof, M., & van der Gaag, M. (2016). Screening for psychosis risk among adolescents in child and adolescent mental health services: A description of the first step with the 16-item version of the prodromal questionnaire (PQ-16). Early Intervention in Psychiatry, 9 (Epub ahead of print), Nov 9. https://doi.org.10.1111/eip.12362.
- Fusar-Poli, P., Cappucciati, M., Rutigliano, G., Schultze-Lutter, F., Bonoldi, I., Borgwardt, S., … McGuire, P. (2015). At risk or not at risk? Meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction. World Psychiatry, 14(3), 322–332. https://doi.org/10.1002/wps.20250
- Green, S. B., Yang, Y., Alt, M., Brinkley, S., Gray, S., Hogan, T., & Cowan, N. (2016). Use of internal consistency coefficients for estimating reliability of experimental task scores. Psychonomic Bulletin & Review, 23(3), 750–763. https://doi.org/10.3758/s13423-015-0968-3
- Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression ( 3rd ed.). Hoboken, NJ: John Wiley & Sons Inc.
- Ising, H. K., Veling, W., Loewy, R. L., Rietveld, M. W., Rietdijk, J., Dragt, S., … van der Gaag, M. (2012). The validity of the 16-item version of the prodromal questionnaire (PQ-16) to screen for ultra-high risk of developing psychosis in the general help-seeking population. Schizophrenia Bulletin, 38(6), 1288–1296. https://doi.org/10.1093/schbul/sbs068
- Jablensky, A., Sartorius, N., Ernberg, G., Anker, M., Korten, A., Cooper, J. E., … Bertelsen, A. (1992). Schizophrenia: Manifestations, incidence and course in different cultures, a World Health Organization ten-country study. Psychological Medicine. Monograph Supplement, 20, 1–97.
- Jaeschke, R., Guyatt, G., & Sackett, D. L. (1994). Users guides to the medical literature - III. How to use an article about a diagnostic test - A. Are the results of the study valid? Evidence-based medicine working group. JAMA, 271(5), 389–391. https://doi.org/10.1001/jama.1994.03510290071040
- Kotzalidis, G. D., Solfanelli, A., Piacentino, D., Savoja, V., Fiori Nastro, P., Curto, M., … Schultze-Lutter, F. (2017). The Italian version of the 92-item prodromal questionnaire: Concurrent validity with the SIPS and factor analysis in a sample of 258 outpatients aged 11-36 years. Schizophrenia Research, 18 (Epub ahead of print), 50–56. https://doi.org/10.1016/j.schres.2017.02.008.
- Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
- Loewy, R. L., Bearden, C. E., Johnson, J. K., Raine, A., & Cannon, T. D. (2005). The prodromal questionnaire (PQ): preliminary validation of a self-report screening measure for prodromal and psychotic syndromes. Schizophr Res, 79(1), 117–125.
- Loewy, R. L., Therman, S., Manninen, M., Huttunen, M. O., & Cannon, T. D. (2012). Prodromal psychosis screening in adolescent psychiatry clinics. Early Interv Psychiatry, 6(1), 69–75. https://doi.org/10.1111/j.1751–7893.2011.00286.x.
- Maric, N. P., Raballo, A., Rojnic Kuzman, M., Andric Petrovic, S., Klosterkötter, J., & Riecher-Rössler, A. (2017). European status and perspectives on early detection and intervention in at-risk mental state and first episode psychosis: Viewpoint from the EPA section for prevention of mental disorders. European Psychiatry, 46, 48–50.
- McGlashan, T. H., Miller, T. J., Woods, S. W., Rosen, J.L., Hoffman, R.E., & Davidson, L. (2003). Structured interview for prodromal syndromes, version 4.0. New haven, CT: Yale School of Medicine.
- McGorry, P. D., Yung, A. R., & Phillips, L. J. (2003). The “close-in” or ultra-high risk model: A safe and effective strategy for research and clinical intervention in pre-psychotic mental disorder. Schizophrenia Bulletin, 29(4), 771–790.
- Preti, A., Cella, M., & Raballo, A. (2012). All that shines is not psychosis: A cautionary note on the assessment of psychotic symptoms in childhood and adolescence. Psychological Medicine, 42(8), 1787–1788. https://doi.org/10.1017/s0033291712001249.
- Pelizza, L., Azzali, S., Garlassi, S., Paterlini, F., Scazza, I., Chiri, L. R., Pupo, S., & Raballo, A. (2017a). Adolescents at ultra-high risk of psychosis in Italian neuropsychiatry services: Prevalence, psychopathology and transition rate. European Child & Adolescent Psychiatry. https://doi.org/10.1007/s00787-017-1070-3
- Pelizza, L., Raballo, A., Semrov, E., Chiri, L. R., Azzali, S., Scazza, I., Garlassi, S., Paterlini, F., Fontana, F., Favazzo, R., Pensieri, L., Fabiani, M., Cioncolini, L., & Pupo, S. (2017b). Validation of the “early detection primary care checklist” in an Italian community help-seeking sample: The “checklist per la Valutazione dell'Esordio Psicotico”. Early Intervention in Psychiatry. https://doi.org/10.1111/eip.12455.
- Raballo, A., Chiri, L. R., Pelizza, L., Fontana, F., Favazzo, R., Pensieri, L., Fabiani, M., Cioncolini, L., Scazza, I., Paterlini, F., & Semrov, E. (2014). Field-testing the early intervention paradigm in Emilia-Romagna: the Reggio Emilia At Risk Mental State (ReARMS) project. Early Intervention in Psychiatry, 8(suppl. 1), s.88. https://doi.org/10.1111/eip.12199
- Raballo, A., Kotzalidis, G. D., Savoja, V., Solfanelli, A., & Preti, A. (2012). Adattamento italiano del PQ-16. Università “La Sapienza” di Roma: Roma.
- Raballo, A., Poletti, M., & McGorry, P. (2017). Architecture of change: Rethinking child and adolescent mental health. Lancet Psychiatry, 4(9), 656–658.
- Raballo, A., Semrov, E., Bonner, Y., & Simmons, M. B. (2013). Traduzione e adattamento Italiano della CAARMS (the comprehensive assessment of at risk mental states). Regione Emilia-Romagna: Bologna.
- Rapp, C., Canela, C., Studerus, E., Walter, A., Aston, J., Borgwardt, S., & Riecher-Rössler, A. (2017). Duration of untreated psychosis/illness and brain volume changes in early psychosis. Psychiatry Research, 255(3), 332–337. https://doi.org/10.1016/j.psychres.2017.06.004
- Savill, M., D'Ambrosio, J., Cannon, T. D., & Loewy, R. L. (2017). Psychosis risk screening in different populations using the prodromal questionnaire: A systematic review. Early Intervention in Psychiatry, 12, 3–14. https://doi.org/10.1111/eip.12446.
- Schultze-Lutter, F., Michel, C., Schmidt, S. J., Schimmelmann, B. G., Maric, N. P., Salokangas, R. K. R., … Klosterkötter, J. (2015). EPA guidance on the early detection of clinical high risk states of psychoses. European Psychiatry, 30(3), 405–416. https://doi.org/10.1016/j.eurpsy.2015.01.010
- SPSS Inc. (2010). SPSS for Windows, Rel. 18.0. Chicago, IL: SPSS Inc.
- Ustun, T. B., & Chisholm, D. (2001). “Global burden of disease”- study for psychiatric disorders. Psychiatrische Praxis, 28(suppl. 1), s7–11.
- Valmaggia, L. R., McCrone, P., Knapp, M., Woolley, J. B., Broome, M. R., Tabraham, P., … McGuire, P. K. (2009). Economic impact of early intervention in people at high risk of psychosis. Psychological Medicine, 39(10), 1617–1626. https://doi.org/10.1017/S0033291709005613
- Yang, L. H., Wonpat-Borja, A. J., Opler, M. G., & Corcoran, C. M. (2010). Potential stigma associated with inclusion of the psychosis risk syndrome in the DSM-V: An empirical question. Schizophrenia Research, 120(1–3), 42–48. https://doi.org/10.1016/j.schres.2010.03.012
- Yung, A. R., Yuen, H. P., McGorry, P. D., Phillips, L. J., Kelly, D., Dell’Olio, M., … Buckby, J. (2005). Mapping the onset of psychosis: The comprehensive assessment of at-risk mental states. The Australian and New Zealand Journal of Psychiatry, 39(11–12), 964–971.
- Zhou, X., Obuchowski, N. A., & McClish, D. K. (2002). Statistical methods in diagnostic medicine. New York: Wiley and Sons.
10.1002/9780470317082 Google Scholar
