Original Article
Systematic Review and Quality Appraisal of Practice Guidelines for Self-Harm in Children and Adolescents
Darren B. Courtney MD, FRCPC,
Stephanie Duda MSc,
Peter Szatmari MD, FRCPC,
Joanna Henderson PhD, CPsych,
Kathryn Bennett PhD,
Corresponding Author
Darren B. Courtney MD, FRCPC
Psychiatry, University of Toronto, Toronto, ON, Canada
Address correspondence to Darren B. Courtney, Psychiatry, University of Toronto, 80 Workman Way, 5th Floor, Toronto, ON M6J1H4, Canada; E-mail: [email protected]Search for more papers by this authorStephanie Duda MSc
Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
Search for more papers by this authorPeter Szatmari MD, FRCPC
Psychiatry, University of Toronto, Toronto, ON, Canada
Search for more papers by this authorJoanna Henderson PhD, CPsych
Psychology, University of Toronto, Toronto, ON, Canada
Search for more papers by this authorKathryn Bennett PhD
Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
Search for more papers by this authorDarren B. Courtney MD, FRCPC,
Stephanie Duda MSc,
Peter Szatmari MD, FRCPC,
Joanna Henderson PhD, CPsych,
Kathryn Bennett PhD,
Corresponding Author
Darren B. Courtney MD, FRCPC
Psychiatry, University of Toronto, Toronto, ON, Canada
Address correspondence to Darren B. Courtney, Psychiatry, University of Toronto, 80 Workman Way, 5th Floor, Toronto, ON M6J1H4, Canada; E-mail: [email protected]Search for more papers by this authorStephanie Duda MSc
Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
Search for more papers by this authorPeter Szatmari MD, FRCPC
Psychiatry, University of Toronto, Toronto, ON, Canada
Search for more papers by this authorJoanna Henderson PhD, CPsych
Psychology, University of Toronto, Toronto, ON, Canada
Search for more papers by this authorKathryn Bennett PhD
Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
Search for more papers by this authorThe authors thank Maureen Rice, research librarian, for conducting the literature search.
This project was funded by the Cundill Centre for Youth Depression and the Margaret and Wallace McCain Centre for Child, Youth, and Family Mental Health. This research received no specific grant from any funding agency, commercial, or nonprofit sectors.
Conflict of interests: None.
Abstract
This study aimed to systematically identify and appraise clinical practice guidelines (CPGs) relating to the assessment and management of suicide risk and self-harm in children and adolescents. Our research question is as follows: For young people (under 18 years old) presenting to clinical care with suicide ideation or a history of self-harm, what is the quality of up-to-date CPGs? Using the PRISMA format, we systematically identified CPGs meeting our inclusion and exclusion criteria. Subsequently, two independent raters conducted appraisals of the eligible CPGs using the Appraisal of Guidelines for Research and Evaluation II instrument. CPGs were then classified as “poor quality,” “minimum quality,” and “high quality” using operationally defined criteria developed a priori. We identified 10 eligible CPGs published or renewed between 2005 and May 2017. Only the long-term management of self-harm CPGs produced by the National Institute for Health and Care Excellence met “high-quality” criteria. Despite multiple options of CPGs published to choose from, only one was identified as “high quality,” where bias is adequately minimized. Clinicians are advised to direct resources to implementing the “high-quality” CPG.
Supporting Information
| Filename | Description |
|---|---|
| sltb12466-sup-0001-AppendixS1.docxWord document, 19.4 KB | Appendix S1. Detailed search strategies. |
| sltb12466-sup-0001-AppendixS2.docxWord document, 17.5 KB | Appendix S2. Item-by-time average post-inter-rater-discussion AGREE II scores for each of the CPGs relating to self-harm. |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- Agree Next Steps Consortium. (2013). AGREE-II user's manual. Retrieved June 3, 2014, from http://www.agreetrust.org
- Agree Research Trust. (2014a). AGREE II overview tutorial and practice exercise. Retrieved November 7, 2014, from http://www.agreetrust.org/resource-centre/agree-ii-training-tools/
- Agree Research Trust. (2014b). My AGREE PLUS. Retrieved January 5, 2016, from http://www.agreetrust.org/login/
- Alonso-Coello, P., Irfan, A., Solà, I., Gich, I., Delgado-Noguer, M., Rigau, D., et al. (2010). The quality of clinical practice guidelines over the last two decades: A systematic review of guideline appraisal studies. Quality & Safety in Health Care, 19, e58.
- Beghi, M., Rosenbaum, J. F., Cerri, C., & Cornaggia, C. M. (2013). Risk factors for fatal and nonfatal repetition of suicide attempts: A literature review. Neuropsychiatric Disease and Treatment, 9, 1725–1736.
- Bennett, K., Gorman, D. A., Duda, S., Brouwers, M., & Szatmari, P. (2016). Practitioner Review: On the trustworthiness of clinical practice guidelines-a systematic review of the quality of methods used to develop guidelines in child and youth mental health. Journal of Child Psychology and Psychiatry, 57, 662-673.
- Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., et al. (2010a). AGREE II: Advancing guideline development, reporting and evaluation in health care. Canadian Medical Association Journal, 182, E839–E842.
- Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., et al. (2010b). Development of the AGREE II, part 1: Performance, usefulness and areas for improvement. Canadian Medical Association Journal, 182, 1045–1052.
- Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., et al. (2010c). Development of the AGREE II, part 2: Assessment of validity of items and tools to support application. Canadian Medical Association Journal, 182, E472–E478.
- Canadian Agency for Drugs and Technologies in Health. (2013). CADTH Peer review checklist for search strategies. Retrieved May 11, 2015, from https://www.cadth.ca/resources/finding-evidence/cadth-peer-review-checklist-search-strategies
- Canadian Agency for Drugs and Technologies in Health. (2014). Strings attached: CADTH's database search filters. Retrieved May 11, 2015, from https://www.cadth.ca/resources/finding-evidence/strings-attached-cadths-database-search-filters
- Carter, G., Page, A., Large, M., Hetrick, S., Milner, A. J., Bendit, N., et al. (2016). Royal Australian and New Zealand College of Psychiatrists clinical practice guideline for the management of deliberate self-harm. Australian and New Zealand Journal of Psychiatry, 50, 939–1000.
- Centers for Disease Control and Prevention. (2013). Deaths, percent of total deaths, and death rates for the 15 leading causes of death in 5-year age groups, by race and sex: United States.
- Cincinnati Children's Hospital Medical Center. (2009a). Table of evidence levels—Levels of individual studies by domain, study design & quality. Retrieved March 15, 2016, from http://www.cincinnatichildrens.org/assets/0/78/1067/2709/2777/2793/9200/5ce396bf-fdcb-4c65-a9f2-1b9888d4fc7e.pdf
- Cincinnati Children's Hospital Medical Center. (2009b). Grading a body of evidence to answer a clinical question. Retrieved March 15, 2016, from http://www.cincinnatichildrens.org/assets/0/78/1067/2709/2777/2793/9200/bd6f4eea-825c-49c3-a0e5-3e66c54dc066.pdf
- Cincinnati Children's Hospital Medical Center. (2009c). Judging the strength of a recommendation. Retrieved March 15, 2016, from http://www.cincinnatichildrens.org/assets/0/78/1067/2709/2777/2793/9200/d7344329-03d0-45f3-b6ca-02c746a472ec.pdf
- Cincinnati Children's Hospital Medical Center. (2011). Best Evidence Statement (BESt): Preventing patient self-harm. Retrieved May 22, 2017, from https://www.cincinnatichildrens.org/-/media/cincinnati%20childrens/home/service/j/anderson-center/evidence-based-care/recommendations/type/self-harm-checklist.pdf?la=en
- Cox, G., & Hetrick, S. (2017). Psychosocial interventions for self-harm, suicidal ideation and suicide attempt in children and young people: What? How? Who? and Where? Evidence-Based Mental Health, 20(2), 35–40.
- Doan, J., Leblanc, A., Roggenbaum, S., & Lazear, K. J. (2012). Youth suicide prevention school-based guide—Issue brief 5: Suicide prevention guidelines. Retrieved May 22, 2017, from http://theguide.fmhi.usf.edu/pdf/2012PDFs/2012GuideAll.pdf
- Doan, J., Roggenbaum, S., Lazear, K. J., & Leblanc, A. (2012). Youth suicide prevention school-based guide—Checklist 5: Suicide prevention guidelines. Retrieved May 22, 2017, from http://theguide.fmhi.usf.edu/pdf/2012PDFs/2012GuideAll.pdf
- Finkelstein, Y., Macdonald, E. M., Hollands, S., Sivilotti, M. L., Hutson, J. R., Mamdani, M. M., et al. (2015). Risk of suicide following deliberate self-poisoning. JAMA Psychiatry, 72, 570–575.
- Fleiss, J. L. (1981). Statistical methods for rates and proportions, 2nd edn (p. 1981). New York: John Wiley.
- Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33(3), 613–619.
- Graham, R., Mancher, M., Miller Wolman, D., Greenfield, S., & Steinberg, E. (2011). In clinical practice guidelines we can trust. Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Institute of Medicine (pp. 26). Washington, DC: National Academies Press. Retrieved May 22, 2017, from https://www.ncbi.nlm.nih.gov/books/NBK209539/
- Granboulan, V., Roudot-Thorval, F., Lemerle, S., & Alvin, P. (2001). Predictive factors of post-discharge follow-up care among adolescent suicide attempters. Acta Psychiatrica Scandinavica, 104(1), 31–36.
- Griffiths, M. (2011). Validity, utility and acceptability of borderline personality disorder diagnosis in childhood and adolescence: Survey of psychiatrist. The Psychiatrist, 35, 19–22.
10.1192/pb.bp.109.028779 Google Scholar
- Harris, R. P., Helfand, M., Woolf, S. H., Lohr, K. N., Mulrow, C. D., Teutsch, S. M., et al. (2001). Current methods of the US Preventive Services Task Force: A review of the process. American Journal of Preventive Medicine, 20(3), 21–35.
- Hawton, K., Bergen, H., Kapur, N., Cooper, J., Steeg, S., Ness, J., et al. (2012). Repetition of self-harm and suicide following self-harm in children and adolescents: Findings from the Multicentre Study of Self-harm in England. Journal of Child Psychology and Psychiatry, 53, 1212–1219.
- Hawton, K., & Harriss, L. (2007). Deliberate self-harm in young people: Characteristics and subsequent mortality in a 20-year cohort of patients presenting to hospital. The Journal of Clinical Psychiatry, 68, 1574–1583.
- Hawton, K., Houston, K., & Shepperd, R. (1999). Suicide in young people. Study of 174 cases, aged under 25 years, based on coroners’ and medical records. The British Journal of Psychiatry, 175(3), 271–276.
- Hawton, K., Saunders, K., & O'Connor, R. (2012). Self-harm and suicide in adolescents. The Lancet, 379, 2373–2382.
- Hawton, K., Witt, K. G., Taylor Salisbury, T. L., Arensman, E., Gunnell, D., Townsend, E., et al. (2015). Interventions for self-harm in children and adolescents. The Cochrane Database of Systematic Reviews, 12, CD012013.
- Jorm, A. (2015). Using the Delphi expert consensus method in mental health research. Australian & New Zealand Journal of Psychiatry, 49, 887–897.
- Kapur, N., Cooper, J., O'Connor, R. C., & Hawton, K. (2013). Non-suicidal self-injury v. attempted suicide: New diagnosis or false dichotomy? The British Journal of Psychiatry, 202, 326–328.
- Kung, J., Miller, R. R., & Mackowiak, P. A. (2012). Failure of clinical practice guidelines to meet Institute of Medicine Standards: Two more decades of little, if any progress. Archives of Internal Medicine, 172, 1628–1633.
- LeFevre, M. L. (2014). Screening for suicide risk in adolescents, adults, and older adults in primary care: US Preventive Services Task Force recommendation statement screening for suicide risk in adolescents and adults in primary care. Annals of Internal Medicine, 160, 719–726.
- Mehlum, L., Tørmoen, A. J., Ramberg, M., Haga, E., Diep, L. M., Laberg, S., et al. (2014). Dialectical behavior therapy for adolescents with repeated suicidal and self-harming behavior: A randomized trial. Journal of the American Academy of Child & Adolescent Psychiatry, 53, 1082–1091.
- Michail, M., Tait, L., & Churchill, D. (2017). General practitioners’ clinical expertise in managing suicidal young people: Implications for continued education. Primary Health Care Research & Development, 18, 419–428.
- National Collaborating Centre for Mental Health. (2004). Self-harm: The short-term physical and psychological management and secondary prevention of self-harm in primary and secondary care. Retrieved May 22, 2017, from https://www.ncbi.nlm.nih.gov/books/NBK56385/
- National Collaborating Centre for Mental Health. (2012). Self-harm: The NICE guideline on longer-term management. Retrieved May 22, 2017, from https://www.ncbi.nlm.nih.gov/books/NBK126777/
- National Institute for Health and Care Excellence. (2005a). Self-harm in over 8s: Short-term management and prevention of recurrence—Tools and resources. Retrieved December 16, 2016, from https://www.nice.org.uk/guidance/cg16/resources
- National Institute for Health and Care Excellence. (2005b). Self-harm in over 8s: Short-term management and prevention of recurrence—Supporting evidence. Retrieved December 16, 2016 from, https://www.nice.org.uk/guidance/cg16/evidence
- National Institute for Health and Care Excellence. (2009). The guidelines manual (Process and methods [PMG6]). London, UK: NICE. Retrieved April 19, 2018 from https://www.zorginzicht.nl/kennisbank/Documents/The_NICEguidelines_manual_2009_All_chapters.pdf
- National Institute for Health and Care Excellence. (2011). Self-harm in over 8s: Long-term management—Tools and resources. Retrieved December 16, 2017, from https://www.nice.org.uk/guidance/cg133/resources
- National Institute for Health and Care Excellence. (2012). Self-harm in over 8s: Long-term management—Supporting evidence. Retrieved December 16, 2016 from https://www.nice.org.uk/guidance/cg133/evidence
- National Institute for Health and Care Excellence. (2013). NICE charter. Retrieved May 22, 2017, from https://www.nice.org.uk/Media/Default/About/Who-we-are/NICE_Charter.pdf
- National Institute for Health and Care Excellence. (2017). Self-harm overview. Retrieved April 17, 2018 from https://pathways.nice.org.uk/pathways/self-harm
- Navaneelan, T. (2017). Suicide rates: An overview. Statistics Canada. 2017. Retrieved May 22, 2017 from http://www.statcan.gc.ca/pub/82-624-x/2012001/article/11696-eng.htm
- Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., et al. (2013). Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: Results from the National Comorbidity Survey Replication Adolescent Supplement. JAMA Psychiatry, 70(3), 300–310.
- O'Connor, E., Gaynes, B. N., Burda, B. U., Soh, C., & Whitlock, E. P. (2013a). Screening for and treatment of suicide risk relevant to primary care: A systematic review for the US Preventive Services Task Force. Annals of Internal Medicine, 158, 741–754.
- O'Connor, E., Gaynes, B., Burda, B. U., Williams, C., & Whitlock, E. P. (2013b). Screening for suicide risk in primary care: A systematic evidence review for the U.S. Preventive Services Task Force. AHRQ Publication No. 13-05188-EF-1. Retrieved May 22, 2017 from https://www.ncbi.nlm.nih.gov/pubmed/23678511
- Ougrin, D., Tranah, T., Leigh, E., Taylor, L., & Asarnow, J. R. (2012). Practitioner review: Self-harm in adolescents. Journal of Child Psychology and Psychiatry, 53(4), 337–350.
- Ougrin, D., Tranah, T., Stahl, D., Moran, P., & Asarnow, J. R. (2015). Therapeutic interventions for suicide attempts and self-harm in adolescents: Systematic review and meta-analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 54(2), 97–107.
- Ougrin, D., Zundel, T., Ng, A., Banarsee, R., Bottle, A., & Taylor, E. (2011). Trial of Therapeutic Assessment in London: Randomised controlled trial of Therapeutic Assessment versus standard psychosocial assessment in adolescents presenting with self-harm. Archives of Disease in Childhood, 96, 148–153.
- Owens, D., Horrocks, J., & House, A. (2002). Fatal and non-fatal repetition of self-harm. The British Journal of Psychiatry, 181(3), 193–199.
- Penn, J. V., & Thomas, C. (2005). Practice parameter for the assessment and treatment of youth in juvenile detention and correctional facilities. Journal of the American Academy of Child & Adolescent Psychiatry, 44, 1085–1098.
- Plenar, P., Brunner, R., Fegert, J., Groschwitz, R. C., In-Albon, T., Kaess, M., et al. (2016). Treating nonsuicidal self-injury (NSSI) in adolescents: Consensus based German Guidelines. Child and Adolescent Psychiatry and Mental Health, 10, 46.
- Rice, S. M., Simmons, M. B., Bailey, A. P., Parker, A. G., Hetrick, S. E., Davey, C. G., et al. (2014). Development of practice principles for the management of ongoing suicidal ideation in young people diagnosed with major depressive disorder. SAGE Open Medicine, 2, 2050312114559574.
10.1177/2050312114559574 Google Scholar
- Roggenbaum, S. (2012). The youth suicide prevention school-based guide development (pp. 4–9). Carleton, MI: The Exchange: A Professional Publication from the Michigan Association of School Social Workers, November.
- Rossouw, T. I., & Fonagy, P. (2012). Mentalization-based treatment for self-harm in adolescents: A randomized controlled trial. Journal of the American Academy of Child & Adolescent Psychiatry, 51, 1304–1313.
- The Agree Collaboration. (2003). Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: The AGREE project. Quality & Safety in Health Care, 12, 18–23.
- Turecki, G., & Brent, D. A. (2016). Suicide and suicidal behaviour. The Lancet, 387, 1227–1239.
- Vlayen, J., Aertgeerts, B., Hannes, K., Sermeus, W., & Ramaekers, D. (2005). A systematic review of appraisal tools for clinical practice guidelines: Multiple similarities and one common deficit. International Journal for Quality in Health Care, 17, 235–242.
- Wasserman, D., Hoven, C. W., Wasserman, C., Wall, M., Eisenberg, R., Hadlaczky, G., et al. (2015). School-based suicide prevention programmes: The SEYLE cluster-randomised, controlled trial. The Lancet, 385, 1536–1544.
- Weinmann, S., Koesters, M., & Becker, T. (2007). Effects of the implementation of psychiatric guidelines on provider performance and patient outcome: Systematic review. Acta Psychiatrica Scandinavica, 115, 420–433.
- White, J., for the British Columbia Ministry of Children and Family Development. (2014). Practice guidelines for working with children and youth at-risk for suicide in community mental health settings. Retrieved May 22, 2017, from http://www2.gov.bc.ca/assets/gov/health/managing-your-health/mental-health-substance-use/child-teen-mental-health/practice_guidelines_children_youth_at_risk_suicide.pdf
- Wilkinson, P., Kelvin, R., Roberts, C., Dubicka, B., & Goodyer, I. (2011). Clinical and psychosocial predictors of suicide attempts and nonsuicidal self-injury in the Adolescent Depression Antidepressants and Psychotherapy Trial (ADAPT). American Journal of Psychiatry, 168(5), 495–501.
- Working Group of the Clinical Practice Guideline for Prevention and Treatment of Suicidal Behaviour. (2012). Clinical practice guideline for the prevention and treatment of suicidal behaviour. Ministry of Health, Social Policy and Equality National Health System Quality Plan. Galician Agency for Health Technology Assessment (avalia-t), SNS Clinical Practice Guidelines: Avalia-t 2010/02. Retrieved May 22, 2017, from http://www.guiasalud.es/GPC/GPC_481_Conducta_Suicida_Avaliat_compl_en.pdf
- World Health Organization. (2014). Mortality, morbidity and disability in adolescence. Retrieved May 22, 2017, from http://apps.who.int/adolescent/second-decade/section3/page2/mortality.html
- Zalsman, G., Hawton, K., Wasserman, D., van Heeringen, K., Arensman, E., Sarchiapone, M., et al. (2016). Suicide prevention strategies revisited: 10-year systematic review. The Lancet Psychiatry, 3, 646–659.
