Evidence-based Medicine and Child Mental Health Services
A Broad Approach to Evaluation is Needed
Corresponding Author
Jacqueline Barnes McGuire
Royal Free Hospital School of Medicine, London
Leopold Muller Department of Child and Family Mental Health, Royal Free Hospital School of Medicine, Rowland Hill Street, London NW3 2PFSearch for more papers by this authorWilliam Rosenberg
John Radcliffe Hospital, University of Oxford
Search for more papers by this authorCorresponding Author
Jacqueline Barnes McGuire
Royal Free Hospital School of Medicine, London
Leopold Muller Department of Child and Family Mental Health, Royal Free Hospital School of Medicine, Rowland Hill Street, London NW3 2PFSearch for more papers by this authorWilliam Rosenberg
John Radcliffe Hospital, University of Oxford
Search for more papers by this authorAbstract
There is increased focus on using research evidence to guide clinical practice in the provision of child mental health services, to allocate resources and to make policy decisions. Emphasis has been placed on randomised controlled trials, which are clearly vital. However, given the complexity of children's lives and the multiple systems relevant to their care, it is important to consider alternative research designs and to think creatively about outcomes. In the context of difficulties with random allocation a number of quasi-experimental designs are described that may more closely reflect actual clinical work. In the context of ecological theory, the importance of taking a systems level approach to evaluation is highlighted, with examples from the US. Finally, the ways in which qualitative outcomes measures can be used to sensitively describe the effects of treatment are outlined, and their potential for giving voice to children and families as consumers of mental health services. These suggestions aim to lessen the tension between the requirements of the scientific investigations of treatment effectiveness and the realities of clinicians' daily experiences.
References
- Audit Commission (1994) Seen but not heard. Co-ordinating Community Child Health and Social Services for Children in Need. HMSO.
- Barrnett, R, Docherty, J and Frommelt, G (1991) ‘A review of psychotherapy research since 1963’, Journal of the American Academy of Child and Adolescent Psychiatry, 30, 1–14.
- Berruta-Clement, J and others (1984) Changed Lives. Ypsilanti , MI : High Scope Press.
- Bickman, L and others (1992) ‘Evaluation planning for an innovative children's mental health system’, Clinical Psychology Review, 12, 853–865.
-
Bronfenbrenner, U (1979) The Ecology of Human Development.
Cambridge
,
MA
: Harvard University Press.
10.4159/9780674028845 Google Scholar
- Brooks-Gunn, J and others (1993) ‘Do neighbourhoods influence child and adolescent development American Journal of Sociology, 99(2), 353–395.
- Burns, B (1994) ‘The challenges of child mental health services research’, Journal of Emotional and Behavioural Disorders, 2(4), 254–259.
- Burns, B and Friedman, R (1990) ‘Examining the research base for child mental health services and policy’, Journal of mental health administration, 17, 87–98.
- Butler RJ, Forsythe, WI and Robertson, J. (1990) ‘The body-worn alarm in the treatment of children enuresis’, British Journal of Clinical Practice, 44(6), 237–241.
- Cook, T and Campbell, D (1979) Quasi-experimentation. Design and analysis issues for field settings. New York : Houghton Mifflin.
- Department of Health (1995) Key Area Handbook: Child and Adolescent Mental Health. HMSO.
- Earls, F, McGuire, J and Shay, S (1994) ‘Evaluating a community intervention to reduce the risk of child abuse. Methodological strategies in conducting neighbourhood surveys’, Child Abuse and Neglect, 18, 473–486.
- Edelbrock, C and others (1986) ‘Parent-child agreement on child psychiatric symptoms assessed via structured interview’, Journal of Child Psychology and Psychiatry, 27, 181–190.
- Fitzpatrick, R and Boulton, M (1994) ‘Qualitative methods for assessing health care’, Quality in Health Care, 3, 107–113.
- Friman, PC (1986) ‘A preventive context for enuresis’, Pediatric Clinics of North America, 33(4), 871–886.
- Garbarino, J and Kostelny, K (1992) ‘Child abuse as a community problems’, Child Abuse and Neglect, 16, 455–464.
- Graham, PJ (1992) ‘Types of psychiatric treatment: overview’, Archives of Diseases in Childhood, 67, 237–239.
- Graham, PJ (1995) ‘Commissioned review. ICD-10 and the clinician’, ACPP Review & Newsletter, 17(3), 127–131.
- Health Advisory Service (1995) The Commissioning, Role and Management of Child and Adolescent Mental Health Services. HMSO.
- Hodges, K, Gordon, Y and Lennon, M (1990) ‘Parent-child agreement on symptoms assessed via a clinical research interview for children: the Child Assessment Schedule (CAS)’, Journal of Child Psychology and Psychiatry, 31, 427–436.
- Jenkins, S, Bax, M and Hart, H (1984) ‘Behaviour problems in pre-school children’, Journal of Child Psychology and Psychiatry, 21, 5–17.
- Jensen, A (1969) ‘How much can we boost IQ and scholastic achievement Harvard Educational Review, 39: 1–123.
- Jones, R (1995) ‘Why do qualitative research British Medical Journal, 311, 2.
- Kurtz, Z, Thornes, R and Wolkind, S (1994) Services for the Mental Health of Children and Young People in England. A National Review. Department of Public Health.
- Kutash, K and others (1993) ‘Multi-stage evaluation for a community mental health system for children’, Administration and Policy in Mental Health, 2(4), 311–322.
- Lazar, I and Darlington, R (1982) ‘Lasting effects of early education’, Monographs of the Society of Research in Child Development, 47(2–2), Serial No. 195.
- Markus, E, Lange, A and Pettigrew, T (1990) ‘Effectiveness of family therapy: a meta-analysis’, Journal of Family Therapy, 12, 205–221.
- McGuire, J and Earls, F (1991) ‘Prevention of psychiatric disorders in early children’, Journal of Child Psychology and Psychiatry, 32(1), 129–153.
-
Posavac, E (1994) ‘Preventing the misuse of evaluation’, New Directions for Program Evaluation, 64: 69–78.
10.1002/ev.1696 Google Scholar
- Richman, N, Stevenson, J and Graham, PJ (1982) Preschool to school. A behavioural study. London : Academic Press.
- Rosenberg, W and Donald, A (1995) ‘Evidence based medicine: an approach to clinical problem-solving’, British Medical Journal, 310, 1122–1125.
- Rossi, P (1991) Evaluating family preservation programs. A report to the Edna McConnell Clark Foundation. Amherst , MA , USA : Social and Demographic Research Institute: University of Massachusetts.
- Sackett, D and others (1996) ‘Evidence based medicine: what it is and what it isn't’, British Medical Journal, 312, 71–72.
- Sampson, R and Groves, W (1989) ‘Community structure and crime: testing social-disorganization theory’, American Journal of Sociology, 94, 774–802.
- Schweinhart, LJ and Weikart, DP (1993) ‘ A summary of significant benefits. The High Scope Perry Pre-School Project study through age 27’, Ypsilanti , MI , USA : High Scope Press.
- Silverman, WK and Eisen, AR (1992) ‘Age differences in reliability of parent and child reports of child anxious symptomatology using a structured interview’, Journal of the American Academy of Child and Adolescent Psychiatry, 31, 117–124.
- Stroul, B (1993) Systems of care for children and adolescents with severe emotional disturbances: What are the results? Washington , DC , USA : CASSP Technical Assistance Center, Georgetown University Child Development Center.
- Stroul, BA and Friedman, FM (1986) A system of care for severely emotionally disturbed children & youth. Washington , DC , USA : CASSP Technical Assistance Center, Georgetown University Child Development Center.
- Weiss, H and Greene, J (1992) ‘An empowerment partnership for family support and education programs and evaluations’, Family Science Review, 5(1&2), 131–148.
- Werry, J and Wollersheim, J (1989) ‘Behaviour therapy with children and adolescents: a twenty-year overview’, Journal of the American Academy of Child and Adolescent Psychiatry, 28, 1–18.
- White, J and others (1990) ‘How early can we tell? Pre-school predictors of boys' conduct disorder and delinquency’, Criminology, 28, 507–533.
- Wilson, P (1996) ‘Book review of children's mental health services’, Young Minds, 25, 21.