Development and Validation of the GAIN Short Screener (GSS) for Internalizing, Externalizing and Substance Use Disorders and Crime/Violence Problems Among Adolescents and Adults
Corresponding Author
Michael L. Dennis PhD
Chestnut Health Systems, Bloomington, Illinois
Address correspondence to Dr. Dennis, Chestnut Health Systems, 720 West Chestnut, Bloomington, IL 61701. E-mail: [email protected].Search for more papers by this authorRodney R. Funk BS
Chestnut Health Systems, Bloomington, Illinois
Search for more papers by this authorCorresponding Author
Michael L. Dennis PhD
Chestnut Health Systems, Bloomington, Illinois
Address correspondence to Dr. Dennis, Chestnut Health Systems, 720 West Chestnut, Bloomington, IL 61701. E-mail: [email protected].Search for more papers by this authorRodney R. Funk BS
Chestnut Health Systems, Bloomington, Illinois
Search for more papers by this authorThe opinions are those of the author and do not reflect official positions of the contributing project directors or government.
Abstract
The Global Appraisal of Individual Needs (GAIN)1 is a 1–2 hour standardized biopsychosocial that integrates clinical and research assessment for people presenting to substance abuse treatment. The GAIN – Short Screener (GSS) is 3–5 minute screener to quickly identify those who would have a disorder based on the full 60–120 minute GAIN and triage the problem and kind of intervention they are likely to need along four dimensions (internalizing disorders, externalizing disorders, substance disorders, and crime/ violence). Data were collected from 6,177 adolescents and 1,805 adults as part of 77 studies in three dozen locations around the United States that used the GAIN. For both adolescents and adults the 20-item total disorder screener (TDScr) and its four 5-item sub-screeners (internalizing disorders, externalizing disorders, substance disorders, and crime/violence) has good internal consistency (alpha of .96 on total screener), is highly correlated (r—.84 to .94) with the 123-item longer scales in the full GAIN. The GSS also does well in terms of its receiver operator characteristics (90% or more under the curve in all analyses) and has clinical decision-making cut points with excellent sensitivity (90% or more) for identifying people with a disorder and excellent specificity (92% or more) for correctly ruling out people who did not have a disorder. The GSS has good potential as an efficient screener for identifying people with co-occurring disorders across multiple systems and routing them to the right services and more detailed assessments.
REFERENCES
- 1 Dennis ML, Titus JC, White M, et al. Global Appraisal of Individual Needs (GAIN): Administration Guide for the GAIN and Related Measures. Version 5 ed. Bloomington, IL: Chestnut Health Systems. 2003; Available at: http://www.chestnut.org/li/gain. Accessed April 6, 2006.
- 2 Angst J, Sellaro R, Ries MK. Multimorbidity of psychiatric disorders as an indicator of clinical severity. European Archives of Psychiatry and Clinical Neuroscience. 2002; 252: 147-154.
- 3 Kandel DB, Johnson JG, Bird HR, et al. Psychiatric comorbidity among adolescents with substance use disorders: Findings from the MECA study. J Am Acad Child Adolesc Psychiatry. 1999; 38: 693-699.
- 4 Kessler RC, Nelson CB, McGonagle KA, et al. The epidemiology of co-occurring addictive and mental disorders: Implications for prevention and service utilization. Am J Orthopsychiatry. 1996; 66: 17-31.
- 5 Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005; 62: 617-627.
- 6 Krueger RF, Markon KE. Reinterpreting Comorbidity: A Model-Based Approach to Understanding and Classifying Psycho-pathology. Annu Revof Clin Psychology. 2006; 2: 111-113.
- 7 Regier DA, Farmer ME, Rae DS, et al. Comorbidity of mental disorders with alcohol and other drug abuse: Results from the Epidemiologic Catchment Area (ECA) study. JAMA. 1990; 264: 2511-2518.
- 8 Crowley TJ, Riggs PD. Adolescent substance use disorder with conduct disorder and comorbid conditions. In: ER Rahdert, D Czecho-wicz, eds. Adolescent Drug Abuse: Clinical Assessment and Therapeutic Interventions. Rockville, MD: National Institute on Drug Abuse; 1995: 49-111.
- 9 Diamond G, Panichelli-Mindel SM, Shera D, et al. Psychiatric syndromes in adolescents seeking outpatient treatment for marijuana with abuse and dependency in outpatient treatment. J Child Adoles Subst Abuse. 2006; 15: 37-54.
- 10 Eronen M, Angermeyer MC. The psychiatric epidemiology of violent behaviour. Social Psychiatry and Psychiatc Epidemiol. 1998; 33(S1): S13–S23.
- 11 Gretton HM, Hare RD, Catchpole REH. Psychopathy and offending from adolescence to adulthood: A 10-year follow-up. J Consult Clin Psychol. 2004; 72: 636-645.
- 12 Mueser KT, Yarnold PR, Levinson DF, et al. Prevalence of substance abuse in schizophrenia: Demographic and clinical correlates. Schizophr Bull. 1990; 16: 31-56.
- 13 Latimer WW, Stone AL, Voight A, et al. Gender differences in psychiatric comorbidity among adolescents with substance use disorders. Exp Clin Psychopharmacology. 2002; 10: 310-315.
- 14 Loeber R, Farrington DP, Stouthamer-Loeber M, et al. Male mental health problems, psychopathy, and personality traits: Key findings from the first 14 years of the Pittsburgh Youth Study. Clin Child Fam Psychol Rev. 2001; 4: 273-297.
- 15 Ross HE, Glaser FB, Germanson T. The prevalence of psychiatric disorders in patients with alcohol and other drug problems. Arc Gen Psychiatry. 1988; 45: 1023-1031.
- 16 Skeem JL, Mulvey EP. Psychopathy and community violence among civil psychiatric patients: Results from the MacArthur Violence Risk Assessment Study. Journal of Consult Clin Psych. 2001; 69: 358-374.
- 17 Brooner RK, King VL, Kidorf M, et al. Psychiatric and substance use comorbidity among treatment-seeking opioid abusers. Arch Gen Psychiatry. 1997; 54: 71-80.
- 18 Cornelius JR, Maisto SA, Martin CS, et al. Major depression associated with earlier alcohol relapse in treated teens with AUD. Addict Behav. 2004; 29: 1035-1038.
- 19 McLellan AT, Luborsky L, Woody GE, et al. Prediction response to alcohol and drug abuse treatments. Arch Gen Psychiatry. 1983; 40: 620-628.
- 20 Mueser KT, Drake RE, Miles KM. The course and treatment of substance use disorder in persons with severe mental illness. In: LS Onken, JD Blaine, S Genser, AM Horton, eds. Treatment of Drug-Dependent Individuals with Comorbid Mental Disorders. National Institute on Drug Abuse; 1997.
- 21 Hien DA, Nunes E, Levin FR, et al. Posttraumatic stress disorder and short-term outcome in early methadone treatment. J Subst Abuse Treat. 2000; 19: 31-37.
- 22 Project MATCH Research Group. Project MATCH secondary a priori hypotheses. Addiction. 1997; 92: 1671-1698.
- 23 Rounsaville BJ, Kosten TR, Weissman MM, et al. Prognostic significance of psychiatric disorders in treated opiate addicts. Arch Gen Psychiatry. 1986; 43: 739-745.
- 24 Shane P, Jasiukaitis P, Green RS. Treatment outcomes among adolescents with substance abuse problems: The relationship between comorbidities and post-treatment substance involvement. Eval Prog Plann. 2003; 26: 393-402.
- 25 Bijl RV, de Graaf R, Hiripi E, et al. The Prevalence of Treated and Untreated Mental Disorders in Five Countries. Health Afs. 2003; 22: 122-133.
- 26 Clark HW, Horton AM, Jr., Dennis ML, et al. Moving from research to practice just in time: The treatment of cannabis use disorders comes of age. Addiction. 2002; 97: S1-S3.
- 27 Drug and Alcohol Services Information System (DASIS). Admissions with Co-Occurring Disorders: 1995 and 2001. Rockville, MD: Office of Applied Studies, Substance Abuse and Mental Health Services Administration. Available at: http://www.oas.samhsa.gov/2k4/dualTX/dualTX.htm. Accessed April 20, 2006.
- 28 Drug and Alcohol Services Information System (DASIS). Adolescents with Co-Occurring Psychiatric Disorders: 2003. Rockville, MD: Office of Applied Studies, Substance Abuse and Mental Health Services Administration. Available at: http://www.oas.samhsa.gov/2k5/youthMH/youthMH.htm. Accessed April 20, 2006.
- 29 Center for Substance Abuse Treatment. Substance Abuse Treatment for Persons With Co-Occurring Disorders. Treatment Improvement Protocol (TIP) Series 42. DHHS Publication No. (SMA) 05–3992. Rockville, MD: Substance Abuse and Mental Health Services Administration, 2005.
- 30 Center for Substance Abuse Treatment. Assessment and Treatment of Patients with Coexisting Mental Illness and Alcohol and Other Drug Abuse. Rockville, MD: Substance Abuse and Mental Health Services Administration; 1994.
- 31 Substance Abuse and Mental Health Services Administration; Report to Congress on the Prevention and Treatment of Co-Occurring Substance Abuse Disorders and Mental Disorders. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2002.
- 32 Weisner C, McLellan T, Barthwell A, et al. Report of the Blue Ribbon Task Force on Health Services Research at the National Institute on Drug Abuse. Rockville, MD: National Institute on Drug Abuse; 2004.
- 33
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR). 4th – text revision ed. Washington, DC: American Psychiatric Association; 2000.
10.1176/appi.books.9780890423349 Google Scholar
- 34 Achenbach TM, Edelbrock CS. The classification of child psycho-pathology: A review and analysis of empirical efforts. Psychol Bull. 1978; 85: 1275-1301.
- 35 Krueger RF. The structure of common mental disorders. Archives of General Psychiatry 1999; 56: 921-926.
- 36 Krueger RF, Caspi A, Moffitt TE, Silva PA. The structure and stability of common mental disorders (DSM-III-R): A longitudinal-epidemiological Study. Journal of Abnormal Psychology 1998; 107: 216-227.
- 37 Vollebergh W, Iedema J, Bijl RV, et al. The structure and stability of common mental disorders: The NEMESIS study. Arch Gen Psychiatry. 2001; 58: 597-603.
- 38 Dennis ML, Dawud-Noursi S, Muck RD, et al. The need for developing and evaluating adolescent treatment models. In: SJ Stevens, AR Morral, eds. Adolescent Substance Abuse Treatment in the United States: Exemplary Models from a National Evaluation Study. Binghamton, NY: Haworth Press; 2003: 3-34.
- 39 Chan YF, Dennis ML, Funk RR. Prevalence and comorbidity of major mental disorders among adolescents and adults presenting to substance abuse treatment. Journal of Substance Abuse Treatment under review.
- 40 Kessler RC, Adler L, Barkley R, et al. The prevalence and correlates of adult ADHD in the United States: Results from the National Comorbidity Survey Replication. American Journal of Psychiatry. 2006; 163: 716-723.
- 41 Levin FR, Evans SM, Kleber HD. Prevalence of adult attention-deficit hyperactivity disorder among cocaine abusers seeking treatment. Drug and Alcohol Dependence. 1998; 52: 15-25.
- 42 Wender PH, Wolf LE, Wasserstein J. Adults with ADHD: An overview. Annals of New York Academy of Science. 2001; 931: 1-16.
- 43 Wilson JJ, Levin FR. Attention Deficit Hyperactivity Disorder (ADHD) and substance use disorders. Current Psychiatry Reports. 2001; 3: 497-506.
- 44 Hare RD, Neumann CS. Structural models of psychopathy. Curr Psychiatry Rep. 2005; 7: 57-64.
- 45 Walters GD, Chlumsky ML. The lifestyle criminality screening form and antisocial personality disorder: Predicting release outcome in a state prison sample. Behav Sci Law. 1993; 11: 111-115.
- 46 Walters GD. Predicting criminal justice outcomes with the Psychopathy Checklist and Lifestyle Criminality Screening Form: A meta-analytic comparison. Behav Sci Law. 2003; 21: 89-102.
- 47 American Society of Addiction Medicine (ASAM). Patient placement criteria for the treatment for substance-related disorders (2nd ed.). 2001; Chevy Chase, MD; American Society of Addiction Medicine.
- 48 Joint Commission on Accreditation of Healthcare Organizations. (JCAHO). Accreditation manual for mental health, chemical dependency, and mental retardation/developmental disabilities services: Standards (Vol. 1). 1995. Oakbrook Terrace, IL: Author.
- 49 Office of Applied Studies, Substance Abuse and Mental Health Services Administration; Preliminary Estimates from the 1995 National Household Survey on Drug Abuse. Rockville, MD: Author; 1996. Advance Report.
- 50 French MT, Bradley CJ, Calingaert B, et al. Cost analysis of training and employment services in methadone treatment. Eval Prog Plann. 1994; 17: 107-120.
- 51 French MT, Roebuck MC, Dennis ML, et al. Outpatient marijuana treatment for adolescents: Economic evaluation of a multisite field experiment. Eval Rev. 2003; 27: 421-459.
- 52 Dennis ML, Titus JC, Diamond G, et al. The Cannabis Youth Treatment (CYT) experiment: Rationale, study design, and analysis plans. Addiction. 2002; 97: S16-S34.
- 53 Dennis ML, Godley SH, Diamond G, et al. Main findings of The Cannabis Youth Treatment randomized field experiment. J Sub Abuse Treat. 2004; 27: 197-213.
- 54 Dennis ML, Scott CK, Funk R. An experimental evaluation of recovery management checkups (RMC) for people with chronic substance use disorders. Eval Prog Plann. 2003; 26: 339-352.
- 55 Godley MD, Godley SH, Dennis ML, et al. Preliminary outcomes from the assertive continuing care experiment for adolescents discharged from residential treatment. J Subst Abuse Treat. 2002; 23: 21-32.
- 56 Lennox RD, Dennis ML, Scott CK, et al. Combining psychometric and biometric measures of substance use. Drug Alcohol Depend. 2006; 83: 95-103.
- 57 Lennox RD, Dennis ML, Ives M, et al. The Construct and Predictive Validity of Different Approaches to Combining Urine and Self-Reported Drug Use Measures among Adolescents in Substance Abuse Treatment. Am J Addict. 2006; 15(Suppl. 1): 92-101.
- 58 White M. Predicting violence in juvenile offenders: The interaction of individual, social, and environmental influences. Offender Subst Abuse Rep. 2005; 83-90.
- 59 White MK, Funk R, White W, et al. Predicting violent behavior in adolescent cannabis users: The GAIN-CVI. Offender Subst Abuse Rep. 2003; 3: 67-69.
- 60 Derogatis LR, Lipman RS, Covi L. SCL-90: An outpatient psychiatric rating scale-Preliminary report. Psychopharmaco Bull. 1973; 9: 13-28.
- 61 Lipman RS, Covi L, Shapiro AK. The Hopkins Symptom Checklist (HSCL): factors derived from the HSCL-90. J Affect Dis. 1979; 1: 9-24.
- 62
King DW,
King LA,
Fairbank JA, et al.
Surface CR. Enhancing the precision of the Mississippi Scale for Combat-Related Posttraumatic Stress Disorder: An application of item response theory.
Psychological Assessment. 1993; 5: 457-471.
10.1037/1040-3590.5.4.457 Google Scholar
- 63
Kulka RA,
Schlenger WE,
Fairbank JA, et al.
Assessment of Posttraumatic Stress Disorder in the community: Prospects and pitfalls from recent studies of Vietnam Veterans.
Psychol Assess. 1991; 3: 547-560.
10.1037/1040-3590.3.4.547 Google Scholar
- 64 Scott CK, Sonis J, Creamer M, Dennis ML. Maximizing follow-up in longitudinal studies of traumatized populations. Journal of Traumatic Stress. In press.
- 65 Stevens SJ, Murphy BS, McKnight K. Traumatic stress and gender differences in relationship to substance abuse, mental health, physical health, and HIV risk behavior in a sample of adolescents enrolled in drug treatment. Child Maltreatment. 2003; 8: 46-57.
- 66 Strauss MA. Conflict tactic scale. In: MA Strauss, RJ Gelles, eds. Physical Violence in American Families: Risk Factors and Adaptations to Violence in 8,145 Families. Durham, NH: University of New Hampshire; 1990.
- 67 Federal Bureau of Investigations. 1993 Uniform Crime Reports. Washington DC: Available at: http://www.fbi.gov/ucr. Accessed May 23, 2006.
- 68 Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struc Equation Model. 1999; 6: 1-55.
- 69 Rasch G. Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Paedogogiske Institut; 1960.
- 70 Linacre JM. Winsteps computer program. Chicago: MESA Press; 2002.
- 71 Riley BB, Conrad KJ, Bezruczko N, et al. Relative precision, efficiency and construct validity of different starting and stopping rules for a computerized adaptive test: The GAIN substance problem scale. J Appl Measur. In press.
- 72 Dennis M, Feeny T. GAIN Short Screener (GSS) Summary Guidelines for Administration and Scoring. Bloomington, IL: Chestnut Health Systems; 2006. Available at: from http://www.chestnut.org/LI/gain/GAIN_SS/index.html. Accessed August 8, 2006.