Catching Up on Health Outcomes: The Texas Medication Algorithm Project
T. Michael Kashner
Search for more papers by this authorThomas J. Carmody
Search for more papers by this authorTrisha Suppes
Search for more papers by this authorA. John Rush
Search for more papers by this authorM. Lynn Crismon
Search for more papers by this authorAlexander L. Miller
Search for more papers by this authorMarcia Toprac
Search for more papers by this authorMadhukar Trivedi
Search for more papers by this authorT. Michael Kashner
Search for more papers by this authorThomas J. Carmody
Search for more papers by this authorTrisha Suppes
Search for more papers by this authorA. John Rush
Search for more papers by this authorM. Lynn Crismon
Search for more papers by this authorAlexander L. Miller
Search for more papers by this authorMarcia Toprac
Search for more papers by this authorMadhukar Trivedi
Search for more papers by this authorAbstract
Objective. To develop a statistic measuring the impact of algorithm-driven disease management programs on outcomes for patients with chronic mental illness that allowed for treatment-as-usual controls to “catch up” to early gains of treated patients.
Data Sources/Study Setting. Statistical power was estimated from simulated samples representing effect sizes that grew, remained constant, or declined following an initial improvement. Estimates were based on the Texas Medication Algorithm Project on adult patients (age≥18) with bipolar disorder (n=267) who received care between 1998 and 2000 at 1 of 11 clinics across Texas.
Study Design. Study patients were assessed at baseline and three-month follow-up for a minimum of one year. Program tracks were assigned by clinic.
Data Collection/Extraction Methods. Hierarchical linear modeling was modified to account for declining-effects. Outcomes were based on 30-item Inventory for Depression Symptomatology—Clinician Version.
Principal Findings. Declining-effect analyses had significantly greater power detecting program differences than traditional growth models in constant and declining-effects cases. Bipolar patients with severe depressive symptoms in an algorithm-driven, disease management program reported fewer symptoms after three months, with treatment-as-usual controls “catching up” within one year.
Conclusions. In addition to psychometric properties, data collection design, and power, investigators should consider how outcomes unfold over time when selecting an appropriate statistic to evaluate service interventions. Declining-effect analyses may be applicable to a wide range of treatment and intervention trials.
References
- American Psychiatric Association. 1994. Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV). Washington, DC: American Psychiatric Association.
- American Psychiatric Association. 1995. American Psychiatric Association Practice Guideline for Psychiatric Evaluation of Adults. Washington, DC: American Psychiatric Association.
- Andrews, G. 2001. “Placebo Response in Depression: Bane of Research, Boon to Therapy. British Journal of Psychiatry 170 (3): 192–194.
- Arndt, S., C. Turvey, W. H. Coryell, J. D. Dawson, A. C. Leon, and H. S. Akiskal. 2000. “Charting Patients’ Course: a Comparison of Statistics Used to Summarize Patient Course in Longitudinal and Repeated Measures Studies. Journal of Psychiatric Research 34 (2): 105–13.
- Berndt, E. R., S. N. Finkelstein, P. E. Greenberg, R. H. Howland, A. Keith, A. J. Rush, J. Russell, and M. B. Keller. 1998. “Workplace Performance Effects from Chronic Depression and its Treatment. Journal of Health Economics 17 (5): 511–35.
- Bryk, A. S., and S. W. Raudenbush. 1992. Hierarchical Linear Models. Newbury Park, CA: Sage.
- Bryk, A. S., S. W. Raudenbush, and R. T. CongdonJr. 1996. Hierarchical Linear and Nonlinear Modeling, with HLM/2l and HLM/3L Programs, (release 4). Chicago: Scientific Software International.
- Chi, E. M., and G. C. Reinsel. 1989. “Models of Longitudinal Data with Random Effects and AR(1) Errors. Journal of the American Statistical Association 84 (406): 452–9.
- Chiles, J. A., A. L. Miller, M. L. Crismon, A. J. Rush, A. S. Krasnoff, and S. S. Shon. 1999. “The Texas Medication Algorithm Project: Development and Implementation of the Schizophrenia Algorithm. Psychiatric Services 50 (1): 69–74.
- Crismon, M. L., M. Trivedi, T. A. Pigott, A. J. Rush, M. A. Hirschfeld, D. A. Kahn, C. DeBattista, J. C. Nelson, A. A. Nierenberg, H. A. Sackeim, M. E., and Thase the Texas Consensus Conference Panel on Medication Treatment of Major Depressive Disorder. 1999. “The Texas Medication Algorithm Project: Report of the Texas Consensus Conference Panel on Medication Treatment of Major Depressive Disorder. Journal of Clinical Psychiatry 60 (3): 142–56.
- Donabedian, A. 1976. Benefits in Medical Care Programs. Cambridge, MA: Harvard University Press.
- Field, M. J., and K. N. Lohr. 1990. Clinical Practice Guidelines: Directions for a New Program. U.S. Institute of Medicine Committee to Advise the Public Health Service on Clinical Practice Guidelines. Washington, DC: U.S. Department of Health and Human Services, National Academy Press.
- Gibbons, R. D., D. Hedeker, I. Elkin, C. Waternaux, H. C. Kraemer, J. B. Greenhouse, T. Shea, S. D. Imber, S. M. Sotsky, and J. T. Watkins. 1993. “Some Conceptual and Statistical Issues in Analysis of Longitudinal Psychiatric Data: Application to the NIMH Treatment of Depression Collaborative Research Program Dataset. Archives General Psychiatry 50 (9): 739–50.
- Gilbert, D. A., K. Z. Altshuler, W. V. Rago, S. P. Shon, M. L. Crismon, M. G. Toprac, and A. J. Rush. 1998. “Texas Medication Algorithm Project: Definitions, Rationale and Methods to Develop Medication Algorithms. Journal of Clinical Psychiatry 59 (7): 345–51.
- Goldstein, H. I. 1986. “Multilevel Mixed Linear Model Analysis Using Iterative Generalized Least Squares. Biometrika 73 (1): 43–56.
- Grossman, M. 1972. “On the Concept of Health Capital and the Demand for Health. Journal of Political Economy 80 (2): 223–55.
- Hedeker, D. 1989. “ Random Regression Models with Autocorrelated Errors.” Doctoral dissertation, University of Chicago.
- Hedeker, D., and R. D. Gibbons. 1994. “A Random-Effects Ordinal Regression Model for Multilevel Analysis. Biometrics 50 (4): 933–44.
- Hrobjartsson, A., and P. C. Gotzsche. 2001. “Is the Placebo Powerless? An Analysis of Clinical Trials Comparing Placebo with No Treatment. New England Journal of Medicine 344 (21): 1594–1601.
- Jennrich, R. I., and M. D. Schluchter. 1986. “Unbalanced Repeated Measures Models with Structured Covariance Matrices. Biometrics 42 (4): 805–20.
- Jobson, K. O., and W. Z. Potter. 1995. “International Psychopharmacology Algorithm Project Report: Introduction. Psychopharmacology Bulletin 31 (3): 457–9.
- Kashner, T. M., R. Rosenheck, A. B. Campinell, A. Suris, R. Crandall, N. J. Garfield, P. Lapuc, K. Pyrcz, T. Soyka, and A. Wicker 2002. “Impact of Work Therapy on Health Status among Homeless, Substance Dependent Veterans: A Randomized Controlled Trial. Archives of General Psychiatry 59 (10): 938–44.
- Kashner, T. M., A. J. Rush, and K. Z. Altshuler. 1999. “Measuring Costs of Guideline-Driven Mental Health Care: The Texas Medication Algorithm Project. Journal of Mental Health Policy and Economics 2 (3): 111–21.
- Kirsch, I. 2000. “Are Drug and Placebo Effects in Depression Additive? Biological Psychiatry 47 (8): 733–5.
- Laird, N. M., and H. Ware. 1982. “Random-Effects Models for Longitudinal Data. Biometrics 38 (4): 963–74.
- La Ruche, G., F. Lorougnon, and N. Digbeu. 1995. “Therapeutic Algorithms for the Management of Sexually Transmitted Diseases at the Peripheral Level in Côte d’Ivoire: Assessment of Efficacy and Cost. Bulletin of the World Health Organization 73 (3): 305–13.
- Lavori, P. W. 1990. “ANOVA, MANOVA, and My Black Hen. Archives of General Psychiatry 47 (8): 775–8.
- Lavori, P. W. 2000. “Placebo Control Groups in Randomized Treatment Trials: A Statistician's Perspective. Biological Psychiatry 47 (8): 717–23.
- Louis, T. A., and A. SpiroIII. 1984. “Fitting First Order Auto-regressive Models with Covariates (Technical Report).” Cambridge, MA: Harvard University School of Public Health, Department of Biostatistics.
- Lubarsky, D. A., P. S. A. Glass, B. Ginsberg, G. de L. Dear, M. E. Dentz, T. J. Gan, I. C. Sanderson, M. G. Mythen, S. Dufore, C. Pressley, W. C. Gilbert, W. D. White, M. L. Alexander, R. L. Coleman, M. Rogers, and J. G. Reves. 1997. “The Successful Implementation of Pharmaceutical Practice Guidelines: Analysis of Associated Outcomes and Cost Savings. Anesthesiology 86 (5): 1145–60.
- McDowell, I., and C. Newell. 1996. Measuring Health: A Guide to Rating Scales and Questionnaires. New York: Oxford University Press.
- McFadden Jr, E. R., N. Elsanadi, L. Dixon, M. Takacs, E. C. Deal, K. K. Boyd, B. K. Idemoto, L. A. Broseman, J. Panuska, T. Hammons, B. Smith, F. Caruso, C. B. McFadden, L. Shoemaker, E. L. Warren, R. Hejal, L. Strauss, and I. A. Gilbert. 1995. “Protocol Therapy for Acute Asthma: Therapeutic Benefits and Cost Savings. American Journal of Medicine 99 (6): 651–61.
- Maritz, T. S. 1970. Empirical Bayes Methods. London: Methuen.
- Overall, J. E., and D. R. Gorham. 1988. “Introduction—The Brief Psychiatric Rating Scale (BPRS): Recent Developments in Ascertainment and Scaling. Psychopharmacological Bulletin 24 (1): 97–9.
- Rush, A. J., M. L. Crismon, M. Toprac, M. H. Trivedi, W. V. Rago, S. Shon, and K. Z. Altshuler. 1998. “Consensus Guidelines in the Treatment of Major Depressive Disorder. Journal of Clinical Psychiatry 59 (20, supplement): 73–84.
- Rush, A. J., D. E. Giles, M. A. Schlesser, C. L. Fulton, J. E. Weissenburger, and C. T. Burns. 1986. “The Inventory of Depressive Symptomatology (IDS): Preliminary Findings. Psychiatry Research 18 (1): 65–87.
- Rush, A. J., C. M. Gullion, M. R. Basco, R. B. Jarrett, and M. H. Trivedi. 1996. “The Inventory of Depressive Symptomatology (IDS): Psychometric Properties. Psychological Medicine 26 (3): 477–86.
- Rush, A. J., and R. F. Prien. 1995. “From Scientific Knowledge to the Clinical Practice of Psychopharmacology: Can the Gap Be Bridged? Psychopharmacology Bulletin 31 (1): 7–20.
- Rush, A. J., W. V. Rago, M. L. Crismon, M. G. Toprac, S. P. Shon, T. Suppes, A. L. Miller, M. H. Trivedi, A. I. C. Swann, M. M. Biggs, K. Shores-Wilson, T. M. Kashner, T. Pigott, J. A. Chiles, D. A. Gilbert, and K. Z. Altshuler. 1999. “Medication Treatment for the Severely and Persistently Mentally Ill: The Texas Medication Algorithm Project. Journal of Clinical Psychiatry 60 (5): 284–91.
- Siegel, S. 1956. Nonparametric Statistics for the Behavioral Sciences. New York: McGraw-Hill.
- Stanek, E. J. III, and S. R. Diehl. 1988. “Growth Curve Models of Repeated Binary Response. Biometrics 44 (4): 973–83.
- Suppes, T., A. Swann, E. B. Dennehy, E. Habermacher, M. Mason, L. Crismon, M. Toprac, A. J. Rush, S. Shon, and K. Z. Altshuler. 2001. “Texas Medication Algorithm Project: Development and Feasibility Testing of a Treatment Algorithm for Patients with Bipolar Disorder. Journal of Clinical Psychiatry 62 (6): 439–47.
- Ventura, J., M. F. Green, A. Shaner, and R. P. Liberman. 1993. “Training and Quality Assurance with the Brief Psychiatric Rating Scale: ‘The Drift Busters’. International Journal of Methods for Psychiatric Research 3 (4): 221–44.
- VHA Directive 96-053. 1996. Washington, DC: Department of Veterans Affairs, Veterans Health Administration.
- Ware, J. E., M. Kosinski, and S. D. Keller. 1996. “A 12-item Short-form Health Survey (SF-12): Construction of Scales and Preliminary Tests of Reliability and Validity. Medical Care 34 (3): 220–33.
- Ware, J. H. 1985. “Linear Models for the Analysis of Longitudinal Studies. American Statistician 39 (2): 95–101.
- Willett, J. B., C. C. Ayoub, and D. Robinson. 1991. “Using Growth Modeling to Examine Systematic Differences in Growth: An Example of Change in the Functioning of Families at Risk of Maladaptive Parenting, Child Abuse, or Neglect. Journal of Consulting Clinical Psychology 59 (1): 38–47.