Can Computer-Generated Evidence-Based Care Suggestions Enhance Evidence-Based Management of Asthma and Chronic Obstructive Pulmonary Disease? A Randomized, Controlled Trial
William M. Tierney
Address correspondence to William M. Tierney, M.D., Department of Medicine, Indiana University School of Medicine, M200-OPW, Wishard Memorial Hospital, 1001 West 10th St., Indianapolis, IN 46202. William M. Tierney, M.D., J. Marc Overhage, M.D., Ph.D., Michael D. Murray, PharmD., M.P.H., Lisa E. Harris, M.D., Xiao-Hua Zhou, Ph.D., Faye E. Smith, M.A., Nancy Nienaber, M.A., Clement J. McDonald, M.D., and Fredric D. Wolinsky, Ph.D., are with the Regenstrief Institute, Incorporated, Indianapolis, IN. William M. Tierney, M.D., J. Marc Overhage, M.D., Ph.D., Lisa E. Harris, M.D., Xiao-Hua Zhou, Ph.D., George J. Eckert, M.A.S., Clement J. McDonald, M.D., and Fredric D. Wolinsky, Ph.D., are with the Department of Medicine, Indiana University School of Medicine, Indianapolis, IN. William M. Tierney, M.D., is with the Richard L. Roudebush Veterans Affairs Medical Center, Indianapolis, IN. Michael D. Murray, PharmD., M.P.H., is with the Purdue University School of Pharmacy, Indianapolis, IN. Fredric D. Wolinsky, Ph.D., is with the University of Iowa School of Medicine, Iowa City, IA.
Search for more papers by this authorJ. Marc Overhage
Search for more papers by this authorMichael D. Murray
Search for more papers by this authorLisa E. Harris
Search for more papers by this authorXiao-Hua Zhou
Search for more papers by this authorGeorge J. Eckert
Search for more papers by this authorFaye E. Smith
Search for more papers by this authorNancy Nienaber
Search for more papers by this authorClement J. McDonald
Search for more papers by this authorFredric D. Wolinsky
Search for more papers by this authorWilliam M. Tierney
Address correspondence to William M. Tierney, M.D., Department of Medicine, Indiana University School of Medicine, M200-OPW, Wishard Memorial Hospital, 1001 West 10th St., Indianapolis, IN 46202. William M. Tierney, M.D., J. Marc Overhage, M.D., Ph.D., Michael D. Murray, PharmD., M.P.H., Lisa E. Harris, M.D., Xiao-Hua Zhou, Ph.D., Faye E. Smith, M.A., Nancy Nienaber, M.A., Clement J. McDonald, M.D., and Fredric D. Wolinsky, Ph.D., are with the Regenstrief Institute, Incorporated, Indianapolis, IN. William M. Tierney, M.D., J. Marc Overhage, M.D., Ph.D., Lisa E. Harris, M.D., Xiao-Hua Zhou, Ph.D., George J. Eckert, M.A.S., Clement J. McDonald, M.D., and Fredric D. Wolinsky, Ph.D., are with the Department of Medicine, Indiana University School of Medicine, Indianapolis, IN. William M. Tierney, M.D., is with the Richard L. Roudebush Veterans Affairs Medical Center, Indianapolis, IN. Michael D. Murray, PharmD., M.P.H., is with the Purdue University School of Pharmacy, Indianapolis, IN. Fredric D. Wolinsky, Ph.D., is with the University of Iowa School of Medicine, Iowa City, IA.
Search for more papers by this authorJ. Marc Overhage
Search for more papers by this authorMichael D. Murray
Search for more papers by this authorLisa E. Harris
Search for more papers by this authorXiao-Hua Zhou
Search for more papers by this authorGeorge J. Eckert
Search for more papers by this authorFaye E. Smith
Search for more papers by this authorNancy Nienaber
Search for more papers by this authorClement J. McDonald
Search for more papers by this authorFredric D. Wolinsky
Search for more papers by this authorAbstract
Objective. Translation of evidence-based guidelines into clinical practice has been inconsistent. We performed a randomized, controlled trial of guideline-based care suggestions delivered to physicians when writing orders on computer workstations.
Study Setting. Inner-city academic general internal medicine practice.
Study Design. Randomized, controlled trial of 246 physicians (25 percent faculty general internists, 75 percent internal medicine residents) and 20 outpatient pharmacists. We enrolled 706 of their primary care patients with asthma or chronic obstructive pulmonary disease. Care suggestions concerning drugs and monitoring were delivered to a random half of the physicians and pharmacists when writing orders or filling prescriptions using computer workstations. A 2 × 2 factorial randomization of practice sessions and pharmacists resulted in four groups of patients: physician intervention, pharmacist intervention, both interventions, and controls.
Data Extraction/Collection Methods. Adherence to the guidelines and clinical activity was assessed using patients' electronic medical records. Health-related quality of life, medication adherence, and satisfaction with care were assessed using telephone questionnaires.
Principal Findings. During their year in the study, patients made an average of five scheduled primary care visits. There were no differences between groups in adherence to the care suggestions, generic or condition-specific quality of life, satisfaction with physicians or pharmacists, medication compliance, emergency department visits, or hospitalizations. Physicians receiving the intervention had significantly higher total health care costs. Physician attitudes toward guidelines were mixed.
Conclusions. Care suggestions shown to physicians and pharmacists on computer workstations had no effect on the delivery or outcomes of care for patients with reactive airways disease.
References
- Bates, D. W., G. J. Kuperman, S. Wang, T. Gandhi, A. Kittler, L. Volk, C. Spurr, R. Khorasani, M. Tanasijevic, and B. Middleton. 2003. “Ten Commandments for Effective Decision Support: Making the Practice of Evidence-Based Medicine a Reality. Journal of the American Medical Informatics Association 10 (6): 523–30.
- Cabana, M. D., C. S. Rand, O. J. Becher, and H. R. Rubin. 2001. “Reasons for Pediatrician Nonadherence to Asthma Guidelines. Archives of Pediatric and Adolescent Medicine 155 (9): 1057–62.
- Canadian Thoracic Society Workshop Group. 1992. “Guidelines for the Assessment and Management of Chronic Obstructive Pulmonary Disease. Canadian Medical Association Journal 147 (4): 420–8.
- Choo, P., C. Rand, T. Inui, M. L. Lee, E. Cain, M. Codiero-Breault, C. Canning, and R. Platt. 1999. “Validation of Patient Reports, Automated Pharmacy Records, and Pill Counts with Electronic Monitoring of Adherence to Antihypertensive Therapy. Medical Care 37 (9): 846–57.
- Dambro, M. R., B. D. Weiss, and C. L. McClure. 1988. “An Unsuccessful Experience with Computerized Medical Records in an Academic Medical Center. Journal of Medical Education 63 (8): 617–23.
- Dexter, P. R., S. Perkins, J. M. Overhage, K. Meharry, R. B. Kohler, and C. J. McDonald. 2001. “A Computerized Reminder System to Increase the Use of Preventive Care for Hospitalized Patients. New England Journal of Medicine 345 (13): 965–70.DOI: 10.1056/NEJMsa010181
- Dexter, P. R., T. E. Stump, W. M. Tierney, and F. D. Wolinsky. 1996. “The Psychometric Properties of the SF-36 Health Survey among Older Adults in the Clinical Setting. Journal of Clinical Gerophsychology 2 (3): 225–37.
- Ferguson, J. A., and M. Weinberger. 1998. “Case Management Programs in Primary Care. Journal of General Internal Medicine 13 (2): 123–6.DOI: 10.1046/j.1525-1497.1998.00029.x
- Guyatt, G. H., L. B. Berman, M. Townsend, S. O. Pugsley, and L. W. Chambers. 1987. “A Measure of Quality of Life for Clinical Trials in Chronic Lung Disease. Thorax 42 (10): 773–8.
- Harris, L. E., F. C. Luft, D. W. Rudy, J. G. Kesterson, and W. M. Tierney. 1998. “Effects of Multidisciplinary Case Management of Patients with Chronic Renal Insufficiency. American Journal of Medicine 105 (6): 464–71.DOI: 10.1016/S0002-9343(98)00329-5
- Institute of Medicine, Committee on Improving the Medical Record. 1991. The Computer-based Patient Record: An Essential Technology for Health Care. Washington, DC: National Academy Press.
- Institute of Medicine. 2001. Crossing the Quality Chasm: A New System for the 21st Century. Washington, DC: National Academy Press.
- Inui, T. S., W. B. Carter, and R. E. Pecoraro. 1981. “Screening for Noncompliance among Patients with Hypertension: Is Self-Report the Best Available Measure? Medical Care 19 (10): 1061–4.
- Johnston, M. E., K. B. Langton, R. B. Haynes, and A. Mathieu. 1994. “Effects of Computer-Based Clinical Decision Support Systems on Clinician Performance and Patient Outcomes. Annals of Internal Medicine 120 (2): 135–42.
- Juniper, E., G. H. Guyatt, P. J. Ferrie, and L. E. Griffith. 1993. “Measuring Quality of Life in Asthma. American Review of Respiratory Diseases 147 (4): 832–8.
- Krall, M. A., and D. F. Sittig. 2001. “Subjective Assessment of Usefulness and Appropriate Presentation Mode of Alerts and Reminders in the Outpatient Setting. Proceedings of the American Medical Informatics Association Symposium: 334–8.
- McDonald, C. J., S. L. Hui, D. M. Smith, W. M. Tierney, S. J. Cohen, M. Weinberger, and G. P. McCabe. 1984. “Reminders to Physicians from an Introspective Computer Medical Record. A Two-Year Randomized Trial. Annals of Internal Medicine 100 (1): 130–8.
- McDonald, C. J., J. M. Overhage, W. M. Tierney, P. R. Dexter, D. K. Martin, J. G. Suico, A. Zafar, G. Schadow, L. Blevins, T. Glazener, J. Meeks-Johnson, L. Lemmon, J. Warvel, B. Porterfield, J. Warvel, P. Cassidy, D. Lindbergh, A. Belsito, M. Tucker, B. Williams, and C. Wodniak. 1999. “The Regenstrief Medical Record System: A Quarter Century Experience. International Journal of Medical Informatics 54 (3): 225–53.DOI: 10.1016/S1386-5056(99)00009-X
- McFadden, E. R., and I. A. Gilbert. 1992. “Asthma. New England Journal of Medicine 327 (27): 1928–37.
- McHorney, C. A., and J. E. Ware Jr. 1995. “Construction and Validation of an Alternate form General Mental Health Scale for the Medical Outcomes Study Short-Form 36-Item Health Survey. Medical Care 33 (1): 15–28.
- McPhee, S. J., J. A. Bird, D. Fordham, J. E. Rodnick, and E. H. Osborn. 1991. “Promoting Cancer Prevention Activities by Primary Care Physicians: Results of a Randomized, Controlled Trial. Journal of the American Medical Association 266 (4): 538–44.DOI: 10.1001/jama.266.4.538
- Mitchell, E., and F. Sulllivan. 2001. “A Descriptive Feast but an Evaluative Famine: Systematic Review of Published Articles on Primary Care Computing during 1980–97. British Medical Journal 322 (7281): 279–82.
- Morisky, D. E., L. W. Green, and D. M. Levine. 1986. “Concurrent and Predictive Validity of a Self-Reported Measure of Medication Adherence. Medical Care 24 (1): 67–74.
- Murray, M. D., B. Loos, T. Wanzhu, G. J. Eckert, X. H. Zhou, and W. M. Tierney. 1999. “Work Patterns of Ambulatory Care Pharmacists with Access to Electronic Guideline-Based Treatment Suggestions. American Journal of Health-System Pharmacy 56 (3): 225–32.
- Murray, M. D., M. T. Rupp, J. M. Overhage, D. Ebbeler, J. W. Main, and W. M. Tierney. 1995. “Multidimensional Work Sampling in an Outpatient Pharmacy. Pharmacy Practice Management Quarterly 15 (3): 44–56.
- National Asthma Education Program Expert Panel Report. Executive Summary: Guidelines for the Diagnosis and Management of Asthma . 1994. Washington, DC: U.S. Department of Health and Human Services (AHCPR Publication No. 94-3042A).
- Norman, D. A. 2002. The Design of Everyday Things. New York: Basic Books (Perseus).
- Overhage, J. M., and A. Lukes. 1999. “Practical, Reliable, Comprehensive Method for Characterizing Pharmacists' Clinical Activities. American Journal of Health-System Pharmacy 56 (23): 2444–50.
- Overhage, J. M., W. M. Tierney, and C. J. McDonald. 1996. “Computer Reminders to Implement Preventive Care Guidelines for Hospitalized Patients. Archives of Internal Medicine 156 (14): 1551–6.DOI: 10.1001/archinte.156.14.1551
- Shea, S., W. DuMouchel, and L. Bahamonde. 1996. “A Meta-Analysis of 16 Randomized Controlled Trials to Evaluate Computer-Based Clinical Reminder Systems for Preventive Care in the Ambulatory Setting. Journal of the American Medical Informatics Association 3 (6): 399–409.
- Singhal, P. K., D. W. Raisch, and G. V. Gupchup. 1999. “The Impact of Pharmaceutical Services in Community and Ambulatory Care Settings: Evidence and Recommendations for Future Research. Annals of Pharmacotherapy 33 (12): 1336–55.DOI: 10.1345/aph.18440
- Steiner, J. F., T. D. Koepsell, S. D. Fihn, and T. S. Inui. 1988. “A General Method of Compliance Assessment Using Centralized Pharmacy Records: Description and Validation. Medical Care 26 (8): 814–23.
- Subramanian, U., S. D. Fihn, M. Weinberger, L. Plue, F. E. Smith, E. Udris, M. B. McDonnel, G. J. Eckert, M. Temkit, X. H. Zhou, L. Chen, and W. M. Tierney. 2004. “A Controlled Trial of Including Symptom Data in Computer-Based Care Suggestions for Managing Chronic Heart Failure. American Journal of Medicine 116 (6): 375–84.DOI: 10.1016/j.amjmed.2003.11.021
- Tierney, W. M., S. L. Hui, and C. J. McDonald. 1986. “Delayed Feedback of Physician Performance versus Immediate Reminders to Perform Preventive Care: Effects on Physician Compliance. Medical Care 24 (8): 659–66.
- Tierney, W. M., C. J. McDonald, S. L. Hui, and D. K. Martin. 1988. “Computer Predictions of Abnormal Test Results: Effects on Outpatient Testing. Journal of the American Medical Association 259 (8): 1194–8.DOI: 10.1001/jama.259.8.1194
- Tierney, W. M., C. J. McDonald, D. K. Martin, S. L. Hui, and M. P. Rogers. 1987. “Computerized Display of Past Test Results: Effects on Outpatient Testing. Annals of Internal Medicine 107 (4): 569–74.
- Tierney, W. M., M. E. Miller, S. L. Hui, and C. J. Mcdonald. 1991. “Practice Randomization and Clinical Research: The Indiana Experience. Medical Care 29 (7 suppl.): JS57–64.
- Tierney, W. M., M. E. Miller, and C. J. McDonald. 1990. “The Effect on Test Ordering of Informing Physicians of the Charges for Outpatient Diagnostic Tests. New England Journal of Medicine 233 (21): 1499–504.
- Tierney, W. M., M. E. Miller, J. M. Overhage, and C. J. McDonald. 1993. “Physician Inpatient Order-Writing on Microcomputer Workstations: Effects on Resource Utilization. Journal of the American Medical Association 269 (3): 379–83.DOI: 10.1001/jama.269.3.379
- Tierney, W. M., J. M. Overhage, M. D. Murray, L. E. Harris, X. H. Zhou, G. J. Eckert, F. E. Smith, N. Nienaber, C. J. McDonald, and F. D. Wolinsky. 2003. “Effects of Computerized Guidelines for Managing Heart Disease in Primary Care: A Randomized, Controlled Trial. Journal of General Internal Medicine 18 (12): 967–76.DOI: 10.1111/j.1525-1497.2003.30635.x
- Tierney, W. M. 2001. “Improving Clinical Decisions and Outcomes with Information: A Review. International Journal of Medical Informatics 62 (1): 1–9.DOI: 10.1016/S1386-5056(01)00127-7
- Tunis, S. R., R. S. A. Hayward, M. C. Wilson, H. R. Rubin, E. B. Bass, M. Johnston, and E. P. Steinberg. 1994. “Internists' Attitudes about Clinical Practice Guidelines. Annals of Internal Medicine 120 (11): 956–63.
- Webster, G. D. 1988. Final Report of the ABIM Patient Satisfaction Project. Philadelphia: American Board of Internal Medicine.
- Weinberger, M., M. D. Murray, D. G. Marrero, N. Brewer, M. Lykens, L. E. Harris, and W. M. Tierney. 2001. “A Pharmaceutical Care Program for Patients with Reactive Airways Disease. American Review of Health-System Pharmacy 58 (9): 791–6.
- Wyrwich, K. W., W. M. Tierney, and F. D. Wolinsky. 1999. “Further Evidence Supporting a SEM-Based Criterion for Identifying Meaningful Intra-Individual Changes in Health-Related Quality of Life. Journal of Clinical Epidemiology 52 (9): 861–73.DOI: 10.1016/S0895-4356(99)00071-2
- Zhou, X. H., and W. Tu. 1999. “Comparisons of Several Independent Population Means When Their Samples Contain Non-Zero Log-Normal and Possibly Zero Observations. Biometrics 55 (2): 645–51.