Large language models for infectious diseases require evidence generation and regulation
Christina Gao
Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
These authors are co-first authors and contributed equally to this study.
Search for more papers by this authorShirajh Satheakeerthy
Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Royal Adelaide Hospital, Adelaide, South Australia, Australia
These authors are co-first authors and contributed equally to this study.
Search for more papers by this authorChristina Guo
Department of Infectious Diseases, The Alfred, Melbourne, Victoria, Australia
Bloomberg School of Public Health, Johns Hopkins, Baltimore, Maryland, USA
Search for more papers by this authorAlyssa Pradhan
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorAndrew E. C. Booth
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorWeng Onn Chan
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Royal Adelaide Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorSanjat Kanjilal
Harvard Medical School, Boston, Massachusetts, USA
Search for more papers by this authorMatthew Blake Roberts
Royal Adelaide Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorCamille Kotton
Harvard Medical School, Boston, Massachusetts, USA
Massachusetts General Hospital, Boston, Massachusetts, USA
Search for more papers by this authorCorresponding Author
Stephen Bacchi
Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Harvard Medical School, Boston, Massachusetts, USA
Massachusetts General Hospital, Boston, Massachusetts, USA
Correspondence
Stephen Bacchi, Neurology Department, Lyell McEwin Hospital, Haydown Road, Elizabeth Vale, SA 5112, Australia.
Email: [email protected]
Search for more papers by this authorChristina Gao
Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
These authors are co-first authors and contributed equally to this study.
Search for more papers by this authorShirajh Satheakeerthy
Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Royal Adelaide Hospital, Adelaide, South Australia, Australia
These authors are co-first authors and contributed equally to this study.
Search for more papers by this authorChristina Guo
Department of Infectious Diseases, The Alfred, Melbourne, Victoria, Australia
Bloomberg School of Public Health, Johns Hopkins, Baltimore, Maryland, USA
Search for more papers by this authorAlyssa Pradhan
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorAndrew E. C. Booth
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorWeng Onn Chan
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Royal Adelaide Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorSanjat Kanjilal
Harvard Medical School, Boston, Massachusetts, USA
Search for more papers by this authorMatthew Blake Roberts
Royal Adelaide Hospital, Adelaide, South Australia, Australia
Search for more papers by this authorCamille Kotton
Harvard Medical School, Boston, Massachusetts, USA
Massachusetts General Hospital, Boston, Massachusetts, USA
Search for more papers by this authorCorresponding Author
Stephen Bacchi
Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
Lyell McEwin Hospital, Adelaide, South Australia, Australia
Harvard Medical School, Boston, Massachusetts, USA
Massachusetts General Hospital, Boston, Massachusetts, USA
Correspondence
Stephen Bacchi, Neurology Department, Lyell McEwin Hospital, Haydown Road, Elizabeth Vale, SA 5112, Australia.
Email: [email protected]
Search for more papers by this authorFunding: S. Bacchi and C. Guo are supported by Fulbright Scholarships.
Conflict of interest: None.
Abstract
Large language models (LLMs) offer significant potential in healthcare, especially in the Australian infectious diseases (ID) context, where a great deal of information must be gathered and synthesised. To maximise benefits, the use of evidence-based medicine principles, robust trials, thorough regulatory frameworks and timely guidelines statements are necessary. Additionally, proactive strategies utilising artificial intelligence architectures such as retrieval-augmented generation can help minimise risks, while optimising the benefits of LLM in ID.
References
- 1Langford BJ, Branch-Elliman W, Nori P, Marra AR, Bearman G. Confronting the disruption of the infectious diseases workforce by artificial intelligence: what this means for us and what we can do about it. Open Forum Infect Dis 2024; 11: ofae053.
- 2Schwartz IS, Link KE, Daneshjou R, Cortes-Penfield N. Black box warning: large language models and the future of infectious diseases consultation. Clin Infect Dis 2024; 78: 860–866.
- 3Cortes-Penfield N, Schwartz IS. Safe implementation of large language models in clinical care requires acknowledgment of their limitations and strong regulation to prevent misuse. Clin Infect Dis 2024. Available from URL: https://doi.org/10.1093/cid/ciae446.
- 4Ray PP. Stepping with caution: large language models for consulting infectious diseases. Clin Infect Dis 2024. Available from URL: https://doi.org/10.1093/cid/ciae442.
- 5Khullar D, Wang X, Wang F. Large language models in health care: charting a path toward accurate, explainable, and secure AI. J Gen Intern Med 2024; 39: 1239–1241.
- 6Markham S. Patient perspective on predictive models in healthcare: translation into practice, ethical implications and limitations? BMJ Health Care Inform 2025; 32: e101153.
- 7Omar M, Brin D, Glicksberg B, Klang E. Utilizing natural language processing and large language models in the diagnosis and prediction of infectious diseases: a systematic review. Am J Infect Control 2024; 52: 992–1001.
- 8Giacobbe DR, Marelli C, La Manna B, Padua D, Malva A, Guastavino S et al. Advantages and limitations of large language models for antibiotic prescribing and antimicrobial stewardship. NPJ Antimicrob Resist 2025; 3: 14.
- 9Sorich MJ, Mangoni AA, Bacchi S, Menz BD, Hopkins AM. The triage and diagnostic accuracy of frontier large language models: updated comparison to physician performance. J Med Internet Res 2024; 26: e67409.
- 10Han R, Acosta JN, Shakeri Z, Ioannidis JPA, Topol EJ, Rajpurkar P. Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review. Lancet Digit Health 2024; 6: e367–e373.
- 11Blease CR, Locher C, Gaab J, Hagglund M, Mandl KD. Generative artificial intelligence in primary care: an online survey of UK general practitioners. BMJ Health Care Inform 2024; 31: e101102.
- 12Zakka C, Shad R, Chaurasia A, Dalal AR, Kim JL, Moor M et al. Almanac – retrieval-augmented language models for clinical medicine. NEJM AI 2024; 1.
- 13Lammert J, Dreyer T, Mathes S, Kuligin L, Borm KJ, Schatz UA et al. Expert-guided large language models for clinical decision support in precision oncology. JCO Precis Oncol 2024; 8: e2400478.
- 14Gilbert S, Kather JN, Hogan A. Augmented non-hallucinating large language models as medical information curators. npj Digital Med 2024; 7: 100.
- 15Quidwai MA, Lagana A. A RAG chatbot for precision medicine of multiple myeloma. medRxiv 2024; 2024.03.14.24304293.
- 16Temsah MH, Jamal A, Alhasan K, Temsah AA, Malki KH. OpenAI o1-preview vs. ChatGPT in healthcare: a new frontier in medical AI reasoning. Cureus 2024; 16: e70640.
- 17Rizzo A, Mensa E, Giacomelli A. The future of large language models in fighting emerging outbreaks: lights and shadows. Lancet Microbe 2024; 5: 100954.
- 18Shah NH, Pfeffer MA, Ghassemi M. The need for continuous evaluation of artificial intelligence prediction algorithms. JAMA Netw Open 2024; 7: e2433009.
- 19Kovoor JG, Bacchi S, Gupta AK, O'Callaghan PG, Abou-Hamden A, Maddern GJ. Artificial intelligence clinical trials and critical appraisal: a necessity. ANZ J Surg 2023; 93: 1141–1142.
- 20Stretton B, Koovor JG, Hains L, Kleinig O, Tan S, Gupta AK et al. How will the artificial intelligence algorithm work within the constraints of this healthcare system? Intern Med J 2024; 54: 190–191.
- 21Manvi R, Khanna S, Burke M, Lobell D, Ermon S. Large language models are geographically biased. arXiv 2024.
- 22Asiedu M, Tomasev N, Ghate C, Tiyasirichokchai T, Dieng A, Akande O et al. Contextual evaluation of large language models for classifying tropical and infectious diseases. arXiv 2024.
- 23Thompson W, Teoh L, Hubbard CC, Marra F, Patrick DM, Mamun A et al. Patterns of dental antibiotic prescribing in 2017: Australia, England, United States, and British Columbia (Canada). Infect Control Hosp Epidemiol 2022; 43: 191–198.
- 24 Australian Government. Investments to Grow Australia's Critical Technologies Industries. Australia; 2023.
- 25 Australian Government. Artificial Intelligence in Government. Australia; 2024.
- 26 Australian Government. TGA Consultation: Clarifying and Strengthening the Regulation of Artificial Intelligence (AI). Australia; 2024.
- 27 State of California. AB-3030 Health Care Services: Artificial Intelligence. USA; 2024.
- 28 RANZCR. Position Statement on the Regulation of Artificial Intelligence in Medicine. Australia; 2022.
- 29 Australian Medical Association. Artificial Intelligence in Healthcare. Australia; 2023.
- 30 Royal Australian College of General Practitioners. Artificial Intelligence in Primary Care. Australia; 2024.
- 31 Royal Australian College of General Practitioners. Artificial Intelligence (AI) Scribes. Australia; 2024.
- 32Kwok KO, Huynh T, Wei WI, Wong SYS, Riley S, Tang A. Utilizing large language models in infectious disease transmission modelling for public health preparedness. Comput Struct Biotechnol J 2024; 23: 3254–3257.
Citing Literature
