BT25: Dermatology and the metaverse: what’s on the horizon?

Navreet Paul, Nada Aboukhatwah, Ben Esdalle

Whittington Health NHS Trust, London, UK

The aim of this study was to explore how the metaverse, a computer-generated reality and next-generation infrastructure of the internet, could impact dermatology in the future. A literature review was conducted to determine the considerations relevant to dermatology. The metaverse has rapidly become a part of life for the digital native population and includes virtual reality (VR), augmented reality (AR) and mixed reality (MR) technologies. VR is a fully immersive digital environment, whereas AR overlays digital information onto real-world elements. MR combines real-world objects with digitally generated ones, allowing them to interact in real time. Most of the research in the health metaverse has encompassed AR/VR/MR through medical education, surgical procedure training, patient information and engagement thus far. Despite dermatology being a visual specialty, limited progress has been made in real-world clinical practice (Bonmarin M, Läuchli S, Navarini A. Augmented and virtual reality in dermatology—where do we stand and what comes next? Dermato 2022; 2: 1–7). Artificial intelligence has been central to diagnostics through convolutional neural networks, consistently achieving dermatologist-level classification of two-dimensional images of skin lesions. However, future technology will be capable of creating three-dimensional (3D) reconstructions of the skin surface using human haptic tactile perception information amalgamated with a digital image, providing addition diagnostic information. Developments in 3D visualization and haptic feedback systems are also expected to revolutionize Mohs micrographic and dermatological surgery. Similar immersive technologies could enhance the provision of dermatology training through VR clinics while educational resources may incorporate synthetically created skin images using generative adversarial networks to demonstrate dermatological presentations. This process could enable the development of cross-border educational resources and maintain training through any future pandemics. New approaches to education in the metaverse also include gamification, such as a skin cancer awareness program exemplified in Australia. The health metaverse is also expected to incorporate the development of virtual teams, geographically dispersed individuals collectively serving a person, potentially centralizing the provision of care. The health metaverse has many potential benefits for the healthcare ecosystem to interact in a 3D immersive way, altering the traditional medical model during consultation and education. Dermatology is a visual speciality ripe for research in this field, as the skin is an accessible organ amenable to an array of digital technologies. Clinicians, trainees and patients are key stakeholders in the development of the health metaverse and should be encouraged to be engaged and advocate for the needs of the population for the future.

[Correction added on 9 November 2022, after first online: second and third authors were missed out and have been added in this version.]