Journal of Hepato-Biliary-Pancreatic Sciences

Volume 20, Issue 2 pp. 249-253

Technical View

Utility of augmented reality system in hepatobiliary surgery

Tomoyoshi Okamoto,

Corresponding Author

Tomoyoshi Okamoto

[email protected]
+81-3-34801151 | Fax: +81-3-34808295

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Shinji Onda,

Shinji Onda

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Michinori Matsumoto,

Michinori Matsumoto

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Takeshi Gocho,

Takeshi Gocho

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Yasuro Futagawa,

Yasuro Futagawa

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Shuichi Fujioka,

Shuichi Fujioka

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Katsuhiko Yanaga,

Katsuhiko Yanaga

Department of Surgery, The Jikei University School of Medicine, Tokyo, Japan

Search for more papers by this author

Naoki Suzuki,

Naoki Suzuki

Institute for High Dimensional Medical Imaging, The Jikei University School of Medicine, Tokyo, Japan

Search for more papers by this author

Asaki Hattori,

Asaki Hattori

Institute for High Dimensional Medical Imaging, The Jikei University School of Medicine, Tokyo, Japan

Search for more papers by this author

Tomoyoshi Okamoto,

Corresponding Author

Tomoyoshi Okamoto

[email protected]
+81-3-34801151 | Fax: +81-3-34808295

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Shinji Onda,

Shinji Onda

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Michinori Matsumoto,

Michinori Matsumoto

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Takeshi Gocho,

Takeshi Gocho

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Yasuro Futagawa,

Yasuro Futagawa

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Shuichi Fujioka,

Shuichi Fujioka

Department of Surgery, The Jikei University Daisan Hospital, 4-11-1 Izumihoncho, Komae, Tokyo, Japan

Search for more papers by this author

Katsuhiko Yanaga,

Katsuhiko Yanaga

Department of Surgery, The Jikei University School of Medicine, Tokyo, Japan

Search for more papers by this author

Naoki Suzuki,

Naoki Suzuki

Institute for High Dimensional Medical Imaging, The Jikei University School of Medicine, Tokyo, Japan

Search for more papers by this author

Asaki Hattori,

Asaki Hattori

Institute for High Dimensional Medical Imaging, The Jikei University School of Medicine, Tokyo, Japan

Search for more papers by this author

First published: 08 March 2012

https://doi.org/10.1007/s00534-012-0504-z

Citations: 41

Electronic supplementary material The online version of this article (doi: 10.1007/s00534-012-0504-z) contains supplementary material, which is available to authorized users.

Share a link

Email
Wechat
Bluesky

Abstract

Background/purpose

The aim of this study was to evaluate the utility of an image display system for augmented reality in hepatobiliary surgery under laparotomy.

Methods

An overlay display of organs, vessels, or tumor was obtained using a video see-through system as a display system developed at our institute. Registration between visceral organs and the surface-rendering image reconstructed by preoperative computed tomography (CT) was carried out with an optical location sensor. Using this system, we performed laparotomy for a patient with benign biliary stricture, a patient with gallbladder carcinoma, and a patient with hepatocellular carcinoma.

Results

The operative procedures performed consisted of choledochojejunostomy, right hepatectomy, and microwave coagulation therapy. All the operations were carried out safely using images of the site of tumor, preserved organs, and resection aspect overlaid onto the operation field images observed on the monitors. The position of each organ in the overlaid image closely corresponded with that of the actual organ. Intraoperative information generated from this system provided us with useful navigation. However, several problems such as registration error and lack of depth knowledge were noted.

Conclusion

The image display system appeared to be useful in performing hepatobiliary surgery under laparotomy. Further improvement of the system with individualized function for each operation will be essential, with feedback from clinical trials in the future.

Supporting Information

References

1Marescaux J, Clement JM, Tassetti V, Koehl C, Cotin S, Russier Y et al. Virtual reality applied to hepatic surgery simulation: the next revolution. Ann Surg. 1998; 228: 627–34.
10.1097/00000658-199811000-00001
CAS PubMed Web of Science® Google Scholar
2Lamada W, Glombitza G, Ficher L, Chiu P, Cárdenas CE Sr, Thorn M et al. The impact of 3-dimensional reconstruction on operation planning in liver surgery. Arch Surg. 2000; 135: 1256–61.
10.1001/archsurg.135.11.1256
PubMed Web of Science® Google Scholar
3Endo I, Shimada H, Sugita M, Fujii Y, Morioka D, Takeda K et al. Role of three-dimensional imaging in operative planning for hilar cholangiocarcinoma. Surgery. 2007; 142: 666–75.
10.1016/j.surg.2007.05.018
PubMed Web of Science® Google Scholar
4Aggarwal R, Crochet P, Dias A, Misra A, Ziprin P, Darzi A. Development of a virtual reality training curriculum for laparoscopic cholecystectomy. Br J Surg. 2009; 96: 1086–93.
10.1002/bjs.6679
CAS PubMed Web of Science® Google Scholar
5Saito S, Yamanaka J, Miura K, Nakao N, Nagao T, Sugimoto T et al. A novel 3-D hepatectomy simulation based on liver circulation: application to liver resection and transplantation. Hepatology. 2005; 41: 1297–304.
10.1002/hep.20684
CAS PubMed Web of Science® Google Scholar
6Yonemura Y, Taketomi A, Soejima Y, Yoshizumi T, Uchiyama H, Gion T et al. Validity of preoperative volumetric analysis of congestion volume in living donor liver transplantation using three-dimensional computed tomography. Liver Transpl. 2005; 11: 1556–62.
10.1002/lt.20537
CAS PubMed Web of Science® Google Scholar
7Yamanaka J, Saito S, Fujimoto J. Impact of preoperative planning using virtual segmental volumetry on liver resection for hepatocellular carcinoma. World J Surg. 2007; 31: 1249–55.
10.1007/s00268-007-9020-8
PubMed Web of Science® Google Scholar
8Satou S, Sugawara Y, Kishi Y, Kaneko J, Matsui Y et al. Preoperative estimation of right sector graft by three-dimensional computed tomography. Transplant Proc. 2007; 39: 145–9.
10.1016/j.transproceed.2006.10.028
CAS PubMed Web of Science® Google Scholar
9Hattori A, Suzuki N, Hashizume M, Akahoshi T, Konishi K, Yamaguchi S et al. A robotic surgery system (da Vinci) with image guided function system architecture and cholecystectomy. Stud Health Technol Inform. 2003; 94: 110–6.
PubMed Web of Science® Google Scholar
10Sugimoto M, Yasuda H, Koda K, Suzuki M, Yamazaki M, Tezuka T et al. Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery. J Hepatobiliary Pancreat Sci. 2010; 17: 629–36.
10.1007/s00534-009-0199-y
CAS PubMed Web of Science® Google Scholar
11Herline AJ, Stefansic JD, Debelak JP, Hartmann SL, Pinson CW, Galloway RL et al. Image-guided surgery. Arch Surg. 1999; 134: 644–50.
10.1001/archsurg.134.6.644
CAS PubMed Web of Science® Google Scholar
12Cash DM, Miga MI, Glascow SC, Dawant BM, Clements LW, Cao Z et al. Concepts and preliminary data toward the realization of image-guided liver surgery. J Gastrointest Surg. 2007; 11: 844–59.
10.1007/s11605-007-0090-6
PubMed Web of Science® Google Scholar
13Robb RA. The biomedical imaging resource at Mayo clinic. Guest editorial. IEEE Trans Med Imaging. 2001; 20: 854–67.
10.1109/42.952724
CAS PubMed Web of Science® Google Scholar
14Robb RA, Barillot C. Interactive display and analysis of 3-D medical images. IEEE Trans Med Imaging. 1989; 8: 217–26.
10.1109/42.34710
CAS PubMed Web of Science® Google Scholar
15Robb RA, Hanson DP, Karwoski RA, Larson AG, Workman EL, Stacy MC. Analyze: a comprehensive, operator-interactive software package for multidimensional medical image display and analysis. Comput Med Imaging Graph. 1989; 13: 433–54.
10.1016/0895-6111(89)90285-1
CAS PubMed Web of Science® Google Scholar
16Lamade W, Vetter M, Hassenphlug P, Thorn M, Meinzer HP, Herfarth C. Navigation and image-guided HBP surgery: a review and preview. J Hepatobiliary Pancreat Sci. 2002; 9: 592–9.
10.1007/s005340200079
Google Scholar
17Sugimoto M. Recent advances in visualization, imaging, and navigation in hepatobiliary and pancreatic sciences. J Hepatobiliary Pancreat Sci. 2010; 17: 574–6.
10.1007/s00534-009-0192-5
PubMed Web of Science® Google Scholar
18Shuhaiber JH. Augmented reality in surgery. Arch Surg. 2004; 139: 170–4.
10.1001/archsurg.139.2.170
PubMed Web of Science® Google Scholar
19Morikawa S, Inubushi T, Kurumi Y, Kurumi Y, Naka S, Haque HA et al. MR-guided microwave thermocoagulation therapy of liver tumors: initial clinical experience using a 0.5T MR system. Magn Reson Med Sci. 2005; 4: 89–94.
PubMed Google Scholar
20Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C et al. Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc. 2010; 24: 1976–85.
10.1007/s00464-010-0890-8
PubMed Web of Science® Google Scholar
21Nakamoto M, Nakada K, Sato Y, Konishi K, Hashizume M, Tamura S. Intraoperative magnetic tracker calibration using a magneto-optic hybrid tracker for 3-D ultrasound-based navigation in laparoscopic surgery. IEEE Trans Med Imaging. 2008; 27: 255–70.
10.1109/TMI.2007.911003
PubMed Web of Science® Google Scholar
22Sato Y, Nakamoto M, Tamaki Y, Sasama T, Sakita I, Nakajima Y et al. Image guidance of breast cancer surgery using 3-D ultrasound images and augmented reality visualization. IEEE Trans Med Imaging. 1998; 17: 681–93.
10.1109/42.736019
CAS PubMed Web of Science® Google Scholar

Citing Literature

Volume20, Issue2

February 2013

Pages 249-253

Filename	Description
534_2012_504_MOESM1_ESM.m1vapplication/m1v, 20.9 MB	Supplementary Material
534_2012_Article_504.xml.MetaXML document, 12.4 KB	Supplementary Material

Utility of augmented reality system in hepatobiliary surgery

Abstract

Background/purpose

Methods

Results

Conclusion

Supporting Information

References

Citing Literature

References

Information

About Wiley Online Library

Help & Support

Opportunities

Connect with Wiley

Utility of augmented reality system in hepatobiliary surgery

Abstract

Background/purpose

Methods

Results

Conclusion

Supporting Information

References

Citing Literature

References

Related

Information