Haptic Interaction in Medical Virtual Environments
Georgios Nikolakis
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorDimitrios Koutsonanos
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorKonstantinos Moustakas
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorPetros Daras
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorDimitrios Tzovaras
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorMichael G. Strintzis
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorGeorgios Nikolakis
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorDimitrios Koutsonanos
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorKonstantinos Moustakas
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorPetros Daras
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorDimitrios Tzovaras
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorMichael G. Strintzis
Informatics & Telematics Institute, C.E.R.T.H., Thessaloniki, Greece
Search for more papers by this authorAbstract
In recent years, there has been a growing interest in developing force feedback interfaces that allow people to access information presented in 3D virtual reality environments (VEs). One of the major application fields is medicine. Several cases exist where standard medical treatment cannot be applied to patients for several reasons, such as distance from hospital, lack of specialized doctor, and lack of medical equipment. The use of haptic-enabled virtual environments provides an alternative solution in a variety of such cases, thus enabling assessment and treatment of patients. Furthermore, haptic-enabled virtual environments provide a nonhazardous means of treatment for several disorders like phobia treatment, where the patient has to be exposed to the phobia object. Training of disabled people, like the visually impaired, is another important application of haptic-enabled VEs. This chapter presents an extended description of haptic virtual environments and the major methodologies and techniques used in medical applications. Further, it demonstrates indicatively a number of applications in order to illustrate the applicability of VEs in several areas of medical treatment and training.
Bibliography
- 1C. Cañero, N. Thomos, G. A. Triantafyllidis, G. C. Litos, and M. G. Strintzis, Mobile tele-echography: user interface design. IEEE Trans. Inform. Technol. Biomed. 2005; 9(1): 44–49.
- 2D. Tzovaras, G. Nikolakis, G. Fergadis, S. Malasiotis, and M. Stavrakis, Design and implementation of haptic virtual environments for the training of visually impaired. IEEE Trans. Neural Syst. Rehabil. Eng. 2004; 12(2): 266–278.
- 3A. Lécuyer, P. Mobuchon, Ch. Mégard, J. Perret, C. Andriot, and J. P. Colinot, HOMERE: a multimodal system for visually impaired people to explore virtual environments. IEEE Virtual Reality 2003 Los Angeles, California. March 22–26, 2003:251–259.
- 4S. Roy, State of the art of virtual reality therapy (VRT) in phobic disorders. Psychol. J. Vol.1. Available: http://www.psychnology.org/State of the Art of Virtual Reality Therapy.htm.
- 5M. A. Gigante, Virtual Reality Systems. London: Academic Press, 1993.
- 6M. Driels and P. Bereri, A finite memory model for haptic teleoperation. IEEE trans. Syst. Man Cybernet. 1994; 24(4): 690–698.
- 7S. J. Lederman, R. L. Klatzky, and J. D. Balakrishnan, Task-driven extraction of object contour by human haptics: Part 2. Robotica 1991; 9: 179–188.
- 8G. Burdea and P. Coiffet, Virtual Reality Technology. New York: John Wiley & Sons, 1994.
- 9S. P. Eberhardt, L. E. Bernstein, D. C. Coulter, and L. A. Hunckler, OMAR - a haptic display for speech perception by deaf and deaf-blind individuals. IEEE Ann. Virtual Reality Int. Symposium, 1993:195–201.
- 10S. A. Stansfield, Haptic perception with an articulate, sensate robot hand. Proc. Robotica 1992; 10: 497–508.
- 11K. B. Shimoga, A survey of perceptual feedback issues in dexterous telemanipulation: Part I. finger force feedback. 1993 IEEE Annual Virtual Reality International Symposium, 1993: 263–270.
- 12K. B. Shimoga, A survey of perceptual feedback issues in dexterous telemanipulation: Part II. Finger touch feedback. 1993 IEEE Annual Virtual Reality International Symposium, 1993: 271–279.
- 13C. Basdogan, S. De, J. Kim, M. Muniyandi, H. Kim, and M. A. Srinivasan, Haptics in minimally invasive surgical simulation and training. IEEE Comput. Graph. Appli. 2004; March/April:56–64.
- 14U. Kühnapfel, H. Çakmak, B. Chantier, H. Maaß, G. Strauss, C. Trantakis, E. Novatius, J. Meixensberger, K. Lehmann, H. J. Buhr, M. Lawo, and G. Bretthauer. (2005) HapticIO: haptic interface-systems for virtual-reality training in minimally-invasive surgery. (on line). Available: http://informatiksysteme.pt-it.de/vr-ar-3/projekte/hapticio/paper_HAPTICIO.pdf.
- 15W. Yu, R. Ramloll, and S. A. Brewster, Haptic graphs for blind computer users. In Proceedings of the First Workshop on Haptic Human-Computer Interaction, 2000:102–107.
- 16H. K. Çakmak and U. Kühnapfel, Animation and Simulation Techniques for VR-Training Systems in Endoscopic Surgery Eurographics Workshop on Animation and Simulation ‘2000 (EGCAS ‘2000) Interlaken/Switzerland, August 21–22, 2000, pp. 173–185, ISBN: 3-211-83549-0.
- 17C. Preusche and G. Hirzinger, Scaling issues for teleoperation. Proceedings of the 5th PHANToM™ user group, 2000.
- 18J. P. Fritz, Haptic rendering techniques for scientific visualization. Master thesis, University of Delaware, Newark, Delaware, 1996.
- 19J. P. Fritz and K. E. Barner, Stochastic models for haptic texture. Proceeding of SPIE's international symposium on intelligent systems and advanced manufacturing- Telemanipulator and telepresence technologies III, Boston, Massachusetts, November, 1996.
- 20M. M. Minsky, Computational haptics: the sandpaper system for synthesizing texture with a force-feedback haptic display, Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, Massachusetts, 1995.
- 21J. Chen, C. DiMattia, R. M. Taylor, M. Falvo, P. Thiansathaporn, and R. Superfine, Sticking to the point: a friction and adhesion model for simulated surfaces. in Proceedings of the Sixth Annual Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME, 1997.
- 22J. P. Fritz, Haptic rendering techniques for scientific visualization. Master thesis. University of Delaware, Newark, Delaware, 1996.
- 23C. B. Zilles, Haptic rendering with the toolhandle haptic interface. Masters of Science and Bachelor of Science in Mechanical Engineering, Massachusetts Institute of Technology Cambridge, Massachusetts, 1995.
- 24V. Hayward and B. Armstrong, A new computational model of friction applied to haptic rendering. In: P. Corke and J. Trevelyan, eds., Experimental Robotics VI. Lecture Notes in Control and Information Sciences, vol. 250. New York: Springer-Verlag, pp. 403–412.
- 25Y. Adachi, T. Kumano, and K. Ogino, Intermediate representation for stiff virtual objects. Proc. IEEE Virtual Reality Annu. Int. Sympo., Research Triangle Park, NC: IEEE Computer Society Press, March 1995, pp. 203–210.
- 26C. Richard, On the identification and haptic display of friction. Ph.D., Stanford University, August 2000.
- 27A. Nahvi and J. M. Hollerbach, Display of friction in virtual environments based on human finger pad characteristics. Symp. Haptic Interfaces, Proc. ASME Dynamic Systems and Control Division, DSC-Vol. 64, Anaheim, California, 1998:179–184.
- 28J. P. Fritz and K. E. Barner, Design of a haptic Data Visualization System for people with visual impairments. IEEE Trans. Rehabil. Eng. 1999; 7(3) Sept.
- 29C. Richard, M. Cutkosky and K. MacLean, Friction identification for haptic display. ASME IMECE 8th Annual Symposium on Haptic Interfaces, Nashville, Tennessee, 1999.
- 30D. F. Green, Haptic simulation of naturally occurring textures and soil properties. M.Sc. Thesis Massachusetts Institute of Technology, Cambridge, Massachusetts, 1998.
- 31J. Fricke, Substituting friction by weak vibration on a tactile pin array. in IPO Colloquium room, Fern Universitaet of Hagen, Germany, 1997.
- 32J. Swevers, F. Al-Bender, C. G. Ganseman, and T. Prajogo, An integrated friction model structure with improved presliding behavior for accurate friction compensation. IEEE Trans. Automatic Control. 2000; 45(4): 675–686.
- 33F. Altpeter, F. Ghorbel, and R. Longchamp, A singular perturbation analysis of two friction models applied to a vertical EDM-axis. 3rd IFAC Workshop on Motion Control, Genoble, France, September 21–23, 1998:7–12.
- 34F. Altpeter, D. Necsulescu, and R. Longchamp, Friction modeling and identification issues for electric drives. Electromotion’97, Chij-Napoca, Romania, 1997:149–154.
- 35C. Preusche and G. Hirzinger, Scaling issues for teleoperation. Proceedings of the 5th PHANToM™ user group, 2000.
- 36L. Moody, J. Arthur, E. A. Dibble, and A. Zivanovic, Haptic accuracy in a Virtual Reality arthroscopy simulator. In: D. Waard, K. A. Brookhuis, S. M. Sommer, and W. B. Verwey, eds., Human Factors in the Age of Virtual Reality. Maastricht, the Netherlands: Shaker Publishing, 2003, pp. 45–62.
- 37O. Sourina, A. Sourin, and H. T. Sen, Virtual orthopedic surgery training on personal computer. Int. J. Inform. Technol. 2000; 6(1): 16–29.
- 38R. Webster, J. Sasanni, R. Shenk, and G. Zoppetti, Simulating the continuous curvilinear capsulorexis procedure during cataract swurgery. Proceedings of the 15th IASTED International Conference Modeling and Simulation, Marina Del Rey, California, March 1–3, 2004:262–265.
- 39R. Webster, J. Sasanni, R. Shenk, and N. Good, A haptic surgical simulator for the continuous curvilinear capsulorexis procedure during cataract surgery. In: J. D. Westwood et al., eds., Medicine Meets Virtual Reality. IOS Press, 2004.
- 40M. Gutierrez, P. Lemoine, D. Thalmann, and F. Vexo, Telerehabilitation: controlling haptic virtual environments through handheld interfaces. Proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST 2004), Hong Kong, November 2004.
Reading List
- O. A. Bauchau, On the modeling of friction and rolling in flexible multi-body systems. Multibody syst. Dynam. 1999; 3: 209–239.