This paper introduces the use of a visual attention model to improve the accuracy of gaze tracking systems. Visual attention models simulate the selective attention part of the human visual system. For instance, in a bottom-up approach, a saliency map is defined for the image and gives an attention weight to every pixel of the image as a function of its colour, edge or intensity.

Our algorithm uses an uncertainty window, defined by the gaze tracker accuracy, and located around the gaze point given by the tracker. Then, using a visual attention model, it searches for the most salient points, or objects, located inside this uncertainty window, and determines a novel, and hopefully, better gaze point. This combination of a gaze tracker together with a visual attention model is considered as the main contribution of the paper.

We demonstrate the promising results of our method by presenting two experiments conducted in two different contexts: (1) a free exploration of a visually rich 3D virtual environment without a specific task, and (2) a video game based on gaze tracking involving a selection task.

Our approach can be used to improve real-time gaze tracking systems in many interactive 3D applications such as video games or virtual reality applications. The use of a visual attention model can be adapted to any gaze tracker and the visual attention model can also be adapted to the application in which it is used.

References

[BF03] Beymer B., Flickner M.: Eye gaze tracking using an active stereo head. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition (2003), 451–459.
Web of Science® Google Scholar
[BMMB06] Bohme M., Meyer A., Martinetz T., Barth E.: Remote eye tracking: state of the art and directions for future development. In Proc. of COGAIN (2006), pp. 10–15.
Web of Science® Google Scholar
[BP94] Baluja S., Pomerleau D.: Non-Intrusive Gaze Tracking Using Artificial Neural Networks. Tech. rep., Carnegie University , 1994.
Google Scholar
[CCW03] Cater K., Chalmers A., Ward G.: Detail to attention: exploiting visual tasks for selective rendering. In Proc. of the 14th Eurographics workshop on Rendering (2003), pp. 270–280.
Google Scholar
[CMA03] Courty N., Marchand E., Arnaldi B.: A new application for saliency maps: Synthetic vision of autonomous actors. In Proc. of IEEE International Conference on Image Processing (2003), pp. 1065–1068.
Web of Science® Google Scholar
[DMC*02] Duchowski A., Medlin E., Cournia N., Gramopadhye A., Melloy B., Nair S.: Binocular eye tracking in vr for visual inspection training. In Proc. of ACM Symposium on Virtual Reality Software and Technology (2002), pp. 1–8.
Google Scholar
[GE06] Guestrin E., Eizenman M.: General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Transactions on Biomedical Engineering 53, 6 (2006), 1124–1133.
10.1109/TBME.2005.863952
PubMed Web of Science® Google Scholar
[GEN95] Glenstrup A., Engell-Nielsen T.: Eye controlled media : present and future state. Master thesis, University of Copenhaguen , 1995.
Google Scholar
[HLCC08] Hillaire S., Lecuyer A., Cozot R., Casiez G.: Using an eye-tracking system to improve camera motions and depth-of-field blur effects in virtual environments. In Proc. of IEEE Virtual Reality (2008), pp. 47–50.
Web of Science® Google Scholar
[HMYS01] Haber J., Myszkowski K., Yamauchi H., Seidel H.-P.: Perceptually guided corrective splatting. Computer Graphics Forum 20, 3 (2001), 142–152.
10.1111/1467-8659.00507
Web of Science® Google Scholar
[HNL06] Hennessey C., Noureddin B., Lawrence P.: A single camera eye-gaze tracking system with free head motion. In Proc. of ACM symposium on Eye tracking research & applications (2006), 87–94.
10.1145/1117309.1117349
Google Scholar
[IKN98] Itti L., Koch C., Niebur E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11 (1998), 1254–1259.
10.1109/34.730558
Web of Science® Google Scholar
[Itt05] Itti L.: Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition 12 (2005), 1093–1123.
10.1080/13506280444000661
Web of Science® Google Scholar
[Jac95] Jacob R. J. K.: Eye tracking in advanced interface design. Virtual Environments and Advanced Interface Design (1995), 258–288.
Google Scholar
[KBS93] Kaufman A., Bandopadhay A., Shaviv B.: An eye tracking computer user interface. In Proc. of IEEE Research Frontier in Virtual Reality Workshop (1993), pp. 120–121.
10.1109/VRAIS.1993.378254
Google Scholar
[LDC06] Longhurst P., Debattista K., Chalmers A.: A gpu based saliency map for high-fidelity selective rendering. In Proc. of the 4th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa (2006), pp. 21–29.
10.1145/1108590.1108595
Google Scholar
[LKC09] Lee S., Kim G., Choi S.: Real-time tracking of visually attended objects in virtual environments and its application to lod. IEEE Transactions on Visualization and Computer Graphics 15, 1 (Jan.-Feb. 2009), 6–19.
10.1109/TVCG.2008.82
PubMed Web of Science® Google Scholar
[LVJ05] Lee C. H., Varshney A., Jacobs D.: Mesh saliency. In Proc. of ACM Transactions on Graphics (2005), 659–666.
Google Scholar
[MM05] Morimoto C. H., Mimica M. R. M.: Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98, 1 (2005), 4–24.
10.1016/j.cviu.2004.07.010
Web of Science® Google Scholar
[NI05] Navalpakkam V., Itti L.: Modeling the influence of task on attention. Vision Research 45, 2 (2005), 205–231.
10.1016/j.visres.2004.07.042
PubMed Web of Science® Google Scholar
[PI07] Peters R., Itti L.: Beyond bottom-up: incorporating task-dependent influences into a computational model of spatial attention. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR07) (2007), pp. 18–23.
Web of Science® Google Scholar
[PJ02] Piratla N. M., Jayasumana A. P.: A neural network based real-time gaze tracker. Journal of Network and Computer Applications 25, 3 (2002), 179–196.
10.1006/jnca.2002.0142
Web of Science® Google Scholar
[Rob90] Robertson A. R.: Historical development of cie recommended color difference equations. Color Research and Application 15, 3 (1990), 167–170.
10.1002/col.5080150308
Web of Science® Google Scholar
[SDL*05] Sundstedt V., Debattista K., Longhurst P., Chalmers A., Troscianko T.: Visual attention for efficient high-fidelity graphics. In SCCG '05: Proceedings of the 21st spring conference on Computer graphics ( New York , NY , USA , 2005), ACM, pp. 169–175.
10.1145/1090122.1090150
Google Scholar
[SSWR08] Sundstedt V., Stavrakis E., Wimmer M., Reinhard E.: A psychophysical study of fixation behavior in a computer game. In APGV '08: Proceedings of the 5th symposium on Applied perception in graphics and visualization ( New York , NY , USA , 2008), ACM, pp. 43–50.
10.1145/1394281.1394288
Web of Science® Google Scholar
[TG80] Treisman A. M., Gelade G.: A feature-integration theory of attention. Cognitive Psychology 12, 1 (1980), 97–136.
10.1016/0010-0285(80)90005-5
CAS PubMed Web of Science® Google Scholar
[Tob] Tobii: http://www.tobii.com. Last accessed May 2009.
Google Scholar
[Wer90] Werbos P. J.: Backpropagation through time: what it does and how to do it. In Proceedings of the IEEE 78, 10 (1990), 1550–1560.
Web of Science® Google Scholar
[Yar67] Yarbus D.: Eye Motion and Vision. Plenum Press, 1967.
10.1007/978-1-4899-5379-7
Google Scholar
[YC06] Yoo D., Chung M.: Non-intrusive eye gaze estimation using a projective invariant under head movement. In Proc. of IEEE International Conference on Robotics and Automation (2006), pp. 3443–3448.
Web of Science® Google Scholar
[YPG01] Yee H., Pattanaik S., Greenberg D. P.: Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments. ACM Trans. Graph. 20, 1 (2001), 39–65.
10.1145/383745.383748
Web of Science® Google Scholar
[YUYA08] Yamazoe H., Utsumi A., Yonezawa T., Abe S.: Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions. In Proc. of ACM symposium on Eye tracking research & applications (2008), pp. 245–250.
10.1145/1344471.1344527
Web of Science® Google Scholar

Citing Literature

Volume29, Issue6

September 2010

Pages 1830-1841

Using a Visual Attention Model to Improve Gaze Tracking Systems in Interactive 3D Applications

Abstract

References

Citing Literature

References

Information

About Wiley Online Library

Help & Support

Opportunities

Connect with Wiley

Using a Visual Attention Model to Improve Gaze Tracking Systems in Interactive 3D Applications

Abstract

References

Citing Literature

References

Related

Information