Visual Comfort and Fatigue in Stereoscopy

This chapter provides an overview of visual fatigue and discomfort, both in terms of the mechanisms involved in the human visual system (HVS) and in terms of 3D content and processing technologies. It begins by defining the notions of fatigue and discomfort. A section provides an overview of cognitive and optical manifestations of fatigue and discomfort. Another section is devoted to different sources of visual fatigue and discomfort, in connection with binocular vision. The chapter considers the problems posed by 3D technologies and content. The whole of the 3D chain, from capture to viewing, via data representation, compression, transmission and display, requires careful mastery in order to limit stereoscopic faults and reproduce content in a suitable manner. The best compromise should be obtained between the quantity or intensity of 3D effects and the level of visual fatigue and discomfort experienced by the majority of people.

Bibliography

[AND 02] ANDO T., TANAKA A., FUKASAKU S., et al., “Pupillary and cardiovascular responses to a video movie in senior human subjects”, Autonomic Neuroscience: Basic & Clinical, vol. 97, no. 2, pp. 129–35, 2002.
10.1016/S1566-0702(02)00047-4
PubMed Web of Science® Google Scholar
[BAR 10] BARKOWSKY M., WANG K., COUSSEAU R., et al., 18th International Packet Video Workshop, 2010, IEEE, Hong Kong, 2010.
Google Scholar
[BLE 05] BLEHM C., VISHNU S., KHATTAK A., et al., “Computer vision syndrome: a review”, Survey of Ophthalmology, vol. 50, no. 3, pp. 253–262, 2005.
10.1016/j.survophthal.2005.02.008
PubMed Web of Science® Google Scholar
[CAI 92] CAIL F., SALSI S., La fatigue visuelle, Report no. 1–3, INRS, 1992.
Google Scholar
[CHA 77] CHARMAN W.N., WHITEFOOT H., “Pupil diameter and the depth-of-field of the human eye as measured by laser speckle”, Journal of Modern Optics, vol. 24, no. 12, pp. 1211–1216, 1977.
Web of Science® Google Scholar
[CHE 10] CHEN W., FOURNIER J., BARKOWSKY M., et al., “New requirements of subjective video quality assessment methodologies for 3DTV”, Proceedings of 5th International Workshop on Video Proceedings and Quality Metrics, Scottsdale, AZ, vol. 2010, 2010.
Google Scholar
[CHO 10] CHOI J., KIM D., HAM B., et al., “Visual fatigue evaluation and enhancement for 2D-plus-depth video”, 17th IEEE International Conference on Image Processing, IEEE, pp. 2981–2984, 2010.
Web of Science® Google Scholar
[CHO 12] CHOI J.-H., YUN M.-J., KIM A.-R., et al., “Visual comfort measurement for 2D/3D converted stereo video sequence”, 3DTV-Conference, IEEE, no. 1, pp. 1–4, 2012.
Google Scholar
[COO 11] COOPER E.A., BURGE J., “The vertical horopter is not adaptable, but it may be adaptive”, Journal of Vision, vol. 11, no. 3, pp. 1–19, 2011.
10.1167/11.3.20
Web of Science® Google Scholar
[CUT 95] CUTTING J.E., VISHTON P.M., “Perceiving layout and knowing distances: the integration, relative potency, and contextual use of different information about depth”, in EPSTEIN W., ROGERS S.J. (eds), Perception of Space and Motion. Handbook of Perception and Cognition, 2nd ed., San Diego, CA, US: Academic Press, vol. 5, pp. 69–117, 1995.
10.1016/B978-012240530-3/50005-5
Google Scholar
[DOM 06] DOMINI F., CAUDEK C., TASSINARI H., “Stereo and motion information are not independently processed by the visual system”, Vision Research, vol. 46, no. 11, pp. 1707–1723, 2006.
10.1016/j.visres.2005.11.018
PubMed Web of Science® Google Scholar
[EMO 04] EMOTO M., NOJIRI Y., OKANO F., “Changes in fusional vergence limit and its hysteresis after viewing stereoscopic TV”, Displays, vol. 25, no. 2–3, pp. 67–76, 2004.
10.1016/j.displa.2004.07.001
Web of Science® Google Scholar
[EMO 05] EMOTO M., NIIDA T., OKANO F., “Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television”, Journal of Display Technology, vol. 1, no. 2, pp. 328–340, 2005.
10.1109/JDT.2005.858938
Web of Science® Google Scholar
[FEN 67] FENDER D., JULESZ B., “Extension of Panum's fusional area in binocularly stabilized vision”, Journal of the Optical Society of America, vol. 57, no. 6, pp. 819–830, 1967.
10.1364/JOSA.57.000819
CAS PubMed Web of Science® Google Scholar
[FUK 09] FUKUSHIMA T., WOLFFSOHN J.S., GILMARTIN B., “The relationship between CA/C ratio and individual differences in dynamic accommodative responses while viewing stereoscopic images”, Journal of Vision, vol. 9, no. 13, pp. 1–13, 2009.
10.1167/9.13.21
Web of Science® Google Scholar
[HAM 83] HAMPTON D.R., KERTESZ A.E., “The extent of Panum's area and the human cortical magnification factor”, Perception, vol. 12, no. 2, pp. 161–165, 1983.
10.1068/p120161
CAS PubMed Web of Science® Google Scholar
[HAS 01] HASEBE S., GRAF E.W., SCHOR C.M., “Fatigue reduces tonic accommodation”, Ophthalmic and Physiological Optics, vol. 21, no. 2, pp. 151–160, 2001.
10.1046/j.1475-1313.2001.00558.x
CAS PubMed Web of Science® Google Scholar
[HEL 10] HELD R.T., COOPER E.A., O'BRIEN J.F., et al., “Using blur to affect perceived distance and size”, ACM Transactions on Graphics, vol. 29, no. 2, pp. 1–16, 2010.
10.1145/1731047.1731057
Web of Science® Google Scholar
[HOF 08] HOFFMAN D.M., GIRSHICK A.R., BANKS M.S., “Vergence accommodation conflicts hinder visual performance and cause visual fatigue”, Journal of Vision, vol. 8, no. 3, pp. 1–30, 2008.
10.1167/8.3.33
Web of Science® Google Scholar
[HOW 97] HOWARTH P., COSTELLO P., “The occurrence of virtual simulation sickness symptoms when an HMD was used as a personal viewing system”, Displays, vol. 18, no. 2, pp. 107–116, 1997.
10.1016/S0141-9382(97)00011-5
Web of Science® Google Scholar
[HOW 11] HOWARTH P.A., “Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: a review”, Ophthalmic & Physiological Optics: The Journal of the British College of Ophthalmic Opticians (Optometrists), vol. 31, no. 2, pp. 111–122, 2011.
10.1111/j.1475-1313.2011.00822.x
PubMed Web of Science® Google Scholar
[HUN 01] HUNG G.K., Models of Oculomotor Control, vol. 55, World Scientific Publishing Co. Pte. Ltd., 2001.
Google Scholar
[HUY 11] HUYNH-THU Q., BARKOWSKY M., CALLET P.L., “The importance of visual attention in improving the 3D-TV viewing experience: overview and new perspectives”, IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 432–444, 2011.
10.1109/TBC.2011.2128250
Web of Science® Google Scholar
[ITU 04] ITU-R-BT.500-11, Methodology for the subjective assessment of the quality of television pictures, Technical report, International Telecommunication Union, 2004.
Google Scholar
[JAS 91] JASCHINSKI-KRUZA W., “Eyestrain in VDU users: viewing distance and the resting position of ocular muscles”, Human Factors, vol. 33, no. 1, pp. 69–83, 1991.
10.1177/001872089103300106
CAS PubMed Web of Science® Google Scholar
[JAS 98] JASCHINSKI-KRUZA W., “Visual strain during VDU work: the effect of viewing distance and dark focus”, Ergonomics, vol. 31, pp. 1449–1465, 1998.
10.1080/00140138808966788
Web of Science® Google Scholar
[JON 89] JONES R., STEPHENS G.L., “Horizontal fusional amplitudes. Evidence for disparity tuning”, Investigative Ophthalmology & Visual Science, vol. 30, no. 7, pp. 1638–1642, 1989.
CAS PubMed Web of Science® Google Scholar
[KEN 93] KENNEDY R., LANE N., BERBAUM K., et al., “Simulator sickness questionnaire: an enhanced method for quantifying simulator Sickness”, The International Journal of Aviation Psychology, vol. 3, no. 3, pp. 203–220, 1993.
10.1207/s15327108ijap0303_3
Google Scholar
[KIM 11] KIM D., JUNG Y., KIM E., et al., “Human brain response to visual fatigue caused by stereoscopic depth perception”, 17th International Conference on Digital Signal Processing (DSP), 2011, IEEE, pp. 1–5, 2011.
10.1109/ICDSP.2011.6004999
Google Scholar
[KIM 12] KIM W.-J., “Feature-based detection of inverted-stereo for stereoscopic 3D viewing comfort”, IEEE Transactions on Broadcasting, vol. 58, no. 2, pp. 296–300, 2012.
10.1109/TBC.2012.2190193
Web of Science® Google Scholar
[KOO 04] KOOI F., TOET A., “Visual comfort of binocular and 3D displays”, Displays, vol. 25, no. 2–3, pp. 99–108, 2004.
10.1016/j.displa.2004.07.004
Web of Science® Google Scholar
[KUZ 08] KUZE J., UKAI K., “Subjective evaluation of visual fatigue caused by motion images”, Displays, vol. 29, no. 2, pp. 159–166, 2008.
10.1016/j.displa.2007.09.007
Web of Science® Google Scholar
[LAM 07] LAMBOOIJ M.T.M., IJSSELSTEIJN W.A., HEYNDERICKX I., “Visual discomfort in stereoscopic displays: a review”, Proceedings of SPIE, vol. 6490, SPIE, 2007.
10.1117/12.705527
Web of Science® Google Scholar
[LAM 09] LAMBOOIJ M.T.M., FORTUIN M.F., IJSSELSTEIJN W.A., et al., “Measuring visual discomfort associated with 3D displays”, Proceedings of SPIE, vol. 7237, SPIE, 2009.
10.1117/12.805977
Google Scholar
[LAM 11] LAMBOOIJ M.T.M., IJSSELSTEIJN W.A., BOUWHUIS D.G., et al., “Evaluation of stereoscopic images: beyond 2D quality”, IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 432–444, 2011.
10.1109/TBC.2011.2134590
Web of Science® Google Scholar
[LI 05] LI Z., SUN F., “Pupillary response induced by stereoscopic stimuli”, Experimental Brain Research, vol. 160, no. 3, pp. 394–397, 2005.
10.1007/s00221-004-2161-1
PubMed Web of Science® Google Scholar
[LI 08] LI H., SEO J., KHAM K., et al., “Measurement of 3D visual fatigue using event-related potential (ERP): 3D oddball paradigm”, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, 2008, IEEE, pp. 213–216, 2008.
10.1109/3DTV.2008.4547846
Google Scholar
[LI 11] LI J., BARKOWSKY M., WANG J., et al., “Study on visual discomfort induced by stimulus movement at fixed depth on stereoscopic displays using shutter glasses”, Proceedings of 17th International Conference on Digital Signal Processing, pp. 1–8, 2011.
Google Scholar
[LI 13] LI J., BARKOWSKY M., LE CALLET P., “Visual discomfort is not always proportional to eye blinking rate: exploring some effects of planar and in-depth motion on 3DTV QoE”, 7th International Workshop on Video Processing and Quality Metrics, pp. 1–6, 2013.
Google Scholar
[MEN 09] MENDIBURU B., 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen, Focal Press, 2009.
Google Scholar
[MIT 66] MITCHELL D.E., “A review of the concept of ‘Panum's fusional area'”, American Journal of Optometry, vol. 43, pp. 387–401, 1966.
10.1097/00006324-196606000-00004
CAS PubMed Web of Science® Google Scholar
[MUR 01] MURATA A., UETAKE A., OTSUKA M., et al., “Proposal of an index to evaluate visual fatigue induced during visual display terminal tasks”, International Journal of Human-Computer Interaction, vol. 13, no. 3, pp. 305–321, 2001.
10.1207/S15327590IJHC1303_2
Web of Science® Google Scholar
[NAG 96] NAGATA S., “The binocular fusion of human vision on stereoscopic displays - field of view and environment effects”, Ergonomics, vol. 39, no. 11, pp. 1273–1284, 1996.
10.1080/00140139608964547
CAS PubMed Web of Science® Google Scholar
[NAG 08] NAGATANI H., HIRAYAMA Y., “Evaluation of the influence on the human body of the autostereoscopic display based on the integral imaging method”, Proceedings of SPIE, vol. 6803, SPIE, pp. 1–8, 2008.
Google Scholar
[NOJ 04a] NOJIRI Y., YAMANOUE H., HANAZATO A., et al., “Parallax distribution and visual comfort on stereoscopic HDTV”, Proceedings of SPIE, vol. 25, SPIE, pp. 303–313, 2004.
10.1117/12.522018
Web of Science® Google Scholar
[NOJ 04b] NOJIRI Y., YAMANOUE H., HANAZATO A., et al., “Visual comfort/discomfort and visual fatigue caused by stereoscopic HDTV viewing”, Proceedings of SPIE, vol. 5291, SPIE, pp. 303–313, 2004.
10.1117/12.522018
Web of Science® Google Scholar
[NOR 81] NORTH R., HENSON D.B., “Adaptation to prism-induced heterophoria in subjects with abnormal binocular vision or asthenopia”, American Journal of Optometry and Physiological Optics, vol. 58, no. 9, pp. 746–752, 1981.
10.1097/00006324-198109000-00009
CAS PubMed Web of Science® Google Scholar
[OKA 06] OKADA Y., UKAI K., WOLFFSOHN J.S., et al., “Target spatial frequency determines the response to conflicting defocus- and convergence-driven accommodative stimuli”, Vision Research, vol. 46, no. 4, pp. 475–484, 2006.
10.1016/j.visres.2005.07.014
PubMed Web of Science® Google Scholar
[PAT 09] PATTERSON R., “Review paper: human factors of stereo displays: an update”, Journal of the Society for Information Display, vol. 17, no. 12, pp. 987–996, 2009.
10.1889/JSID17.12.987
Web of Science® Google Scholar
[QUA 12] QUALINET, Qualinet white paper on definitions of quality of experience, Technical report, Dagstuhl Seminar, 2012.
Google Scholar
[RIC 71] RICHARDS W., “Anomalous stereoscopic depth perception”, Journal of the Optical Society of America, vol. 61, no. 3, pp. 410–413, 1971.
10.1364/JOSA.61.000410
CAS PubMed Web of Science® Google Scholar
[RIC 09] RICHARDS W., “Configuration stereopsis: a new look at the depth-disparity relation”, Spatial Vision, vol. 22, no. 1, pp. 91–103, 2009.
10.1163/156856809786618493
PubMed Web of Science® Google Scholar
[ROO 00] ROOKES P., WILLSON J., Perception: Theory, Development and Organisation, Routledge Modular Psychology Series, 1st ed., London, 2000.
Google Scholar
[SCH 81] SCHOR C.M., TYLER C.W., “Spatio-temporal properties of Panum's fusional area”, Vision Research, vol. 21, no. 5, pp. 683–692, 1981.
10.1016/0042-6989(81)90076-6
CAS PubMed Web of Science® Google Scholar
[SCH 87] SCHOR C.M., TSUETAKI T.K., “Fatigue of accommodation and vergence modifies their mutual interactions”, Investigative Ophthalmology & Visual Science, vol. 28, no. 8, pp. 1250–1259, 1987.
CAS PubMed Web of Science® Google Scholar
[SCH 06] SCHREIBER K.M., TWEED D.B., SCHOR C.M., “The extended horopter: quantifying retinal correspondence across changes of 3D eye position”, Journal of Vision, vol. 6, no. 1, pp. 64–74, 2006.
10.1167/6.1.6
PubMed Web of Science® Google Scholar
[SIE 01] SIEGEL M., “Perceptions of crosstalk and the possibility of a zoneless autostereoscopic display”, Proceedings of SPIE, SPIE, pp. 34–41, 2001.
Google Scholar
[SOH 11] SOHN H., JUNG Y.J., LEE S.-I., et al., “Attention model-based visual comfort assessment for stereoscopic depth perception”, 2011 17th International Conference on Digital Signal Processing (DSP), 2011, IEEE, pp. 1–6, 2011.
10.1109/ICDSP.2011.6004985
Google Scholar
[SPE 02] SPERANZA F., WILCOX L.M., “Viewing stereoscopic images comfortably: the effects of whole-field vertical disparity”, Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems, vol. 4660, SPIE, pp. 18–25, 2002.
Google Scholar
[SPE 06] SPERANZA F., TAM W.J., RENAUD R., et al., “Effect of disparity and motion on visual comfort of stereoscopic images”, Proceedings of SPIE, vol. 6055, SPIE, pp. 94–103, 2006.
Google Scholar
[STR 10] STRANSKY D., WILCOX L., “Depth magnitude and binocular disparity: a closer look at patent vs. qualitative stereopsis”, Journal of Vision, vol. 10, no. 7, p. 330, 2010.
10.1167/10.7.330
Google Scholar
[SUZ 04] SUZUKI Y., ONDA Y., KATADA S., et al., “Effects of an eyeglass-free 3-D display on the human visual system”, Japanese Journal of Ophthalmology, vol. 48, no. 1, pp. 1–6, 2004.
10.1007/s10384-003-0001-7
CAS Web of Science® Google Scholar
[UKA 97] UKAI K., TSUCHIYA K., ISHIKAWA S., “Induced pupillary hippus following near vision: increased occurrence in visual display unit workers”, Ergonomics, vol. 40, no. 11, pp. 1201–1211, 1997.
10.1080/001401397187441
CAS PubMed Web of Science® Google Scholar
[UKA 02] UKAI K., KATO Y., “The use of video refraction to measure the dynamic properties of the near triad in observers of a 3-D display”, Journal of the British College of Ophthalmic Opticians (Optometrists), vol. 22, no. 5, pp. 385–388, 2002.
10.1046/j.1475-1313.2002.00061.x
PubMed Web of Science® Google Scholar
[UKA 08] UKAI K., HOWARTH P.A., “Visual fatigue caused by viewing stereoscopic motion images: background, theories, and observations”, Displays, vol. 29, no. 2, pp. 106-116, 2008.
10.1016/j.displa.2007.09.004
Web of Science® Google Scholar
[VIN 07] VINK P., DE LOOZE M.P., “Crucial elements of designing for comfort”, inSCHIFFERSTEIN H. N.J., HEKKERT P., (eds), Product Experience, Elsevier Science, pp. 441–460, 2007.
Google Scholar
[WAN 02] WANN J.P., MON-WILLIAMS M., “Measurement of visual aftereffects following virtual environment exposure”, STANNEY K.M., (ed.), Handbook of Virtual Environments: Design, Implementation, and Applications, Chapter 37, Lawrence Erlbaum Associates, Mahwah, NJ, USA, pp. 731–749, 2002.
Google Scholar
[WAN 11] WANG J., BARKOWSKY M., RICORDEL V., “Quantifying how the combination of blur and disparity affects the perceived depth”, SPIE Electronic Imaging, vol. 7865, pp. 1–10, 2011.
Google Scholar
[WAT 04] WATT S.J., AKELEY K., GIRSHICK A.R., et al., “Achieving near-correct focus cues in a 3-D display using multiple image planes”, ACM Transactions on Graphics - Proceedings of ACM SIGGRAPH 2004, vol. 23, no. 3, 2004.
CAS Web of Science® Google Scholar
[WOO 74] WOO G., “The effect of exposure time on the foveal size of Panum's area”, Vision Research, vol. 14, no. 7, pp. 473–480, 1974.
10.1016/0042-6989(74)90035-2
CAS PubMed Web of Science® Google Scholar
[YAN 02] YANO S., IDE S., MITSUHASHI T., et al., “A study of visual fatigue and visual comfort for 3D HDTV/HDTV images”, Displays, vol. 23, no. 4, pp. 191–201, 2002.
10.1016/S0141-9382(02)00038-0
Web of Science® Google Scholar
[YAN 04] YANO S., EMOTO M., MITSUHASHI T., “Two factors in visual fatigue caused by stereoscopic HDTV images”, Displays, vol. 25, no. 4, pp. 141–150, 2004.
10.1016/j.displa.2004.09.002
Web of Science® Google Scholar
[YAN 11] YANG S., SHEEDY J.E., “Effects of vergence and accommodative responses on viewer's comfort in viewing 3D stimuli”, Proceedings of SPIE Stereoscopic Displays and Applications XXII, vol. 7863, SPIE, pp. 78630Q1–13, 2011.
Google Scholar
[ZHA 10] ZHANG Y., JIANG G., YU M., et al., “Stereoscopic visual attention model for 3d video”, 16th International Conference on Advances in Multimedia Modeling, Chongqing, China, pp. 314–324, 6–8 January 2010.
Google Scholar

Citing Literature

3D Video: From Capture to Diffusion