Optical Image Processing Using Light Modulation Displays
Gordon Wetzstein
The University of British Columbia, Canada [email protected]
Search for more papers by this authorWolfgang Heidrich
The University of British Columbia, Canada [email protected]
Search for more papers by this authorGordon Wetzstein
The University of British Columbia, Canada [email protected]
Search for more papers by this authorWolfgang Heidrich
The University of British Columbia, Canada [email protected]
Search for more papers by this authorAbstract
We propose to enhance the capabilities of the human visual system by performing optical image processing directly on an observed scene. Unlike previous work which additively superimposes imagery on a scene, or completely replaces scene imagery with a manipulated version, we perform all manipulation through the use of a light modulation display to spatially filter incoming light. We demonstrate a number of perceptually motivated algorithms including contrast enhancement and reduction, object highlighting for preattentive emphasis, colour saturation, de-saturation and de-metamerization, as well as visual enhancement for the colour blind. A camera observing the scene guides the algorithms for on-the-fly processing, enabling dynamic application scenarios such as monocular scopes, eyeglasses and windshields.
References
- [ABB*01] Azuma R., Baillot Y., Behringer R., Feiner S., Julier S., MacIntyre B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21, 6 (2001), 34–47.
- [BA83] Burt P., Adelson E.: The Laplacian Pyramid as a Compact Image Code. IEEE Transactions on Communications, 31, 4 (1983), 532–540.
- [BGWK03] Bimber O., Grundhöfer A., Wetzstein G., Knödel S.: Consistent illumination within optical see-through augmented environments. In Proceedings of ISMAR (2003), pp. 198–207.
- [BPR83]
Beck J.,
Prazdny K.,
Rosenfeld A.: A theory of textural segmentation. In
Human and Machine Vision. Academic Press, New York, 1983.
10.1016/B978-0-12-084320-6.50007-4 Google Scholar
- [BR05]
Bimber O.,
Raskar R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters, Ltd., Wellesley, MA, 2005.
10.1201/b10624 Google Scholar
- [BVM97] Brettel H., Viénot F., Mollon J. D.: Computerized simulation of color appearance for dichromats. JOSA A 14, 10 (1997), 2647–2655.
- [BW97] Born M., Wolf E.: Principles of Optics ( 6th edition). Cambridge University Press, Cambridge, UK, 1997.
- [CHR04] Cakmakci O., Ha Y., Rolland J. P.: A compact optical see-through head-worn display with occlusion support. In Proceedings of ISMAR (2004), pp. 16–25.
- [CR06] Cakmakci O., Rolland J.: Head-worn displays: a review. IEEE Journal of Display Technology 2, 3 (2006), 199–216.
- [Cra05] Crawford G.: Flexible Flat Panel Displays. John Wiley and Sons, West Sussex, UK, 2005.
- [FMS93] Feiner S., Macintyre B., Seligmann D.: Knowledge-Based Augmented Reality. Communications of the ACM 36, 7 (1993), 53–62.
- [HE99] Healey C., Enns J.: Large datasets at a glance: Combining textures and colors in scientific visualization. IEEE TVCG 5, 2 (1999), 145–167.
- [Hra02] Hradaynath R.: An Introduction to Night Vision Technology. Defence Research & Development Organization (India), 2002.
- [ITU90] ITU: ITU-R BT.709, Basic Parameter Values for the HDTV Standard for the Studio and for International Programme Exchange. Standard Recommendation 709, International Telecommunication Union, 1990.
- [KKO01] Kiyokawa K., Kurata Y., Ohno H.: ELMO: An enhanced optical see-through display using an LCD panel for mutual occlusion. In Proceedings of ISMAR (2001), pp. 186–187.
- [KM88]
Kingdom F.,
Moulden B.: Border effects on brightness: A review of findings, models and issues.
Spatial Vision
3, 4 (1988), 255–262.
10.1163/156856888X00140 Google Scholar
- [KMS07] Krawczyk G., Myszkowski K., Seidel H.-P.: Contrast restoration by adaptive countershading. Computer Graphics Forum (Proceedings of Eurographics) 26 (2007), 581–590.
- [LP08] Lingley A., Parviz B.: Multipurpose integrated active contact lenses. The Neuromorphic Engineer (2008).
- [Man97] Mann S.: Wearable computing: a first step toward personal imaging. IEEE Computer 30, 2 (1997), 25–32.
- [MFA*05] Mann S., Fung J., Aimone C., Sehgal A., Chen D.: Designing EyeTap digital eyeglasses for continuous lifelong capture and sharing of personal experiences. In CHI extended abstracts (2005).
- [MRT08] Mohan A., Raskar R., Tumblin J.: Agile spectrum imaging: programmable wavelength modulation for cameras and projectors. Computer Graphics Forum (Proceedings of Eurographics) 27, 2 (2008), 709–717.
- [NB03] Nayar S., Branzoi V.: Adaptive dynamic range imaging: optical control of pixel exposures over space and time. In Proceedings of ICCV (2003), pp. 1168–1175.
- [NBB04] Nayar S., Branzoi V., Boult T.: Programmable imaging using a digital micromirror array. In Proceedings of CVPR (June 2004), pp. 436–443.
- [NBB06] Nayar S. K., Branzoi V., Boult T. E.: Programmable imaging: towards a flexible camera. IJCV 70, 1 (2006), 7–22.
- [NS90] Nagy A., Sanchez R.: Critical color differences determined with a visual search task. JOSA A 7, 7 (1990), 1209–1217.
- [NVI08] NVIDIA Tegra: http://www.nvidia.com/page/handheld, 2008.
- [RGW05] Rasche K., Geist R., Westall J.: Re-coloring images for gamuts of lower dimension. Computer Graphics Forum (Proceedings of Eurographics) 24, 3 (2005), 423–432.
- [RHF94] Rolland J., Holloway R. L., Fuchs H.: A comparison of optical and video see-through head-mounted displays. In SPIE 2351 (1994), pp. 293–307.
- [RWPD05] Reinhard E., Ward G., Pattanaik S., Debevec P.: High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting. Morgan Kaufmann Publishers, San Francisco, CA, 2005.
- [See08] Seeing Machines: http://www.seeingmachines.com, 2008.
- [SM07] Sabzmeydani P., Mori G.: Detecting pedestrians by learning shapelet features. In Proceedings of CVPR (2007), pp. 1–8.
- [SSK01] Shih M., Shishido A., Khoo I.: All-optical image processing by means of a photosensitive nonlinear liquid-crystal film: Edge enhancement and image addition&subtraction. Optics Letters 26 (2001), 1140–1142.
- [Sut68] Sutherland I. E.: A head-mounted three dimensional display. Fall Joint Computer Conference (1968), 757–764.
- [WH01] Wichmann F. A., Hill N. J.: The psychometric function: fitting, sampling and goodness-of-fit. Perception and Psychophysics 63, 8 (2001), 1293–1313.
- [YWK*06] Yelleswarapu C., Wu P., Kothapalli S., Rao D., Kimball B., Sai S., Gowrishankar R., Sivaramakrishnan S.: All-optical spatial filtering with power limiting materials. Optics Express 14 (2006), 1451–1457.