3D HDR Images and Videos: Acquisition and Restitution

This chapter is divided into two main sections, concerning acquisition and rendering. The chapter provides a classification of acquisition methods based on the domain in question, organized according to criteria: number of views in the scene, simultaneous or spread acquisition, and acquisition of a static scene or a scene with variable representations over time. The chapter considers the possibilities of adapting existing technologies. The methods presented in the chapter are classified according to the number of viewpoints and the number of different exposures used during acquisition to construct high dynamic range (HDR) data. A section presents methods that aim to acquire images with a single camera. Another section discusses a method that allows the acquisition of HDR video. The chapter also deals with methods involving 3D HDR content.

Bibliography

[AGG 04] AGGARWAL M., AHUJA N., “Split aperture imaging for high dynamic range”, International Journal of Computer Vision, vol. 58, pp. 7–17, 2004.
10.1023/B:VISI.0000016144.56397.1a
Web of Science® Google Scholar
[AGU 12] AGUERREBERE C., DELON J., GOUSSEAU Y., et al., Best algorithms for HDR image generation. A study of performance bounds, Technical report, 2012.
Google Scholar
[BAN 11] BANTERLE F., ARTUSI A., DEBATTISTA K., et al., Advanced High Dynamic Range Imaging: Theory and Practice, AK Peters (CRC Press), Natick, MA, 2011.
10.1201/b11373
Google Scholar
[BLE 08] BLEYER M., CHAMBON S., POPPE U., et al., “Evaluation of different methods for using colour information in global stereo matching approaches”, in CHEN J., JIANG J., FÖRSTNER W. (eds), Congress of the International Society for Photogrammetry and Remote Sensing, vol. XXXVII, Part B3a, Beijing, China, pp. 415–420, July 2008.
Web of Science® Google Scholar
[BON 12] BONNARD J., LOSCOS C., VALETTE G., et al., “High-dynamic range video acquisition with a multiview camera”, Proceedings of SPIE Optics, Photonics, and Digital Technologies for Multimedia Applications II, SPIC, vol. 8436, no. 1, p. 84360A, 2012.
10.1117/12.922789
Web of Science® Google Scholar
[CAD 08] CADÍK M., WIMMER M., NEUMANN L., et al., “Evaluation of HDR tone mapping methods using essential perceptual attributes”, Computers & Graphics, vol. 32, no. 3, pp. 330–349, June 2008.
10.1016/j.cag.2008.04.003
Web of Science® Google Scholar
[DEB 97] DEBEVEC P.E., MALIK J., “Recovering high dynamic range radiance maps from photographs”, Proceedings of SIGGRAPH97, Computer Graphics Proceedings, Annual Conference Series, pp. 369–378, August 1997.
Google Scholar
[DEV 02] DEVLIN K., CHALMERS A., WILKIE A., et al., “STAR: tone reproduction and physically based spectral rendering”, in FELLNER D., SCOPIGNIO R. (eds), State of the Art Reports, Eurographics 2002, The Eurographics Association, pp. 101–123, 2002.
Google Scholar
[DRA 03] DRAGO F., MYSZKOWSKI K., ANNEN T., et al., “Adaptive logarithmic mapping for displaying high contrast scenes”, Computer Graphics Forum, vol. 22, pp. 419–426, 2003.
10.1111/1467-8659.00689
Web of Science® Google Scholar
[FAT 02] FATTAL R., LISCHINSKI D., WERMAN M., “Gradient domain high dynamic range compression”, ACM Transactions on Graphics, vol. 21, no. 3, pp. 249–256, July 2002.
10.1145/566654.566573
Web of Science® Google Scholar
[FER 01] FERWERDA J.A., “Elements of early vision for computer graphics”, IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 22–33, 2001.
10.1109/38.946628
Web of Science® Google Scholar
[GAL 09] GALLO O., GELFAND N., CHEN W., et al., “Artifact-free high dynamic range imaging”, IEEE International Conference on Computational Photography (ICCP), San Francisco, CA, USA, April 2009.
Google Scholar
[GRA 08] GRANADOS M., SEIDEL H.-P., LENSCH H.P.A., “Background estimation from non-time sequence images”, Proceedings of graphics interface 2008, GI '08, Canadian Information Processing Society, Toronto, Ontario, Canada, pp. 33–40, 2008.
Google Scholar
[GRA 10] GRANADOS M., AJDIN B., WAND M., et al., “Optimal HDR reconstruction with linear digital cameras”, 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, pp. 215–222, 2010.
Google Scholar
[GRO 06] GROSCH T., “Fast and robust high dynamic range image generation with camera and object movement”, Vision, Modeling and Visualization, RWTH Aachen, pp. 277–284, 2006.
Google Scholar
[JAC 08] JACOBS K., LOSCOS C., WARD G., “Automatic high-dynamic range generation for dynamic scenes”, IEEE Computer Graphics and Applications, vol. 28, no. 2, pp. 24–33, March 2008.
10.1109/MCG.2008.23
Web of Science® Google Scholar
[KAN 03] KANG S.B., UYTTENDAELE M., WINDER S., et al., “High dynamic range video”, ACM Transactions on Graphics, vol. 22, no. 3, pp. 319–325, ACM, 2003.
10.1145/882262.882270
Web of Science® Google Scholar
[KAN 04] KANG S.B., SZELISKI R., “Extracting view-dependent depth maps from a collection of images”, International Journal of Computer Vision, vol. 58, no. 2, pp. 139–163, 2004.
10.1023/B:VISI.0000015917.35451.df
PubMed Web of Science® Google Scholar
[KHA 06] KHAN E.A., AKYZ A.O., REINHARD E., “Ghost removal in high dynamic range images”, IEEE International Conference on Image Processing, Atlanta, GA, USA, pp. 2005–2008, 2006.
Google Scholar
[LIN 09] LIN H.-Y., CHANG W.-Z., “High dynamic range imaging for stereoscopic scene representation”, Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt, pp. 4305–4308, 2009.
Google Scholar
[LOS 10] LOSCOS C., JACOBS K., “High-dynamic range imaging for dynamic scenes”, in RATISLAV L. (ed.), Computational Photography: Methods and Applications, CRC Press/Taylor & Francis, pp. 259–281, October 2010.
Google Scholar
[LU 11] LU F., JI X., DAI Q., et al., “Multi-view stereo reconstruction with high dynamic range texture”, Proceedings of the Computer Vision ACCV 2010, Springer, pp. 412–425, 2011.
10.1007/978-3-642-19309-5_32
Google Scholar
[MAN 95] MANN S., PICARD R.W., “On being ‘undigital’︁ with digital cameras: extending dynamic range by combining differently exposed pictures”, Proceedings of IS&T, pp. 442–448, 1995.
Google Scholar
[MAN 04] MANTIUK R., KRAWCZYK G., MYSZKOWSKI K., et al., “Perception-motivated high dynamic range video encoding”, ACM SIGGRAPH 2004 Papers, SIGGRAPH '04, ACM, New York, NY, pp. 733–741, 2004.
10.1145/1186562.1015794
Google Scholar
[MER 07] MERTENS T., KAUTZ J., REETH F.V., “Exposure fusion”, Computer Graphics and Applications, Pacific Conference, pp. 382–390, 2007.
Google Scholar
[MIT 99] MITSUNAGA T., NAYAR S., “Radiometric self calibration”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 374–380, June 1999.
Google Scholar
[NAY 00] NAYAR S., MITSUNAGA T., “High dynamic range imaging: spatially varying pixel exposures”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 472–479, June 2000.
Google Scholar
[NIQ 10] NIQUIN C., PRÉVOST S., REMION Y., “An occlusion approach with consistency constraint for multiscopic depth extraction”, International Journal of Digital Multimedia Broadcasting (IJDMB), special issue Advances in 3DTV: Theory and Practice, vol. 2010, no. 857160, pp. 1–8, February 2010.
10.1155/2010/857160
Google Scholar
[ORO 12] OROZCO R.R., MARTIN I., LOSCOS C., et al., “Full high-dynamic range images for dynamic scenes”, Proceedings of SPIE, vol. 8436, pp. 843609–843609-16, 2012.
10.1117/12.922825
Web of Science® Google Scholar
[PED 08] PEDONE M., HEIKKILÄ J., “Constrain propagation for ghost removal in high dynamic range images”, 3rd International Conference on Computer Vision Theory and Applications (VISAPP), Funchal, Madeira - Portugal, vol. 1, pp. 36–41, 2008.
Google Scholar
[REI 05] REINHARD E., DEVLIN K., “Dynamic range reduction inspired by photoreceptor physiology”, IEEE Transactions on Visualization and Computer Graphics, vol. 11, no. 1, pp. 13–24, January 2005.
10.1109/TVCG.2005.9
PubMed Web of Science® Google Scholar
[REI 10] REINHARD E., WARD G., PATTANAIK S., et al., High Dynamic Range Imaging: Acquisition, Display, and Image-based Lighting, The Morgan Kaufmann series in Computer Graphics, 2nd ed., Elsevier (Morgan Kaufmann), Burlington, MA, 2010.
Google Scholar
[SAN 04] SAND P., TELLER S., “Video matching”, ACM Transactions on Graphics, vol. 23, no. 3, pp. 592–599, ACM, 2004.
10.1145/1015706.1015765
Web of Science® Google Scholar
[SEE 04] SEETZEN H., HEIDRICH W., STUERZLINGER W., et al., “High dynamic range display systems”, Proceedings of SIGGRAPH '04 (Special issue of ACM Transactions on Graphics), August 2004.
Google Scholar
[SEL 12] SELMANOVIC E., DEBATTISTA K., BASHFORD-ROGERS T., et al., “Backwards compatible JPEG stereoscopic high dynamic range imaging”, Theory and Practice of Computer Graphics (TPCG), pp. 1–8, 2012.
Google Scholar
[SUN 03] SUN J., ZHENG N.-N., SHUM H.-Y., “Stereo matching using belief propagation”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 787–800, July 2003.
10.1109/TPAMI.2003.1206509
Web of Science® Google Scholar
[SUN 10] SUN N., MANSOUR H., WARD R.K., “HDR image construction from multi-exposed stereo LDR images”, IEEE International Conference on Image Processing (ICIP), pp. 2973–2976, 2010.
Google Scholar
[TOC 11] TOCCI M.D., KISER C., TOCCI N., et al., “A versatile HDR video production system”, ACM SIGGRAPH 2011 papers (SIGGRAPH '11), ACM, New York, NY, USA, pp. 41:1–41:10, 2011.
Web of Science® Google Scholar
[TRO 06] TROCCOLI A., KANG S.B., SEITZ S., “Multi-view multi-exposure stereo”, Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06), IEEE Computer Society, Washington, DC, pp. 861–868, 2006.
10.1109/3DPVT.2006.98
Google Scholar
[TUM 93] TUMBLIN J., RUSHMEIER H.E., “Tone reproduction for realistic images”, IEEE Computer Graphics and Applications, Los Alamitos, CA, USA, vol. 13, no. 6, pp. 42–48, November 1993.
10.1109/38.252554
Web of Science® Google Scholar
[WAR 03] WARD G., “Fast, robust image registration for compositing high dynamic range photographs from handheld exposures”, Journal of Graphics Tools, vol. 8, pp. 17–30, 2003.
10.1080/10867651.2003.10487583
Google Scholar
[YAN 12] YANG X., ZHANG L., WONG T.-T., et al., “Binocular tone mapping”, ACM Transactions on Graphics (SIGGRAPH 2012 issue), vol. 31, no. 4, pp. 93:1–93:10, July 2012.
Google Scholar

3D Video: From Capture to Diffusion