Example-based Interpolation and Synthesis of Bidirectional Texture Functions
Roland Ruiters
Institute for Computer Science II, University of Bonn
Search for more papers by this authorChristopher Schwartz
Institute for Computer Science II, University of Bonn
Search for more papers by this authorReinhard Klein
Institute for Computer Science II, University of Bonn
e-mail: [email protected], [email protected], [email protected]
Search for more papers by this authorRoland Ruiters
Institute for Computer Science II, University of Bonn
Search for more papers by this authorChristopher Schwartz
Institute for Computer Science II, University of Bonn
Search for more papers by this authorReinhard Klein
Institute for Computer Science II, University of Bonn
e-mail: [email protected], [email protected], [email protected]
Search for more papers by this authorAbstract
Bidirectional Texture Functions (BTF) have proven to be a well-suited representation for the reproduction of measured real-world surface appearance and provide a high degree of realism. We present an approach for designing novel materials by interpolating between several measured BTFs. For this purpose, we transfer concepts from existing texture interpolation methods to the much more complex case of material interpolation. We employ a separation of the BTF into a heightmap and a parallax compensated BTF to cope with problems induced by parallax, masking and shadowing within the material. By working only on the factorized representation of the parallax compensated BTF and the heightmap, it is possible to efficiently perform the material interpolation. By this novel method to mix existing BTFs, we are able to design plausible and realistic intermediate materials for a large range of different opaque material classes. Furthermore, it allows for the synthesis of tileable and seamless BTFs and finally even the generation of gradually changing materials following user specified material distribution maps.
Supporting Information
Please note: Blackwell Publishing are not responsible for the content or functionality of any supplementary materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.
The folder "Videos" contains H264 encoded videos of small animation sequences showing the results presented in the paper under varying light and view directions.
In case you have trouble opening the .avi files we recommend to use the cross-platform, open-source and freely available VLC player http://www.videolan.org/.
The file "Gravel - ClayPebbles sequence without parallax-correction.avi" contains an example what would happen if the algorithm would be performed on planar BTF data without the described parallax correction. This is _not_ the final result, which can be found in "Gravel - ClayPebbles - sequence.avi".
The file "Sponge sequence.avi" demonstrates a failure case. In addition to the images depicted in the paper, the video shows that the interpolated ABRDFs do not seem to correspond to the synthesised height maps.
All animations were rendered using OpenGL with 63 directional lights to approximate the environment used for the still images and an additional point-light source to emphasize highlights. Despite shadow-computation, no global illumination effects were considered.
The folder "Images" contains the results presented in Figures 1, 8, 9 and 11 in the paper as well as more versions of the EG logo and an additional example for the smooth multi-material interpolation.
All still renderings were made using global illumination in a monte-carlo raytracer (extended version of mental-ray) under environment illumination with an additional point-light source to emphasize highlights.
The folder "Heightfield Comparison" contains the results of the interpolation sequence "Cat litter to clay pebbles" with paralax correction performed using the heightfield obtained from ARC3D (www.arc3d.be), using the heightfield from the structured light approach by Weinmann et al., and no parallax correction at all.
It also contains the obtained heightmaps as grayscale images for comparison. The ARC3D and the structured light reconstruction do not show exactly the same excerpt of the material. This was taken into account during pre-processing and interpolation.
| Filename | Description |
|---|---|
| CGF_12056_sm_heightfield_comparison.zip3.2 MB | Supporting info item |
| CGF_12056_sm_images.zip2.3 MB | Supporting info item |
| CGF_12056_sm_videos.zip90.5 MB | Supporting info item |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- [DSB*12] Darabi S., Shechtman E., Barnes C., Goldman D. B., Sen P.: Image Melding: Combining Inconsistent Images using Patch-based Synthesis. SIGGRAPH (2012). 3.
- [HB95] Heeger D. J., Bergen J. R.: Pyramid-based texture analysis/synthesis. In SIGGRAPH (1995), pp. 229–238. 3.
- [HF11] Haindl M., Filip J.: Advanced textural representation of materials appearance. In SIGGRAPHAsiaCourses (2011). 3.
- [HH09] Haindl M., Havlíček V.: Texture editing using frequency swap strategy. In Computer Analysis of Images and Patterns, vol. 5702 of Lecture Notes in Computer Science. Springer, 2009, pp. 1146–1153. 3.
- [KBD07] Kautz J., Boulos S., Durand F.: Interactive editing and modeling of bidirectional texture functions. In SIGGRAPH (2007). 3.
- [KEBK05] Kwatra V., Essa I., Bobick A., Kwatra N.: Texture optimization for example-based synthesis. ACM Transactions on Graphics, SIGGRAPH 2005 (2005). 10.
- [KM03] Koudelka M. L., Magda S.: Acquisition, compression, and synthesis of bidirectional texture functions. In Texture 2003 Workshop (2003), pp. 59–64. 3, 4, 6.
- [KPRN11] Kabul I., Pizer S. M., Rosenman J., Niethammer M.: An optimal control approach for texture metamorphosis. Computer Graphics Forum 30, 8 (2011), 2341–2353. 3.
- [LBAD*06] Lawrence J., Ben-Artzi A., DeCoro C., Matusik W., Pfister H., Ramamoorthi R., Rusinkiewicz S.: Inverse shade trees for non-parametric material representation and editing. In SIGGRAPH (2006), pp. 735–745. 3.
- [LL11]
Lepage D.,
Lawrence J.: Material matting.
ACM Trans. Graph.
30, 6 (Dec 2011), 144:1–144:10. 3.
10.1145/2070781.2024178 Google Scholar
- [LM01] Leung T., Malik J.: Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. J. Comput. Vision 43, 1 (June 2001), 29–44. 3.
- [LYS01] Liu X., Yu Y., Shum H.-Y.: Synthesizing bidirectional texture functions for real-world surfaces. In SIGGRAPH (2001), pp. 97–106. 3, 5.
- [MG09] Menzel N., Guthe M.: g-BRDFs: An Intuitive and Editable BTF Representation. Computer Graphics Forum 28, 8 (2009), 2189–2200. 3, 5, 6.
- [MPBM03] Matusik W., Pfister H., Brand M., McMillan L.: A data-driven reflectance model. ACM Trans. Graph. 22, 3 (2003), 759–769. 2, 4.
- [MSK07] Müller G., Sarlette R., Klein R.: Procedural editing of bidirectional texture functions. In EGSR (2007). 2, 3.
- [MZD05] Matusik W., Zwicker M., Durand F.: Texture design using a simplicial complex of morphable textures. ACM Trans. Graph. 24, 3 (2005), 787–794. 2, 3.
- [NZG04] Neubeck A., Zalesny A., Gool L. V.: Viewpoint consistent texture synthesis. In 3DPVT (2004), pp. 388–395. 3.
- [NZG05] Neubeck A., Zalesny A., Gool L. V.: 3d texture reconstruction from extensive btf data. In Texture 2005 Workshop (2005), pp. 13–19. 6.
- [PS00] Portilla J., Simoncelli E. P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vision 40, 1 (2000), 49–70. 3, 4.
- [RK09] Ruiters R., Klein R.: Heightfield and spatially varying BRDF reconstruction for materials with interreflections. CGF 28, 2 (Apr 2009), 513–522. 5, 6, 9.
- [RLW*09] Ray N., Lévy B., Wang H., Turk G., Vallet B.: Material space texturing. Comput. Graph. Forum 28, 6 (2009), 1659–1669. 3.
- [RRK09] Ruiters R., Rump M., Klein R.: Parallelized matrix factorization for fast BTF compression. In EGPGV (2009), pp. 25–32. 4.
- [RSK10] Ruiters R., Schnabel R., Klein R.: Patch-based texture interpolation. CGF 29, 4 (2010), 1421–1429. 2, 3, 4, 6.
- [SWRK11] Schwartz C., Weinmann M., Ruiters R., Klein R.: Integrated high-quality acquisition of geometry and appearance for cultural heritage. In VAST (2011). 5.
- [WAKB09] Wills J., Agarwal S., Kriegman D., Belongie S.: Toward a perceptual space for gloss. ACM Trans. Graph. 28, 4 (2009), 1–15. 4.
- [WDR11] Wu H., Dorsey J., Rushmeier H.: A sparse parametric mixture model for BTF compression, editing and rendering. CGF 30, 2 (2011), 465–473. 3.
- [Wei02] Wei L.-Y.: Texture Synthesis by Fixed Neighborhood Searching. PhD thesis, Stanford University, 2002. 3.
- [WSRK11] Weinmann M., Schwartz C., Ruiters R., Klein R.: A multi-camera, multi-projector super-resolution framework for structured light. In 3DIMPVT (2011), pp. 397–404. 6.
- [WTL*06] Wang J., Tong X., Lin S., Pan M., Wang C., Bao H., Guo B., Shum H.-Y.: Appearance manifolds for modeling time-variant appearance of materials. In SIGGRAPH (2006), pp. 754–761. 3.
- [XWT*09] Xu K., Wang J., Tong X., Hu S.-M., Guo B.: Edit propagation on bidirectional texture functions. Computer Graphics Forum 28, 7 (2009), 1871–1877. 3.
