Example-Based Colour Transfer for 3D Point Clouds
Corresponding Author
Ific Goudé
CNRS, IRISA, Univ Rennes, Rennes, France
Search for more papers by this authorCorresponding Author
Ific Goudé
CNRS, IRISA, Univ Rennes, Rennes, France
Search for more papers by this authorAbstract
Example-based colour transfer between images, which has raised a lot of interest in the past decades, consists of transferring the colour of an image to another one. Many methods based on colour distributions have been proposed, and more recently, the efficiency of neural networks has been demonstrated again for colour transfer problems. In this paper, we propose a new pipeline with methods adapted from the image domain to automatically transfer the colour from a target point cloud to an input point cloud. These colour transfer methods are based on colour distributions and account for the geometry of the point clouds to produce a coherent result. The proposed methods rely on simple statistical analysis, are effective, and succeed in transferring the colour style from one point cloud to another. The qualitative results of the colour transfers are evaluated and compared with existing methods.
Supporting Information
Filename | Description |
---|---|
cgf14388-sup-0001-videoS1.mov23 MB | Video S1 |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- [ABA*16] Artusi A., Banterle F., Aydın T. O., Panozzo D., Sorkine-Hornung O.: Image Content Retargeting: Maintaining Color, Tone, and Spatial Consistency. CRC Press, 2016.
10.1201/9781315372624 Google Scholar
- [AE19] Alexiou E., Ebrahimi T.: Exploiting user interactivity in quality assessment of point cloud imaging. In 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) (2019), IEEE, pp. 1–6.
10.1109/QoMEX.2019.8743277 Google Scholar
- [BPC16] Bonneel N., Peyré G., Cuturi M.: Wasserstein barycentric coordinates: histogram regression using optimal transport. ACM Trans. Graph. 35, 4 (2016), 71–1.
- [CN19] Cao X., Nagao K.: Point cloud colorization based on densely annotated 3d shape dataset. In International Conference on Multimedia Modeling (2019), Springer, pp. 436–446.
10.1007/978-3-030-05710-7_36 Google Scholar
- [CWNN20] Cao X., Wang W., Nagao K., Nakamura R.: Psnet: A style transfer network for point cloud stylization on geometry and color. In The IEEE Winter Conference on Applications of Computer Vision (2020), pp. 3337–3345.
- [GD98] Grossman J. P., Dally W. J.: Point sample rendering. In Rendering Techniques' 98. Springer, 1998, pp. 181–192.
10.1007/978-3-7091-6453-2_17 Google Scholar
- [GEB16] Gatys L. A., Ecker A. S., Bethge M.: Image style transfer using convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 2414–2423.
- [GWH*19] Guo Y., Wang H., Hu Q., Liu H., Liu L., Bennamoun M.: Deep learning for 3d point clouds: a survey. arXiv preprint arXiv:1912.12033 (2019).
- [HLMCB15] Hristova H., Le Meur O., Cozot R., Bouatouch K.: Style-aware robust color transfer. In Computational Aesthetics (2015), pp. 67–77.
- [HLMCB17] Hristova H., Le Meur O., Cozot R., Bouatouch K.: Transformation of the multivariate generalized gaussian distribution for image editing. IEEE Transactions on Visualization and Computer Graphics 24, 10 (2017), 2813–2826.
- [HLMCB18] Hristova H., Le Meur O., Cozot R., Bouatouch K.: Transformation of the beta distribution for color transfer. In VISIGRAPP (GRAPP) (2018).
10.5220/0006610801120121 Google Scholar
- [HSDL*13] Hichri N., Stefani C., De Luca L., Veron P., Hamon G.: From point cloud to BIM: a survey of existing approaches. In XXIV International CIPA Symposium (Strasbourg, France, 2013), Proceedings of the XXIV International CIPA Symposium.
- [JAFF16] Johnson J., Alahi A., Fei-Fei L.: Perceptual losses for real-time style transfer and super-resolution. In European Conference on Computer Vision (2016), Springer, pp. 694–711.
10.1007/978-3-319-46475-6_43 Google Scholar
- [Jun05] Jun Y.: A piecewise hole filling algorithm in reverse engineering. Computer-aided Design 37, 2 (2005), 263–270.
- [KCAGS20] Kim B., Azevedo V. C., Gross M., Solenthaler B.: Lagrangian neural style transfer for fluids. ACM Transactions on Graphics 39, 4 (2020). https://doi.org/10.1145/3386569.3392473.
- [LW85] Levoy M., Whitted T.: The Use of Points as a Display Primitive. Citeseer, 1985.
- [MD04] Moenning C., Dodgson N. A.: Intrinsic point cloud simplification. Proc. 14th GrahiCon 14 (2004), 23.
- [MG08] Mérillou S., Ghazanfarpour D.: A survey of aging and weathering phenomena in computer graphics. Computers & Graphics 32, 2 (2008), 159–174.
- [MKC*06] Mertens T., Kautz J., Chen J., Bekaert P., Durand F.: Texture transfer using geometry correlation. Rendering Techniques 273, 10.2312 (2006), 273–284.
- [Mro19] Mroueh Y.: Wasserstein style transfer. arXiv preprint arXiv:1905.12828 (2019).
- [NN05] Neumann L., Neumann A.: Color style transfer techniques using hue, lightness and saturation histogram matching. In Computational Aesthetics (2005), Citeseer, pp. 111–122.
- [PGA01] Pieraccini M., Guidi G., Atzeni C.: 3d digitizing of cultural heritage. Journal of Cultural Heritage 2, 1 (2001), 63–70.
- [PK07] Pitie F., Kokaram A.: The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer. 4th European Conference on Visual Media Production (2007) pp. 1–9, https://doi.org/10.1049/cp:20070055.
- [PR10] Pouli T., Reinhard E.: Progressive histogram reshaping for creative color transfer and tone reproduction. In Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering (2010), pp. 81–90.
10.1145/1809939.1809949 Google Scholar
- [QL15] Quinsat Y., Lartigue C.: Filling holes in digitized point cloud using a morphing-based approach to preserve volume characteristics. The International Journal of Advanced Manufacturing Technology 81, 1-4 (2015), 411–421.
- [QSMG17] Qi C. R., Su H., Mo K., Guibas L. J.: Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (2017), pp. 652–660.
- [RAGS01] Reinhard E., Adhikhmin M., Gooch B., Shirley P.: Color transfer between images. IEEE Computer Graphics and Applications 21, 5 (2001), 34–41.
- [RCC98] Ruderman D. L., Cronin T. W., Chiao C.-C.: Statistics of cone responses to natural images: implications for visual coding. JOSA A 15, 8 (1998), 2036–2045.
- [RL08] Rosenthal P., Linsen L.: Image-space point cloud rendering. In Proceedings of Computer Graphics International (2008), pp. 136–143.
- [SPB*19] Sabbadin M., Palma G., Banterle F., Boubekeur T., Cignoni P.: High dynamic range point clouds for real-time relighting. Computer Graphics Forum (2019), 38, 513–525.
- [SW15] Schütz M., Wimmer M.: High-quality point-based rendering using fast single-pass interpolation. In 2015 Digital Heritage (2015), vol. 1, IEEE, pp. 369–372.
10.1109/DigitalHeritage.2015.7413904 Google Scholar
- [TFK*20] Texler O., Futschik D., Kučera M., Jamriška O., Sochorová Š., Chai M., Tulyakov S., Sỳkora D.: Interactive video stylization using few-shot patch-based training. arXiv preprint arXiv:2004.14489 (2020).
- [WCK15] Wang C., Cho Y. K., Kim C.: Automatic bim component extraction from point clouds of existing buildings for sustainability applications. Automation in Construction 56 (2015), 1–13.
- [XNYC04] Xu H., Nguyen M. X., Yuan X., Chen B.: Interactive silhouette rendering for point-based models. In Proceedings of the First Eurographics conference on Point-Based Graphics (2004), Eurographics Association, pp. 13–18.
- [Yas07] Yastikli N.: Documentation of cultural heritage using digital photogrammetry and laser scanning. Journal of Cultural Heritage 8, 4 (2007), 423–427.