Neural Modelling of Flower Bas-relief from 2D Line Drawing
Corresponding Author
Yu-Wei Zhang
School of Mechanical and Automotive Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Search for more papers by this authorJinlei Wang
School of Mechanical and Automotive Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Search for more papers by this authorWenping Wang
Department of Computer Science, the University of Hong Kong, Hong Kong, China
Search for more papers by this authorYanzhao Chen
School of Mechanical and Automotive Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Search for more papers by this authorHui Liu
School of Computer Science and Technology, Shandong University of Finance and Economics, Jinan, China
Search for more papers by this authorZhongping Ji
Institute of Graphics and Image, Hangzhou Dianzi University, Hangzhou, China
Search for more papers by this authorCaiming Zhang
School of Computer Science and Technology, Shandong University, Jinan, China
Search for more papers by this authorCorresponding Author
Yu-Wei Zhang
School of Mechanical and Automotive Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Search for more papers by this authorJinlei Wang
School of Mechanical and Automotive Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Search for more papers by this authorWenping Wang
Department of Computer Science, the University of Hong Kong, Hong Kong, China
Search for more papers by this authorYanzhao Chen
School of Mechanical and Automotive Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
Search for more papers by this authorHui Liu
School of Computer Science and Technology, Shandong University of Finance and Economics, Jinan, China
Search for more papers by this authorZhongping Ji
Institute of Graphics and Image, Hangzhou Dianzi University, Hangzhou, China
Search for more papers by this authorCaiming Zhang
School of Computer Science and Technology, Shandong University, Jinan, China
Search for more papers by this authorAbstract
Different from other types of bas-reliefs, a flower bas-relief contains a large number of depth-discontinuity edges. Most existing line-based methods reconstruct free-form surfaces by ignoring the depth-discontinuities, thus are less efficient in modeling flower bas-reliefs. This paper presents a neural-based solution which benefits from the recent advances in CNN. Specially, we use line gradients to encode the depth orderings at leaf edges. Given a line drawing, a heuristic method is first proposed to compute 2D gradients at lines. Line gradients and dense curvatures interpolated from sparse user inputs are then fed into a neural network, which outputs depths and normals of the final bas-relief. In addition, we introduce an object-based method to generate flower bas-reliefs and line drawings for network training. Extensive experiments show that our method is effective in modelling bas-reliefs with depth-discontinuity edges. User evaluation also shows that our method is intuitive and accessible to common users.
Supporting Information
| Filename | Description |
|---|---|
| cgf14273-sup-0001-Demo.mp45.2 MB | Video S1 |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- [BH11] Bian Z., Hu S.-M.: Preserving detailed features in digital bas-relief making. Computer Aided Geometric Design 28, 4 (2011), 245–256.
- [BS08] Botsch M., Sorkine O.: On linear variational surface deformation methods. IEEE Transactions on Visualization and Computer Graphics 14, 1 (2008), 213–230.
- [BSCH18] Bobenrieth C., Seo H., Cordier F., Habibi A.: Reconstructing flowers from sketches. Computer Graphics Forum 37, 7 (2018), 167–178.
- [DAI*18] Delanoy J., Aubry M., Isola P., Efros A., Bousseau A.: 3d sketching using multi-view deep volumetric prediction. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 21 (May 2018).
- [HGPS18] Hudon M., Grogan M., Pages R., Smolic A.: Deep normal estimation for automatic shading of hand-drawn characters. In European Conference on Computer Vision Workshops (2018).
- [IBB15] Iarussi E., Bommes D., Bousseau A.: Bendfields: regularized curvature fields from rough concept sketches. ACM Transactions on Graphics 34, 3 (2015), 1–16.
- [JFS*] Ji Z., Feng W., Sun X., Qin F., Wang Y., Zhang Y.-W., Ma W.: Reliefnet: fast bas-relief generation from 3d scenes. Computer-Aided Design. (2020).
- [JMS13] Ji Z., Ma W., Sun X.: Bas-relief modeling from normal images with intuitive styles. IEEE Transactions on Visualization and Computer Graphics 20, 5 (2013), 675–685.
- [KB14] Kingma D., Ba J.: Adam: a method for stochastic optimization. Computer Science (2014).
- [KLST13] Kolomenkin M., Leifman G., Shimshoni I., Tal A.: Reconstruction of relief objects from line drawings. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on (2013).
- [LGK*17] Lun Z., Gadelha M., Kalogerakis E., Maji S., Wang R.: 3d shape reconstruction from sketches via multi-view convolutional networks. International Conference on 3D Vision (3DV) (2017), 67–77.
10.1109/3DV.2017.00018 Google Scholar
- [LJZX] Liu Y., Ji Z., Zhang Y.-W., Xu G.: Example-driven modeling of portrait bas-relief. Computer Aided Geometric Design. (2020).
- [LPL*] Li C., Pan H., Liu Y., Tong X., Sheffer A., Wang W.: Bendsketch: modeling freeform surfaces through 2d sketching. ACM Transactions on Graphics 36 (2017), 125.
- [LPL*18] Li C., Pan H., Liu Y., Tong X., Sheffer A., Wang W.: Robust flow-guided neural prediction for sketch-based freeform surface modeling. ACM Transactions on Graphics 37, 6 (2018), 1–12.
- [LWYM12] Li Z., Wang S., Yu J., Ma K.-L.: Restoration of brick and stone relief from single rubbing images. IEEE Transactions on Visualization and Computer Graphics 18, 2 (2012), 177–187.
- [RMP11] Reichinger A., Maierhofer S., Purgathofer W.: High-quality tactile paintings. Journal on Computing and Cultural Heritage 4, 2 (2011), 5.
- [SAGS13] Shtof A., Agathos A., Gingold Y., Shamir A.: Geosemantic snapping for sketch-based modeling. Computer Graphics Forum 32, (2013), 245–253.
- [SDY*18] Su W., Du D., Yang X., Zhou S., Fu H.: Interactive sketch-based normal map generation with deep neural networks. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1 (07 2018), 1–17.
- [SKC*14] Sykora D., Kavan L., Cadik M., Jamriska O., Jacobson A., Whited B., Simmons M., Sorkine-Hornung O.: Ink-and-ray: bas-relief meshes for adding global illumination effects to hand-drawn characters. ACM Transactions on Graphics 33, 2 (2014), 1–15.
- [SPSH14] Schüller C., Panozzo D., Sorkine-Hornung O.: Appearance-mimicking surfaces. ACM Transactions on Graphics 33, 6 (2014), 1–10.
- [SRML09] Sun X., Rosin P. L., Martin R. R., Langbein F. C.: Bas-relief generation using adaptive histogram equalization. IEEE Transactions on Visualization and Computer Graphics 15, 4 (2009), 642–653.
- [WDB*07] Weyrich T., Deng J., Barnes C., Rusinkiewicz S., Finkelstein A.: Digital bas-relief from 3d scenes. ACM Transactions on Graphics 26, 3 (2007), 32–38.
- [XWJ*20] Xiang N., Wang R., Jiang T., Wang L., Zhang J.: Sketch-based modeling with a differentiable renderer. Computer Animation and Virtual Worlds 31, 4-5 (2020).
- [YHJ*17] Yeh C.-K., Huang S. Y., Jayaraman P. K., Fu C. W., Lee T. Y.: Interactive high-relief reconstruction for organic and double-sided objects from a photo. IEEE Transactions on Visualization and Computer Graphics 23, 7 (2017), 1796–1808.
- [YJL*15] Yeh C.-K., Jayaraman P. K., Liu X., Fu C.-W., Lee T.-Y.: 2.5D Cartoon hair modeling and manipulation. IEEE Transactions on Visualization and Computer Graphics 21, 3 (2015), 304–314.
- [ZCL*] Zhang Y.-W., Chen Y., Liu H., Ji Z., Zhang C.: Modeling chinese calligraphy reliefs from one image. Computers and Graphics 70, (2017), 300–306.
- [ZGZS20] Zhong Y., Gryaditskaya Y., Zhang H., Song Y. Z.: Deep sketch-based modeling: tips and tricks. 3DV (2020).
- [ZQC*19] Zhang Y.-W., Qin B.-b., Chen Y., Ji Z., Zhang C.: Portrait relief generation from 3d object. Graphical Models 102 (2019), 10–18.
- [ZQG*20] Zhong Y., Qi Y., Gryaditskaya Y., Zhang H., Song Y. Z.: Towards practical sketch-based 3d shape generation: the role of professional sketches. IEEE Transactions on Circuits and Systems for Video Technology (2020).
10.1109/TCSVT.2020.3040900 Google Scholar
- [ZS84] Zhang T. Y., Suen C. Y.: A fast parallel algorithm for thinning digital patterns. Communications of the ACM 27, 3 (1984), 236–239.
- [ZWJ*19] Zhang Y.-W., Wu J., Ji Z., Wei M., Zhang C.: Computer-assisted relief modelling: a comprehensive survey. In Computer Graphics Forum 38, 2 (2019), 521–534.
- [ZWZ*20] Zhang Y.-W., Wang J., Zhang C., Wenfei L., Liu H., Chen Y.: A fast solution for chinese calligraphy relief modeling from 2d handwriting image. The Visual Computer (2020), 1–10.
- [ZZL*15] Zhang Y.-W., Zhou Y.-Q., Li X.-L., Liu H., Zhang L.-L.: Bas-relief generation and shape editing through gradient-based mesh deformation. IEEE Transactions on Visualization and Computer Graphics 21, 3 (2015), 328–338.
- [ZZW*20] Zhang Y.-W., Zhang C., Wang W., Chen Y., Ji Z., Hui L.: Portrait relief modeling from a single image. IEEE Transactions on Visualization and Computer Graphics 26, 8 (2020), 2659–2670.
- [ZZWC16] Zhang Y.-W., Zhang C., Wang W., Chen Y.: Adaptive bas-relief generation from 3d object under illumination. Computer Graphics Forum 35, 7 (2016), 311–321.
