Fashion Transfer: Dressing 3D Characters from Stylized Fashion Sketches
Corresponding Author
Amelie Fondevilla
IRIT, Université de Toulouse, CNRS, INPT, UPS, UT1, UT2J, Toulouse, France
Search for more papers by this authorStefanie Hahmann
Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LJK, Grenoble, France
Search for more papers by this authorAdrien Bousseau
Inria, Université Côte d'Azur, Côte d'Azur, France
Search for more papers by this authorMarie-Paule Cani
LIX, Ecole Polytechnique/CNRS, IP Paris, France
Search for more papers by this authorCorresponding Author
Amelie Fondevilla
IRIT, Université de Toulouse, CNRS, INPT, UPS, UT1, UT2J, Toulouse, France
Search for more papers by this authorStefanie Hahmann
Univ. Grenoble Alpes, CNRS, Inria, Grenoble INP, LJK, Grenoble, France
Search for more papers by this authorAdrien Bousseau
Inria, Université Côte d'Azur, Côte d'Azur, France
Search for more papers by this authorMarie-Paule Cani
LIX, Ecole Polytechnique/CNRS, IP Paris, France
Search for more papers by this authorAbstract
Fashion design often starts with hand-drawn, expressive sketches that communicate the essence of a garment over idealized human bodies. We propose an approach to automatically dress virtual characters from such input, previously complemented with user-annotations. In contrast to prior work requiring users to draw garments with accurate proportions over each virtual character to be dressed, our method follows a style transfer strategy : the information extracted from a single, annotated fashion sketch can be used to inform the synthesis of one to many new garment(s) with similar style, yet different proportions. In particular, we define the style of a loose garment from its silhouette and folds, which we extract from the drawing. Key to our method is our strategy to extract both shape and repetitive patterns of folds from the 2D input. As our results show, each input sketch can be used to dress a variety of characters of different morphologies, from virtual humans to cartoon-style characters.
Supporting Information
Filename | Description |
---|---|
cgf14390-sup-0001-videoS1.mp43.5 MB | Video S1 |
cgf14390-sup-0002-videoS1.mp413.1 MB | Video S2 |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- [BSBC12] Brouet R., Sheffer A., Boissieux L., Cani M.-P.: Design preserving garment transfer. ACM Transactions on Graphics 31, 4 (2012), 1–11.
- [BSK*16] Bartle A., Sheffer A., Kim V. G., Kaufman D. M., Vining N., Berthouzoz F.: Physics-driven pattern adjustment for direct 3D garment editing. ACM Transactions on Graphics 35, 4 (2016), 50–1.
- [BWK03] Baraff D., Witkin A., Kass M.: Untangling cloth. ACM Transactions on Graphics 22, 3 (2003), 862–870.
- [Clo] Clo3D: Clo Virtual Fashion. https://www.clo3d.com/.
- [CSE*16] Cordier F., Singh K., Etem E., Cani M.-P., Gingold Y.: Sketch-based modeling. In Proceedings of the 37th Annual Conference of the European Association for Computer Graphics: Tutorials (2016), EG '16, pp. 7:1–7:1.
- [CSMS13] Cordier F., Seo H., Melkemi M., Sapidis N. S.: Inferring mirror symmetric 3D shapes from sketches. Computer-Aided Design 45, 2 (2013), 301–311. Solid and Physical Modeling 2012.
- [DAI*18] Delanoy J., Aubry M., Isola P., Efros A., Bousseau A.: 3D sketching using multi-view deep volumetric prediction. Proceedings of ACM on Computer Graphics and Interactive Techniques 1, 1 (2018).
- [DBB*17] Dvorožňák M., Bénard P., Barla P., Wang O., Sỳkora D.: Example-based expressive animation of 2D rigid bodies. ACM Transactions on Graphics 36, 4 (2017), 1–10.
- [DDÖ*17] Danecek R., Dibra E., Öztireli A. C., Ziegler R., Gross M.: Deepgarment: 3D garment shape estimation from a single image. Computer Graphics Forum (Proceedings of Eurographics) 36, 2 (2017), 269–280.
- [DJW*06] Decaudin P., Julius D., Wither J., Boissieux L., Sheffer A., Cani M.-P.: Virtual garments: a fully geometric approach for clothing design. Computer Graphics Forum 25, 3 (2006), 625–634.
- [DP73] Douglas D. H., Peucker T. K.: Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Cartographica: The International Journal for Geographic Information and Geovisualization 10, 2 (1973), 112–122.
10.3138/FM57-6770-U75U-7727 Google Scholar
- [DPS15] De Paoli C., Singh K.: Secondskin: sketch-based construction of layered 3D models. ACM Transactions on Graphics 34, 4 (2015), 126.
- [FBR*17] Fondevilla A., Bousseau A., Rohmer D., Hahmann S., Cani M.-P.: Patterns from photograph: reverse-engineering developable products. Computers & Graphics 66 (2017), 4–13.
- [FJL*16] Fišer J., Jamriška O., Lukáč M., Shechtman E., Asente P., Lu J., Sỳkora D.: Stylit: illumination-guided example-based stylization of 3D renderings. ACM Transactions on Graphics 35, 4 (2016), 1–11.
- [FLB16] Favreau J.-D., Lafarge F., Bousseau A.: Fidelity vs. simplicity: a global approach to line drawing vectorization. ACM Transactions on Graphics 35, 4 (2016), 1–10.
- [GFL03] Groß C., Fuhrmann A., Luckas V.: Automatic pre-positioning of virtual clothing. In Proceedings of the 19th Spring Conference on Computer Graphics (New York, NY, USA, 2003), SCCG '03, ACM, pp. 99–108.
10.1145/984952.984970 Google Scholar
- [GRH*12] Guan P., Reiss L., Hirshberg D., Weiss A., Black M.: Drape: Dressing any person. ACM Transactions on Graphics 31, 4 (2012), 1–10.
- [HJO*01] Hertzmann A., Jacobs C. E., Oliver N., Curless B., Salesin D. H.: Image analogies. In of the 28th Annual Conference on Computer Graphics and Interactive Techniques (2001), SIGGRAPH '01, ACM, pp. 327–340.
10.1145/383259.383295 Google Scholar
- [IMT99] Igarashi T., Matsuoka S., Tanaka H.: Teddy: a sketching interface for 3D freeform design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (1999), SIGGRAPH '99, pp. 409–416.
10.1145/311535.311602 Google Scholar
- [JHR*15] Jung A., Hahmann S., Rohmer D., Begault A., Boissieux L., Cani M.-P.: Sketching folds: developable surfaces from non-planar silhouettes. ACM Transactions on Graphics 34, 5 (2015), 155.
- [JYSL19] Jiang L., Ye J., Sun L., Li J.: Transferring and fitting fixed-sized garments onto bodies of various dimensions and postures. Computer-Aided Design 106 (2019), 30–42.
- [JZH*20] Jiang B., Zhang J., Hong Y., Luo J., Liu L., Bao H.: Bcnet: Learning body and cloth shape from a single image. In Computer Vision – ECCV 2020 (Cham, 2020), A. Vedaldi, H. Bischof, T. Brox, J.-M. Frahm, (Eds.), Springer International Publishing, pp. 18–35.
- [LCBD*18] Ly M., Casati R., Bertails-Descoubes F., Skouras M., Boissieux L.: Inverse elastic shell design with contact and friction. ACM Transactions on Graphics 37 (2018), 1–16.
- [LKWS16] Lun Z., Kalogerakis E., Wang R., Sheffer A.: Functionality preserving shape style transfer. ACM Transactions on Graphics 35, 6 (2016), 209.
- [LL14] Li J., Lu G.: Modeling 3D garments by examples. Computer-Aided Design 49 (2014), 28–41.
- [LPL*17] Li C., Pan H., Liu Y., Tong X., Sheffer A., Wang W.: Bendsketch: modeling freeform surfaces through 2D sketching. ACM Transactions on Graphics 36, 4 (2017), 125.
- [LSGV18] Li M., Sheffer A., Grinspun E., Vining N.: Foldsketch: enriching garments with physically reproducible folds. ACM Transactions on Graphics 37, 4 (2018), 1–13.
- [LYW*10] Li J., Ye J., Wang Y., Bai L., Lu G.: Fitting 3D garment models onto individual human models. Computers & Graphics 34, 6 (2010), 742–755.
- [LZY10] Liu Y.-J., Zhang D.-L., Yuen M.: A survey on CAD methods in 3D garment design. Computers in Industry 61 (2010), 576–593.
- [Mar] MarvelousDesigner: Clo Virtual Fashion. https://www.marvelousdesigner.com/.
- [MWJ12] Meng Y., Wang C. C., Jin X.: Flexible shape control for automatic resizing of apparel products. Computer-Aided Design 44, 1 (2012), 68–76.
- [NISA07] Nealen A., Igarashi T., Sorkine O., Alexa M.: Fibermesh: Designing freeform surfaces with 3D curves. ACM Transactions on Graphics 26, 3 (2007), 41–es.
- [Opt] Optitex: EFI Optitex. https://optitex.com/.
- [OSJ11] Olsen L., Samavati F., Jorge J.: Naturasketch: Modeling from images and natural sketches. IEEE Computer Graphics and Applications 31, 6 (2011), 24–34.
- [OSSJ09] Olsen L., Samavati F. F., Sousa M. C., Jorge J. A.: Sketch-based modeling: a survey. Computers & Graphics 33, 1 (2009), 85–103.
- [PMPHB17] Pons-Moll G., Pujades S., Hu S., Black M.: Clothcap: Seamless 4D clothing capture and retargeting. ACM Transactions on Graphics 36, 4 (2017), 1–15.
- [RMSC11] Robson C., Maharik R., Sheffer A., Carr N.: Context-aware garment modeling from sketches. Computers & Graphics 35, 3 (2011), 604–613.
- [RPC*10] Rohmer D., Popa T., Cani M.-P., Hahmann S., Sheffer A.: Animation wrinkling: augmenting coarse cloth simulations with realistic-looking wrinkles. ACM Transactions on Graphics 29, 6 (2010), 157–157.
- [SBS19] Smirnov D., Bessmeltsev M., Solomon J.: Deep sketch-based modeling of man-made shapes. ArXiv abs/1906.12337 (2019).
- [SCF*04] Sederberg T. W., Cardon D. L., Finnigan G. T., North N. S., Zheng J., Lyche T.: T-spline simplification and local refinement. ACM Transactions on Graphics 23, 3 (2004), 276–283.
- [SKSK09] Schmidt R., Khan A., Singh K., Kurtenbach G.: Analytic drawing of 3D scaffolds. ACM Transactions on Graphics 28, 5 (2009), 1–10.
- [SKv*14] Sýkora D., Kavan L., Čadík M., Jamriška O., Jacobson A., Whited B., Simmons M., Sorkine-Hornung O.: Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters. ACM Transactions on Graphics 33, 2 (2014), 1–15.
- [TCH07] Turquin E., Cani M.-P., Hughes J. F.: Sketching garments for virtual characters. In Proceedings of Eurographics Workshop on Sketch-Based Interfaces and Modeling (2007), pp. 175–182.
- [TWB*07] Turquin E., Wither J., Boissieux L., Cani M.-P., Hughes J. F.: A sketch-based interface for clothing virtual characters. IEEE Computer Graphics and Applications 27, 1 (2007), 72–81.
- [UKIG11] Umetani N., Kaufman D. M., Igarashi T., Grinspun E.: Sensitive couture for interactive garment modeling and editing. ACM Transactions on Graphics 30, 4 (2011), 1–12.
- [VCMT05] Volino P., Cordier F., Magnenat-Thalmann N.: From early virtual garment simulation to interactive fashion design. Computer-Aided Design 37, 6 (2005), 593–608.
- [Wan08] Wang C. C. L.: Towards flattenable mesh surfaces. Computer-Aided Design 40, 1 (2008), 109–122.
- [Wat09] Watanabe N.: Contemporary Fashion Illustration Techniques. Rockport Publishers, 2009.
- [WCPM18] Wang T. Y., Ceylan D., Popović J., Mitra N. J.: Learning a shared shape space for multimodal garment design. ACM Transactions on Graphics 37, 6 (2018), 1–13.
- [WHRO10] Wang H., Hecht F., Ramamoorthi R., O'Brien J. F.: Example-based wrinkle synthesis for clothing animation. ACM Transactions on Graphics 29, 4 (2010), 1–8.
- [WLL*09] Wang J., Lu G., Li W., Chen L., Sakaguti Y.: Interactive 3D garment design with constrained contour curves and style curves. Computer-Aided Design 41, 9 (2009), 614–625.
- [WWY03] Wang C. C., Wang Y., Yuen M. M.: Feature based 3D garment design through 2D sketches. Computer-Aided Design 35, 7 (2003), 659–672.
- [XCS*14] Xu B., Chang W., Sheffer A., Bousseau A., McCrae J., Singh K.: True2Form: 3D curve networks from 2D sketches via selective regularization. ACM Transactions on Graphics 33, 4 (2014), 1–13.
- [YPA*18] Yang S., Pan Z., Amert T., Wang K., Yu L., Berg T., Lin M. C.: Physics-inspired garment recovery from a single-view image. ACM Transactions on Graphics 37, 5 (2018), 1–14.