Learning A Stroke-Based Representation for Fonts
Elena Balashova
Department of Computer Science, Princeton University, Princeton, NJ USA
Search for more papers by this authorAmit H. Bermano
Department of Computer Science, Princeton University, Princeton, NJ USA
Search for more papers by this authorThomas Funkhouser
Department of Computer Science, Princeton University, Princeton, NJ USA
Search for more papers by this authorElena Balashova
Department of Computer Science, Princeton University, Princeton, NJ USA
Search for more papers by this authorAmit H. Bermano
Department of Computer Science, Princeton University, Princeton, NJ USA
Search for more papers by this authorThomas Funkhouser
Department of Computer Science, Princeton University, Princeton, NJ USA
Search for more papers by this authorAbstract
Designing fonts and typefaces is a difficult process for both beginner and expert typographers. Existing workflows require the designer to create every glyph, while adhering to many loosely defined design suggestions to achieve an aesthetically appealing and coherent character set. This process can be significantly simplified by exploiting the similar structure character glyphs present across different fonts and the shared stylistic elements within the same font. To capture these correlations, we propose learning a stroke-based font representation from a collection of existing typefaces. To enable this, we develop a stroke-based geometric model for glyphs, a fitting procedure to reparametrize arbitrary fonts to our representation. We demonstrate the effectiveness of our model through a manifold learning technique that estimates a low-dimensional font space. Our representation captures a wide range of everyday fonts with topological variations and naturally handles discrete and continuous variations, such as presence and absence of stylistic elements as well as slants and weights. We show that our learned representation can be used for iteratively improving fit quality, as well as exploratory style applications such as completing a font from a subset of observed glyphs, interpolating or adding and removing stylistic elements in existing fonts.
Supporting Information
| Filename | Description |
|---|---|
| cgf13540-sup-0001-index.pdf5.5 MB |
Figure 1: Visualization of templates used by our system. Figure 2: Mean Hausdorff error for many-to-one completion. |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- [Ada86] Adams D. A.: A Dialogue of Forms: Letter and Digital Font Design. PhD thesis, Massachusetts Institute of Technology, 1986.
- [Ada89] Adams D.: abcdefg (A better constraint driven environment for font generation). In Proceedings of International Conference on Raster Imaging and Digital Typography (Lausanne, Switzerland, 1989), pp. 54–70.
- [Ado97] Adobe: Designing multiple master typefaces. Tech. Rep., 1997.
- [as8] as8: Typography & type design. Available at http://www.as8.it/edu/typography.html. Accessed April 9, 2018.
- [AXZ*15] Alhashim I., Xu K., Zhuang Y., Cao J., Simari P., Zhang H.: Deformation-driven topology-varying 3D shape correspondence. ACM Transactions on Graphics 34, 6 (Oct.2015), 236:1–236:13. https://doi.org/10.1145/2816795.2818088.
- [Bel15] Bellman R. E.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton, 2015.
- [Car95] Carter S.: Twentieth Century Type Designers. Lund Humphries, London, 1995.
- [CK14] Campbell N. D., Kautz J.: Learning a manifold of fonts. ACM Transactions on Graphics 33, 4 (2014), 91:1–91:11.
- [EHN*98] Ennis M., Hinton G., Naylor D., Revow M., Tibshirani R.: A comparison of statistical learning methods on the gusto database. Statistics in Medicine 17, 21 (1998), 2501–2508.
10.1002/(SICI)1097-0258(19981115)17:21<2501::AID-SIM938>3.0.CO;2-M CAS PubMed Web of Science® Google Scholar
- [Fon17] Fonts.: Fonts database. Available at http://www.1001fonts.com/. Accessed September 1, 2016.
- [Gon98]
Gonczarowski J.: Producing the skeleton of a character. In Electronic Publishing, Artistic Imaging, and Digital Typography. Springer, Berlin Heidelberg (1998), pp. 66–76.
10.1007/BFb0053263 Google Scholar
- [HB91]
Hersch R. D., Bétrisey C.: Model-based matching and hinting of fonts. ACM SIGGRAPH Computer Graphics 25 (1991) 71–80.
10.1145/127719.122726 Google Scholar
- [Her94]
Hersch R. D.: Font rasterization: The state of the art. In From Object Modelling to Advanced Visual Communication. Springer, New York (1994), pp. 274–296.
10.1007/978-3-642-78291-6_9 Google Scholar
- [HH01] Hu C., Hersch R. D.: Parameterizable fonts based on shape components. IEEE Computer Graphics and Applications 21, 3 (2001), 70–85.
- [hin] Typotheque: Font hinting. Available at https://www.typotheque.com/articles/hinting. Accessed April 9, 2018.
- [JPF06]
Jakubiak E. J., Perry R. N., Frisken S. F.: An improved representation for stroke-based fonts. In Proceedings of ACM SIGGRAPH (Boston, MA, USA, 2006), vol. 4.
10.1145/1179849.1180020 Google Scholar
- [KCKK12] Kalogerakis E., Chaudhuri S., Koller D., Koltun V.: A probabilistic model for component-based shape synthesis. ACM Transactions on Graphics 31, 4 (2012), 55:1–55:11.
- [KLM*13] Kim V. G., Li W., Mitra N. J., Chaudhuri S., DiVerdi S., Funkhouser T.: Learning part-based templates from large collections of 3D shapes. ACM Transactions on Graphics 32, 4 (2013), 70:1–70:12.
- [Knu86] Knuth D. E.: METAFONT: The Program. Addison-Wesley, Reading, MA, 1986.
- [KW13] Kingma D. P., Welling M.: Auto-encoding variational Bayes. arXiv preprint arXiv:1312.6114, 2013.
- [LHLF15] Liu T., Hertzmann A., Li W., Funkhouser T.: Style compatibility for 3D furniture models. ACM Transactions on Graphics 34, 4 (2015), 85:1–85:9.
- [LKS15] Lun Z., Kalogerakis E., Sheffer A.: Elements of style: Learning perceptual shape style similarity. ACM Transactions on Graphics 34, 4 (2015), 84:1–84:14.
- [LKWS16] Lun Z., Kalogerakis E., Wang R., Sheffer A.: Functionality preserving shape style transfer. ACM Transactions on Graphics 35, 6 (2016), 209:1–209:14.
- [LZX16] Lian Z., Zhao B., Xiao J.: Automatic generation of large-scale handwriting fonts via style learning. In SIGGRAPH ASIA 2016 Technical Briefs (2016), ACM, pp. 12:1–12:14.
10.1145/3005358.3005371 Google Scholar
- [Mic16] Microsoft: Opentype font variations. Available at https://www.microsoft.com/typography/otspec180/otvaroverview.htm. Accessed September 1, 2016.
- [MSCP*07] Myronenko A., Song X., Carreira-Perpinán M. A.: Non-rigid point set registration: Coherent point drift. Advances in Neural Information Processing Systems 19 (2007), 1009–1016.
- [NFC07]
Navaratnam R., Fitzgibbon A. W., Cipolla R.: The joint manifold model for semi-supervised multi-valued regression. In Proceedings of IEEE 11th International Conference on Computer Vision (Rio de Janeiro, Brazil, Oct. 2007), pp. 1–8. https://doi.org/10.1109/ICCV.2007.4408976.
10.1109/ICCV.2007.4408976 Google Scholar
- [OST14] Osterer H., Stamm P., Typographie S.: Adrian Frutiger – Typefaces: The Complete Works. Birkhäuser, Basel, 2014.
10.1515/9783038212638 Google Scholar
- [PFC15] Phan H. Q., Fu H., Chan A. B.: Flexyfont: Learning transferring rules for flexible typeface synthesis. Computer Graphics Forum 34 (2015), 245–256.
- [PPS03] Perlich C., Provost F., Simonoff J. S.: Tree induction vs. logistic regression: A learning-curve analysis. Journal of Machine Learning Research 4, (2003), 211–255.
- [PSS01]
Praun E., Sweldens W., Schröder P.: Consistent mesh parameterizations. In SIGGRAPH '01: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (Los Angeles, CA, USA, 2001), ACM, pp. 179–184. https://doi.org/10.1145/383259.383277.
10.1145/383259.383277 Google Scholar
- [Row98] Roweis S. T.: EM algorithms for PCA and SPCA. In Advances in Neural Information Processing Systems 10. M. I. Jordan, M. J. Kearns and S. A. Solla (Eds.). MIT Press, Cambridge, MA (1998), pp. 626–632.
- [SI10]
Suveeranont R., Igarashi T.: Example-based automatic font generation. In Proceedings of Smart Graphics, LNCS (Banff, AB, Canada, 2010), pp. 127–138.
10.1007/978-3-642-13544-6_12 Google Scholar
- [SKG*05] Scholz M., Kaplan F., Guy C. L., Kopka J., Selbig J.: Non-linear PCA: A missing data approach. Bioinformatics 21, 20 (2005), 3887–3895.
- [SR98]
Shamir A., Rappoport A.: Feature-based design of fonts using constraints. In Electronic Publishing, Artistic Imaging, and Digital Typography. Springer, Berlin Heidelberg (1998), pp. 93–108.
10.1007/BFb0053265 Google Scholar
- [SR99] Shamir A., Rappoport A.: Compacting oriental fonts by optimizing parametric elements. Visual Computer 15, 6 (1999), 302–318.
- [SSCO08] Shapira L., Shamir A., Cohen-Or D.: Consistent mesh partitioning and skeletonisation using the shape diameter function. Visual Computer 24, 4 (2008), 249. https://doi.org/10.1007/s00371-007-0197-5.
- [TLZJ17]
Tran L., Liu X., Zhou J., Jin R.: Missing modalities imputation via cascaded residual autoencoder. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (Honolulu, HI, USA, 2017), pp. 1405–1414.
10.1109/CVPR.2017.528 Google Scholar
- [Tra03] Tracy W.: Letters of Credit: A View of Type Design. David R. Godine Publisher, Boston, 2003.
- [Tsc98] Tschichold J.: The new typography: a handbook for modern designers (vol. 8). University of California Press, Berkeley, CA, 1998.
- [USB16] Upchurch P., Snavely N., Bala K.: From a to z: Supervised transfer of style and content using deep neural network generators. arXiv preprint arXiv:1603.02003, 2016.
- [VLBM08] Vincent P., Larochelle H., Bengio Y., Manzagol P.-A.: Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th International Conference on Machine Learning (Helsinki, Finland, 2008), ACM, pp. 1096–1103.
10.1145/1390156.1390294 Google Scholar
- [WHWW14]
Wang W., Huang Y., Wang Y., Wang L.: Generalized autoencoder: A neural network framework for dimensionality reduction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (Columbus, OH, USA, 2014), pp. 490–497.
10.1109/CVPRW.2014.79 Google Scholar
- [WYJ*15] Wang Z., Yang J., Jin H., Shechtman E., Agarwala A., Brandt J., Huang T. S.: Deepfont: Identify your font from an image. In Proceedings of the 23rd ACM International Conference on Multimedia (Brisbane, Australia, 2015), ACM, pp. 451–459.
10.1145/2733373.2806219 Google Scholar
- [Zap87] Zapf H.: Hermann Zapf & His Design Philosophy: Selected Articles and Lectures on Calligraphy and Contemporary Developments in Type Design, with Illustrations and Bibliographical Notes, and a Complete List of His Typefaces. Society of Typographic Arts, Chicago, IL, 1987.
