Parametric Generation of Facial Expressions Based on FACS
A. Wojdeł,
L. J. M. Rothkrantz,
A. Wojdeł
Man-Machine Interaction Group, Delft University of Technology, The Netherlands
Search for more papers by this authorL. J. M. Rothkrantz
Man-Machine Interaction Group, Delft University of Technology, The Netherlands
Search for more papers by this authorA. Wojdeł,
L. J. M. Rothkrantz,
A. Wojdeł
Man-Machine Interaction Group, Delft University of Technology, The Netherlands
Search for more papers by this authorL. J. M. Rothkrantz
Man-Machine Interaction Group, Delft University of Technology, The Netherlands
Search for more papers by this authorAbstract
This paper presents a parametric performance-based model for facial animation that was inspired by Facial Action Coding System (FACS) developed by P. Ekman and F. W. Friesen. The FACS consists of 44 Action Units (AUs) corresponding to visual changes on the face. Additionally, predefined co-occurrence rules describe how different AUs influence each other. In our model, each facial animation parameter corresponds to one of the AUs as defined in FACS. Implementation of the model is completed with methods for accumulating displacement from separate AUs together, and fuzzy-logical adaptation of co-occurrence rules from the FACS. We also describe the method for adapting our model to a specific person.
References
- 1 C. Benoît and T. K. S. Mohamadi. Audio-visual intelligibility of french speech in noise. Journal of Speech and Hearing Research, 37, 1195–1203, 1994.
- 2 J. Jiang, A. Alwan, E. Auer, and L. Bernstein. Predicting visual consonant perception from physical measures. In Proceedings of Eurospeech 2001—Scandinavia ( Aalborg , Denmark , September 2001, P. Dalsgaard, B. Lindberg, and H. Benner, (Eds.), Kommunik Grafiske Løsninger A/S, Aalborg, pp. 179–182, 2001.
- 3 J. A. Graham, and M. Argyle. A cross-cultural study of the communication of extra-verbal meaning by gestures. International Journal of Psychology, 10, 67–67, 1975.
- 4 G. Wainright. Teach Yourself Body Language, 2 ed. McGraw–Hill, January 2003.
- 5 Z. Ruttkay, and H. Noot. Animated CharToon faces. In Proceedings of NPAR 2000—First International Symposium on Non Photorealistic Animation and Rendering ( Annecy , France , 2000), ACM Press, pp. 91–100, 2000.
- 6
P. Kalra,
A. Mangili,
Magnenat-Thalmann N., and
D. Thalmann.
Simulation of facial muscle actions based on rational free form deformations.
Computer Graphics Forum (Proceedings of Eurographics'92), 11 (3), 59–69, 1992.
10.1111/1467-8659.1130059 Google Scholar
- 7 T. Ezzat, G. Geiger, and T. Poggio. Trainable videorealistic speech animation. ACM Transactions on Graphics, 21(3), 388–398, 2002.
- 8 F. Pighin, R. Szeliski, and D. H. Salesin. Modeling and animating realistic faces from images. International Journal of Computer Vision, 50(2) 143–169, 2002.
- 9 J. Kleiser. A fast, efficient, accurate way to represent the human face. In State of the Art in Facial Animation, SIGGRAPH'89 Tutorials ( New York , 1989), Vol. 22, ACM, pp. 37–40, 1989.
- 10 Y. Lee, D. Terzopoulos, and K. Waters. Realistic modeling for facial animation. In Computer Graphics Proceedings, Annual Conference Series, pp. 55–61, 1995.
- 11 F. I. Parke, and K. Waters. Computer Facial Animation. A. K. Peters, Ltd., Wellesley , MA , USA , 1996.
- 12 J. Y. Noh, and U. Neumann. A Survey of Facial Modeling and Animation Techniques. Technical Report 99–705, University of Southern California , 1998.
- 13 F. I. Parke. Computer generated animation of faces. In Proceedings of the ACM National Conference, pp. 451–457, 1972.
- 14 F. I. Parke. A Parametric Model for Human Faces. PhD thesis, University of Utah, Department of Computer Science , 1974.
- 15 F. I. Parke. Parameterized model for facial animation. IEEE Computer Graphics, 2(9), 61–68, 1982.
- 16 K. Waters. A muscle model for animating three-dimensional facial expressions. Computer Graphics (SIGGRAPH'87), 21(4) 17–24, July 1987.
- 17 P. Ekman, and W. F. Friesen. Facial Action Coding System. Consulting Psychologists Press, Inc., California , 1978.
- 18
N. Magnenat-Thalmann,
E. Primeau, and
D. Thalmann.
Abstract muscle action procedures for human face animation.
The Visual Computer, 3(5) 290–297, 1988.
10.1007/BF01914864 Google Scholar
- 19
S. M. Platt, and
N. I. Badler.
Animating facial expressions.
Computer Graphics (SIGGRAPH'81), 15(3), 245–252, August 1981.
10.1145/965161.806812 Google Scholar
- 20
D. Terzopoulos, and
K. Waters.
Physically-based facial modelling, analysis, and animation.
The Journal of Visualisation and Computer Animation, 1(2) 73–80, 1990.
10.1002/vis.4340010208 Google Scholar
- 21 Y. Zhang, E. C. Prakash, and E. Sung. A physically-based model with adaptive refinement for facial animation. In Proceedings of IEEE Computer Animation 2001 (CA2001) (November 2001), IEEE Computer Society Press, pp. 28–39, 2001.
- 22
R. M. Koch,
M. H. Gross, and
Bosshard A..
A. Emotion editing using finite elements.
Computer Graphics Forum, 17(3), 1998.
10.1111/1467-8659.00276 Google Scholar
- 23 Y. Aoki, S. Hashimoto, M. Terajima, and A. Nakasima. Simulation of postoperative 3d facial morphology using a physic-based head model. The Visual Computer, 17, 121–131, 2001.
- 24 J. Ostermann. MPEG-4 overview. In Circuits and Systems in the Information Age, Y.-F. Huang, and C.-H. Wei, (Eds.). IEEE, pp. 119–135, 1997.
- 25 T. Sikora. The MPEG-4 video standard and its potential for future multimedia applications. In Proceedings IEEE ISCAS Conference ( Hongkong , June 1997).
- 26 P. Ekman, and W. F. Friesen. Unmasking the Face. Prentice–Hall, Inc., Englewood Cliffs, New Jersey , USA , 1975.
- 27 P. Ekman. Telling lies: Clues to deceit in the marketplace, marriage and politics. New York: Norton, Berkeley Books, New York , 1985.
- 28 M. Heller, and V. Haynal. The faces of suicidal depression (translation les visages de la depression de suicidal). Kahiers Psychiatriques Genevois (Medicine et Hygiene Editors) l1, 107–117, 1994.
- 29 Y.-L. Tian, T. Kanade, and J. Cohn. Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2) 97–115, February 2001.
- 30 M. S. Bartlett, G. Littlewort, B. Braathen, T. J. Sejnowski, and J. R. Movellan. A prototype for automatic recognition of spontaneous facial actions. In Advances in Neural Information Processing Systems, 15, S. Becker, S. Thurn, and K. Obermayer, (Eds). MIT Press, Cambridge , MA , pp. 1271–1278, 2003.
- 31 M. Pantic, and L. J. M. Rothkrantz. Facial action recognition for facial expression analysis from static face images. IEEE Transactions on Systems, Man, And Cybernetics—Part B: Cybernetics, 34(3) 1449–1461, June 2004.
- 32 C. Pelachaud, N. I. Badler, and M. Steedman. Generating facial expressions for speech. Cognitive Science, 20(1), 1–46, 1996.
- 33 A. Wojdeł, and L. J. M. Rothkrantz. A performance based parametric model for facial animation. In Proceedings of IEEE International Conference on Multimedia and Expo 2000 ( New York , NY USA , JulyAugust 2000.
- 34 A. Wojdeł, and L. J. M. Rothkrantz. Implementing facial expressions modeller from single au models. In Proceedings of International Conference on Augment, Virtual Environments and Three-Dimensional Imaging ( Mykonos , Greece , May 2001), pp. 144–147, 2001.
- 35 A. Wojdeł, L. J. M. Rothkrantz, and J. C. Wojdeł. Fuzzy-logical implementation of co-occurrence rules for combining aus. In Proceedings of 6th IASTED International Conference on Computers, Graphics, and Imaging ( Honolulu , Hawaii , USA , August 2003), The International Association of Science and Technology for Development , 2003.
- 36 L. A. Zadeh. Fuzzy sets. Information and Control, 8, 338–353, 1965.
- 37 M. Matous̆ek, and A. Wojdeł. 3D Reconstruction of Marked Vertices of a Wire-Frame Model of Face. Internal report, Knowledge Based Systems Group, Delft University of Technology , Delft , The Netherlands , 2001.
- 38 N. Magnenat-Thalmann, P. Kalra, and M. Escher. Face to virtual face. Proceedings of the IEEE, 86(5), 870–883, May 1998.
