Volume 27, Issue 4 pp. 544-553
ORIGINAL ARTICLE

Japanese experiment of a complete and objective automatic grading system of facial signs from selfie pictures: Validation with dermatologists and characterization of changes due to age and sun exposures

Frederic Flament

Corresponding Author

Frederic Flament

L'Oréal Research and Innovation, Clichy, France

Correspondence

Frederic Flament, L'Oreal Research and Innovation, 9 Rue Pierre Dreyfus, 92110, Clichy, France.

Email: [email protected]

Search for more papers by this author
Damien Velleman

Damien Velleman

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
Eri Yamashita

Eri Yamashita

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
Alexandre Nicolas

Alexandre Nicolas

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
Emilie Yokoyama

Emilie Yokoyama

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
Ayako Itaya

Ayako Itaya

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
Yuze Zhang

Yuze Zhang

ModiFace – A L'Oréal Group Company, Toronto, Canada

Search for more papers by this author
Ruowei Jiang

Ruowei Jiang

ModiFace – A L'Oréal Group Company, Toronto, Canada

Search for more papers by this author
Pahram Aarabi

Pahram Aarabi

ModiFace – A L'Oréal Group Company, Toronto, Canada

Search for more papers by this author
Aurelie Abric

Aurelie Abric

Eurosyn, Villebon-sur-Yvette, France

Search for more papers by this author
Aya Nakada

Aya Nakada

Department of Geriatric and Environmental Dermatology, Nagoya City University Graduate School of Medical Sciences, Nagoya, Japan

Search for more papers by this author
Yoko Sagawa

Yoko Sagawa

Department of Geriatric and Environmental Dermatology, Nagoya City University Graduate School of Medical Sciences, Nagoya, Japan

Search for more papers by this author
Haruna Nishihara

Haruna Nishihara

Department of Geriatric and Environmental Dermatology, Nagoya City University Graduate School of Medical Sciences, Nagoya, Japan

Search for more papers by this author
Akimichi Morita

Akimichi Morita

Department of Geriatric and Environmental Dermatology, Nagoya City University Graduate School of Medical Sciences, Nagoya, Japan

Search for more papers by this author
Matthieu Cassier

Matthieu Cassier

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
Caroline Delaunay

Caroline Delaunay

L'Oréal Research and Innovation, Clichy, France

L'Oréal Research and Innovation, Tokyo, Japan

Search for more papers by this author
First published: 27 December 2020
Citations: 19
“Punctum is what I add to the photograph and what is nonetheless already there”. R. Barthes (French philosopher, 1915-1980).
Funding informationAll costings of the present work were entirely met by L'Oréal Research & Innovation Dpt

Abstract

Objective

To evaluate the capacity of the automatic detection system to accurately grade, from smartphones' selfie pictures, the severity of ten facial signs in Japanese women and their changes due to age and sun exposures.

Methods

A three-step approach was conducted, based on self-taken selfie images. At first, to check on 310 Japanese women (18-69 years) enrolled in the northerner Hokkaido area (latitude 43.2°N), how, on ten facial signs, the A.I-based automatic grading system may correlate with dermatological assessments, taken as reference. Second, to assess and compare age changes in 310 Japanese and 112 Korean women. Third, as these Japanese panelists were recruited according to their usual behavior toward sun exposure, that is, non-sun-phobic (NSP, N = 114) and sun-phobic (SP, N = 196), and through their regular and early use of a photo-protective product, to characterize the facial photo-damages.

Results

(a) On the ten facial signs, detected automatically, nine were found significantly (P < .0001) highly correlated with the evaluations made by three Japanese dermatologists (Wrinkles: r = .75; Sagging: r = .80; Pigmentation: r = .75). (b) The automatic scores showed significant changes with age, by decade, of Wrinkles/Texture, Pigmentation, and Ptosis/Sagging (P < .05). (c) After 45 years, a significantly increased severity of Wrinkles/Texture and Pigmentation was observed in NSP vs. SP women (P < .05). A trend of an increased Ptosis/Sagging (P = .09) was observed.

Conclusion

This work illustrates, for the first time through investigations conducted at home, some impacts of aging and sun exposures on facial signs of Japanese women. Results significantly confirm the importance of sun avoidance coupled with photo-protective measures. In epidemiological studies, the AI-based system offers a fast, affordable, and confidential approach in detection and quantification of facial signs and their dependence with ages, environments and lifestyles.

CONFLICT OF INTEREST

All authors are employees of L'Oréal Research & Innovation Dpt and the Modiface™ company.

The full text of this article hosted at iucr.org is unavailable due to technical difficulties.