>
Disney Uses AI To Re-Age Faces
Written by David Conrad   
Sunday, 15 January 2023

Disney Research has a new visual effects tool that can make actors look older or younger for movies without needing to collect longitudinal data using photographs. 

disney res banner

Remember the breakthrough when AI was first used to estimate a person's age? We had great fun trying to fool Microsoft's implementation of it but we probably underestimated how important facial recognition would become.

A paper recently presented at ACM SIGGRAPH Asia (2022) introduced FRAN, a "Face Re-Aging Network" that can:

automatically re-age face images in video without identity loss

Intended for visual effects, FRAN comes from a team of researchers from the Zurich-based Disney Research Studios,  and ETH Zurich. Setting the scene the paper states:

The use of digitally aged or de-aged human characters in movie productions and advertising has increased dramatically over the last few years. Whether for making Robert De Niro younger in The Irishman [2020], or David Beckham older in an ad campaign against malaria [2020], digital re-aging is quickly becoming an essential tool in every visual effects studio. 

This video presents the research, opening with video frames of an male aged 35, re-aged to 65 (top row) and to 18 (bottom row):

As an AI-based, fully-automatic tool, FRAN is intended to replace the predominant 2D painting workflow which often requires frame-by-frame manual work that can take days to accomplish, even by skilled artists.The research paper states:

Although research on facial image reaging has attempted to automate and solve this problem, current techniques are of little practical use as they typically suffer from facial identity loss, poor resolution, and unstable results across subsequent video frames.  

The approach used for FRAN that overcomes these problems dispensed with collecting data from real human subjects. Instead the neural network was trained with a  large database containing pairs of randomly generated synthetic faces at varying ages.

disneyfran2

FRAN also provides artists with localized control and creative freedom to direct and fine-tune the re-aging effect, such as adding or erasing wrinkles and jowls, something the paper suggests is important in real production pipelines and often overlooked in related research work.

The results seem impressively credible but it isn’t clear if Disney intends to make this technology available to the public.

disneyfran

More Information

Production-Ready Face Re-Aging for Visual Effects (pdf)

Related Articles

Face Recognition Adds Age Estimation

How Old - Eun, Wrong, Potentially Risky

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Supersimple - Deep Insights From Data
02/04/2024

Announcing $2.2 Million in pre-seed funding, the Estonian startup Supersimple has launched an AI-native data analytics platform which combines a semantic data modeling layer with the ability to answer [ ... ]



Azure AI And Pgvector Run Generative AI Directly On Postgres
26/03/2024

It's a match made in heaven. The Azure AI extension enables the database to call into various Azure AI services like Azure OpenAI. Combined with pgvector you can go far beyond full text search. Let's  [ ... ]


More News

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Sunday, 15 January 2023 )