We all know Disney for their movies and animations, but did you know that the company has an elite research branch that strives to create the greatest technology for the future of filmmaking?
Disney Research’s most recent pursuit has been developing a system that can map a person’s face in real-time to allow projected augmentations. This essentially allows the user to act out a scene without wearing a costume or mask, and their face can be augmented in real life from a digital controller. The result is almost like a digital form of makeup.
The engineering behind the project is rather innovative. A series of sensors picks up the facial movements of the subject which then feeds into a program. Along with the cues from the user’s face, the software predicts the movements the user might make to develop a real-time projection. This predictive algorithm was used to decrease lag time in the entire system. All in all, the team has reduced lag down to below 10 microseconds, which makes the illusions rather believable in person.
Right now, the project is still in the development phase, but it is to a point that it could already be used within the theater or to create some interesting illusions. You can check out a demo of the project and some of the engineering behind it in the video below.