Staff writers
Pre-recorded videos can be edited in real-time via facial capture and re-enactment technology, thanks to software developed by researchers from Stanford University in the US and the University of Erlangen-Nuremberg and Max Planck Institute for Informatics in Germany.
The purpose of their study, which will be published in Computer Vision and Pattern Recognition, was to demonstrate the capabilities of modern computer vision and graphics technology.
In the video below you can see how facial expressions in a target video are animated to match the expressions of a source actor in real-time. The software re-renders the manipulated output video in a photo-realistic fashion.
The effect of seamlessly blending real-world facial movements and those within a video is impressive, if not a little terrifying.
