"The technology relies on advances in 3-D face reconstruction, tracking, alignment, multi-texture modeling and puppeteering that have been developed over the last five years," a university news article said.
Basically they pulled together more than 200 images of the actor's face from Google Image searches, fed them to their algorithms, and out came a digital Tom Hanks model that completely captures his mannerisms and expressions - even if the words aren't his, Mashable's Lance Ulanoff explained.
After Hanks, the team threw other actors and politicians into the mix. Real video of George W. Bush starts out next to their digital model of him. Then Bush's voice comes out of their Barack Obama digital model. And finally Bush gets parroted by a chorus of personae: Hillary Clinton, Arnold Schwarzenegger, Daniel Craig, and, yes, Tom Hanks.
The tech has even weirder potential. With enough photos, the technology could allow us to have realistic virtual reality interactions with people who aren't even there. Historical figures, famous celebs, family members.
Robot Guesses Mood, Wears Your Friend's Face
"You might one day be able to put on a pair of augmented reality glasses and there is a 3-D model of your mother on the couch," Kemelmacher-Shlizerman told the university.
Suwajanakorn, who will be presenting their technology at the International Conference on Computer Vision in Chile, didn't say whether he's a Spike Jonze fan. But all I could think was, "Malkovich, Malkovich, Malkovich."