Deep Nostalgia, a new service from the genealogy site MyHeritage that animates old family photos, has gone viral on social media, in another example of the way artificial-intelligence-based image manipulation is becoming increasingly mainstream.
Launched in late February, the service uses an AI technique called deep learning to automatically animate faces in photographs uploaded to the system. Because of its ease of use, and free trial, it soon took off on Twitter, where users uploaded animated versions of old family photos, celebrity pictures and even drawings and illustrations.
Like most “deepfakes” – the name for the popular use of this technology to map one person’s face on to footage of another – the service is exceptionally good at smoothly animating features and expressions. But it can struggle to generate data to fill in the “gaps” in what it can see from the source images, causing a sense of the uncanny.
So I wanted to know how the recent #DeepLearning facial animations services do with busts and decided to give that botched Christiano Ronaldo statue a spin. What ensued can only be summarised as #DeepNostalgia --> #DeeplyDisturbed. Sweet dreams! ;) pic.twitter.com/g2J0LV5DAi
— Jan Smeddinck (@smeddinck) February 27, 2021
I just ran the @Warcraft cover through the Deep Nostalgia Tool, and this happened... pic.twitter.com/1eD3bb7fAN
— Solitaire #The06 (@SolitaireYTG) March 1, 2021
“It makes me so happy to see him smile again!" Try our new #DeepNostalgia #PhotoAnimation feature for yourself and prepare to be AMAZED!!! https://t.co/p3h600G3MX pic.twitter.com/YdAn9IxyW0
— MyHeritage (@MyHeritage) February 28, 2021
“Some people love the Deep Nostalgia feature and consider it magical, while others find it creepy and dislike it,” MyHeritage says about its technology. “Indeed, the results can be controversial, and it’s hard to stay indifferent to this technology. This feature is intended for nostalgic use, that is, to bring beloved ancestors back to life. Our driver videos don’t include speech in order to prevent abuse of this, such as the creation of deepfake videos of living people.”
Not every video created with the service is elegantly animated, or even good enough to be unsettling, of course. An animated version of the infamous bust of Cristiano Ronaldo, for instance, is exactly as distressing as the static version.
While the automatically produced videos of Deep Nostalgia are not likely to fool anyone into thinking they are real footage, more careful application of the same technology can be difficult to distinguish from reality.
Tom Cruise seems to be a particular subject of choice. In 2019 a video clip went viral of the comedian Bill Hader being morphed into the Hollywood star as he performed an impression on David Letterman's show.
Last month, a new TikTok account named deeptomcruise racked up millions of views with a series of videos that are, it claims, deepfake versions of the actor talking to camera. The Cruise fakes are so accurate that many programmes designed to recognise manipulated media are unable to spot them. – Guardian
