AI creates a realistic video of you dancing from a single still image
An artificial intelligence trained on TikTok videos could help you take part in dance trends without moving a muscle
By Matthew Sparkes
19 July 2023
No need for this anymore
Nattakorn_Maneerat/Shutterstock
Want to jump on the latest TikTok dance trend, but don’t have time to learn the moves? Now, an artificial intelligence (AI) can create a video of you dancing from a single still image.
Tan Wang at Nanyang Technological University in Singapore and colleagues, including researchers at Microsoft, developed a model they call Disentangled Control for Referring Human Dance Generation in Real World (DisCo), which splits an image into three parts: the background, the foreground and the pose of the person in the shot.
Their AI can then morph the person into a series of poses to create individual frames that, when compiled back into a video, produce realistic footage of that person dancing.
Advertisement
“With these things, you can try to compose anything you want,” says Wang. “If you want Elon Musk to dance, you can just use our [code].”
Read more:
An AI dedicated to drawing hands could help all the other AIs improve
The team trained DisCo on around 700,000 generic images of people taken from TikTok, so that it could learn about poses and how to separate foregrounds from backgrounds. The researchers then trained it further on a small data set of about 350 dance videos, each 10 to 15 seconds long, to give the AI a deeper knowledge of how people move while dancing.