Artificial intelligence tool turns audio into video

The technology is based on newly prepared algorithms, which are designed to overcome a limitation with ‘computer vision’. This is with turning audio clips into realistic, lip-synced videos of the person who is speaking the words. The developed algorithms learn from videos that exist “in the wild”, such as on the Internet or elsewhere. READ MORE: New software edits voices like text To do so involved training a neural network (a collection of connected units called artificial neurons) to view videos of an individual and then to translate different audio sounds into basic mouth shapes. The second area was using a new mouth synthesis technique to realistically superimpose mouth shapes and textures onto an existing reference video of a given person. Individual brain cells within a neural network are highlighted in this image obtained by CMU’s Sandra Kuhlman using a fluorescent imaging technique Carnegie Mellon University To test out the technology, the research group generated a realistic video of Barack Obama discussing such diverse subjects as terrorism, fatherhood and employment. The video was created using audio clips alone together with a separate video image of the former president. The video overcomes a major problem with adding audio to video, where…


Link to Full Article: Artificial intelligence tool turns audio into video

Pin It on Pinterest

Share This