Meta declares Make-A-Video, which produces video from text

Today, Meta declared Make-A-Video, an AI-powered video generator that can make novel video content from text or picture prompts, like existing picture union instruments like DALL-E and Stable Dissemination. It can likewise make varieties of existing videos, however it’s not yet accessible for public use.

On Make-A-Video’s declaration page, Meta shows example videos created from text, including “a young couple walking in heavy rain” and “a teddy bear painting a portrait.” It likewise exhibits Make-A-Video’s ability to take a static source picture and animate it. For example, a still photograph of a sea turtle, when processed through the AI model, can give off an impression of being swimming.

The key technology behind Make-A-Video — and why it has shown up sooner than certain specialists expected — is that it works off existing work with text-to-image synthesis used with picture generators like OpenAI’s DALL-E. In July, Meta reported its own text-to-image AI model called Make-A-Scene.

Rather than training the Make-A-Video model on named video data (for example, captioned descriptions of the actions depicted), Meta rather took image synthesis data (actually pictures trained with captions) and applied unlabeled video training information so the model learns a sense of where a text or picture brief could exist in reality. Then it can predict what comes after the picture and show the scene moving for a short period.

“Using function-preserving transformations, we extend the spatial layers at the model initialization stage to include temporal information,” Meta wrote in a white paper. “The extended spatial-temporal network includes new attention modules that learn temporal world dynamics from a collection of videos.”

Meta has not made a declaration about how or when Make-A-Video could become available to people in general or who might access it. Meta gives a sign-up form individuals can fill out on the off chance that they are interested in trying it in the future.

Meta recognizes that the capacity to encourage photorealistic videos on demand presents specific social dangers. At the bottom of the declaration page, Meta says that all AI-generated video content from Make-A-Video contains a watermark to “help ensure viewers know the video was generated with AI and is not a captured video.”

Related post

Akbar Khazaei, the only IFBB PRO bodybuilding judge from Iran, has recently judged the 7th Npc competition/the us visa was not issued for him

Akbar Khazaei, the only IFBB PRO bodybuilding judge from Iran, has recently judged the 7th Npc…

Akbar Khazaei, the only ifbb pro League & Npc bodybuilding professional judge from Iran, participated as…
North Carolina’s Armando Bacot will return for the fifth season

North Carolina’s Armando Bacot will return for the fifth season

On Wednesday, big man Armando Bacot informed Stadium that he will remain with the Tar Heels…
The exclusivity agreement that Rivian has with Amazon for electric delivery trucks is being reviewed

The exclusivity agreement that Rivian has with Amazon for electric delivery trucks is being reviewed

A company spokeswoman stated on Monday that Rivian and Amazon are in talks to modify the…