If you thought ChatGPT and DALL-E 3 were impressive, wait until you see what Sora can do.
The science of generating content with AI has been progressing rapidly on all fronts as of late, but video presents a lot of unique challenges due to the amount of data involved. OpenAI is right at the forefront of solving these challenges, though, and the company just presented its new model called, “Sora”, as proof of that.The name “Sora” means “sky”, “vagueness”, or “falsehood” in Japanese. It’s a fitting appellation for the new video generation model, which OpenAI has shown to be able to generate incredible video clips from just a simple description. The image in the top of this post is one frame from a shockingly convincing video that was created using the prompt “A Chinese Lunar New Year celebration video with Chinese Dragon.”Announcing Sora — our model which creates minute-long videos from a text prompt: https://t.co/SZ3OxPnxwzpic.twitter.com/0kzXTqK9bG
Greg Brockman (@gdb) February 15, 2024
OpenAI says that it created Sora using evolutions of the methods that it used to create GPT-4 and DALL-E 3. Sora is a transformer, like GPT, and it is also a diffusion model, similar to the familiar Stable Diffusion.
