OpenAI CEO Sam Altman said GPT-4o “feels like AI from the movies” – here’s everything you need to know about the new model
OpenAI has introduced GPT-4o, its latest flagship large language model, featuring improvements to how it deals with text, voice, and video – and a lot more charm.
The ‘o’ in GPT-4o stands for ‘omni’ and refers to its multimodal capabilities, meaning it has the ability to accept combinations of text, audio, and images as input, and then to generate text, audio, and images as outputs in response.
This, OpenAI said, is a step towards much more natural human-computer interaction.
OpenAI showcased the new model’s abilities in a series of videos that feature the AI assistant creating and then singing a song, cooing over a cute dog it is shown, joking and flirting with people, and even being sarcastic towards users as they chat.
OpenAI CEO Sam Altman described the new voice and video mode as “the best computer interface I’ve ever used”.
“It feels like AI from the movies; and it’s still a bit surprising to me that it’s real. Getting to human-level response times and expressiveness turns out to be a big change,” he said.
“The original ChatGPT showed a hint of what was possible with language interfaces; this new thing feels viscerally different.
“Talking to a computer has never felt really natural for me; now it does.”
The new model can respond to spoken questions in an average of 320 milliseconds, similar to human response times. OpenAI said the version matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages.
GPT-4o is especially better at visual and audio understanding compared to existing models, it said.
“Today, GPT-4o is much better than any existing model at understanding and discussing the images you share.
