While today’s chatbots are some of the most advanced ever created, they all suffer from high latency. Depending on the query, response times can range from a.
Forward-looking: OpenAI just introduced GPT-4o (GPT-4 Omni or „O“ for short). The model is no „smarter“ than GPT-4 but still some remarkable innovations set it apart: the ability to process text, visual, and audio data simultaneously, almost no latency between asking and answering, and an unbelievably human-sounding voice.
While today’s chatbots are some of the most advanced ever created, they all suffer from high latency. Depending on the query, response times can range from a second to several seconds. Some companies, like Apple, want to resolve this with on-device AI processing. OpenAI took a different approach with Omni.
Most of Omni’s replies were quick during the Monday demonstration, making the conversation more fluid than your typical chatbot session. It also accepted interruptions gracefully. If the presenter started talking over the GPT-4o’s reply, it would pause what it was saying rather than finishing its response.
