OpenAI unveiled new developer tools at DevDay 2024, focusing on enabling the creation of advanced AI applications. Key announcements included a Realtime API for low-latency multimodal experiences.
At DevDay 2024, OpenAI announced several new developer tools, enabling them to create advanced AI applications more easily. As expected, the company did not announce any new models during the event.
OpenAI made four major announcements for developers. First, it announced a public beta of the Realtime API, which will allow developers to build low-latency, multimodal experiences in their apps. This will enable developers to build applications similar to ChatGPT’s Advanced Voice Mode with natural speech-to-speech conversations using six preset voices. For developers who don’t need the low-latency benefits of the Realtime API, OpenAI also announced audio input and output in the Chat Completions API.
The Realtime API text input tokens will cost $5 per 1 million and $20 per 1 million output tokens. Audio input will cost $100 per 1 million tokens, and output is $200 per 1 million tokens.
