- Bay Area Times
- Posts
- OpenAI introduces Realtime API to let devs build apps with low-latency AI voice responses
OpenAI introduces Realtime API to let devs build apps with low-latency AI voice responses
Bay Area Times
October 02, 2024
Brought to you by:
Top stories today:
- OpenAI introduces Realtime API to let devs build apps with fast AI voice responses
- NVIDIA releases NVLM 1.0 open-weights LLM to fight Meta, OpenAI
- Microsoft Copilot Vision, Voice reads your screen, speaks to you
- Apple said to soon begin production of new iPhone SE
- Samsung laying off 1K's of employees in overseas markets
0. Data and calendar
All values as of 6 AM ET / 3 AM PT, other than S&P500 and NASDAQ close (4 PM ET / 1 PM PT).
All times are ET.
We are proud to be launching the Bay Area Times Daily, hosted by our very new Amy and Ian (our AI duo). We’re still getting Amy and Ian up to speed (they still hallucinate a bit), but check them out below and reply back to this email letting us know what you think!
1. OpenAI introduces Realtime API to let devs build apps with low-latency AI voice responses
OpenAI gave a glimpse of the Realtime API with demo apps at its 2024 DevDay:
Public beta now available to all paid devs.
Natural speech-to-speech conversations are claimed through the API.
6 preset voices are supported, similar to ChatGPT’s Advanced Voice Mode.
Additionally, OpenAI introduced vision fine-tuning on GPT-4o to custom train AI with images
OpenAI also launched a Model Distillation feature to fine-tune smaller models with the outputs of larger AI models
Prompt Catching was introduced, offering a 50% discount on inputs that the model has recently seen
Prompt Catching is automatically applied on the latest versions of GPT-4o, GPT-4o mini, o1-preview, and o1-mini.
Gain clarity and control to help connect your work to your business goals.
Collaborate easily, communicate clearly, and bridge silos across your organization.
Collaborate easily, communicate clearly, and bridge silos across your organization.
*Sponsored.