About
All Posts
Partner
Logo
Login
Subscribe
Logo
  • Home
  • Posts
  • OpenAI introduces Realtime API to let devs build apps with low-latency AI voice responses

Oct 2, 2024

OpenAI introduces Realtime API to let devs build apps with low-latency AI voice responses

Bay Area Times
Bay Area Times

Brought to you by:

Top stories today:

  1. OpenAI introduces Realtime API to let devs build apps with fast AI voice responses
  2. NVIDIA releases NVLM 1.0 open-weights LLM to fight Meta, OpenAI
  3. Microsoft Copilot Vision, Voice reads your screen, speaks to you
  4. Apple said to soon begin production of new iPhone SE
  5. Samsung laying off 1K's of employees in overseas markets

Follow us on X | Instagram | Advertise

0. Data and calendar

All values as of 6 AM ET / 3 AM PT, other than S&P500 and NASDAQ close (4 PM ET / 1 PM PT).

All times are ET.

We are proud to be launching the Bay Area Times Daily, hosted by our very new Amy and Ian (our AI duo). We’re still getting Amy and Ian up to speed (they still hallucinate a bit), but check them out below and reply back to this email letting us know what you think!

1. OpenAI introduces Realtime API to let devs build apps with low-latency AI voice responses

OpenAI gave a glimpse of the Realtime API with demo apps at its 2024 DevDay:

Healthify app uses Realtime API to enable natural conversations (OpenAI).

  • Public beta now available to all paid devs.

  • Natural speech-to-speech conversations are claimed through the API.

  • 6 preset voices are supported, similar to ChatGPT’s Advanced Voice Mode.

Additionally, OpenAI introduced vision fine-tuning on GPT-4o to custom train AI with images

A desktop bot identifying UI elements via vision fine-tuning with website screenshots (OpenAI).

OpenAI also launched a Model Distillation feature to fine-tune smaller models with the outputs of larger AI models

OpenAI.

Prompt Catching was introduced, offering a 50% discount on inputs that the model has recently seen

Differences between the pricing of uncached and cached input tokens (OpenAI).

  • Prompt Catching is automatically applied on the latest versions of GPT-4o, GPT-4o mini, o1-preview, and o1-mini.

2. Transform Your Workflow with monday.com*

monday.com.

  • Gain clarity and control to help connect your work to your business goals.

  • Collaborate easily, communicate clearly, and bridge silos across your organization.

  • Collaborate easily, communicate clearly, and bridge silos across your organization.

Get Started Now.

*Sponsored.

3. NVIDIA releases NVLM 1.0 open-weights LLM to fight Meta, OpenAI, Anthropic

Subscribe to keep reading

This content is free, but you must be subscribed to Bay Area Times to continue reading.

Already a subscriber?Sign in.Not now

Keep reading

Jul 2, 2026

Meta said to plan AI cloud business, rivaling AWS, Azure, Google Cloud

Meta said to plan AI cloud business, rivaling AWS, Azure, Google Cloud

Jul 1, 2026

Anthropic restores Fable 5, Mythos 5 after U.S. lifts export controls

Anthropic restores Fable 5, Mythos 5 after U.S. lifts export controls

Jun 30, 2026

OpenAI teases Codex keyboard device for Jul. 15

OpenAI teases Codex keyboard device for Jul. 15

Jun 29, 2026

GPT-5.6 Sol, Terra, Luna debut in limited preview as OpenAI’s newest frontier models

GPT-5.6 Sol, Terra, Luna debut in limited preview as OpenAI’s newest frontier models

Subscribe

Your morning briefing, free forever.

Get the latest news, resources, and more delivered straight to your inbox everyday.

The visual daily newsletter on business and tech. Analyzing the news with 1 visual per story. Join our 250,000+ subscribers here.

Copyright Ā© 2026 Bay Area Times.

BAT

Company

Legal

Privacy Policy

Terms of Service