OpenAI’s new voice mode makes it to the ChatGPT desktop app

· Source: TechCrunch · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering, Robotics & Autonomous Systems · Depth: Fundamental Awareness, quick

Summary

OpenAI has updated its ChatGPT desktop application to integrate ChatGPT Voice, enabling users to control AI agents and execute computer tasks through spoken commands. This new feature utilizes OpenAI's recently launched ChatGPT-Live voice models. The desktop app's voice capabilities extend to ChatGPT Work and Codex, allowing it to interact with websites and applications. Specifically on macOS, Appshots grants the app access to screen content, including alt-text. Unlike its smartphone counterpart, the desktop version supports complex, multi-step commands and interactive responses, as demonstrated by a developer using a single command to create a thread, make a pull request, and diagnose a bug. Additionally, ChatGPT Voice in Codex is accessible remotely via the iOS app. This update follows Anthropic's enhancement of its Claude voice mode, which leverages Opus, Sonnet, and Haiku models for tasks across various applications like Gmail and Slack.

Key takeaway

For software engineers seeking to streamline complex development workflows, the new ChatGPT desktop app's voice mode offers a significant efficiency boost. You can now dictate multi-step commands, like creating pull requests or debugging, directly to your computer, reducing manual input. Consider integrating this voice control into your daily coding and task management to accelerate routine operations and improve hands-free productivity. Evaluate its macOS Appshots feature for deeper screen interaction.

Key insights

OpenAI's ChatGPT desktop app now offers voice control for complex, multi-step computer tasks.

Principles

In practice

Topics

Best for: Entrepreneur, AI Engineer, Software Engineer, AI Product Manager

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by TechCrunch.