OpenAI updates Codex to access all applications on your computer

OpenAI has announced a significant update to its Codex developer application available on Mac and Windows. Now, Codex not only assists in writing and debugging software but can also interact with other applications on the computer, providing a more integrated experience for users.

According to Andrew Ambrosino from OpenAI, Codex can now launch applications, type into them, and execute commands in the background, allowing developers to work simultaneously across different applications. This update essentially transforms Codex into a more powerful tool for developers, enabling them to use it as a 'super app' for managing their projects.

A key feature introduced is the built-in web browser, which allows developers to preview their frontend developments. Additionally, the powerful image generation model gpt-image-1.5 has been integrated, enabling users to create graphics for their projects, including websites and games, all in a consistent style.

The Codex update also includes support for numerous new plugins, allowing integration of various tools used by developers, such as CircleCI and Microsoft Suite. This significantly streamlines workflows, enabling Codex to gather information from multiple sources and present it to the user.

Furthermore, Codex has introduced 'Heartbeat Automations', allowing it to schedule future tasks and automatically respond to changes in documentation or Slack channels. This makes Codex more proactive and adaptive to user needs, enhancing overall productivity.