Oliver Haslam on May 13, 2024, 6:38 pm

OpenAI Announces GPT-4o With Premium Features Going Free, Desktop Mac App, New AI Models, More

While Apple is thought to be in talks with OpenAI about licensing its ChatGPT technology for us in iOS 18, the company has today announced that it is making the upgraded version of ChatGPT, GPT-4o, available to everyone for free.

The news comes as OpenAI also announced that it is making a desktop Mac app available to ChatGPT Plus subscribers today before rolling it out to everyone within weeks. Windows app will come at a later date. The updated iPhone, iPad app, along with new Mac app, is equipped to utilize voice and text inputs, and it also incorporates “vision” through screen sharing functionality. Additionally, ChatGPT’s web user interface is slated for a redesign, promising a more streamlined and visually appealing experience.

By making the GPT-4o large language model available for free, people will no longer need to pay for the ChatGPT Plus subscription to benefit from some of its upgrades. The newer GPT-4o model is faster and has improved capabilities when dealing with text, voice, and vision, OpenAI says. Such improvements were previously locked behind the ChatGPT Plus paywall, so this is a big deal for those who want to use the latest version of ChatGPT without having to pay for it.

Here are some of the latest changes coming as part of GPT-4o for free:

– Access GPT-4 level intelligence for comprehensive responses.
– Obtain responses from both the model and the web simultaneously.
– Utilize data analysis tools to analyze data and generate charts.
– Engage in conversation about captured photos.
– Ability to have live translation in different languages.
– Upload files for assistance with summarization, writing, or analysis tasks.
– Explore and utilize GPTs and the GPT Store.
– Enhance user experience by incorporating memory capabilities for more helpful assistance.

One standout showcase of the upgrade is the integration of live video, enhancing the interactive experience. This feature enables users to engage in real-time conversations with prompts. Demonstrations included scenarios such as solving linear equations and analyzing facial expressions to gauge mood, showcasing the versatility and practicality of this advancement.

Even more remarkable is the introduction of an enhanced audio feature in ChatGPT. Users now have the ability to manipulate the chatbot’s voice, issuing commands like “increase dramatic tone” or “emulate robotic speech,” thereby customizing the auditory experience according to their preferences.

You can watch these demos in YouTube video embedded below:

This latest news comes amid ongoing reports that Apple and OpenAI could bring some form of the ChatGPT technology to the iPhone. The partnership would likely see Apple’s in-house large language model systems handle some of the less complex tasks before handing over to ChatGPT for the more complex queries and requests.

Apple is expected to announce the iOS 18 software update, with new AI-powered features, at the WWDC event on June 10. From there, the software will undergo months of beta testing before being released to the public in or around the middle of September.