OpenAI Debuts New Features That Will Help ChatGPT Speak, Listen And See!

OpenAI announced on Monday that the latest version of ChatGPT can "see, hear, and speak," - that is recognize human speech, reply in a synthetic voice and analyze visual data. Excited to hear that?

Let’s explore more about this new announcement by OpenAI!

Users can now opt to have voice discussions with ChatGPT's mobile app and select from five different synthetic voices for the bot to answer with, marking OpenAI's most significant enhancement to the chatbot since the launch of GPT-4.

The ability to upload photographs means that users may ask their chatbot to do things like "explore the contents of your fridge to plan a meal" or "analyze this complex graph for work-related data." ChatGPT users will also be able to annotate shared photographs (as in, "What kinds of clouds are these?") to facilitate better discussions.

There has been a rush among Big Tech to release their own products based on generative AI since ChatGPT was adopted by businesses for everything from summarizing texts to coding. The new voice feature in ChatGPT can read user-entered text aloud, settle dinner table arguments, or narrate a bedtime story.

OpenAI stated the updates would go live for paying customers within the following two weeks. The image processing features will be cross-platform but the voice recognition features will only be available on iOS and Android.

AI giants in the chatbot space, including OpenAI, Microsoft, Google and Anthropic, are raising the stakes with latest features. Tech firms are racing to release not only new AI chatbots but also new functionality in an effort to entice customers to embrace generative AI into their daily life. Updates to Google's Bard chatbot have been unveiled and Bing now features visual search thanks to Microsoft.
   

Isn't It Worrying That Artificial Intelligence Can Create Fake Voices?

Concerns have been expressed by experts concerning artificial intelligence-generated synthetic voices, which might provide a more authentic experience for users but also make deep fakes more convincing. Researchers and cybercriminals alike have started investigating the potential of deepfakes to breach secure networks with synthetic voice data.

OpenAI addressed these concerns by announcing that its synthetic voices were "created with voice actors we have directly worked with," as opposed to being taken from random online sources. Moreover, OpenAI announced that Spotify is using the same technology to help its podcasters translate their content into other languages while retaining their voice.

Further, OpenAI directed CNBC to the company's guidance on voice interactions, which clarifies that audio recordings of conversations are not stored or used to train models. The company does mention, though, that transcriptions are treated as inputs and could be utilized to enhance the large language models (LLMs).

With ChatGPT's newfound voice, eyes and ears, has OpenAI created a revolution in the making?
Let us know your thoughts in the comments section below!