Technology Desk: Google has announced a new look to its real-time AI experience. In the company's new Gemini Live with Live Avatar feature, AI will not only respond by listening to your voice, but will also be able to interact with the voice and digital face in real-time by understanding the visual input through the camera.
According to Google, Live Avatar has been designed in such a way that during conversation, the digital avatar can show facial expressions like humans. Additionally, the avatar's lip movements will be in sync with the words being spoken, making conversations feel more natural.
AI will not only hear you, it will also be able to see you
The specialty of this technology is its simultaneous processing of audio and visual inputs. That is, by turning on the camera, the user can talk to the AI and show it the person or any object in front of him.
AI can understand these visual inputs and respond through voice and video at the same time. This could open up new avenues of use like product demos, virtual assistants and interactive guides.
Will be able to work in the background while talking
Another specialty of Live Avatar is said to be multitasking. The user can ask to check any information or complete any other task during the conversation.
In such a situation, instead of stopping the conversation completely, AI can complete the necessary work in the background and then continue the conversation with the result.
Claims to communicate in 97 languages
According to Google, Live Avatar supports conversations in 97 different languages. The special thing is that with the change of language, not only the voice but also the lip movements and facial expressions of the avatar can change according to the same language.
This feature can be especially useful for businesses that need to communicate with customers in different languages.
Companies will be able to choose the face and voice of Avatar
Business users can be given the option to choose an avatar as per their needs from the many faces and voices already available.
Apart from this, Google is also giving companies the facility to create custom avatars according to their brand identity. According to available information, an animated digital avatar can be created for a company with just one high-quality photo.
However, the custom avatar feature is said to be available to limited companies at present.
Usage from Customer Support to Product Demo
The use of Live Avatar will not be limited to normal conversations only. Companies can use it for a variety of purposes, such as:
customer support
virtual assistant
product demo
Interactive walkthrough of service
Providing real-time information to customers
In this way, AI can go beyond a chatbot and take the form of a digital assistant who can interact with the user by seeing, hearing and speaking.
SynthID to protect against deepfake
Google has used SynthID digital watermark to prevent misuse of AI generated videos and audios. According to the company, this watermark will be included in AI generated audio and video.
This watermark is not visible or audible to human eyes or ears, but AI based detection systems can identify it.
The special thing is that it has been designed to retain the watermark even after the video or audio is edited, trimmed or compressed. It aims to make it easier to identify AI-generated content and help combat the potential abuse of deepfakes.
AI can change the way of conversation
Features like Live Avatar are making AI assistants more visual and interactive instead of limiting them to just text or voice. If this technology is adopted on a large scale, it could change the way AI is used in areas like customer service, online demos and virtual assistants.
