NVIDIA Broadcast App: To Have an AI-powered Eye Contact Function to Improve Video Conversations and Live Streaming

NVIDIA Broadcast, a video conferencing and live streaming application, has received an upgrade to address an old video conferencing issue. The company's new Eye Contact function estimates and alters your directional glance to make it appear as though you're staring into the camera when you're not.

Nvidia Vision

• The effect is meant for speakers reading from a script while recording or streaming.
•  To assist viewers in maintaining eye contact with the speaker on the video.
• To make the effect more lifelike, Nvidia says Eye Contact will aim to match the colour of the simulated eyes to the actual ones.
• There's "even a disconnect function" to assist with transitions between real and virtual eyes.

"The eyes keep their original colour and blink, and there's even a disconnect option in case you stare too far away to transition smoothly between simulated and actual eyes. Broadcast maintains excellent progress, with active users more than doubling from the previous year. "In addition, over 20 partners have directly integrated Broadcast effects into their apps," the business stated.

Is Nvidia still in the Beta phase and its features?

• Nvidia's version of the technology is still in beta since the business has yet to test it for all possible combinations of eye colour and illumination.
• Users are asked to upload video snippets as feedback to the AI-powered system.
• The second prominent new feature of Nvidia Broadcast is a vignette effect that simulates bokeh depth of focus to improve virtual backdrops.
• Including the Eye Contact functionality in Nvidia Broadcast may assist content creators in creating more compelling presentations and making video chats more natural and comfortable.
• Presenters can maintain a more genuine connection with their audience by simulating eye contact.

Conclusion

Nvidia is one of many businesses attempting to imitate eye contact in video chats or conferencing. FaceTime Attention Correction was implemented by Apple in 2019 with iOS 13 to prevent the impact that happens when users gaze at the screen rather than the camera during FaceTime chats, which ironically disrupts eye contact between callers. In 2020, Microsoft added a similar capability to the Surface Pro X, which works in various video calling apps like Microsoft Teams and Skype.