Eye contact via AI in the video call

Nvidia has announced a new version of its own broadcast tool for live streaming and video conferencing. Version 1.4 includes two new effects called Eye Contact and Vignette, as well as virtual background improvements.

Eye Contact is an AI controlled effect that moves the speaker’s eyes around the Eye contact with the camera to simulate. According to Nvidia, this is achieved by estimating and directing the gaze, while preserving the natural color and blinking of the eyes. The effect also includes an interrupt function in case the narrator is looking away from the camera to ensure a smooth transition between simulated and real eyes. The new feature is particularly useful for video conference moderators or content creators who record themselves while reading notes or a script.

Innovations for background effects

On Vignette effect was also integrated into broadcast. In combination with the “Background Blur” effect, it simulates a bokeh on the webcam. Temporal information has also been added to the Blur, Replace, and Virtual Background Removal effects, which should result in better segmentation and stability, and allow the AI ​​to make better decisions.

In addition to these new effects, Nvidia Broadcast also two features requested by the community integrated: the possibility of mirroring the camera and taking a screenshot of the webcam. App developers can also integrate the SDKs behind Broadcast into their apps, including the latest features.

With active users doubling year over year and more than 20 partners embedding broadcast effects directly into their apps, the tool has seen a strong upswing, according to Nvidia. It comes pre-installed on select laptops from Acer, Asus, Gigabyte, MSI, Lenovo and Razer. The Nvidia website can be used Broadcast free download. For the effects, which, by the way, too RTX Voice counts, however, an RTX graphics card from the company is required, i.e. at least an RTX 2060.

Sources

Leave a Replay