Leading into TwitchCon — the world’s top gathering of livestreamers — Nvidia announced the RTX Broadcast Engine, a new set of RTX-accelerated software development kits that use the AI capabilities of GeForce RTX GPUs to transform livestreams.

Powered by dedicated AI processors called Tensor Cores on RTX GPUs, the new SDKs enable virtual greenscreens, style filters and augmented reality effects, all using AI and without the need for special equipment, special cameras or physical props.

The new SDKs include:

• RTX Greenscreen, to deliver real-time background removal of a webcam feed, so only your face and body show up on the livestream. The RTX Greenscreen AI model understands which part of an image is human and which is background, so gamers get the benefits of a greenscreen without needing to buy one.
• RTX AR, which can detect faces, track facial features such as eyes and mouth, and even model the surface of a face, enabling real-time augmented reality effects using a standard web camera. Developers can use it to create AR effects, such as overlaying 3D content on a face or allowing a person to control 3D characters with their face.
• RTX Style Filters, which use an AI technique called style transfer to transform the look and feel of a webcam feed based on the style of another image. With the press of a hotkey, you can style your video feed with your favorite painting or game art.

In addition, Nvidia is working with OBS, one of the leading livestreaming applications, to integrate RTX Greenscreen. With it, livestreamers will be able to remove their background environment or instantly teleport themselves anywhere . This feature will be showcased at TwitchCon for the first time and available in the coming months.

In addition to RTX Broadcast Engine, applications such as OBS, XSplit, Huya, Douya and Streamlabs have deployed the NVIDIA Video Codec SDK for. Three new integrations made their debut this month:

• Twitch Studio, a new application for new livestreamers currently in beta, has integrated the Video Codec SDK to enable high-quality livestreaming.
• Discord gaming chat application just released a new group broadcasting feature called “Go Live,” which uses NVIDIA GPUs and the Video Codec SDK to accelerate broadcasting games in Discord.
• Elgato recently integrated the Video Codec SDK into the software of its new 4K60 Pro MK.2 capture card for recording 4K at 60fps video in High Dynamic Range.

Developers can learn more about the RTX Broadcast Engine and apply for early access at developer.nvidia.com/broadcastengine.