Breaking News

EnGenius Announces Affordable ECW520 Access Point KIOXIA Announces Industry’s First 245.76 TB NVMe SSD Built for the Demands of Generative AI Environments DeepCool Releases GENOME III, a Flagship Full-Tower Case for Extreme Cooling and Intelligent Monitoring CORSAIR Launches VENGEANCE 7000 AIR Series Gaming PC, Built with FRAME 4000D Case Elgato Brings 4K60 Game Capture to the Masses

logo

  • Share Us
    • Facebook
    • Twitter
  • Home
  • Home
  • News
  • Reviews
  • Essays
  • Forum
  • Legacy
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map

Search form

Nvidia Uses Deep Learning to Turn Doodles into Photorealistic Landscapes

Nvidia Uses Deep Learning to Turn Doodles into Photorealistic Landscapes

Enterprise & IT Mar 19,2019 0

A deep learning model developed by NVIDIA Research can turns rough doodles into photorealistic masterpieces with ease.

The tool leverages generative adversarial networks, or GANs, to convert segmentation maps into lifelike images.

The interactive app using the model, in a lighthearted nod to the post-Impressionist painter, has been christened GauGAN.

GauGAN could offer a powerful tool for creating virtual worlds to everyone from architects and urban planners to landscape designers and game developers. With an AI that understands how the real world looks, these professionals could better prototype ideas and make rapid changes to a synthetic scene.

“It’s much easier to brainstorm designs with simple sketches, and this technology is able to convert sketches into highly realistic images,” said Bryan Catanzaro, vice president of applied deep learning research at NVIDIA.

Catanzaro likens the technology behind GauGAN to a “smart paintbrush” that can fill in the details inside rough segmentation maps, the high-level outlines that show the location of objects in a scene.

GauGAN allows users to draw their own segmentation maps and manipulate the scene, labeling each segment with labels like sand, sky, sea or snow.

Trained on a million images, the deep learning model then fills in the landscape with show-stopping results: Draw in a pond, and nearby elements like trees and rocks will appear as reflections in the water. Swap a segment label from “grass” to “snow” and the entire image changes to a winter scene, with a formerly leafy tree turning barren.

“It’s like a coloring book picture that describes where a tree is, where the sun is, where the sky is,” Catanzaro said. “And then the neural network is able to fill in all of the detail and texture, and the reflections, shadows and colors, based on what it has learned about real images.”

Despite lacking an understanding of the physical world, GANs can produce convincing results because of their structure as a cooperating pair of networks: a generator and a discriminator. The generator creates images that it presents to the discriminator. Trained on real images, the discriminator coaches the generator with pixel-by-pixel feedback on how to improve the realism of its synthetic images.

After training on real images, the discriminator knows that real ponds and lakes contain reflections — so the generator learns to create a convincing imitation.

The tool also allows users to add a style filter, changing a generated image to adapt the style of a particular painter, or change a daytime scene to sunset.

“This technology is not just stitching together pieces of other images, or cutting and pasting textures,” Catanzaro said. “It’s actually synthesizing new images, very similar to how an artist would draw something.”

While the GauGAN app focuses on nature elements like land, sea and sky, the underlying neural network is capable of filling in other landscape features, including buildings, roads and people.

The research paper behind GauGAN has been accepted as an oral presentation at the CVPR conference in June.

Tags: deep learningNvidia
Previous Post
Google Brings High-end Gaming to Your Browser With 'Stadia' Online Gaming Platform
Next Post
Slide into the Deep Learning Research in the NVIDIA AI Playground

Related Posts

  • PNY Announces Support for the New NVIDIA RTX PRO Blackwell Graphics Card Family

  • KIOXIA flash memory and SSD solutions empower AI applications at NVIDIA GTC 2025

  • INNO3D GEFORCE RTX 50 SERIES IS HERE!

  • VENGEANCE Gaming PCs are Ready for NVIDIA GeForce RTX 50 Series GPUs

  • GeForce At Computex 2024

  • ASUS Presents ESC AI POD With NVIDIA GB200 NVL72 at Computex 2024

  • NVIDIA Teams Up With Google DeepMind to Drive Large Language Model Innovation

  • ASUS Presents MGX-Powered Data-Center Solutions

Latest News

EnGenius Announces Affordable ECW520 Access Point
Enterprise & IT

EnGenius Announces Affordable ECW520 Access Point

KIOXIA Announces Industry’s First 245.76 TB NVMe SSD Built for the Demands of Generative AI Environments
Enterprise & IT

KIOXIA Announces Industry’s First 245.76 TB NVMe SSD Built for the Demands of Generative AI Environments

DeepCool Releases GENOME III, a Flagship Full-Tower Case for Extreme Cooling and Intelligent Monitoring
Cooling Systems

DeepCool Releases GENOME III, a Flagship Full-Tower Case for Extreme Cooling and Intelligent Monitoring

CORSAIR Launches VENGEANCE 7000 AIR Series Gaming PC, Built with FRAME 4000D Case
Cooling Systems

CORSAIR Launches VENGEANCE 7000 AIR Series Gaming PC, Built with FRAME 4000D Case

Elgato Brings 4K60 Game Capture to the Masses
Consumer Electronics

Elgato Brings 4K60 Game Capture to the Masses

Popular Reviews

be quiet! Light Loop 360mm

be quiet! Light Loop 360mm

be quiet! Dark Mount Keyboard

be quiet! Dark Mount Keyboard

be quiet! Light Mount Keyboard

be quiet! Light Mount Keyboard

Noctua NH-D15 G2

Noctua NH-D15 G2

Soundpeats Pop Clip

Soundpeats Pop Clip

be quiet! Light Base 600 LX

be quiet! Light Base 600 LX

be quiet! Pure Base 501

be quiet! Pure Base 501

Terramaster F8-SSD

Terramaster F8-SSD

Main menu

  • Home
  • News
  • Reviews
  • Essays
  • Forum
  • Legacy
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map
  • About
  • Privacy
  • Contact Us
  • Promotional Opportunities @ CdrInfo.com
  • Advertise on out site
  • Submit your News to our site
  • RSS Feed