This new work is part of a shift in the computer graphics, film, animation and video game industries toward greater realism through the use of "ray tracing algorithms." Much of the realism in ray tracing technologies comes from calculating how the light in computer generated images would behave if it were set loose in the real world and followed the laws of nature.
At the heart of the new UCSD advance are computationally slimmed "photon mapping" algorithms, which are a subset of the ray tracing algorithms. The computer scientists found a way to collect all of the pertinent lighting information in computer generated scenes at once, which made the new photon mapping approach more lightweight than conventional photon mapping. This technique is especially good for creating smoky, foggy or cloudy scenes and producing images that do not have much unwanted visual noise.
"We took an algorithm that is already great and made it more efficient," said Wojciech Jarosz, a Ph.D. candidate from the Department of Computer Science and Engineering at UCSD?s Jacobs School of Engineering.
Computerized Fog Costs
To date, ray tracing algorithms are primarily used in settings where ultimate realism is required and where heavy computation can be tolerated ? such as offline environments that do not require real-time image rendering.
Computational constraints, however, have limited the use of photon mapping and other ray tracing approaches in places where speed and lightweight computation are crucial ? such as video games. These domains have embraced an approach called rasterization, which is faster, but unable to easily simulate advanced lighting effects.
The new photon mapping approach from UCSD, and related advances, are poised to increase the reach of ray tracing algorithms ? perhaps even into the domain of 3-D animation software for the general public and video games. The Larrabee chip that Intel is working on is just one indication that ray tracing technologies may play an increasing important role in consumer oriented graphics of the future.
Much of the richness in images created with photon mapping algorithms comes from precisely accounting for the amount of light is in a scene and where that light is. Photon mapping algorithms provide a way to follow the light around the scene, as it bounces off various objects and lands on other objects. Photon mapping can also determine how light will interact with fog, smoke or other "participating media" that absorb, reflect and scatter some portion of the light. This task has been traditionally quite computationally costly to perform because it requires sampling the light at many locations in order to make sure that nearly all the light is accounted for.
"Instead of computing the light at thousands of discrete points along the ray between the camera and the object, which is the conventional approach, we compute the lighting along the whole length of the ray all at once," said Jarosz.
To Movies, Then Milk
This more efficient approach to photon mapping could be extended well beyond foggy and smoky scenes, because many materials, including skin, milk and plants, behave like fog or smoke, but on a more limited basis.
"Most natural materials behave like really dense fog because light penetrates them to a limited extent, so this work has a lot of potential future applications," said Jensen, who published work in 2007 at SIGGRAPH on a graphics model capable of generating realistic milk images based on the fat and protein content. This research is pushing the field of computer graphics into the realms of diagnostic medicine, food safety and atmospheric science.
While photon mapping and other ray tracing algorithms that more closely mimic the natural world are making their way into movie special effects and animated films, Jarosz does not expect movies and video games to strictly follow the laws of nature.
"In live action movies, the lighting is incredibly controlled. If a character walks into a shadow, they will add light to the face even if you would never get that kind of light in a real shadow. The composition on the screen must tell the story and not distract the viewer. Realism doesn?t always matter. It?s the movies."
More detailled information is available at the Eurographics 2008 Paper: "The Beam Radiance Estimate for Volumetric Photon Mapping," by Wojciech Jarosz, Matthias Zwicker and Henrik Wann Jensen at the Department of Computer Science and Engineering at University of California, San Diego?s Jacobs School of Engineering.