The integration of 3D graphics with the images of real scenes involves the extraction of sufficient information from the surrounding physical scene. The realism of the resulting system depends upon the quality of such information. One example of such information is the 3D geometry of the scene.
The extraction of the 3D structure from a scene is one of the classical vision problems. This process can be based on a number of visual cues such as shading, stereo, texture, and motion. We concentrate on shape from stereo and shape from shading.