Acquiring 3D Shapes and Models from Image sequences of objects
Recent progresses on multimedia, information network, and virtual reality raise new requirements of modeling 3D objects. Such objects can be commercial products, industrial parts, folk arts, sculptures, environment, antiques and archaeological finds, etc. New display tools, for example VRML, have also been available for viewing objects via network. How to input 3D models of objects conveniently and stably thus becomes a challenging problem. Although various laser range finders have been developed for measuring 3D shape, they are still too expensive and object specific. We select video camera as the input device for 3D modeling because it has been widely used even in family. Our objective is: receiving a standard image sequence through network from a user or an image sequence recorded in a video tape, we construct 3D models and return the data to the user. To make reconstruction process robust, we fix the way of taking images rather than just waving the camera in the space and solving a general problem. We rotate an object around an axis and take an image sequence in the direction orthogonal to the axis. The rotation angle is controllable or measured in the images. This camera setting is easy to be achieved. It not only simplifies the algorithms of shape recovery, but also creates an intrinsic circumstance for investigating natures of different visual cues. We have studied shape recovery on each rotation plane using contour, highlight, edge, and shading according to their motions in the corresponding epipolar plane image. We explored how to combine their results for a complete model.
|
Shape from Moving Patterns |
Shape from Moving Contour |
Shape from Moving Highlights |
Shape from Moving Shading |
Fusing Multiple Visual Cues |
Objects in the Images |
|
|
|
|
|
Recovered 3D Models |
|
|
|
|
|
Looking at an example of input image sequence and the Epipolar Plane Image at a selected height.
My publications
- Acquiring A Complete 3D Model from Specular Motion Under the Illumination of Circular-shaped Light Sources, IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 22, No. 8, pp. 913-920, Aug. 2000.
- Acquiring 3D Object Models from Specular Motion Using Circular Lights Illumination, 6th International Conference on Computer Vision, pp. 1998.
- Generating 3D Models of Objects Using Multiple Visual Cues in Image Sequences, 3rd Asia Conference on Computer Vision, Vol. 2, pp. 487-494,1998.
- Multiple visual features identification and integration for 3D recovery of rotating objects. Transactions of the Institute of Electronics, Information, and Communication Engineers, Vol. J80-D-II, No. 9, pp.2324-2332,1997.
- 3D Surface Estimation and Model Construction from Specular Motion in Image Sequences. IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol 19, No. 5, 513-520 (1997).
- Recovering 3D models from highlight motion using multiple circular lights, Transactions of the Institute of Electronics, Information, and Communication Engineers, Vol. J80-D-II, No. 7, pp. 1659-1667, 1997.
- Reconstruction of 3D Models from Specular Motion Using Circular Lights, 13th International Conference on Pattern Recognition, Vol. 1, pp. 869-873, (1996).
- Computing 3D Models of Rotating Objects from Moving Shading. 13th International Conference on Pattern Recognition, Vol. 1, pp.800-804, (1996).
- Recovering 3D models from highlight motion, Transactions of the Institute of Electronics, Information, and Communication Engineers, Vol. J79-D-II, No. 5, pp. 719-726, 1996.
- Constructing a 3D Object Model from Multiple Visual Features, IEEE International Conference on Systems, Man and Cybernetics, Vol. 4, pp. 2457-2461, (1996)
- Shape and Model from Specular Motion, 5th International Conference on Computer Vision, pp.92-97, (1995).
- Acquiring 3D models from rotation and a highlight. 12th International Conference on Pattern Recognition, Vol. 1, pp. 331-336, (1994).
- Acquiring 3D models from fixed points during rotation. 3th International Conference on Automation, Robotics, and Computer Vision, Vol. 1, pp. 459-463, (1994)
- Acquiring 3D models from sequences of contours. IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol 16, No. 2, 163-178 (1994).
- Recovering 3D models from silhouette sequence and detecting unexposed regions. Transactions of the Institute of Electronics, Information, and Communication Engineers, Vol J76-D-II, No. 6, pp. 1114-1122 (1993). (also selected and translated in American Magazine of Computer and Systems in Japan)
- Verifying and combining different visual cues into a complete 3D model. IEEE Conference on Computer Vision and Pattern Recognition (1992), pp. 777-780.
- 3D model from Contours: Further identification of unexposed areas. 11th International Conference on Pattern Recognition (1992), Vol.1, pp. 349-353.