3D Photography
Spring 2009
Prof. Ioannis Stamos
Tentative Schedule

• Introduction to 3D Photography.
• Introduction to Open Inventor Libraries.
• Reading:

• Fausto Bernardini and Holly Rushmeier, The 3D Model Acquisition Pipeline, Computer Graphics Forum V.21, No.2, pp. 149-172.
• Fausto Bernardini etal. Building a Digital Model of Michelangelo's Florentine Pieta, Computer Graphics and Applications, 2002
• Pieta Project web site.

Libraries and Sample Code
Coin3D library
Sample Code (to read input files)
Code EigenVector
Computing local planes (section 3.1)
Coin3D_Sample_Code

Input File 0 (Small Example)
Input File 1 (Real Data)
Input File 2 (Real Data)

Feb. 2

• Laser Scanning.
• Segmentation
  
• Reading:
• Review of 20 Years of Range Sensor Development by Francois Blais, Journal of Electronic Imaging, 13(1): 231-240. January 2004.
• Range Image Segmentation for Modeling and Object Detection in Urban Scenes, C. Chen, I. Stamos, The 6th International Conference on 3-D Digital Imaging and Modeling, Montreal, Canada, August 21-23 2007. PDF
• Szymon Rusinkiewicz, Olaf Hall-Holt and Marc Levoy, Real-Time 3D Model Acquisition, SIGGRAPH 2002.
• Other references:
• Yizhou Yu, Andras Ferencz, and Jitendra Malik, Extracting Objects from Range and Radiance Images, IEEE Transactions on Visualization and Computer Graphics, Vol. 7, No. 4, 2001, pp.351-364.
• J. Shi and J. Malik, Normalized Cuts and Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2000.  <Helpful references>
  
• J. Shi and J. Malik, Normalized Cuts and Image Segmentation, IEEE Conf. in Computer Vision and Pattern Recognition, Puerto Rico, 1997 [shorter version of the journal paper].
• Besl and Jain, Segmentation through Variable-Order Surface Fitting, IEEE Transactions on PAMI, 1988 (Vol. 10, number 2).

Feb. 9

• Alignment of 3D Point Sets (Range Registration).
  
• Reading:

• Efficient variants of the ICP algorithm 
• I. Stamos and M. Leordeanu, Automated Feature-Based Range Registration of Urban Scenes of Large Scale, IEEE International Conference of Computer Vision and Pattern Recognition 2003, pp. 555-561, Vol. II, Madison, WI. 
• Semi-automatic range to range registration: a feature-based method, C. Chen and I. Stamos, The 5th International Conference on 3-D Digital Imaging and Modeling, Ottawa,June 13-17, 2005, pp. 254-261.PDF
• Registration notes - Peter K. Allen, Columbia University
• 4-points Congruent Sets for Robust Surface Registration
• A. Makadia, A. Patterson, and K. Daniilidis. Fully automatic registration of 3d point clouds. In IEEE Conf. Computer Vision and Pattern Recognition, New York, NY, June 18-20, 2006. pdf
• Andrew E. Johnson and Martial Hebert, Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes,IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 21, NO. 5, MAY 1999.
• D. Huber and M. Hebert, Fully Automatic Registration of Multiple 3D Data Sets, IEEE Computer Society Workshop on Computer Vision Beyond the Visible Spectrum(CVBVS 2001), December, 2001.

Feb. 16   [PRESIDENT's day - GC closed]

Feb. 23

• 3D Modeling on the Mesh Level.
• Reading:
• Mesh representations (slides needed).
• Mesh Data Structures - Intro to Decimation (2nd lecture)  by Prof. Szymon Rusinkiewicz, Princeton University

• The "Zipper" algorithm
• The "BPA" algorithm

• Mesh Parametrization.
• Reading:
• TBA
• Think Globally, Cluster Locally: A Unified Framework for Range Segmentation, G. Yu, M. Grossberg, G. Wolberg, I. Stamos,  Fourth International Symposium on 3D Data Processing, Visualization and Transmission. June 18-20, 2008,  Georgia Institute of Technology, Atlanta, GA.  PDF.
• Variational Shape Approximation
  

• 3D Modeling on the Voxel Level.
• Reading:
• Michael Reed and Peter Allen 3-D Modeling from Range Imagery: An Incremental Method with a Planning Component, Image and Vision Computing, V. 17, pp. 99-111, 1999.
• Brian Curless and Marc Levoy, A Volumetric Method for Building Complex Models from Range Images, Proc. SIGGRAPH '96.
• Brian Curless and Marc Levoy, Better optical triangulation through spacetime analysis, Proc. ICCV '95.
• A Bayesian Method for Probable Surface Reconstruction and Decimation

 

• Mesh Simplification
• Reading:
• Mesh simplification using quadric error measures
• Variational Shape Approximation

• Passive Techniques (Structure From Motion)
• Reading:
• Detailed Real-Time Urban 3D Reconstruction from Video.
• PhotoSynth
• S.M. Seitz, etal. A comparison and evaluation of multi-view stereo reconstruction algorithms, IEEE Conference on Computer Vision and Pattern Recognition, volume I, pages 519-526, 2006.
  

• Fusing 3D and 2D techniques
• Reading:
• Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes, I. Stamos, L. Liu, C. Chen,G. Wolberg, G. Yu, S. Zokai, International Journal of Computer Vision [Special Issue on Modeling and Representation of Large-Scale 3D Scenes], 2008. PDF -- The original publication is available at www.springerlink.com (DOI 10.1007/s11263-007-0089-1). To get the original publication click here
• A systematic approach for 2D-image to 3D-range registration in urban environments, L. Liu, I. Stamos, VRML Workshop, 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, October 14-20 2007. PDF
• Estimating the Location of a Camera with Respect to a 3D Model Gehua Yang, Jacob Becker, Charles V. Stewart, 3DIM 2007.
• J. Diebel and S. Thrun. An application of markov random fields to range sensing. In Proceedings of Conference on Neural Information Processing Systems (NIPS), Cambridge, MA, 2005. MIT Press.

• City Modeling
• Reading:
• An Automated Method for Large-Scale, Ground-Based City Model Acquisition, C Früh, A Zakhor - International Journal of Computer Vision, 2004 - Springer
• Towards Wiki based Dense City Modeling, Arnold Irschara, Christopher Zach and Horst Bischof, ICCV VRML Workshop 2007 (need link!)
• The MIT City Scanning Project.
• Seth Teller and Matthew Antone Scalable Rotational Registration of Omni-Directional Image Networks, IJCV 2001. City Scanning Project.
• Seth Teller and Matthew Antone Scalable, Absolute Position Recovery for Omni-Directional Image Networks IJCV, 2001

• Steven J. Gortler, Radek Grzeszczu, Richard Szeliski, Michael F. Cohen, The Lumigraph, SIGGRAPH 1996.
• Marc Levoy and Pat Hanrahan LightField Rendering , SIGGRAPH, 1996.
• Chris Buehler etal. Unstructured Lumigraph, SIGGRAPH 2000.
• The Facade Method
• Paul E. Debevec, Camillo J. Taylor, and Jitendra Malik. Modeling and Rendering Architecture from Photographs. In SIGGRAPH '96, August 1996.

• Texture Mapping
• Reading:
• Acquiring, Stitching and Blending Appearance Attributes on 3D Models, by Rocchini, P. Cignoni, C. Montani and R. Scopigno The Visual Computer, Springer International, 18 (2002) 3, 186-204, 2002. 
• Building illumination coherent 3D models of large-scale outdoor scenes, A. Troccoli and P.K. Allen, IJCV Special Issue, 2008. 
• "High-Quality Texture Reconstruction from Multiple Scans" by Fausto Bernardini, Ioana M. Martin and Holly Rushmeier, IBM T. J. Watson Research Center.

• Additional Topics
• Reading:
• 3D Urban Scene Modeling Integrating Recognition and Reconstruction, IJCV 2008.
• Discovering Structural Regularity in 3D Geometry, SIGGRAPH 2008.
• Image-based procedural modeling of facades, SIGGRAPH 2007.
  

May 11

Project Presentations

Additional Material (time permitting)

• Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs.
• Y. Sato, M. D. Wheeler, and K. Ikeuchi,Object shape and reflectance modeling from observation, Proceedings of ACM SIGGRAPH 97, In Computer Graphics Proceedings, Annual Conference Series 1997, ACM SIGGRAPH, pp. 379-387, August 1997.
• S. M. Seitz and C. R. Dyer, Photorealistic Scene Reconstruction by Voxel Coloring ,Proc. Computer Vision and Pattern Recognition Conf., 197, 1067-1073.
  

THE END