3D Photography
Spring 2010 Tentative Schedule



February 2nd


Introduction to 3D Photography.
Introduction to Open Inventor Libraries.

Reading:
Fausto Bernardini and Holly Rushmeier, The 3D Model Acquisition Pipeline, Computer Graphics Forum V.21, No.2, pp. 149-172.
Fausto Bernardini etal. Building a Digital Model of Michelangelo's Florentine Pieta, Computer Graphics and Applications, 2002
Pieta Project web site.

Slides:

Introduction, Sensors




Libraries and Sample Code
Coin3D library

Reading and Visualizing Points in Scan Order (code presented in class), Input File (Park Avenue)

Sample Code (to read input files)
Code EigenVector
Computing local planes (section 3.1)
Coin3D_Sample_Code

Input File 0 (Small Example)
Input File 1 (Real Data)
Input File 2 (Real Data)



February 9th

Laser Scanning and
Segmentation

Reading:

Review of 20 Years of Range Sensor Development by Francois Blais, Journal of Electronic Imaging, 13(1): 231-240. January 2004.

Szymon Rusinkiewicz, Olaf Hall-Holt and Marc Levoy, Real-Time 3D Model Acquisition, SIGGRAPH 2002.

Range Image Segmentation for Modeling and Object Detection in Urban Scenes, C. Chen, I. Stamos, The 6th International Conference on 3-D Digital Imaging and Modeling, Montreal, Canada, August 21-23 2007. PDF

Slides:

RangeSegmentation, RegionGrowing, Hough

Project1

Other references:

Yizhou Yu, Andras Ferencz, and Jitendra Malik, Extracting Objects from Range and Radiance Images, IEEE Transactions on Visualization and Computer Graphics, Vol. 7, No. 4, 2001, pp.351-364.
J. Shi and J. Malik, Normalized Cuts and Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2000.  <Helpful references>

J. Shi and J. Malik, Normalized Cuts and Image Segmentation, IEEE Conf. in Computer Vision and Pattern Recognition, Puerto Rico, 1997 [shorter version of the journal paper].
Besl and Jain, Segmentation through Variable-Order Surface Fitting, IEEE Transactions on PAMI, 1988 (Vol. 10, number 2).






February 16th


Alignment of 3D Point Sets (Range Registration).

Reading:

Efficient variants of the ICP algorithm

I. Stamos and M. Leordeanu, Automated Feature-Based Range Registration of Urban Scenes of Large Scale, IEEE International Conference of Computer Vision and Pattern Recognition 2003, pp. 555-561, Vol. II, Madison, WI.

Registration notes - Peter K. Allen, Columbia University

4-points Congruent Sets for Robust Surface Registration

A. Makadia, A. Patterson, and K. Daniilidis. Fully automatic registration of 3d point clouds. In IEEE Conf. Computer Vision and Pattern Recognition, New York, NY, June 18-20, 2006. pdf

Andrew E. Johnson and Martial Hebert, Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes,IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 21, NO. 5, MAY 1999.

Slides+:

ICP_slides, ICP_point_to_plane_linear_version,Line-based Registration

Original ICP papers: BeslMcKay,ChenMedioni

Horn's Closed Form Solution

Tutorials+code

A tutorial on k-d trees, Approximate Nearest Neighbor Code



February 23rd [First HW due]


3D Modeling on the Mesh Level.

Reading:

Mesh representations (slides needed).

Mesh Data Structures - Intro to Decimation (2nd lecture)  by Prof. Szymon Rusinkiewicz, Princeton University

The "Zipper" algorithm

The "BPA" algorithm

BPASlides, ZipperSlides1,SurfaceReconstructionSlides,MeshDataStructuresSlides




March 2nd

3D Modeling on the Voxel Level.

Reading:

Michael Reed and Peter Allen 3-D Modeling from Range Imagery: An Incremental Method with a Planning Component, Image and Vision Computing, V. 17, pp. 99-111, 1999.

Brian Curless and Marc Levoy, A Volumetric Method for Building Complex Models from Range Images, Proc. SIGGRAPH '96.

Brian Curless and Marc Levoy, Better optical triangulation through spacetime analysis, Proc. ICCV '95.


Brian Curless: PhD Thesis



MichaelReed_Slides, VRIP_slides

Project2



March 9th
Mesh Simplification

Reading:

Mesh simplification using quadric error measures

Variational Shape Approximation

Slides:
quadric_error_measures, vsa



March 16th[Second HW Due]


Passive Techniques (Structure From Motion)

Reading:

Detailed Real-Time Urban 3D Reconstruction from Video.

PhotoSynth

S.M. Seitz, etal. A comparison and evaluation of multi-view stereo reconstruction algorithms, IEEE Conference on Computer Vision and Pattern Recognition, volume I, pages 519-526, 2006.




March 23rd[Project Proposal Due]

Fusing 3D and 2D techniques

Reading:

Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes,I. Stamos, L. Liu, C. Chen,G. Wolberg, G. Yu, S. Zokai, International Journal of Computer Vision [Special Issue on Modeling and Representation of Large-Scale 3D Scenes], 2008. PDF -- The original publication is available at www.springerlink.com (DOI 10.1007/s11263-007-0089-1). To get the original publication click here

A systematic approach for 2D-image to 3D-range registration in urban environments, L. Liu, I. Stamos, VRML Workshop, 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, October 14-20 2007. PDF

Estimating the Location of a Camera with Respect to a 3D Model Gehua Yang, Jacob Becker, Charles V. Stewart, 3DIM 2007.

Slides:

CameraCalibrationSlides, DistortionCorrectionNotes, 2D_3D_AutomatedMethods

More data:

SomeScansToTryWithICP




March 30th [Spring Break, No class]



April 6th

City Modeling

Reading:

An Automated Method for Large-Scale, Ground-Based City Model Acquisition, C Früh, A Zakhor - International Journal of Computer Vision, 2004 - Springer
Towards Wiki based Dense City Modeling, Arnold Irschara, Christopher Zach and Horst Bischof, ICCV VRML Workshop 2007 (need link!)

Student Presention: Tom Flynn, Spin Images.

The MIT City Scanning Project.

Seth Teller and Matthew Antone Scalable Rotational Registration of Omni-Directional Image Networks, IJCV 2001. City Scanning Project.

Seth Teller and Matthew Antone Scalable, Absolute Position Recovery for Omni-Directional Image Networks IJCV, 2001

J. Diebel and S. Thrun. An application of markov random fields to range sensing. In Proceedings of Conference on Neural Information Processing Systems (NIPS), Cambridge, MA, 2005. MIT Press.




April 13th

Symmetry

Main Reading: 

Discovering Structural Regularity in 3D Geometry, SIGGRAPH 2008 [related: Partial and Approximate Symmetry Detection for 3D Geometry, SIGGRAPH 2006 and Symmetrization, SIGGRAPH 2007]


A Planar-Reflective Symmetry Transform for 3D shapes, SIGGRAPH 2006 [related: A reflective symmetry descriptor for 3D models, Algorithmica 2003]


Student Presentation: Sam Friedman, Symmetry.

Other:

Image-based procedural modeling of facades, SIGGRAPH 2007.

Detecting and Matching Repeated Patterns for Automatic Geo-tagging in Urban Environments





April 20th


Texture Mapping

Reading:

Acquiring, Stitching and Blending Appearance Attributes on 3D Models, by Rocchini, P. Cignoni, C. Montani and R. Scopigno The Visual Computer, Springer International, 18 (2002) 3, 186-204, 2002.

Building illumination coherent 3D models of large-scale outdoor scenes, A. Troccoli and P.K. Allen, IJCV Special Issue, 2008.

"High-Quality Texture Reconstruction from Multiple Scans" by Fausto Bernardini, Ioana M. Martin and Holly Rushmeier, IBM T. J. Watson Research Center.

Student Presentation: Ilya Korsunsky, Real time 3D model acquisition.



April 27th

Alternative Methods

Reading:

Steven J. Gortler, Radek Grzeszczu, Richard Szeliski, Michael F. Cohen, The Lumigraph, SIGGRAPH 1996.

Marc Levoy and Pat Hanrahan LightField Rendering , SIGGRAPH, 1996. More recent work: Marc Levoy, IEEE Computer Society 2006: Light Fields and Computational Imaging.

Chris Buehler etal. Unstructured Lumigraph, SIGGRAPH 2000.

The Facade Method

Paul E. Debevec, Camillo J. Taylor, and Jitendra Malik. Modeling and Rendering Architecture from Photographs. In SIGGRAPH '96, August 1996.

Student Presentation: George Koumantaris, Subdivision Surfaces: Approximating Catmull-Clark Subdivision Surfaces, CGAL Tutorial



May 4th

Student Presentations



May 11th [last class]

Student Presentations