Fall 2019 Tentative Schedule (Topics may change later in the semester)
August
29, 2019
Introduction
Reading:
Rusu PhD thesis, Chapters 2, 6,
Luc Van Gool etal., 3D Challanges and Non-In-Depth Overview of Recent Progress, 3D Imaging and Modlineg Conference, 2007. [Optional]
Fausto Bernardini and Holly Rushmeier, The 3D Model Acquisition Pipeline, Computer Graphics Forum V.21, No.2, pp. 149-172. [Optional]
Fausto Bernardini etal. Building a Digital Model of Michelangelo's Florentine Pieta, Computer Graphics and Applications, 2002 [Optional]
Libraries and
Sample Code
Coin3D library -> will not be required for this course
Reading and Visualizing Points in Scan Order (not required), Coin3D_Sample_Code (not required)
Various PTX files
Pre-compiled open source code for visualizing point clouds: CloudCompare
K-D tree libraries
Coin3D library -> will not be required for this course
Reading and Visualizing Points in Scan Order (not required), Coin3D_Sample_Code (not required)
Various PTX files
Pre-compiled open source code for visualizing point clouds: CloudCompare
K-D tree libraries
September 5, 2019 : NO CLASS - Monday Schedule
September 12, 2019
Laser Scanning and Segmentation
Reading:
Review of 20 Years of Range Sensor Development by Francois Blais, Journal of Electronic Imaging, 13(1): 231-240. January 2004.
Szymon Rusinkiewicz, Olaf Hall-Holt and Marc Levoy, Real-Time 3D Model Acquisition, SIGGRAPH 2002.
Range Image Segmentation for Modeling and Object Detection in Urban Scenes,
Slides:
RangeSegmentation, RegionGrowing, Hough,
RangeSegmentation2
Real-time acquisition
Other references:
Yizhou Yu, Andras Ferencz, and Jitendra Malik, Extracting Objects from Range and Radiance Images, IEEE Transactions on Visualization and Computer Graphics, Vol. 7, No. 4, 2001, pp.351-364.
J. Shi and J. Malik, Normalized Cuts and Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2000. <Helpful references>
J. Shi and J. Malik, Normalized Cuts and Image Segmentation, IEEE Conf. in Computer Vision and Pattern Recognition, Puerto Rico, 1997 [shorter version of the journal paper].
Besl and Jain, Segmentation through Variable-Order Surface Fitting, IEEE Transactions on PAMI, 1988 (Vol. 10, number 2).
Computing local planes (section 3.1) -- for math understanding
September 19, 2019
Alignment of 3D Point Sets (Range Registration).
Reading:
Efficient variants of the ICP algorithm
I. Stamos and M. Leordeanu, Automated Feature-Based Range Registration of Urban Scenes of Large Scale, IEEE International Conference of Computer Vision and Pattern Recognition 2003, pp. 555-561, Vol. II, Madison, WI.
Registration notes - Peter K. Allen, Columbia University
4-points Congruent Sets for Robust Surface Registration
A. Makadia, A. Patterson, and K. Daniilidis. Fully automatic registration of 3d point clouds. In IEEE Conf. Computer Vision and Pattern Recognition, New York, NY, June 18-20, 2006. pdf
Andrew E. Johnson and Martial Hebert, Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes,IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 21, NO. 5, MAY 1999.
Slides+:
ICP_slides, ICP_point_to_plane_linear_version,Line-based Registration
Original ICP papers: BeslMcKay,ChenMedioni
Horn's Closed Form Solution
Tutorials+code
A tutorial on k-d trees, Approximate Nearest Neighbor Code
Data
Ground Truth Data
Project 1
September 19 / September 26
3D Modeling on the Mesh Level.
Reading:
Mesh Data Structures - Intro to Decimation (2nd lecture) by Prof. Szymon Rusinkiewicz, Princeton University
The "Zipper" algorithm
The "BPA" algorithm
October
3 / October 10
3D Modeling on the Voxel Level.
Reading:
Michael Reed and Peter Allen 3-D Modeling from Range Imagery: An Incremental Method with a Planning Component, Image and Vision Computing, V. 17, pp. 99-111, 1999.
Brian Curless and Marc Levoy, A Volumetric Method for Building Complex Models from Range Images, Proc. SIGGRAPH '96.
Brian Curless and Marc Levoy, Better optical triangulation through spacetime analysis, Proc. ICCV '95.
Brian Curless: PhD Thesis
MichaelReed_Slides, VRIP_slides
October 17
Classification / Neural Networks in 3D Space
October
24
Fusing 3D and 2D techniquesReading:
Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes,
Estimating the Location of a Camera with Respect to a 3D Model Gehua Yang, Jacob Becker, Charles V. Stewart, 3DIM 2007.
Slides:
CameraCalibrationSlides, DistortionCorrectionNotes, 2D_3D_AutomatedMethods
Presentation by Martin: A systematic approach for 2D-image to 3D-range registration in urban environments,
PROJECTS TO BE DEFINED
October 31
Passive Techniques (Structure From Motion)
Reading:
Detailed Real-Time Urban 3D Reconstruction from Video.
PhotoSynth
S.M. Seitz, etal. A comparison and evaluation of multi-view stereo reconstruction algorithms, IEEE Conference on Computer Vision and Pattern Recognition, volume I, pages 519-526, 2006.
November 7
An Automated Method for Large-Scale, Ground-Based City Model Acquisition, C Früh, A Zakhor - International Journal of Computer Vision, 2004 - Springer
Towards Wiki based Dense City Modeling, Arnold Irschara, Christopher Zach and Horst Bischof, ICCV VRML Workshop 2007 (need link!)
The MIT City Scanning Project.
Seth Teller and Matthew Antone, Scalable Extrinsic Calibration of Omni-Directional Image Networks, IJCV 2002. City Scanning Project.
Student Presentation: Farnaz -> Planar segmentation from range data.
November 14
Symmetry
Main Reading:
Discovering Structural Regularity in 3D Geometry, SIGGRAPH 2008 [related: Partial and Approximate Symmetry Detection for 3D Geometry, SIGGRAPH 2006 and Symmetrization, SIGGRAPH 2007]
A Planar-Reflective Symmetry Transform for 3D shapes, SIGGRAPH 2006 [related: A reflective symmetry descriptor for 3D models, Algorithmica 2003] -- Slides
Online Detection of Repeated Structures in Point Clouds of Urban Scenes for Compression and Registration, S. Friedman and I. Stamos, International Journal of Computer Vision (Special Issue: 3D Imaging, Processing and Modeling), Volume 102, Issue 1-3, pp 112-128, March 2013. Online version here (DOI 10.1007/s11263-012-0575-y). Local copy (PDF) -- do not redistribute.
J-Linage models and VPs
November 21
November 28
December 5 - December 12
<project presentations>