Monthly Subscription Starting at AED 99 + VAT

3D Reconstruction - Single Viewpoint
  • Level Foundation
  • Duration 11 hours
  • Course by Columbia University
  • Offered by

About

This course focuses on the recovery of the 3D structure of a scene from its 2D images. In particular, we are interested in the 3D reconstruction of a rigid scene from images taken by a stationary camera (same viewpoint). This problem is interesting as we want the multiple images of the scene to capture complementary information despite the fact that the scene is rigid and the camera is fixed. To this end, we explore several ways of capturing images where each image provides additional information about the scene. In order to estimate scene properties (depth, surface orientation, material properties, etc.) we first define several important radiometric concepts, such as, light source intensity, surface illumination, surface brightness, image brightness and surface reflectance. Then, we tackle the challenging problem of shape from shading - recovering the shape of a surface from its shading in a single image. Next, we show that if multiple images of a scene of known reflectance are taken while changing the illumination direction, the surface normal at each scene point can be computed. This method, called photometric stereo, provides a dense surface normal map that can be integrated to obtain surface shape. Next, we discuss depth from defocus, which uses the limited depth of field of the camera to estimate scene structure. From a small number of images taken by changing the focus setting of the lens, a dense depth of the scene is recovered. Finally, we present a suite of techniques that use active illumination (the projection of light patterns onto the scene) to get precise 3D reconstructions of the scene. These active illumination methods are the workhorse of factory automation. They are used on manufacturing lines to assemble products and inspect their visual quality. They are also extensively used in other domains such as driverless cars, robotics, surveillance, medical imaging and special effects in movies.

Modules

Welcome to First Principles of Computer Vision: 3D Reconstruction - Single Viewpoint

    • 6 Readings
Show info about module content

6 Readings

  • Course Syllabus
  • About the Instructor
  • Course Information and Support
  • Academic Honesty Policy
  • Discussion Forum Etiquette
  • Frequently Asked Questions

Pre-Course Survey

    • 1 Readings
    • 1 Plugin
Show info about module content

1 Readings

  • Pre-Course Survey

Week 1: Introduction to First Principles of Computer Vision

    • 2 Discussion
    • 7 Plugin
Show info about module content

2 Discussions

  • Introductions
  • Week 1 Questions and Feedback

Week 2: Radiometry and Reflectance

    • 2 Discussion
    • 7 Plugin
    • 6 Assignment
Show info about module content

6 Assignment

  • 2.2 Radiometric Concepts Self-Check Quiz
  • 2.3 Scene Radiance and Image Irradiance Self-Check Quiz
  • 2.4 BRDF: Bidirectional Reflectance Distribution Function Self-Check Quiz
  • 2.5 Reflectance Models Self-Check Quiz
  • 2.6 Reflectance from Rough Surfaces Self-Check Quiz
  • 2.7 Dichromatic Model Self-Check Quiz

2 Discussions

  • Week 2 Lambertian Sphere
  • Week 2 Questions and Feedback

Week 2 Quiz

    • 1 Assignment
Show info about module content

1 Assignment

  • Week 2 Radiometry and Reflectance

Week 3: Photometric Stereo

    • 2 Discussion
    • 7 Plugin
    • 6 Assignment
Show info about module content

6 Assignment

  • 3.2 Gradient Space and Reflectance Map Self-Check Quiz
  • 3.3 Photometric Stereo Self-Check Quiz
  • 3.4 Lambertian Case Self-Check Quiz
  • 3.5 Calibration Based Photometric Stereo Self-Check Quiz
  • 3.6 Shape from Normals Self-Check Quiz
  • 3.7 Interreflections Self-Check Quiz

2 Discussions

  • Week 3 Lambertian Surface
  • Week 3 Questions and Feedback

Week 3 Quiz

    • 1 Assignment
Show info about module content

1 Assignment

  • Week 3 Photometric Stereo

Week 4: Shape from Shading

    • 2 Discussion
    • 5 Plugin
    • 5 Assignment
Show info about module content

5 Assignment

  • 4.1 Overview of Shape from Shading Self-Check Quiz
  • 4.2 Human Perception of Shading Self-Check Quiz
  • 4.3 Stereographic Projection Self-Check Quiz
  • 4.4 Shape from Shading Algorithm Self-Check Quiz
  • 4.5 Shading Illusions Self-Check Quiz

2 Discussions

  • Week 4 Shape from Shading and Photometric Stereo
  • Week 4 Questions and Feedback

Week 4 Quiz

    • 1 Assignment
Show info about module content

1 Assignment

  • Week 4 Shape from Shading

Week 5: Depth from Defocus

    • 2 Discussion
    • 4 Plugin
    • 4 Assignment
Show info about module content

4 Assignment

  • 5.1 Overview of Depth from Defocus Self-Check Quiz
  • 5.2 Point Spread Function Self-Check Quiz
  • 5.3 Depth from Focus Algorithm Self-Check Quiz
  • 5.4 Depth from Defocus Self-Check Quiz

2 Discussions

  • Week 5 Depth of Field Camera
  • Week 5 Questions and Feedback

Week 5 Quiz

    • 1 Assignment
Show info about module content

1 Assignment

  • Week 5 Depth from Defocus

Active Illumination Methods

    • 2 Discussion
    • 6 Plugin
    • 5 Assignment
Show info about module content

5 Assignment

  • 6.2 Photometric Stereo Systems Self-Check Quiz
  • 6.3 Structured Light Range Finding Self-Check Quiz
  • 6.4 Phase Shifting Method Self-Check Quiz
  • 6.5 Structured Light Systems Self-Check Quiz
  • 6.6 Time of Flight Method Self-Check Quiz

2 Discussions

  • Week 6 Phase Shifting Method
  • Week 6 Questions and Feedback

Week 6 Quiz

    • 1 Assignment
Show info about module content

1 Assignment

  • Week 6 Active Illumination Methods

Post-Course Survey

    • 1 Readings
    • 1 Plugin
Show info about module content

1 Readings

  • Post-Course Survey
Shree Nayar
Instructor

Shree Nayar