Description

16-822: Geometry-based Methods in Vision

Instructor: Martial Hebert
TA: Xiaofang Wang, Xinshuo Weng

Monday and Wednesday, 09:00 - 10:20 AM, NSH 1305
Alternate time: Thursday, 6PM, TBD

Summary:
The course focuses on the geometric aspects of computer vision: the geometry of image formation and its use for 3D reconstruction and calibration. The objective of the course is to introduce the formal tools and results that are necessary for developing multi-view reconstruction algorithms. The fundamental tools introduced study affine and projective geometry, which are essential to the development of image formation models. Additional algebraic tools, such as exterior algebras are also introduced at the beginning of the course. These tools are then used to develop formal models of geometric image formation for a single view (camera model), two views (fundamental matrix), and three views (trifocal tensor); 3D reconstruction from multiple images; and auto-calibration. If time permits, we will also look at the application of these concepts to the reconstruction of smooth surfaces and deep learning related topics.

Books:
R. Hartley and A. Zisserman, “Multiple View Geometry in Computer Vision”, Cambridge University Press.
O.D. Faugeras, Q.-T. Luong, and T. Papadopoulo, “The Geometry of Multiple Images”, MIT Press, 2001.

Add a Class Description

Click the Edit button to add a class description.

No description, yet. Stay tuned!

General Information

Grading Policy
4 Homeworks (implementation + theory) (45%)
Midterm (20%)
Project (proposal + mid-presentation + final presentation) (20%)
Scribing (15%)

The deadline for all homework is by midnight (11:59pm) of the due day.

Homework Late Submission Policy
Late days: Each student is allocated 3 late days for the semester. Each is worth an extension of 24 hours (CANNOT BE SPLIT). You could extend 3 homeworks by a late day each, or you could extend 1 homework 3 late days, etc.

Homework is worth up to full credit before the due date.
It is worth up to half credit for the next 48 hours.
It is worth zero credit after that.

You must inform the TA when you plan to take late days before the original homework due date. It's recommended that you save your late days for when you need them (which can be hard to predict far in advance).
Remove Row
Class Schedule
27-Aug Intro Homework 0 out

MATH FUNDAMENTALS
29-Aug Geometry intro
3-Sep Labor Day Homework 1 out
5-Sep Geometry intro

SINGLE VIEW GEOMETRY
10-Sep Single view geometry
12-Sep Calibration and PnP problems
17-Sep Calibration and PnP problems

TWO VIEW GEOMETRY
19-Sep Two-view geometry
24-Sep Two-view geometry
26-Sep Two-view geometry
1-Oct N-pt algorithms Homework 1 due; Homework 2 out
3-Oct N-pt algorithms Project Proposal due
8-Oct Review
10-Oct Midterm

MULTIVIEW GEOMETRY
15-Oct Autocalibration
17-Oct Autocalibration
22-Oct N view geometry Homework 2 due; Homework 3 out
24-Oct N view geometry
29-Oct Rigid SfM, Bundle adjustment
31-Oct Rigid SfM, Bundle adjustment
5-Nov Incremental techniques
7-Nov Dense reconstruction
12-Nov Dense reconstruction Homework 3 due; Homework 4 out
14-Nov Non rigid SfM
19-Nov Non rigid SfM
21-Nov Thanksgiving

DEEP LEARNING
26-Nov Deep learning techniques
28-Nov Deep learning techniques
3-Dec Deep learning techniques Homework 4 due
5-Dec Deep learning techniques
Remove Row
Scribing
Scribing is compulsory for each student for at least three lectures. To make it easier, two students form a group to scribe a lecture. Each lecture will be usually scribed by three groups.

The scribing duties for each group will be as follows:
1) Take detailed notes in the class.
2) Clarify any ambiguities in their notes by discussion within their group.
3) Build the LaTeX document, and submit.

The scribing for class on Monday are due on Friday same week, and scribing for class on Wednesday/Thursday are due on Monday next week. If they are submitted between 1 week and 2 weeks afterward, they are worth up to half credit. If they are submitted later than 2 weeks afterward, they are worth zero credit (and they are still mandatory). The Latex template for submission is posted in the class resources.

Students are free to make their own group for the scribing. For students who cannot find a teammate, we will randomly assign students to form the group. Once the groups are formed, each group should sign up the first scribing date: https://docs.google.com/spreadsheets/d/1EPyDUUM50io0VN1d5X9hVMPKtO67Q1JyE2aICbyVAGw/edit#gid=639489248. If all dates listed are occupied, put your group and name on the bottom, we will randomly assign a date for you. The rest of the two scribings for each group will be assigned in order. Note that the students should not expect to scribe the exactly same lecture on the date shown in the Class Schedule, as the schedule may change in case of traveling or holidays. The different groups can discuss and explain, but they *must* submit independent notes and *must* acknowledge the help from other groups (See Collaboration Policy).
Remove Row
Collaboration Policy
Each student must hand in their own answers. In addition, each student must write their own code in the programming part of the assignment. It is acceptable, however, for students to collaborate in figuring out answers and helping each other solve the problems. We will be assuming that, as participants in a graduate course, you will be taking the responsibility to make sure you personally understand the solution to any work arising from such collaboration. You *must* indicate on each homework with whom you collaborated. Do not share non-pseudocode with each other. If in doubt, consult the CMU plagiarism page here: https://www.cmu.edu/academic-integrity/defining/plagiarism.html

Remove Row

Edit Class Information

Click the Edit button to add class information.

Some Ideas:

  • Class Website
  • Class Facebook Page

No information, yet. Stay tuned!

Announcements

show all show recent

Announcements are not public for this course.

Scribed Notes for Lecture on 12/03

12/11/18 9:55 AM

Hi All: 

 

The final scribed notes for the lecture on 12/03 are available on Piazza "Resources" section.

You are all done here. Excellent work throughout the semester!
 

Thanks,

TAs

View More View Less · View on Piazza

Clean Up After Poster Session

12/10/18 2:37 PM

Hi All,

We will have our final poster presentation today starting from 05:30 PM in NSH Atrium. This is just a friendly request that please clean up your space before you leave and do not leave any leftover you have there.

Thanks!

TAs

View More View Less · View on Piazza

Scribed Notes for Lecture on 11/28

12/04/18 10:12 AM

Hi All: 

 

The scribed notes for the lecture on 11/28 are available on Piazza "Resources" section.
 

Thanks,

TAs

 

View More View Less · View on Piazza

Solution Released

12/02/18 8:50 PM

Hi All,

The grade and solution are released for both HW2 and HW3. The class has done exceptionally well in the homework! 

In case someone did not receive the grade, please let me know. Also, if you find there is any typo in the solution, please contact us.

Thanks,

TAs

View More View Less · View on Piazza

Scribed Notes for Lecture on 11/26

12/01/18 9:17 AM

Hi All: 

 

The scribed notes for the lecture on 11/26 are available on Piazza "Resources" section.
 

Thanks,

TAs

View More View Less · View on Piazza

Final Project Presentation

11/28/18 10:44 AM

Hi All,

The following contains information about the final project presentation: 

 

1. We will have a final poster presentation on Dec 10 (Monday) from 05:30-08:30 PM in NSH Atrium. All the students should have their setup done by 05:20 pm in NSH atrium. 

2. Regarding poster printing. Now every SCS students should have an SCS account to do the poster printing for free. You will have to follow the instructions here <https://computing.cs.cmu.edu/desktop/printing-posters.html>. The poster board is roughly 32x40 (there are a few larger boards of 40x60 if anyone needs). So it might be good to optimize the size so that your poster can be fully contained on the poster board.

3. Deadline for poster submission: If you are not an SCS student and thus do not have the SCS account. We can print the poster for you, you will have to upload on piazza as a private post by Dec 5 (Wednesday) 11:00 am. This is a strict deadline as it is end-of-the-semester time and there would be a big queue at SCS poster printing services. We want to avoid any delays due to such issues.

4. The poster should cover the motivation, the problem, the methodology, and explanation of the results. We encourage you present results regardless if you do not have positive results. It is highly motivated to present the negative results as well. In research, the negative results are as much important as positive results, and that students should not shy away from it. 

5. Please put your project-id and Andrew-id on your poster. The project ID is the one you are assigned during the mid-presentation.

6. Let us know in advance if you have a live demo for your results that you want to show at the poster presentation OR you need any logistic help with the demo of your results (video etc). 

7. There will be some snacks served.

 

Please let us know if you have any other queries or we missed something here.

 

Looking forward to your presentation!

 

Thanks,

TAs

#pin

View More View Less · View on Piazza

Tuesday Office Hour Change

11/26/18 10:32 AM

Hello everyone,

I will have to end at 10:25 AM for tomorrow's office hour due to some schedule change. I am sorry for that and please feel free to contact me if you have any questions.

Best,

Xiaofang

View More View Less · View on Piazza

Scribed Notes for Lecture on 11/19

11/24/18 12:22 PM

Hi All: 

 

The scribed notes for the lecture on 11/19 are available on Piazza "Resources" section: 
 

Thanks,

TAs

 

View More View Less · View on Piazza

Add an Announcement

Click the Add button to add an announcement.

No announcements, yet. Stay tuned!

Name   Office Hours
hebert
When? Noon-1:30pm Mondays
Where? NSH 4113
Xinshuo Weng
When? 10:00am - 12:00pm Fridays
Where? Smith 200
Xiaofang Wang
When? 9am - 11am Tuesdays
Where? Smith 200
Martin Li
When?
Where?
Nate Chodosh
When?
Where?
dinesh reddy
When?
Where?

No instructors have been added to this course, yet. Stay tuned!

Your changes were successfully saved!
Want to associate dates with your resources? Make sure to enter a Date Title, like "Lecture Date."
Section Title Add a Date? Date Title Actions
Need to add a new section? Enter a Section Title. You can configure the section before saving it.

Homework

Homework Due Date Actions
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date

Nothing has been added to the Homework section, yet.

Click the "Add Links" or "Add Files" button to add resources.

This resource section is not public for this course.

Homework Solutions

Homework Solutions Actions
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date

Nothing has been added to the Homework Solutions section, yet.

Click the "Add Links" or "Add Files" button to add resources.

This resource section is not public for this course.

Lecture Notes

Lecture Notes Lecture Date Actions
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Aug 27, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Aug 27, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Sep 5, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Sep 10, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Sep 17, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Sep 19, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Oct 1, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Oct 3, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Oct 3, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Oct 22, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
Oct 24, 2018
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date

Nothing has been added to the Lecture Notes section, yet.

Click the "Add Links" or "Add Files" button to add resources.

This resource section is not public for this course.

General Resources

General Resources Actions
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date

Nothing has been added to the General Resources section, yet.

Click the "Add Links" or "Add Files" button to add resources.

This resource section is not public for this course.

Scribing

Scribing Date Actions
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date
Click "Post a note" anytime to create a note related to this resource. (you can review its content before posting)
click to edit date

Nothing has been added to the Scribing section, yet.

Click the "Add Links" or "Add Files" button to add resources.

This resource section is not public for this course.

Groups allow instructors and students to post to a subset of students in the class, suitable for when your class consists of multiple sections or project groups. Join a group to read and ask questions for that particular group.


Instructor has not allowed students to join groups themselves. You can edit this option in the Class Settings page.