At a recent MIT/Lincoln Labs 2017 Beaver Works Summer Institute Seminar, Sertac Karaman gave a lecture on low-level robot vision. Looky here:
With the advent of the digital camera, vision sensors have become ubiquitous. Combining vision sensors with GPU computing elements enables a breakthrough in camera based perception for a wide range of applications. In this lecture, we find out how this can be applied to mobile robots. As this information forms a basis for programming the MIT RACECAR, a NVIDIA Jetson based robot, we cover that information here.
In the lecture, Dr. Karaman gives a short history of computer vision and then expounds on how modern low-level robot vision systems work. Topics include:
- Camera as sensor
- Color representation
- Object detection
- Camera calibration
Much of this lecture is drawn from material covered in actual MIT classes.
There are many more lectures available in this summer series, with a wide range of subject matter. We will be providing pointers to the lectures that directly address the RACECAR, but it’s worth going through the playlist to find other topics which may interest you.
Note that these lectures are given to high school senior students.
Note: In case there are browser issues, the YouTube address is: https://www.youtube.com/watch?v=tqLaCJfkVaI
Note: Some people find it helpful to set the playback speed for these types of videos to 1.25X on YouTube, the setting is available in the settings menu. This saves a little time while watching, but the fidelity is still good enough to understand the lecture. You can always put it back to normal speed for the tricky bits.