Computer Vision, One Photon at a Time
Machine Learning Lunch Meeting: Mohit Gupta, Tuesday April 11, 12:15pm CS 1240
Event Details
You are cordially invited to the weekly CS Machine Learning Lunch Meetings. This is a chance to get to know machine learning professors, and talk to your fellow researchers. Our next meeting will be on Tuesday April 11 12:12-1:30pm in CS 1240. Professor Mohit Gupta will explain single photon imaging, see abstract below.
If you would like to be informed of future CS Machine Learning Lunch Meetings, please sign up our mailing list at https://lists.cs.wisc.edu/mailman/listinfo/mllm -- please use your cs or wisc email. After you enter your email, the system will send you an email for confirmation. Only after you respond to that email will you be on the mailing list.
Title: Computer Vision, One Photon at a Time
Abstract: Single-photon avalanche diodes (SPADs) are an emerging sensor technology that promises single-photon sensitivity and the ability to time-tag photons with picosecond precision. In the last few years, we have witnessed a single-photon revolution, resulting for the first time in multi-megapixel SPAD arrays, which allow capturing sufficient spatial details needed for mainstream computer vision applications, including object detection and tracking, text recognition, pose recognition, and SLAM. This raises the following questions: Are SPADs ready to be used beyond niche scientific applications, as general-purpose computer vision sensors? Can they be deployed outside the lab in-the-wild? If so, what are their benefits over conventional cameras?
I will talk about developing single-photon vision algorithms for extracting scene information from SPAD photon streams. With extensive real-world data, we demonstrate that current SPAD arrays, along with single-photon burst processing as an example plug-and-play algorithm, are now capable of a wide range of downstream vision tasks in extremely challenging imaging conditions including rapid motion in low light (~0.1 lux) and high dynamic range. I will briefly discuss open challenges in the rapidly developing area of single-photon computer vision.