SlideShare a Scribd company logo
Gordon Wetzstein
http://web.media.mit.edu/~gordonw
MIT Media Lab / Stanford University
Computational Cameras and Displays
Matthew O’Toole
www.dgp.toronto.edu/~motoole
University of Toronto
www.dgp.toronto.edu/~motoole/computationalcamerasanddisplays.html
evolution of digital imaging
2000 20142002 2004 2006 2008 2010 2012
evolution of digital imaging
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D30
3.1 megapixels
evolution of digital imaging
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D30
3.1 megapixels
EOS 10D
6.3 MPs
EOS D60
6.3 MPs
EOS 20D
8.2 MPs
EOS 30D
8.2 MPs
EOS 40D
10.1 MPs
EOS 50D
15.1 MPs
EOS 60D
17.9 MPs
Canon EOS 70D
20.2 megapixels
0
10
20
30
resolution
(megapixels)
2000 2014
evolution of digital imaging
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D30
3.1 megapixels
EOS 10D
6.3 MPs
EOS D60
6.3 MPs
EOS 20D
8.2 MPs
EOS 30D
8.2 MPs
EOS 40D
10.1 MPs
EOS 50D
15.1 MPs
EOS 60D
17.9 MPs
Canon EOS 70D
20.2 megapixels
0
10
20
30
resolution
(megapixels)
0
20
40
60
quantum
efficiency(%)
2000 2014
2000 2014
measurements by DxOMark.com
evolution of digital imaging
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D30
3.1 megapixels
EOS 10D
6.3 MPs
EOS D60
6.3 MPs
EOS 20D
8.2 MPs
EOS 30D
8.2 MPs
EOS 40D
10.1 MPs
EOS 50D
15.1 MPs
EOS 60D
17.9 MPs
Canon EOS 70D
20.2 megapixels
0
10
20
30
resolution
(megapixels)
0
20
40
60
quantum
efficiency(%)
2000 2014
2000 2014
measurements by DxOMark.com
nearing end of the megapixel race for cameras and displays…
evolution of digital imaging
“Retina” display: pixels imperceptible to the eye
nearing end of the megapixel race for cameras and displays
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D30
3.1 megapixels
EOS 10D
6.3 MPs
EOS D60
6.3 MPs
EOS 20D
8.2 MPs
EOS 30D
8.2 MPs
EOS 40D
10.1 MPs
EOS 50D
15.1 MPs
EOS 60D
17.9 MPs
Canon EOS 70D
20.2 megapixels
evolution of digital imaging
“Retina” display: pixels imperceptible to the eye
nearing end of the megapixel race for cameras and displays
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D30
3.1 megapixels
EOS 10D
6.3 MPs
EOS D60
6.3 MPs
EOS 20D
8.2 MPs
EOS 30D
8.2 MPs
EOS 40D
10.1 MPs
EOS 50D
15.1 MPs
EOS 60D
17.9 MPs
Canon EOS 70D
20.2 megapixels
compressive displays
[Lanman et al. 2011]light field imaging [Ng et al. 05]
cameras and displays revolution
cameras
Lytro
Pelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
cameras and displays revolution
Nintendo 3DSGoogle Glass
displayscameras
Lytro
Pelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
cameras and displays revolution
Microsoft Kinect for Xbox OneLeap Motion
Nintendo 3DSGoogle Glass
displays
light
transportcameras
Lytro
Pelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
cameras and displays revolution
Microsoft Kinect for Xbox OneLeap Motion
Nintendo 3DSGoogle Glass
displays
light
transport
use computation to reform digital imaging (display, capture, …)
cameras
Lytro
Pelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
three domains of computation
computational
cameras
three domains of computation
computational
cameras
computational
displays
three domains of computation
computational
cameras
computational
displays
physical
world
computational
light transport
speakers
Gordon Wetzstein
• assistant professor at Stanford University (EE)
• received an award for his dissertation titled
“Computational Plenoptic Image Acquisition and
Display”
• spent last 3 years as a Postdoc at MIT Media Lab’s
camera culture group
speakers
Matthew O’Toole
Gordon Wetzstein
• Ph.D. student at the University of Toronto
supervised by Kyros Kutulakos
• focus on light transport analysis
• assistant professor at Stanford University (EE)
• received an award for his dissertation titled
“Computational Plenoptic Image Acquisition and
Display”
• spent last 3 years as a Postdoc at MIT Media Lab’s
camera culture group
overview
10 min | computational cameras (Wetzstein)
overview
30 min | computational displays (Wetzstein)
10 min | computational cameras (Wetzstein)
overview
35 min | computational light transport (O’Toole)
30 min | computational displays (Wetzstein)
10 min | computational cameras (Wetzstein)
overview
35 min | computational light transport (O’Toole)
30 min | computational displays (Wetzstein)
10 min | computational cameras (Wetzstein)
10 min | summary and Q&A (both)
takeaways from the course
• review current research topics and recent work
in computational sensing and displays
• introduce core concepts, including plenoptic cameras, compressive
displays and transport matrices
• provide a sense as to possible directions for future research
Computational Cameras
Part 1:

More Related Content

PPTX
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
PPTX
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
PPTX
Light Field Photography Introduction
PPTX
Optical Computing for Fast Light Transport Analysis
PPTX
3D Shape and Indirect Appearance by Structured Light Transport
PPT
Introduction to Camera Challenges - Ramesh Raskar
PPTX
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
PPTX
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
Light Field Photography Introduction
Optical Computing for Fast Light Transport Analysis
3D Shape and Indirect Appearance by Structured Light Transport
Introduction to Camera Challenges - Ramesh Raskar
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport

What's hot (20)

PDF
Light Field Technology
PPTX
Light field
PPTX
DIY motion capture with KinectToPin
PPT
Raskar Keynote at Stereoscopic Display Jan 2011
PDF
20th. Single Molecule Workshop Picoquant 2014
PPTX
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
PPT
Motion capture technology
DOCX
Motion capture document
DOCX
Motion capture technology
PDF
"What is Neuromorphic Event-based Computer Vision? Sensors, Theory and Applic...
PPTX
Motion capture technology
PPTX
Motion capture technology
PPTX
Mitchell Reifel (pmdtechnologies ag): pmd Time-of-Flight – the Swiss Army Kni...
PPTX
Motion capture technology
PPSX
DIGITAL IMAGE TECHNOLOGY
PPTX
Single photon 3D Imaging with Deep Sensor Fusion
PPTX
Motion Capture Technology Computer Graphics
PDF
8 k extremely high resolution camera system
PPTX
Motion capture
Light Field Technology
Light field
DIY motion capture with KinectToPin
Raskar Keynote at Stereoscopic Display Jan 2011
20th. Single Molecule Workshop Picoquant 2014
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Motion capture technology
Motion capture document
Motion capture technology
"What is Neuromorphic Event-based Computer Vision? Sensors, Theory and Applic...
Motion capture technology
Motion capture technology
Mitchell Reifel (pmdtechnologies ag): pmd Time-of-Flight – the Swiss Army Kni...
Motion capture technology
DIGITAL IMAGE TECHNOLOGY
Single photon 3D Imaging with Deep Sensor Fusion
Motion Capture Technology Computer Graphics
8 k extremely high resolution camera system
Motion capture
Ad

Viewers also liked (7)

PPTX
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
PPTX
Primal-Dual Coding to Probe Light Transport
PPTX
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
PPTX
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
PPTX
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
PPTX
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
PPTX
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 3 Spectral Imaging
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
Primal-Dual Coding to Probe Light Transport
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 3 Spectral Imaging
Ad

Similar to SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1) (20)

PPTX
Computer Vision Crash Course
PPTX
Computer Vision Crash Course
PDF
Designing Mobile AR Applications
PPTX
3D scanner using kinect
PDF
Panorama Technique for 3D Animation movie, Design and Evaluating
PDF
Motion detection system
PDF
Three-dimensional video
DOCX
Motion detection system
PPT
SEG3490
PDF
Slides on Photosynth.net, from my MSc at Imperial
PPT
Kinect krishna kumar-itkan
PPT
Kinect krishna kumar-itkan
PDF
A Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
PPT
Raskar Next Billion Cameras Siggraph 2009
PPTX
Presentation on 3D Printers for B.Com
PPTX
Becoming a kinect hacker innovator v2
PDF
Microlithography Science and Technology 2nd Edition Kazuaki Suzuki
PPTX
DIGITAL CAMERA MANUFACTURING PROCESS.pptx
PDF
Enhancing readability of digital image using image processing - Full Report
PPTX
ISO/IEC JTC 1/WG 9 (MAR) Convenor Report
Computer Vision Crash Course
Computer Vision Crash Course
Designing Mobile AR Applications
3D scanner using kinect
Panorama Technique for 3D Animation movie, Design and Evaluating
Motion detection system
Three-dimensional video
Motion detection system
SEG3490
Slides on Photosynth.net, from my MSc at Imperial
Kinect krishna kumar-itkan
Kinect krishna kumar-itkan
A Framework for Interactive 3D Photo Stylization Techniques on Mobile Devices
Raskar Next Billion Cameras Siggraph 2009
Presentation on 3D Printers for B.Com
Becoming a kinect hacker innovator v2
Microlithography Science and Technology 2nd Edition Kazuaki Suzuki
DIGITAL CAMERA MANUFACTURING PROCESS.pptx
Enhancing readability of digital image using image processing - Full Report
ISO/IEC JTC 1/WG 9 (MAR) Convenor Report

Recently uploaded (20)

PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PDF
RMMM.pdf make it easy to upload and study
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
Pharma ospi slides which help in ospi learning
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
Computing-Curriculum for Schools in Ghana
PDF
Pre independence Education in Inndia.pdf
PDF
TR - Agricultural Crops Production NC III.pdf
PPTX
Lesson notes of climatology university.
PDF
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
Insiders guide to clinical Medicine.pdf
PPTX
Cell Types and Its function , kingdom of life
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Institutional Correction lecture only . . .
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
RMMM.pdf make it easy to upload and study
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Pharma ospi slides which help in ospi learning
Abdominal Access Techniques with Prof. Dr. R K Mishra
Computing-Curriculum for Schools in Ghana
Pre independence Education in Inndia.pdf
TR - Agricultural Crops Production NC III.pdf
Lesson notes of climatology university.
Physiotherapy_for_Respiratory_and_Cardiac_Problems WEBBER.pdf
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Insiders guide to clinical Medicine.pdf
Cell Types and Its function , kingdom of life
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
FourierSeries-QuestionsWithAnswers(Part-A).pdf
2.FourierTransform-ShortQuestionswithAnswers.pdf
human mycosis Human fungal infections are called human mycosis..pptx
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Institutional Correction lecture only . . .
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...

SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)

  • 1. Gordon Wetzstein http://web.media.mit.edu/~gordonw MIT Media Lab / Stanford University Computational Cameras and Displays Matthew O’Toole www.dgp.toronto.edu/~motoole University of Toronto www.dgp.toronto.edu/~motoole/computationalcamerasanddisplays.html
  • 2. evolution of digital imaging 2000 20142002 2004 2006 2008 2010 2012
  • 3. evolution of digital imaging 2000 20142002 2004 2006 2008 2010 2012 Canon EOS D30 3.1 megapixels
  • 4. evolution of digital imaging 2000 20142002 2004 2006 2008 2010 2012 Canon EOS D30 3.1 megapixels EOS 10D 6.3 MPs EOS D60 6.3 MPs EOS 20D 8.2 MPs EOS 30D 8.2 MPs EOS 40D 10.1 MPs EOS 50D 15.1 MPs EOS 60D 17.9 MPs Canon EOS 70D 20.2 megapixels 0 10 20 30 resolution (megapixels) 2000 2014
  • 5. evolution of digital imaging 2000 20142002 2004 2006 2008 2010 2012 Canon EOS D30 3.1 megapixels EOS 10D 6.3 MPs EOS D60 6.3 MPs EOS 20D 8.2 MPs EOS 30D 8.2 MPs EOS 40D 10.1 MPs EOS 50D 15.1 MPs EOS 60D 17.9 MPs Canon EOS 70D 20.2 megapixels 0 10 20 30 resolution (megapixels) 0 20 40 60 quantum efficiency(%) 2000 2014 2000 2014 measurements by DxOMark.com
  • 6. evolution of digital imaging 2000 20142002 2004 2006 2008 2010 2012 Canon EOS D30 3.1 megapixels EOS 10D 6.3 MPs EOS D60 6.3 MPs EOS 20D 8.2 MPs EOS 30D 8.2 MPs EOS 40D 10.1 MPs EOS 50D 15.1 MPs EOS 60D 17.9 MPs Canon EOS 70D 20.2 megapixels 0 10 20 30 resolution (megapixels) 0 20 40 60 quantum efficiency(%) 2000 2014 2000 2014 measurements by DxOMark.com nearing end of the megapixel race for cameras and displays…
  • 7. evolution of digital imaging “Retina” display: pixels imperceptible to the eye nearing end of the megapixel race for cameras and displays 2000 20142002 2004 2006 2008 2010 2012 Canon EOS D30 3.1 megapixels EOS 10D 6.3 MPs EOS D60 6.3 MPs EOS 20D 8.2 MPs EOS 30D 8.2 MPs EOS 40D 10.1 MPs EOS 50D 15.1 MPs EOS 60D 17.9 MPs Canon EOS 70D 20.2 megapixels
  • 8. evolution of digital imaging “Retina” display: pixels imperceptible to the eye nearing end of the megapixel race for cameras and displays 2000 20142002 2004 2006 2008 2010 2012 Canon EOS D30 3.1 megapixels EOS 10D 6.3 MPs EOS D60 6.3 MPs EOS 20D 8.2 MPs EOS 30D 8.2 MPs EOS 40D 10.1 MPs EOS 50D 15.1 MPs EOS 60D 17.9 MPs Canon EOS 70D 20.2 megapixels compressive displays [Lanman et al. 2011]light field imaging [Ng et al. 05]
  • 9. cameras and displays revolution cameras Lytro Pelican Imaging [Venkataraman et al. SIG Asia 2013]Raytrix
  • 10. cameras and displays revolution Nintendo 3DSGoogle Glass displayscameras Lytro Pelican Imaging [Venkataraman et al. SIG Asia 2013]Raytrix
  • 11. cameras and displays revolution Microsoft Kinect for Xbox OneLeap Motion Nintendo 3DSGoogle Glass displays light transportcameras Lytro Pelican Imaging [Venkataraman et al. SIG Asia 2013]Raytrix
  • 12. cameras and displays revolution Microsoft Kinect for Xbox OneLeap Motion Nintendo 3DSGoogle Glass displays light transport use computation to reform digital imaging (display, capture, …) cameras Lytro Pelican Imaging [Venkataraman et al. SIG Asia 2013]Raytrix
  • 13. three domains of computation computational cameras
  • 14. three domains of computation computational cameras computational displays
  • 15. three domains of computation computational cameras computational displays physical world computational light transport
  • 16. speakers Gordon Wetzstein • assistant professor at Stanford University (EE) • received an award for his dissertation titled “Computational Plenoptic Image Acquisition and Display” • spent last 3 years as a Postdoc at MIT Media Lab’s camera culture group
  • 17. speakers Matthew O’Toole Gordon Wetzstein • Ph.D. student at the University of Toronto supervised by Kyros Kutulakos • focus on light transport analysis • assistant professor at Stanford University (EE) • received an award for his dissertation titled “Computational Plenoptic Image Acquisition and Display” • spent last 3 years as a Postdoc at MIT Media Lab’s camera culture group
  • 18. overview 10 min | computational cameras (Wetzstein)
  • 19. overview 30 min | computational displays (Wetzstein) 10 min | computational cameras (Wetzstein)
  • 20. overview 35 min | computational light transport (O’Toole) 30 min | computational displays (Wetzstein) 10 min | computational cameras (Wetzstein)
  • 21. overview 35 min | computational light transport (O’Toole) 30 min | computational displays (Wetzstein) 10 min | computational cameras (Wetzstein) 10 min | summary and Q&A (both)
  • 22. takeaways from the course • review current research topics and recent work in computational sensing and displays • introduce core concepts, including plenoptic cameras, compressive displays and transport matrices • provide a sense as to possible directions for future research