Abstract image of a woman sitting on books and studying on a laptop

Digital Hologram Image Processing

Conor Mc Elhinney, profile picture
Conor Mc Elhinney

The document discusses digital hologram image processing. It begins by explaining why digital holography records 3D information about a scene compared to standard 2D images. It then discusses applying image processing techniques used for standard images to digital holograms to understand what is in a hologram. The document outlines research goals around developing algorithms to determine object information, locations, appearances and identities within a hologram. It also discusses making algorithms applicable to different types of holography.

TechnologyBusiness
1 of 93
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
Digital Hologram Image Processing(DHIP)Conor Mc ElhinneyWednesday 13th MayContact: conormce@cs.nuim.ie
Why digital holography?Using digital holography we can record a scene in a complex valued data structure which retains some of the scene's 3D information. A standard image obtained with a camera records a 2D focused image of the scene from one perspective.Contact: conormce@cs.nuim.ie
Why digital holography?Yves Gevant Ultimate Hologramhttp://www.ultimate-holography.comContact: conormce@cs.nuim.ie
Image ProcessingImage processing attempts to “understand” a scene through the analysis of one recorded image or a sequence of recorded images of the scene. Typical questions it tries to answer are:What is important in the scene?How many relevant objects are in the scene?Where are they in the scene?What do they look like?What are they?In standard image processing each recorded image is a 2D focused image of the scene.We wanted to apply image processing to digital holograms where each reconstruction is a 2D focused image of the scene. Contact: conormce@cs.nuim.ie
How can we use this extra information in a hologramIn the early days we took a look around to see what was being attempted in digital holography and what had and hadn’t been solvedMicroscopicMacroscopicAutofocus – Some Proposed solutionsShape Estimation – Phase unwrappingSegmentation - ?Autofocus – Some Proposed solutionsShape Estimation – Ma depth extraction just proposedSegmentation - ?Contact: conormce@cs.nuim.ie
How can we use this extra information in a hologramIn the early days we took a look around to see what was being attempted in digital holography and what had and hadn’t been solvedMicroscopicMacroscopicIn-LineIn-LineAutofocus – Some Proposed solutionsShape Estimation – Phase unwrappingSegmentation - ?Twin-Image - ?Autofocus – Some Proposed solutionsShape Estimation – Ma depth extraction just proposedSegmentation - ?Twin-Image - ?Contact: conormce@cs.nuim.ie
How can we use this extra information in a hologramIn the early days we took a look around to see what was being attempted in digital holography and what had and hadn’t been solvedWe saw a lack of research in the processing of single capture in-line macroscopic digital hologramsMicroscopicMacroscopicIn-LineIn-LineAutofocus – Some Proposed solutionsShape Estimation – Phase unwrappingSegmentation - ?Twin-Image - ?Autofocus – Some Proposed solutionsShape Estimation – Ma depth extraction just proposedSegmentation - ?Twin-Image - ?Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?+Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?+Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?What does it look like?++Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?What does it look like?What is it?+++Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?What does it look like?What is it?+++Object 1Object 2Contact: conormce@cs.nuim.ie
Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....Combined this helps us “understand” the sceneWhat information is in the scene?Where is this information?What does it look like?What is it?+++Object 1Object 2Contact: conormce@cs.nuim.ie
To be generally applicable..We also wanted our algorithms to be useful to as many forms of holography as possible.So each function or algorithm should be modular, i.eDepth segmentation requires a depth map as input which could be an unwrapped phase map from digital holographic microscopy.Contact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
What I’ve doneWhat is a digital hologram? Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
Digital reconstructionJust some quick examples and reminders of what is in a reconstruction.Contact: conormce@cs.nuim.ie
DC-term suppressionTaking a single hologram prior to any processing, we reconstruct this to demonstrate the corruptive effect of the DC-term365 mmReconstruction planeHologramReconstructContact: conormce@cs.nuim.ie
DC-term suppressionTaking a single hologram prior to any processing, we reconstruct this to demonstrate the corruptive effect of the DC-term365 mmReconstruction planeHologramReconstructThere are many methods for suppressing the DC-term, our twin-image removal algorithm takes as input a DC-term suppressed hologram. For our experiments we apply a high-pass filter in the Fourier domain to suppress the DC-term.Contact: conormce@cs.nuim.ie
DC-term suppressionHologramReconstructionContact: conormce@cs.nuim.ie
DC-term suppressionHologramFouriertransformContact: conormce@cs.nuim.ie
DC-term suppressionHologramFouriertransformHigh-passFilterContact: conormce@cs.nuim.ie
DC-term suppressionHologramDC-Free HologramInverseFouriertransformFouriertransformHigh-passFilterContact: conormce@cs.nuim.ie
DC-term suppressionHologramDC-Free HologramInverseFouriertransformFouriertransformHigh-passFilterReconstructionContact: conormce@cs.nuim.ie
DC-term suppressionHologramDC-Free HologramInverseFouriertransformFouriertransformHigh-passFilterReconstructionReconstructionContact: conormce@cs.nuim.ie
DC-term suppression exampleContact: conormce@cs.nuim.ie
Shallow depth-of-fieldReconstructions from digital holograms have a shallow depth of field, sometimes as small as 1mm. This means that processing an individual reconstruction is rarely a good idea. 188mm178mmContact: conormce@cs.nuim.ie
Shallow depth-of-fieldReconstructions from digital holograms have a shallow depth of field, sometimes as small as 1mm. This means that processing an individual reconstruction is rarely a good idea. 188mm178mmContact: conormce@cs.nuim.ie
Focusing a digital hologramContact: conormce@cs.nuim.ie
Using a window to reconstructContact: conormce@cs.nuim.ie
Perspectives and digital holographySo we first select a window from within the hologram plane (we also need to know the distance to the object).ViewerDisplayContact: conormce@cs.nuim.ie
Perspectives and digital holographySo we first select a window from within the hologram plane (we also need to know the distance to the object).ViewerDisplayContact: conormce@cs.nuim.ie
How to we reconstruct a perspectiveWe select a window size from within the hologram.Win SizeContact: conormce@cs.nuim.ie
How to we reconstruct a perspectiveWe select a window size from within the hologram.As we have already seen there is a trade-off between window size and visual quality.Win SizeContact: conormce@cs.nuim.ie
How to we reconstruct a perspectiveWe select a window size from within the hologram.There is a trade-off between window size and visual quality.We then move the window from the centre of the hologram window.Offset axContact: conormce@cs.nuim.ie
What angle are we reconstructing?So we first select a window from within the hologram plane (we also need to know the distance to the object).Hologram PlaneNear Object PlanedOptical AxisContact: conormce@cs.nuim.ie
What angle are we reconstructing?So we first select a window from within the hologram plane (we also need to know the distance to the object).Hologram PlaneNear Object PlanedOptical AxisContact: conormce@cs.nuim.ie
What angle are we reconstructing?We then work out how far we want to offset this window from the centre of the hologram.Hologram PlaneNear Object PlaneaxdOptical AxisContact: conormce@cs.nuim.ie
What angle are we reconstructing?The angle we are reconstructing can then be worked out with trigonometry.Hologram PlaneNear Object PlaneaxdOptical AxisContact: conormce@cs.nuim.ie
What angle are we reconstructing?The angle we are reconstructing can then be worked out with trigonometry.Hologram PlaneNear Object PlaneaxθxdOptical AxisContact: conormce@cs.nuim.ie
What angle are we reconstructing?The angle we are reconstructing can then be worked out with trigonometry.Hologram PlaneNear Object PlaneaxθxdOptical AxisContact: conormce@cs.nuim.ie
What perspective are we reconstructingNxyNx’NyayNy’xaxzdandContact: conormce@cs.nuim.ie
Perspective reconstructionContact: conormce@cs.nuim.ie
How does speckle reduction effect the reconstructionContact: conormce@cs.nuim.ie
Simple linear autofocusContact: conormce@cs.nuim.ie
Examples of what we’ve doneAutomatically determining the focal plane of a digital hologram using a Fibonacci searchContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Choose our search rangeContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Choose our search rangestartContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Choose our search rangeendContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mmCalculate our first reconstruction distanceContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm682.96mmCalculate our second reconstruction distanceContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Focus value for that distanceContact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Red means current best estimate.Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Iteration 6:383.6mm (54.3)Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Iteration 6:383.6mm (54.3)Iteration 7:355.02mm (103.1)Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Iteration 6:383.6mm (54.3)Iteration 7:355.02mm (103.1)...............Iteration 14:353.42mm (108.0)Contact: conormce@cs.nuim.ie
Autofocus - Fibonacci search exampleDisplayed in the plot is the first 8 estimates output from Fibonacci (both correct and incorrect) overlayed on the focus plot from the fixed step size search.Contact: conormce@cs.nuim.ie
Depth from focus decisions Two of the primary decisions in depth-from-focus are:What block size to use?What interval between reconstructions to use?Contact: conormce@cs.nuim.ie
Block Size To determine the depth of a block in an image using a focus measure there needs to be enough object information in the block.Smaller block sizes: finer object features but high error in the estimate of the general shape.Larger block sizes: low error but fine object features lost.ObjectContact: conormce@cs.nuim.ie7x743x4381x81121x121151x151
Block SizeContact: conormce@cs.nuim.ie
Distance between reconstructionsBy changing the distance between reconstructions we affect the quality of the depth maps. The smaller the distance the more features we can detect but at the expense of speed.Contact: conormce@cs.nuim.ie
Distance between reconstructionsBy changing the distance between reconstructions we affect the quality of the depth maps. The smaller the distance the more features we can detect but at the expense of speed.Contact: conormce@cs.nuim.ie
Depth segmentation and the reconstruction intervalFirst we are going to look at the two bolts object and segmenting it into 4 regionsContact: conormce@cs.nuim.ie
Two bolts - 4 segments0.1mmContact: conormce@cs.nuim.ie
Two bolts - 4 segments0.2mmContact: conormce@cs.nuim.ie
Two bolts - 4 segments0.5mmContact: conormce@cs.nuim.ie
Two bolts - 4 segments1mmContact: conormce@cs.nuim.ie
Two bolts - 4 segments2mmContact: conormce@cs.nuim.ie
Depth segmentation and the reconstruction intervalNow we will see if we can segment it into 8 regionsContact: conormce@cs.nuim.ie
Two bolts - 8 segments0.1mmContact: conormce@cs.nuim.ie
Two bolts - 8 segments0.1mmContact: conormce@cs.nuim.ie
Two bolts - 8 segments0.5mmContact: conormce@cs.nuim.ie
Two bolts - 8 segments1mmContact: conormce@cs.nuim.ie
Two bolts - 8 segments2mm??Contact: conormce@cs.nuim.ie
Twin-imageA hologram contains a set of twin-images.One at the positive distance and one at the negative.They act as a noise source in each others in-focus plane.DC-Free HologramVirtual ImageReal Image355 mm-355 mmContact: conormce@cs.nuim.ie
Results – Rotating objectContact: conormce@cs.nuim.ie
Results – Rotating objectQuestions??Contact: conormce@cs.nuim.ie

More Related Content

PPTX
Digital Hologram Image Processing
Conor Mc Elhinney
 
PPTX
Focused Image Creation Algorithms for digital holography
Conor Mc Elhinney
 
PPT
Digital Holography
Conor Mc Elhinney
 
PPTX
Regeneration of hologram from a slice
Dheeraj Yadav
 
PPT
Holographic projections vaibhavp
Vaibhav P
 
PDF
Holography
mandeep kaur virk
 
PDF
3D Holography: When Might it become Economically Feasible?
Jeffrey Funk
 
PPTX
Holography technology
Sai Kumar
 
Digital Hologram Image Processing
Conor Mc Elhinney
 
Focused Image Creation Algorithms for digital holography
Conor Mc Elhinney
 
Digital Holography
Conor Mc Elhinney
 
Regeneration of hologram from a slice
Dheeraj Yadav
 
Holographic projections vaibhavp
Vaibhav P
 
Holography
mandeep kaur virk
 
3D Holography: When Might it become Economically Feasible?
Jeffrey Funk
 
Holography technology
Sai Kumar
 

What's hot (20)

PPTX
3D Holography
Vish Pepala
 
PPTX
Holographic Projection Technology COMPLETE DETAILS NEW PPT
 Abin Baby
 
PPTX
Holography
nakshatradev28
 
PPTX
Applications of lasers Holography
G Mothy
 
PPTX
Holography
Rahul Baghla
 
PPTX
NEW holography TECHNOLOGY ALL PPT
Connecting Point
 
PPTX
3D HOLOGRAPHIC PROJECTION
Prakash Thulaseedharan
 
PPT
Holography
Vishesh Banga
 
PPTX
3 d holographic projection technology
swathi b
 
PPTX
O.i.ppt
Priya_Srivastava
 
PPTX
Holography and Virtual Reality
Lotifur Rahman Kajol
 
DOC
Hologram project 2
Justine Jay Naviamos
 
DOC
Seminar report neelam
Neelam Chhipa
 
PPTX
3 dimentional holographic technique
SHUBHAM MORGAONKAR
 
PPTX
3D Holographic Projection Technology
Kirantheja Kittu
 
PPTX
What is a 3 d hologram
Hasana El Nour
 
PPTX
Holography & its Applications
Bisma Princezz
 
PPTX
Technology of Holographic Projection
Bhanupriya
 
PPTX
3D HOLOGRAPHIC PROJECTION TECHNOLOGY
nivesai
 
PPTX
Holography
Krishna Teja
 
3D Holography
Vish Pepala
 
Holographic Projection Technology COMPLETE DETAILS NEW PPT
 Abin Baby
 
Holography
nakshatradev28
 
Applications of lasers Holography
G Mothy
 
Holography
Rahul Baghla
 
NEW holography TECHNOLOGY ALL PPT
Connecting Point
 
3D HOLOGRAPHIC PROJECTION
Prakash Thulaseedharan
 
Holography
Vishesh Banga
 
3 d holographic projection technology
swathi b
 
O.i.ppt
Priya_Srivastava
 
Holography and Virtual Reality
Lotifur Rahman Kajol
 
Hologram project 2
Justine Jay Naviamos
 
Seminar report neelam
Neelam Chhipa
 
3 dimentional holographic technique
SHUBHAM MORGAONKAR
 
3D Holographic Projection Technology
Kirantheja Kittu
 
What is a 3 d hologram
Hasana El Nour
 
Holography & its Applications
Bisma Princezz
 
Technology of Holographic Projection
Bhanupriya
 
3D HOLOGRAPHIC PROJECTION TECHNOLOGY
nivesai
 
Holography
Krishna Teja
 
Ad

Similar to Digital Hologram Image Processing (20)

PDF
The sweet spot
Alberto Brandolini
 
PPTX
Chap2 Overview of 3D Animation .pptx
ellyviethra
 
PPTX
Imagine camp, Developing Image Processing app for windows phone platform
Rahat Yasir
 
PPT
lecture33333333333333333333333333331.ppt
samikun760
 
PPT
lecture1hhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ppt
aliimad10
 
PDF
ICS1020 CV
Vanessa Camilleri
 
PPTX
OpenCV Essentials: From Basics to Small Projects, by Irina Nikulina
Paris Women in Machine Learning and Data Science
 
DOCX
Image processing
pradnya patil
 
PDF
We Are A Camera Analysis
Nicole Wells
 
PDF
1st section
Hadi Rahmat-Khah
 
PDF
Binder2
allodesignk6
 
PDF
Portfolio allodesign.k6 2011
allodesignk6
 
PPTX
RMIT Univ lecture - "Envisioning Holograms" by M. Pell
Mike Pell
 
PPT
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
Ray Phan
 
PDF
Holographs
HaberTunes
 
PDF
Machine Learning for Designers
Memi Beltrame
 
PDF
Immersive Computing @ #YOWConnected 2017
Rob Manson
 
PDF
3D modelling and animation using Autodesk maya
Parvesh Taneja
 
PPTX
Final presentation
Mustaza Kamal
 
ODP
Introduction to 3D Animation
Gary Ferguson
 
The sweet spot
Alberto Brandolini
 
Chap2 Overview of 3D Animation .pptx
ellyviethra
 
Imagine camp, Developing Image Processing app for windows phone platform
Rahat Yasir
 
lecture33333333333333333333333333331.ppt
samikun760
 
lecture1hhhhhhhhhhhhhhhhhhhhhhhhhhhhh.ppt
aliimad10
 
ICS1020 CV
Vanessa Camilleri
 
OpenCV Essentials: From Basics to Small Projects, by Irina Nikulina
Paris Women in Machine Learning and Data Science
 
Image processing
pradnya patil
 
We Are A Camera Analysis
Nicole Wells
 
1st section
Hadi Rahmat-Khah
 
Binder2
allodesignk6
 
Portfolio allodesign.k6 2011
allodesignk6
 
RMIT Univ lecture - "Envisioning Holograms" by M. Pell
Mike Pell
 
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
Ray Phan
 
Holographs
HaberTunes
 
Machine Learning for Designers
Memi Beltrame
 
Immersive Computing @ #YOWConnected 2017
Rob Manson
 
3D modelling and animation using Autodesk maya
Parvesh Taneja
 
Final presentation
Mustaza Kamal
 
Introduction to 3D Animation
Gary Ferguson
 
Ad

More from Conor Mc Elhinney (7)

PDF
Presenting - Why we switch off
Conor Mc Elhinney
 
PDF
Mobile Mapping Spatial Database Framework
Conor Mc Elhinney
 
PDF
Geo-referenced human-activity-data; access, processing and knowledge extraction
Conor Mc Elhinney
 
PDF
Multi-thematic spatial databases
Conor Mc Elhinney
 
PPTX
LiDAR feature extraction
Conor Mc Elhinney
 
PPTX
LiDAR processing for road network asset inventory
Conor Mc Elhinney
 
PPTX
Initial results from EuRSI project
Conor Mc Elhinney
 
Presenting - Why we switch off
Conor Mc Elhinney
 
Mobile Mapping Spatial Database Framework
Conor Mc Elhinney
 
Geo-referenced human-activity-data; access, processing and knowledge extraction
Conor Mc Elhinney
 
Multi-thematic spatial databases
Conor Mc Elhinney
 
LiDAR feature extraction
Conor Mc Elhinney
 
LiDAR processing for road network asset inventory
Conor Mc Elhinney
 
Initial results from EuRSI project
Conor Mc Elhinney
 

Recently uploaded (20)

PDF
A proposed approach for plagiarism detection in Myanmar Unicode text
IAESIJAI
 
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
Epec Engineered Technologies
 
PPT
What is a Computer? Input Devices /output devices
GulJan8
 
PPTX
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
HiraJay1
 
PDF
Convolutional neural network based encoder-decoder for efficient real-time ob...
IAESIJAI
 
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
IAESIJAI
 
PDF
UiPath Agentic Automation session 1: RPA to Agents
suhanisingh58689
 
PPTX
Chapter 5: Probability Theory and Statistics
RandyFin
 
PDF
Zenith AI: Advanced Artificial Intelligence
Biz Preneurs
 
PDF
Flame analysis and combustion estimation using large language and vision assi...
IAESIJAI
 
PDF
Architecture types and enterprise applications.pdf
ChristopherTHyatt
 
PDF
A review of recent deep learning applications in wood surface defect identifi...
IAESIJAI
 
PDF
Developing a website for English-speaking practice to English as a foreign la...
IAESIJAI
 
PDF
1 - Historical Antecedents, Social Consideration.pdf
tuazon2030627
 
PPTX
The various Industrial Revolutions .pptx
bandileshozi3
 
PPTX
Configure Apache Mutual Authentication
Antonino Piraino
 
PDF
Enhancing emotion recognition model for a student engagement use case through...
IAESIJAI
 
PDF
CloudStack 4.21: First Look Webinar slides
ShapeBlue
 
PDF
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
IAESIJAI
 
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
Safe Software
 
A proposed approach for plagiarism detection in Myanmar Unicode text
IAESIJAI
 
Custom Battery Pack Design Considerations for Performance and Safety
Epec Engineered Technologies
 
What is a Computer? Input Devices /output devices
GulJan8
 
AI IN MARKETING- PRESENTED BY ANWAR KABIR 1st June 2025.pptx
HiraJay1
 
Convolutional neural network based encoder-decoder for efficient real-time ob...
IAESIJAI
 
A contest of sentiment analysis: k-nearest neighbor versus neural network
IAESIJAI
 
UiPath Agentic Automation session 1: RPA to Agents
suhanisingh58689
 
Chapter 5: Probability Theory and Statistics
RandyFin
 
Zenith AI: Advanced Artificial Intelligence
Biz Preneurs
 
Flame analysis and combustion estimation using large language and vision assi...
IAESIJAI
 
Architecture types and enterprise applications.pdf
ChristopherTHyatt
 
A review of recent deep learning applications in wood surface defect identifi...
IAESIJAI
 
Developing a website for English-speaking practice to English as a foreign la...
IAESIJAI
 
1 - Historical Antecedents, Social Consideration.pdf
tuazon2030627
 
The various Industrial Revolutions .pptx
bandileshozi3
 
Configure Apache Mutual Authentication
Antonino Piraino
 
Enhancing emotion recognition model for a student engagement use case through...
IAESIJAI
 
CloudStack 4.21: First Look Webinar slides
ShapeBlue
 
How ambidextrous entrepreneurial leaders react to the artificial intelligence...
IAESIJAI
 
Taming the Chaos: How to Turn Unstructured Data into Decisions
Safe Software
 

Digital Hologram Image Processing

  • 1. Digital Hologram Image Processing(DHIP)Conor Mc ElhinneyWednesday 13th MayContact: conormce@cs.nuim.ie
  • 2. Why digital holography?Using digital holography we can record a scene in a complex valued data structure which retains some of the scene's 3D information. A standard image obtained with a camera records a 2D focused image of the scene from one perspective.Contact: conormce@cs.nuim.ie
  • 3. Why digital holography?Yves Gevant Ultimate Hologramhttp://www.ultimate-holography.comContact: conormce@cs.nuim.ie
  • 4. Image ProcessingImage processing attempts to “understand” a scene through the analysis of one recorded image or a sequence of recorded images of the scene. Typical questions it tries to answer are:What is important in the scene?How many relevant objects are in the scene?Where are they in the scene?What do they look like?What are they?In standard image processing each recorded image is a 2D focused image of the scene.We wanted to apply image processing to digital holograms where each reconstruction is a 2D focused image of the scene. Contact: conormce@cs.nuim.ie
  • 5. How can we use this extra information in a hologramIn the early days we took a look around to see what was being attempted in digital holography and what had and hadn’t been solvedMicroscopicMacroscopicAutofocus – Some Proposed solutionsShape Estimation – Phase unwrappingSegmentation - ?Autofocus – Some Proposed solutionsShape Estimation – Ma depth extraction just proposedSegmentation - ?Contact: conormce@cs.nuim.ie
  • 6. How can we use this extra information in a hologramIn the early days we took a look around to see what was being attempted in digital holography and what had and hadn’t been solvedMicroscopicMacroscopicIn-LineIn-LineAutofocus – Some Proposed solutionsShape Estimation – Phase unwrappingSegmentation - ?Twin-Image - ?Autofocus – Some Proposed solutionsShape Estimation – Ma depth extraction just proposedSegmentation - ?Twin-Image - ?Contact: conormce@cs.nuim.ie
  • 7. How can we use this extra information in a hologramIn the early days we took a look around to see what was being attempted in digital holography and what had and hadn’t been solvedWe saw a lack of research in the processing of single capture in-line macroscopic digital hologramsMicroscopicMacroscopicIn-LineIn-LineAutofocus – Some Proposed solutionsShape Estimation – Phase unwrappingSegmentation - ?Twin-Image - ?Autofocus – Some Proposed solutionsShape Estimation – Ma depth extraction just proposedSegmentation - ?Twin-Image - ?Contact: conormce@cs.nuim.ie
  • 8. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....Contact: conormce@cs.nuim.ie
  • 9. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Contact: conormce@cs.nuim.ie
  • 10. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Contact: conormce@cs.nuim.ie
  • 11. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?+Contact: conormce@cs.nuim.ie
  • 12. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?+Contact: conormce@cs.nuim.ie
  • 13. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?What does it look like?++Contact: conormce@cs.nuim.ie
  • 14. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?What does it look like?What is it?+++Contact: conormce@cs.nuim.ie
  • 15. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....What information is in the scene?Where is this information?What does it look like?What is it?+++Object 1Object 2Contact: conormce@cs.nuim.ie
  • 16. Our noble goalSo we started out wanting to develop ways of “understanding” what is in a hologram.....Combined this helps us “understand” the sceneWhat information is in the scene?Where is this information?What does it look like?What is it?+++Object 1Object 2Contact: conormce@cs.nuim.ie
  • 17. To be generally applicable..We also wanted our algorithms to be useful to as many forms of holography as possible.So each function or algorithm should be modular, i.eDepth segmentation requires a depth map as input which could be an unwrapped phase map from digital holographic microscopy.Contact: conormce@cs.nuim.ie
  • 18. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 19. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 20. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 21. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 22. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 23. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 24. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 25. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 26. What I’ve doneWhat is a digital hologram?Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 27. What I’ve doneWhat is a digital hologram? Twin-images / dc-term/...How does holography work?What have others done in macroscopic DH?How to focus a DH?How to get depth info?Segmenting based on focus infoCreate an in-focus image from depth/intensitySegmenting based on depth infoHow do we focus fast?Segment and remove the twinContact: conormce@cs.nuim.ie
  • 28. Digital reconstructionJust some quick examples and reminders of what is in a reconstruction.Contact: conormce@cs.nuim.ie
  • 29. DC-term suppressionTaking a single hologram prior to any processing, we reconstruct this to demonstrate the corruptive effect of the DC-term365 mmReconstruction planeHologramReconstructContact: conormce@cs.nuim.ie
  • 30. DC-term suppressionTaking a single hologram prior to any processing, we reconstruct this to demonstrate the corruptive effect of the DC-term365 mmReconstruction planeHologramReconstructThere are many methods for suppressing the DC-term, our twin-image removal algorithm takes as input a DC-term suppressed hologram. For our experiments we apply a high-pass filter in the Fourier domain to suppress the DC-term.Contact: conormce@cs.nuim.ie
  • 38. Shallow depth-of-fieldReconstructions from digital holograms have a shallow depth of field, sometimes as small as 1mm. This means that processing an individual reconstruction is rarely a good idea. 188mm178mmContact: conormce@cs.nuim.ie
  • 39. Shallow depth-of-fieldReconstructions from digital holograms have a shallow depth of field, sometimes as small as 1mm. This means that processing an individual reconstruction is rarely a good idea. 188mm178mmContact: conormce@cs.nuim.ie
  • 40. Focusing a digital hologramContact: conormce@cs.nuim.ie
  • 41. Using a window to reconstructContact: conormce@cs.nuim.ie
  • 42. Perspectives and digital holographySo we first select a window from within the hologram plane (we also need to know the distance to the object).ViewerDisplayContact: conormce@cs.nuim.ie
  • 43. Perspectives and digital holographySo we first select a window from within the hologram plane (we also need to know the distance to the object).ViewerDisplayContact: conormce@cs.nuim.ie
  • 44. How to we reconstruct a perspectiveWe select a window size from within the hologram.Win SizeContact: conormce@cs.nuim.ie
  • 45. How to we reconstruct a perspectiveWe select a window size from within the hologram.As we have already seen there is a trade-off between window size and visual quality.Win SizeContact: conormce@cs.nuim.ie
  • 46. How to we reconstruct a perspectiveWe select a window size from within the hologram.There is a trade-off between window size and visual quality.We then move the window from the centre of the hologram window.Offset axContact: conormce@cs.nuim.ie
  • 47. What angle are we reconstructing?So we first select a window from within the hologram plane (we also need to know the distance to the object).Hologram PlaneNear Object PlanedOptical AxisContact: conormce@cs.nuim.ie
  • 48. What angle are we reconstructing?So we first select a window from within the hologram plane (we also need to know the distance to the object).Hologram PlaneNear Object PlanedOptical AxisContact: conormce@cs.nuim.ie
  • 49. What angle are we reconstructing?We then work out how far we want to offset this window from the centre of the hologram.Hologram PlaneNear Object PlaneaxdOptical AxisContact: conormce@cs.nuim.ie
  • 50. What angle are we reconstructing?The angle we are reconstructing can then be worked out with trigonometry.Hologram PlaneNear Object PlaneaxdOptical AxisContact: conormce@cs.nuim.ie
  • 51. What angle are we reconstructing?The angle we are reconstructing can then be worked out with trigonometry.Hologram PlaneNear Object PlaneaxθxdOptical AxisContact: conormce@cs.nuim.ie
  • 52. What angle are we reconstructing?The angle we are reconstructing can then be worked out with trigonometry.Hologram PlaneNear Object PlaneaxθxdOptical AxisContact: conormce@cs.nuim.ie
  • 53. What perspective are we reconstructingNxyNx’NyayNy’xaxzdandContact: conormce@cs.nuim.ie
  • 55. How does speckle reduction effect the reconstructionContact: conormce@cs.nuim.ie
  • 56. Simple linear autofocusContact: conormce@cs.nuim.ie
  • 57. Examples of what we’ve doneAutomatically determining the focal plane of a digital hologram using a Fibonacci searchContact: conormce@cs.nuim.ie
  • 58. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Choose our search rangeContact: conormce@cs.nuim.ie
  • 59. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Choose our search rangestartContact: conormce@cs.nuim.ie
  • 60. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Choose our search rangeendContact: conormce@cs.nuim.ie
  • 61. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:Contact: conormce@cs.nuim.ie
  • 62. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mmCalculate our first reconstruction distanceContact: conormce@cs.nuim.ie
  • 63. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm682.96mmCalculate our second reconstruction distanceContact: conormce@cs.nuim.ie
  • 64. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Focus value for that distanceContact: conormce@cs.nuim.ie
  • 65. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Red means current best estimate.Contact: conormce@cs.nuim.ie
  • 66. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Contact: conormce@cs.nuim.ie
  • 67. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)Contact: conormce@cs.nuim.ie
  • 68. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Contact: conormce@cs.nuim.ie
  • 69. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Contact: conormce@cs.nuim.ie
  • 70. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Iteration 6:383.6mm (54.3)Contact: conormce@cs.nuim.ie
  • 71. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Iteration 6:383.6mm (54.3)Iteration 7:355.02mm (103.1)Contact: conormce@cs.nuim.ie
  • 72. Autofocus - Fibonacci search exampleSearch Range: [170mm,............................................................................................., 1000mm]Iteration 1:487.03mm (26.5)682.96mm (22.3)Iteration 2:365.93mm (73.3)Iteration 3:291.1mm (35.9)412.20mm (44.8)Iteration 4:Iteration 5:337.35mm (66.6)Iteration 6:383.6mm (54.3)Iteration 7:355.02mm (103.1)...............Iteration 14:353.42mm (108.0)Contact: conormce@cs.nuim.ie
  • 73. Autofocus - Fibonacci search exampleDisplayed in the plot is the first 8 estimates output from Fibonacci (both correct and incorrect) overlayed on the focus plot from the fixed step size search.Contact: conormce@cs.nuim.ie
  • 74. Depth from focus decisions Two of the primary decisions in depth-from-focus are:What block size to use?What interval between reconstructions to use?Contact: conormce@cs.nuim.ie
  • 75. Block Size To determine the depth of a block in an image using a focus measure there needs to be enough object information in the block.Smaller block sizes: finer object features but high error in the estimate of the general shape.Larger block sizes: low error but fine object features lost.ObjectContact: conormce@cs.nuim.ie7x743x4381x81121x121151x151
  • 77. Distance between reconstructionsBy changing the distance between reconstructions we affect the quality of the depth maps. The smaller the distance the more features we can detect but at the expense of speed.Contact: conormce@cs.nuim.ie
  • 78. Distance between reconstructionsBy changing the distance between reconstructions we affect the quality of the depth maps. The smaller the distance the more features we can detect but at the expense of speed.Contact: conormce@cs.nuim.ie
  • 79. Depth segmentation and the reconstruction intervalFirst we are going to look at the two bolts object and segmenting it into 4 regionsContact: conormce@cs.nuim.ie
  • 80. Two bolts - 4 segments0.1mmContact: conormce@cs.nuim.ie
  • 81. Two bolts - 4 segments0.2mmContact: conormce@cs.nuim.ie
  • 82. Two bolts - 4 segments0.5mmContact: conormce@cs.nuim.ie
  • 83. Two bolts - 4 segments1mmContact: conormce@cs.nuim.ie
  • 84. Two bolts - 4 segments2mmContact: conormce@cs.nuim.ie
  • 85. Depth segmentation and the reconstruction intervalNow we will see if we can segment it into 8 regionsContact: conormce@cs.nuim.ie
  • 86. Two bolts - 8 segments0.1mmContact: conormce@cs.nuim.ie
  • 87. Two bolts - 8 segments0.1mmContact: conormce@cs.nuim.ie
  • 88. Two bolts - 8 segments0.5mmContact: conormce@cs.nuim.ie
  • 89. Two bolts - 8 segments1mmContact: conormce@cs.nuim.ie
  • 90. Two bolts - 8 segments2mm??Contact: conormce@cs.nuim.ie
  • 91. Twin-imageA hologram contains a set of twin-images.One at the positive distance and one at the negative.They act as a noise source in each others in-focus plane.DC-Free HologramVirtual ImageReal Image355 mm-355 mmContact: conormce@cs.nuim.ie
  • 92. Results – Rotating objectContact: conormce@cs.nuim.ie
  • 93. Results – Rotating objectQuestions??Contact: conormce@cs.nuim.ie