SlideShare a Scribd company logo
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 235
PRELIMINARY STUDY OF MULTI-VIEW IMAGING FOR ACCURATE
3D RECONSTRUCTION USING STRUCTURED LIGHT SCANNER
Siti Syazalina Mohd Sobani1
, Siti Asmah Daud2
, Nasrul Humaimi Mahmood3
1, 2
Postgraduate Student, 3
Senior Lecturer, Faculty of Biosciences & Medical Engineering, Universiti Teknologi
Malaysia, Johor, Malaysia, syazalina.sobani@yahoo.com, sitiasmahdaud@gmail.com, nasrul@fke.utm.my
Abstract
This paper presents a multi-view structured-light approach for surface scanning to reconstruct three-dimensional (3D) object using a
turntable. It is a modification from DAVID 3D Scanner SLS-1 (Structured-Light Scanner) as a starting point of study on improving
and builds a complete system of 3D structured-light based scanner. This type of scanner uses a video projector to project various
patterns onto an object which is going to be digitized or reconstruct to a 3D model. At the same time, a camera will record and
capture the scene at least one image of each pattern from a certain point of view for example from right, left, above or below of the
video projector. Then, 3D meshes of surface of the object will be computed based on the deformations of the projected patterns. The
preliminary results show that object which are model of prostheses are successfully reconstructed.
Index Terms: 3D scanner, structured-light scanner, 3D reconstruction, and multiple-view
--------------------------------------------------------------------***--------------------------------------------------------------------------
1. INTRODUCTION
Structured-light three-dimensional (3D) scanning technique is
a non-contact active measurement method. It is a system of a
fixed scanner with a turntable which can scan surfaces of
object fast as many time as necessary to get sets of point
clouds needed to reconstruct 3D model of the object scanned
[1-2]. 3D scanners particularly being used to digitized 3D
surface in 3D entertainment industry, robotic vision, digital
model of heritage sites and historical building preservation
(for archaeologists and curators) and also medical field (for
orthotics and prosthetics) [2-5]. The system has many
advantages such as simple optical arrangement, stable and also
fast acquisition speed. The structured-light sensors use many
light patterns in order to acquire accurate measurement and
information as high as possible. The light patterns are usually
consisted of grids, gratings and stripes. Fig -1 shows some
examples of structured-light patterns.
(a) (b)
(c) (d)
Fig -1: Examples of structured-light patterns
Within past decades, many researches have been generated by
3D object modeling and it is a constraint in computer vision
field. It is encouraged to use this technology to digitized 3D
surfaces as it did not need a direct contact which can affect the
accuracy of reconstructed model. Cheng et al. improved the
resolution and accuracy for spatial neighborhood coding by
46%. This is also has fault tolerance ability using groups of
color coded pattern [6]. Keerativittayanun et al. presented 3D
reconstruction using primary colours structured-light which
are red, green and blue. There are 108 stripes in each separate
10 pixels width pattern [7]. Kazó et al. provided automated
scanning and turntable system which reconstruct high-quality
realistic 3D models [8]. Zhou et al. recently presented real-
time reconstruction with 300fps high-resolution point cloud
registration using structured-light illumination (SLI) 3D
scanner and also contribute to research community with 3D
gesture and face databases [9].
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 236
2. METHODOLOGY
Most 3D scanners (including the scanner which will be
described in this paper) can do the scanning from a single
viewpoint only at one time. So it is a need to scan one by one,
angle by angle to get more information in order to reconstruct
a complete 3D model. In this paper, it is proposed that overall
processes are user friendly and required minimal preparation
of the experimental environment while the reconstruction is
done using DAVID Laser Scanner software.
The setup of the experimental is shown in Fig -2 where the
projector displayed structured-light patterns on a calibration
board which is half-folded with an angel of 90. Camera is
placed behind and slightly higher than the projector to record
and capture the scene clearly. Fig-3 shows an object is placed
on a turntable in front of calibration board while Fig-4 shows
two examples of objects used in the test which are Object1 and
Object2. The processes to reconstruct 3D model from an
object are consisted of two phases which explained as follows.
Fig -2: Experimental set up
Fig -3: Object placed on turntable in front of calibration board
(a) (b)
Fig -4: (a) Object1 and (b) Object2 that has been used to test
the system
2.1 Camera Calibration
The most important thing to do in 3D reconstruction from
corresponding two-dimensional (2D) images, one must know
how to obtain unknown parameters of camera model [10].
This process is well-known as camera calibration in computer
vision field. Basically, camera calibration can be categorized
into two main groups which are non-self (photogrammetric)
calibration and self-calibration [11]. At present, various
methods are listed that can be reviewed such as direct linear
transformation method, nonlinear optimization method, two-
step method, biplane method, self-calibration method and
plane pattern method (which has been on focus by many
researchers).However, all these camera calibration techniques
do not work when the charge-couple device (CCD) plane is
tilted but parallel to the lens plane [1]. Structured-light scanner
needs both projector and camera to be calibrated. The
calibration is done based on the well-known pinhole camera
model as shown in Fig-5, where Ο is the optical centre, the
projection of real world point X Y Z T
onto the image
plane at projection of pixel number u v T
u =
Xf
Z
and
v =
Yf
Z
, noted that f is the focal length. This relation then
reformulated using projective geometry framework and
expressed as λ
u
v
1
=
f
0
0
0 0 0
f 0 0
0 1 0
X
Y
Z
1
noted that the
homogeneous scaling factor is λ = Z. Then, this relation will
be solved to find intrinsic and extrinsic parameters of the
camera by considering the radial distortion and camera
rotation and camera rotation involved.
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 237
Fig -5: Pinhole camera model
2.2 Point Cloud Registration
Multi-view approach is used in order to acquire a complete
model of object. This can help to overcome the limitation in
camera 2D view, so the object can be scanned from different
viewpoints. The viewpoints are according to specific angle
that can be acquired by rotating the object to be scanned using
a turntable while the projector and camera are fixed at a
certain distance and place. Point cloud registration or also
called as splicing is a process to convert more than one
coordinate system into one coordinate system [12]. It works
by aligning point clouds of the scanned surface one by one,
where local coordinate is given to a point cloud from each
scan surface according to the position of the object and
scanner obtained via calibration of camera. In order to merge
the point clouds, at least three pairs of corresponding points or
N ≪ 3 to be ideal. This is essential so that when all the scans
are merged together to form a complete 3D model, each view
transformation is same to world coordinate. It is computed by
considering the N pairs of corresponding 3D points which can
be expressed as p1; q1 , p2; q2 , … , pN; qN , in order to
find a rotation matrix, R and translation vector, T so that
Rpj + T = qj, where j = 1, 2, 3, … , N. There are manual and
automatic point cloud registration algorithm presented in the
3D reconstruction. Manual registration is done by putting
markers where is necessary onto the scanned surface.
Compared to automatic registration which is much simpler to
compute, however it is also known that it has limitation such
as poor stability, insufficient accuracy, low speed, etc [2].
3. RESULTS AND DISCUSSIONS
It is important to have the latest working device to do the test
to make sure it will run smoothly. DAVID 3D Scanner
suggested to use a standards PC with Windows XP, Vista or 8
(32 or 64 bit), with two available USB ports and at least must
have 2 GHz CPU, 1 GB RAM, 3D graphics card for example
NVIDIA GeForce or ATI Radeon. Considering the
recommendations, the PC used for this project is consisting of
2.40GHz Intel Core i5 processor, NVIDIA GeForce with
CUDA graphics card and 4GB RAM. Each scanning needs
around 15 seconds to record a part of surface of an object. Fig-
6 shows examples for several scans of an object taken from
different angle of views using turntable.
(a) (b)
(c) (d)
Fig -6: Different angles of scans for an object (a) 0, (b) 90,
(c) 180 and (d) 270
This research does not focused on the time required to do a
complete 3D reconstruction but the accuracy and quality of the
3D models. Fig-7shows the results of alignment or point
clouds registrations while Fig -8shows the complete 3D
models after shape fusion for the two tested objects which are
Object1 and Object2 respectively. However, the 3D
reconstruction result did not come out well since the surfaces
scanned are not smooth and some parts of it are missing. So it
affects the 3D model which there is some flat part at the
corner. This is also an effect of the interference of light that
causes the scanner cannot get all information required while
scanning.
(a) (b)
Fig -7: Aligned scans for (a) Object1, and (b) Object2
(a) (b)
Fig -8: Complete 3D model for (a) Object1, and (b) Object2
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 238
CONCLUSIONS
This paper proposes structured-light scanning approach for 3D
reconstruction inspired by DAVID 3D Scanner SLS-1
(Structured-Light Scanner). It is a user friendly scanning
method, so it can be used by anyone who is non-expert in this
field of study. However, the interference of light affects the
accuracy of 3D reconstruction. It is suggested to do the scan in
a dark environment so the information that needed to be
recorded is more accurate. In the future, there are some plans
to improve the reconstruction so it will be higher resolution,
accurate and more realistic.
ACKNOWLEDGEMENTS
The authors would like to express their gratitude to Ministry
of Science Technology and Innovation (MOSTI) that provide
eScience Fund research grant (Vote Number: 4S027) for this
project and also scholarship from the Ministry of Higher
Education of Malaysia. Thank you very much.
REFERENCES
[1] J. Li, Y. Guo, J. Zhu, X. Lin, Y. Xin, K. Duan, and Q.
Tang, “Large depth-of-view portable three-dimensional
laser scanner and its segmental calibration for robot
vision,” Optics and Lasers in Engineering, vol. 45, no.
11, pp. 1077–1087, Nov. 2007.
[2] J. Chen, X. Wu, M. Yu Wang, and X. Li, “3D shape
modeling using a self-developed hand-held 3D laser
scanner and an efficient HT-ICP point cloud
registration algorithm,” Optics & Laser Technology,
vol. 45, pp. 414–423, Feb. 2013.
[3]. B. W. He, Z. X. Long, and Y. F. Li, “The research of an
automatic object reconstruction method based on limit
visible region of the laser-scanning vision system,”
Robotics and Computer-Integrated Manufacturing, vol.
26, no. 6, pp. 711–719, Dec. 2010.
[4]. S. Al-kheder, Y. Al-shawabkeh, and N. Haala,
“Developing a documentation system for desert palaces
in Jordan using 3D laser scanning and digital
photogrammetry,” Journal of Archaeological Science,
vol. 36, no. 2, pp. 537–546, Feb. 2009.
[5]. B. Coudrin, M. Devy, J.-J. Orteu, and L. Brèthes, “An
innovative hand-held vision-based digitizing system for
3D modelling,” Optics and Lasers in Engineering, vol.
49, no. 9–10, pp. 1168–1176, Sep. 2011.
[6]. F.-H. Cheng, C.-T. Lu, and Y.-S. Huang, “3D Object
Scanning System by Coded Structured Light,” 2010
Third International Symposium on Electronic
Commerce and Security, pp. 213–217, Jul. 2010.
[7]. S. Keerativittayanun, T. Kondo, P. Sira-uksorn, T.
Phatrapornant, and M. Sato, “3D scan of a color object
using a color structured light pattern,” 2011 IEEE 7th
International Colloquium on Signal Processing and its
Applications, pp. 460–463, Mar. 2011.
[8]. C. Kaz, “High-quality Structured-light Scanning of 3D
Objects using Turntable,” pp. 553–557, 2012.
[9]. Y. Zhou, K. Liu, J. Gao, K. E. Barner, and F. Kiamilev,
“High-Speed Structured Light Scanning System And 3d
Gestural Point Cloud Recognition University of
Delaware , Newark , DE , USA , 19716 School of
Electrical Engineering and Information , Sichuan
University , China,” no. 0812458, 2013.
[10] J. Dong and Z. Qin, “Camera self-calibration based on
single rectangle,” 2012 Third International Conference
on Intelligent Control and Information Processing, pp.
674–677, Jul. 2012.
[11] S. Sugimoto and M. Okutomi, “Camera Self Calibration
Based on Direct Image Alignment,” no. Icpr, pp. 3240–
3243, 2012.
[12] Z. Yi, G. Liwei, and Y. Li, “Research on error
propagation of point cloud registration,” 2012 IEEE
International Conference on Computer Science and
Automation Engineering (CSAE), no. 2, pp. 18–21,
May 2012.
BIOGRAPHIES
Siti Syazalina Mohd Sobani graduated
from Universiti Teknologi Malaysia with
Bachelor’s Degree of Engineering
(Electrical – Medical Electronics) in 2012.
She is currently a Ph.D student who
undergoes research of image processing centered on 3D
reconstruction.
Siti Asmah Daud obtained her Bachelor’s
Degree of Engineering (Electrical –
Medical Electronics) from Universiti
Teknologi Malaysia in 2012. She
continues her study as a Ph.D research
student in exploring of infrared sensor in reconstructing a 3D
image.
Nasrul Humaimi Mahmood obtained his
PhD Degree from University of Warwick,
United Kingdom. He is a Senior lecturer at
Faculty of Electrical Engineering, Universiti
Teknologi Malaysia. He currently served as
a Head of Department at Faculty of Biosciences and Medical
Engineering.

More Related Content

PDF
Preliminary study of multi view imaging for accurate
PDF
3 d video streaming for virtual exploration of planet surface
PDF
Integration of poses to enhance the shape of the object tracking from a singl...
PDF
Automatic 3D view Generation from a Single 2D Image for both Indoor and Outdo...
PDF
Simulation of collision avoidance by navigation
PDF
Ijnsa050207
PDF
Vision based non-invasive tool for facial swelling assessment
PDF
A ROBUST BACKGROUND REMOVAL ALGORTIHMS USING FUZZY C-MEANS CLUSTERING
Preliminary study of multi view imaging for accurate
3 d video streaming for virtual exploration of planet surface
Integration of poses to enhance the shape of the object tracking from a singl...
Automatic 3D view Generation from a Single 2D Image for both Indoor and Outdo...
Simulation of collision avoidance by navigation
Ijnsa050207
Vision based non-invasive tool for facial swelling assessment
A ROBUST BACKGROUND REMOVAL ALGORTIHMS USING FUZZY C-MEANS CLUSTERING

What's hot (19)

PPTX
Scanning 3 d full human bodies using kinects
PDF
Computer Vision Based 3D Reconstruction : A Review
PDF
Intelligent two axis dual-ccd image-servo shooting platform design
PDF
A comparative study on classification of image segmentation methods with a fo...
PDF
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
PPTX
Human action recognition with kinect using a joint motion descriptor
PDF
Analysis and characterization of dendrite structures from microstructure imag...
PDF
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
PDF
Human action recognition using local space time features and adaboost svm
PDF
ICVG : Practical Constructive Volume Geometry for Indirect Visualization
PDF
ICVG: PRACTICAL CONSTRUCTIVE VOLUME GEOMETRY FOR INDIRECT VISUALIZATION
PDF
Unsupervised region of interest
PDF
10.1.1.38.8576
PDF
Applying edge density based region growing with frame difference for detectin...
PDF
Welcome to the New-Era in Automation]
PDF
10.1007@978 3-319-29504-657
PDF
Real time implementation of object tracking through
PDF
IRJET- Image Feature Extraction using Hough Transformation Principle
PDF
JBSC_online
Scanning 3 d full human bodies using kinects
Computer Vision Based 3D Reconstruction : A Review
Intelligent two axis dual-ccd image-servo shooting platform design
A comparative study on classification of image segmentation methods with a fo...
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
Human action recognition with kinect using a joint motion descriptor
Analysis and characterization of dendrite structures from microstructure imag...
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
Human action recognition using local space time features and adaboost svm
ICVG : Practical Constructive Volume Geometry for Indirect Visualization
ICVG: PRACTICAL CONSTRUCTIVE VOLUME GEOMETRY FOR INDIRECT VISUALIZATION
Unsupervised region of interest
10.1.1.38.8576
Applying edge density based region growing with frame difference for detectin...
Welcome to the New-Era in Automation]
10.1007@978 3-319-29504-657
Real time implementation of object tracking through
IRJET- Image Feature Extraction using Hough Transformation Principle
JBSC_online
Ad

Similar to Preliminary study of multi view imaging for accurate 3 d reconstruction using structured light scanner (20)

PDF
Intelligent two axis dual-ccd image-servo shooting platform design
PDF
Automated Laser Scanning System For Reverse Engineering And Inspection
PDF
Bl32821831
PPTX
3D PRINTING - REVERSE ENGINEERING
PDF
IRJET- 3D Object Recognition of Car Image Detection
PDF
Reverse engineering
PDF
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
PDF
Real-time 3D Object Detection on LIDAR Point Cloud using Complex- YOLO V4
PDF
GIS 3D and Science of Augmented Reality: Modeling a 3D Geospatial Environment
PDF
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
PDF
ANALYSIS OF LUNG NODULE DETECTION AND STAGE CLASSIFICATION USING FASTER RCNN ...
PDF
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
PDF
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
PDF
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
PDF
A Wireless Network Infrastructure Architecture for Rural Communities
PDF
A case study: Grid services for satellite image processing
PDF
Enhanced target tracking based on mean shift algorithm for satellite imagery
PDF
Enhanced target tracking based on mean shift
PPTX
3D Scanning ppt ME582.pptxwefwegwegwgwrghw
PDF
Generating higher accuracy digital data products by model parameter
Intelligent two axis dual-ccd image-servo shooting platform design
Automated Laser Scanning System For Reverse Engineering And Inspection
Bl32821831
3D PRINTING - REVERSE ENGINEERING
IRJET- 3D Object Recognition of Car Image Detection
Reverse engineering
From Sense to Print: Towards Automatic 3D Printing from 3D Sensing Devices
Real-time 3D Object Detection on LIDAR Point Cloud using Complex- YOLO V4
GIS 3D and Science of Augmented Reality: Modeling a 3D Geospatial Environment
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
ANALYSIS OF LUNG NODULE DETECTION AND STAGE CLASSIFICATION USING FASTER RCNN ...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrated...
COMPLETE END-TO-END LOW COST SOLUTION TO A 3D SCANNING SYSTEM WITH INTEGRATED...
Complete End-to-End Low Cost Solution to a 3D Scanning System with Integrate...
A Wireless Network Infrastructure Architecture for Rural Communities
A case study: Grid services for satellite image processing
Enhanced target tracking based on mean shift algorithm for satellite imagery
Enhanced target tracking based on mean shift
3D Scanning ppt ME582.pptxwefwegwegwgwrghw
Generating higher accuracy digital data products by model parameter
Ad

More from eSAT Journals (20)

PDF
Mechanical properties of hybrid fiber reinforced concrete for pavements
PDF
Material management in construction – a case study
PDF
Managing drought short term strategies in semi arid regions a case study
PDF
Life cycle cost analysis of overlay for an urban road in bangalore
PDF
Laboratory studies of dense bituminous mixes ii with reclaimed asphalt materials
PDF
Laboratory investigation of expansive soil stabilized with natural inorganic ...
PDF
Influence of reinforcement on the behavior of hollow concrete block masonry p...
PDF
Influence of compaction energy on soil stabilized with chemical stabilizer
PDF
Geographical information system (gis) for water resources management
PDF
Forest type mapping of bidar forest division, karnataka using geoinformatics ...
PDF
Factors influencing compressive strength of geopolymer concrete
PDF
Experimental investigation on circular hollow steel columns in filled with li...
PDF
Experimental behavior of circular hsscfrc filled steel tubular columns under ...
PDF
Evaluation of punching shear in flat slabs
PDF
Evaluation of performance of intake tower dam for recent earthquake in india
PDF
Evaluation of operational efficiency of urban road network using travel time ...
PDF
Estimation of surface runoff in nallur amanikere watershed using scs cn method
PDF
Estimation of morphometric parameters and runoff using rs & gis techniques
PDF
Effect of variation of plastic hinge length on the results of non linear anal...
PDF
Effect of use of recycled materials on indirect tensile strength of asphalt c...
Mechanical properties of hybrid fiber reinforced concrete for pavements
Material management in construction – a case study
Managing drought short term strategies in semi arid regions a case study
Life cycle cost analysis of overlay for an urban road in bangalore
Laboratory studies of dense bituminous mixes ii with reclaimed asphalt materials
Laboratory investigation of expansive soil stabilized with natural inorganic ...
Influence of reinforcement on the behavior of hollow concrete block masonry p...
Influence of compaction energy on soil stabilized with chemical stabilizer
Geographical information system (gis) for water resources management
Forest type mapping of bidar forest division, karnataka using geoinformatics ...
Factors influencing compressive strength of geopolymer concrete
Experimental investigation on circular hollow steel columns in filled with li...
Experimental behavior of circular hsscfrc filled steel tubular columns under ...
Evaluation of punching shear in flat slabs
Evaluation of performance of intake tower dam for recent earthquake in india
Evaluation of operational efficiency of urban road network using travel time ...
Estimation of surface runoff in nallur amanikere watershed using scs cn method
Estimation of morphometric parameters and runoff using rs & gis techniques
Effect of variation of plastic hinge length on the results of non linear anal...
Effect of use of recycled materials on indirect tensile strength of asphalt c...

Recently uploaded (20)

PDF
Model Code of Practice - Construction Work - 21102022 .pdf
PPT
Mechanical Engineering MATERIALS Selection
DOCX
573137875-Attendance-Management-System-original
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PPTX
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
PPTX
Internet of Things (IOT) - A guide to understanding
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PPTX
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
PDF
R24 SURVEYING LAB MANUAL for civil enggi
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
additive manufacturing of ss316l using mig welding
PPTX
Foundation to blockchain - A guide to Blockchain Tech
PPTX
Construction Project Organization Group 2.pptx
PPTX
Welding lecture in detail for understanding
PDF
PPT on Performance Review to get promotions
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PDF
Well-logging-methods_new................
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
Model Code of Practice - Construction Work - 21102022 .pdf
Mechanical Engineering MATERIALS Selection
573137875-Attendance-Management-System-original
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
Internet of Things (IOT) - A guide to understanding
Operating System & Kernel Study Guide-1 - converted.pdf
Recipes for Real Time Voice AI WebRTC, SLMs and Open Source Software.pptx
R24 SURVEYING LAB MANUAL for civil enggi
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
UNIT-1 - COAL BASED THERMAL POWER PLANTS
additive manufacturing of ss316l using mig welding
Foundation to blockchain - A guide to Blockchain Tech
Construction Project Organization Group 2.pptx
Welding lecture in detail for understanding
PPT on Performance Review to get promotions
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
Well-logging-methods_new................
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd

Preliminary study of multi view imaging for accurate 3 d reconstruction using structured light scanner

  • 1. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 235 PRELIMINARY STUDY OF MULTI-VIEW IMAGING FOR ACCURATE 3D RECONSTRUCTION USING STRUCTURED LIGHT SCANNER Siti Syazalina Mohd Sobani1 , Siti Asmah Daud2 , Nasrul Humaimi Mahmood3 1, 2 Postgraduate Student, 3 Senior Lecturer, Faculty of Biosciences & Medical Engineering, Universiti Teknologi Malaysia, Johor, Malaysia, syazalina.sobani@yahoo.com, sitiasmahdaud@gmail.com, nasrul@fke.utm.my Abstract This paper presents a multi-view structured-light approach for surface scanning to reconstruct three-dimensional (3D) object using a turntable. It is a modification from DAVID 3D Scanner SLS-1 (Structured-Light Scanner) as a starting point of study on improving and builds a complete system of 3D structured-light based scanner. This type of scanner uses a video projector to project various patterns onto an object which is going to be digitized or reconstruct to a 3D model. At the same time, a camera will record and capture the scene at least one image of each pattern from a certain point of view for example from right, left, above or below of the video projector. Then, 3D meshes of surface of the object will be computed based on the deformations of the projected patterns. The preliminary results show that object which are model of prostheses are successfully reconstructed. Index Terms: 3D scanner, structured-light scanner, 3D reconstruction, and multiple-view --------------------------------------------------------------------***-------------------------------------------------------------------------- 1. INTRODUCTION Structured-light three-dimensional (3D) scanning technique is a non-contact active measurement method. It is a system of a fixed scanner with a turntable which can scan surfaces of object fast as many time as necessary to get sets of point clouds needed to reconstruct 3D model of the object scanned [1-2]. 3D scanners particularly being used to digitized 3D surface in 3D entertainment industry, robotic vision, digital model of heritage sites and historical building preservation (for archaeologists and curators) and also medical field (for orthotics and prosthetics) [2-5]. The system has many advantages such as simple optical arrangement, stable and also fast acquisition speed. The structured-light sensors use many light patterns in order to acquire accurate measurement and information as high as possible. The light patterns are usually consisted of grids, gratings and stripes. Fig -1 shows some examples of structured-light patterns. (a) (b) (c) (d) Fig -1: Examples of structured-light patterns Within past decades, many researches have been generated by 3D object modeling and it is a constraint in computer vision field. It is encouraged to use this technology to digitized 3D surfaces as it did not need a direct contact which can affect the accuracy of reconstructed model. Cheng et al. improved the resolution and accuracy for spatial neighborhood coding by 46%. This is also has fault tolerance ability using groups of color coded pattern [6]. Keerativittayanun et al. presented 3D reconstruction using primary colours structured-light which are red, green and blue. There are 108 stripes in each separate 10 pixels width pattern [7]. Kazó et al. provided automated scanning and turntable system which reconstruct high-quality realistic 3D models [8]. Zhou et al. recently presented real- time reconstruction with 300fps high-resolution point cloud registration using structured-light illumination (SLI) 3D scanner and also contribute to research community with 3D gesture and face databases [9].
  • 2. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 236 2. METHODOLOGY Most 3D scanners (including the scanner which will be described in this paper) can do the scanning from a single viewpoint only at one time. So it is a need to scan one by one, angle by angle to get more information in order to reconstruct a complete 3D model. In this paper, it is proposed that overall processes are user friendly and required minimal preparation of the experimental environment while the reconstruction is done using DAVID Laser Scanner software. The setup of the experimental is shown in Fig -2 where the projector displayed structured-light patterns on a calibration board which is half-folded with an angel of 90. Camera is placed behind and slightly higher than the projector to record and capture the scene clearly. Fig-3 shows an object is placed on a turntable in front of calibration board while Fig-4 shows two examples of objects used in the test which are Object1 and Object2. The processes to reconstruct 3D model from an object are consisted of two phases which explained as follows. Fig -2: Experimental set up Fig -3: Object placed on turntable in front of calibration board (a) (b) Fig -4: (a) Object1 and (b) Object2 that has been used to test the system 2.1 Camera Calibration The most important thing to do in 3D reconstruction from corresponding two-dimensional (2D) images, one must know how to obtain unknown parameters of camera model [10]. This process is well-known as camera calibration in computer vision field. Basically, camera calibration can be categorized into two main groups which are non-self (photogrammetric) calibration and self-calibration [11]. At present, various methods are listed that can be reviewed such as direct linear transformation method, nonlinear optimization method, two- step method, biplane method, self-calibration method and plane pattern method (which has been on focus by many researchers).However, all these camera calibration techniques do not work when the charge-couple device (CCD) plane is tilted but parallel to the lens plane [1]. Structured-light scanner needs both projector and camera to be calibrated. The calibration is done based on the well-known pinhole camera model as shown in Fig-5, where Ο is the optical centre, the projection of real world point X Y Z T onto the image plane at projection of pixel number u v T u = Xf Z and v = Yf Z , noted that f is the focal length. This relation then reformulated using projective geometry framework and expressed as λ u v 1 = f 0 0 0 0 0 f 0 0 0 1 0 X Y Z 1 noted that the homogeneous scaling factor is λ = Z. Then, this relation will be solved to find intrinsic and extrinsic parameters of the camera by considering the radial distortion and camera rotation and camera rotation involved.
  • 3. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 237 Fig -5: Pinhole camera model 2.2 Point Cloud Registration Multi-view approach is used in order to acquire a complete model of object. This can help to overcome the limitation in camera 2D view, so the object can be scanned from different viewpoints. The viewpoints are according to specific angle that can be acquired by rotating the object to be scanned using a turntable while the projector and camera are fixed at a certain distance and place. Point cloud registration or also called as splicing is a process to convert more than one coordinate system into one coordinate system [12]. It works by aligning point clouds of the scanned surface one by one, where local coordinate is given to a point cloud from each scan surface according to the position of the object and scanner obtained via calibration of camera. In order to merge the point clouds, at least three pairs of corresponding points or N ≪ 3 to be ideal. This is essential so that when all the scans are merged together to form a complete 3D model, each view transformation is same to world coordinate. It is computed by considering the N pairs of corresponding 3D points which can be expressed as p1; q1 , p2; q2 , … , pN; qN , in order to find a rotation matrix, R and translation vector, T so that Rpj + T = qj, where j = 1, 2, 3, … , N. There are manual and automatic point cloud registration algorithm presented in the 3D reconstruction. Manual registration is done by putting markers where is necessary onto the scanned surface. Compared to automatic registration which is much simpler to compute, however it is also known that it has limitation such as poor stability, insufficient accuracy, low speed, etc [2]. 3. RESULTS AND DISCUSSIONS It is important to have the latest working device to do the test to make sure it will run smoothly. DAVID 3D Scanner suggested to use a standards PC with Windows XP, Vista or 8 (32 or 64 bit), with two available USB ports and at least must have 2 GHz CPU, 1 GB RAM, 3D graphics card for example NVIDIA GeForce or ATI Radeon. Considering the recommendations, the PC used for this project is consisting of 2.40GHz Intel Core i5 processor, NVIDIA GeForce with CUDA graphics card and 4GB RAM. Each scanning needs around 15 seconds to record a part of surface of an object. Fig- 6 shows examples for several scans of an object taken from different angle of views using turntable. (a) (b) (c) (d) Fig -6: Different angles of scans for an object (a) 0, (b) 90, (c) 180 and (d) 270 This research does not focused on the time required to do a complete 3D reconstruction but the accuracy and quality of the 3D models. Fig-7shows the results of alignment or point clouds registrations while Fig -8shows the complete 3D models after shape fusion for the two tested objects which are Object1 and Object2 respectively. However, the 3D reconstruction result did not come out well since the surfaces scanned are not smooth and some parts of it are missing. So it affects the 3D model which there is some flat part at the corner. This is also an effect of the interference of light that causes the scanner cannot get all information required while scanning. (a) (b) Fig -7: Aligned scans for (a) Object1, and (b) Object2 (a) (b) Fig -8: Complete 3D model for (a) Object1, and (b) Object2
  • 4. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 02 Issue: 10 | Oct-2013, Available @ http://www.ijret.org 238 CONCLUSIONS This paper proposes structured-light scanning approach for 3D reconstruction inspired by DAVID 3D Scanner SLS-1 (Structured-Light Scanner). It is a user friendly scanning method, so it can be used by anyone who is non-expert in this field of study. However, the interference of light affects the accuracy of 3D reconstruction. It is suggested to do the scan in a dark environment so the information that needed to be recorded is more accurate. In the future, there are some plans to improve the reconstruction so it will be higher resolution, accurate and more realistic. ACKNOWLEDGEMENTS The authors would like to express their gratitude to Ministry of Science Technology and Innovation (MOSTI) that provide eScience Fund research grant (Vote Number: 4S027) for this project and also scholarship from the Ministry of Higher Education of Malaysia. Thank you very much. REFERENCES [1] J. Li, Y. Guo, J. Zhu, X. Lin, Y. Xin, K. Duan, and Q. Tang, “Large depth-of-view portable three-dimensional laser scanner and its segmental calibration for robot vision,” Optics and Lasers in Engineering, vol. 45, no. 11, pp. 1077–1087, Nov. 2007. [2] J. Chen, X. Wu, M. Yu Wang, and X. Li, “3D shape modeling using a self-developed hand-held 3D laser scanner and an efficient HT-ICP point cloud registration algorithm,” Optics & Laser Technology, vol. 45, pp. 414–423, Feb. 2013. [3]. B. W. He, Z. X. Long, and Y. F. Li, “The research of an automatic object reconstruction method based on limit visible region of the laser-scanning vision system,” Robotics and Computer-Integrated Manufacturing, vol. 26, no. 6, pp. 711–719, Dec. 2010. [4]. S. Al-kheder, Y. Al-shawabkeh, and N. Haala, “Developing a documentation system for desert palaces in Jordan using 3D laser scanning and digital photogrammetry,” Journal of Archaeological Science, vol. 36, no. 2, pp. 537–546, Feb. 2009. [5]. B. Coudrin, M. Devy, J.-J. Orteu, and L. Brèthes, “An innovative hand-held vision-based digitizing system for 3D modelling,” Optics and Lasers in Engineering, vol. 49, no. 9–10, pp. 1168–1176, Sep. 2011. [6]. F.-H. Cheng, C.-T. Lu, and Y.-S. Huang, “3D Object Scanning System by Coded Structured Light,” 2010 Third International Symposium on Electronic Commerce and Security, pp. 213–217, Jul. 2010. [7]. S. Keerativittayanun, T. Kondo, P. Sira-uksorn, T. Phatrapornant, and M. Sato, “3D scan of a color object using a color structured light pattern,” 2011 IEEE 7th International Colloquium on Signal Processing and its Applications, pp. 460–463, Mar. 2011. [8]. C. Kaz, “High-quality Structured-light Scanning of 3D Objects using Turntable,” pp. 553–557, 2012. [9]. Y. Zhou, K. Liu, J. Gao, K. E. Barner, and F. Kiamilev, “High-Speed Structured Light Scanning System And 3d Gestural Point Cloud Recognition University of Delaware , Newark , DE , USA , 19716 School of Electrical Engineering and Information , Sichuan University , China,” no. 0812458, 2013. [10] J. Dong and Z. Qin, “Camera self-calibration based on single rectangle,” 2012 Third International Conference on Intelligent Control and Information Processing, pp. 674–677, Jul. 2012. [11] S. Sugimoto and M. Okutomi, “Camera Self Calibration Based on Direct Image Alignment,” no. Icpr, pp. 3240– 3243, 2012. [12] Z. Yi, G. Liwei, and Y. Li, “Research on error propagation of point cloud registration,” 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE), no. 2, pp. 18–21, May 2012. BIOGRAPHIES Siti Syazalina Mohd Sobani graduated from Universiti Teknologi Malaysia with Bachelor’s Degree of Engineering (Electrical – Medical Electronics) in 2012. She is currently a Ph.D student who undergoes research of image processing centered on 3D reconstruction. Siti Asmah Daud obtained her Bachelor’s Degree of Engineering (Electrical – Medical Electronics) from Universiti Teknologi Malaysia in 2012. She continues her study as a Ph.D research student in exploring of infrared sensor in reconstructing a 3D image. Nasrul Humaimi Mahmood obtained his PhD Degree from University of Warwick, United Kingdom. He is a Senior lecturer at Faculty of Electrical Engineering, Universiti Teknologi Malaysia. He currently served as a Head of Department at Faculty of Biosciences and Medical Engineering.