2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis
0 likes241 views
The document discusses a novel image-processing method for automatically detecting broken pins of integrated circuits (ICs) during manufacturing using 2-dimensional wavelet pre-processing before applying edge detection. It compares the efficiency of various conventional edge-detection methods—Sobel, Prewitt, and Canny—against the proposed wavelet-enhanced approach, concluding that the latter significantly improves accuracy in detecting IC pins. This automated method is expected to enhance productivity and accuracy in the IC manufacturing process.
![IOSR Journal of Electronics and Communication Engineering (IOSR-JECE)
e-ISSN: 2278-2834,p- ISSN: 2278-8735. Volume 7, Issue 6 (Sep. - Oct. 2013), PP 36-38
www.iosrjournals.org
www.iosrjournals.org 36 | Page
2-Dimensional Wavelet pre-processing to extract IC-Pin
information for disarrangement analysis
Kushal Kumar1
, Anamika Yadav2
, Himanshi Rani3
, Yashasvi Nijhawan4
,
Sudha Radhika5
1
(Electronics and Communication Engineering, Jaypee University of Engineering and Technology,Guna, India, 2013)
2
(Electronics and Communication Engineering, Bhagwan Parshuram Institute of Technology, Delhi, India, 2012)
3
(Electronics and Communication Engineering, Vellore Institute of Technology, Chennai, India, 2015)
4
(Electronics and Communication Engineering, Jaypee University of Information Technology, India, 2013)
5
(ECE Department, Jaypee University of Engineering and Technology, India)
Abstract: Due to higher processing power to cost ratio, it is now possible to replace the manual detection
methods used in the IC (Integrated Circuit) industry by Image-processing based automated methods, to detect a
broken pin of an IC connected on a PCB during manufacturing, which will make the process faster, easier and
cheaper. In this paper an accurate and fast automatic detection method is used where the top view camera shots
of PCBs are processed using advanced methods of 2-dimensional discrete wavelet pre-processing before
applying edge-detection. Comparison with conventional edge detection methods such as Sobel, Prewitt and
Canny edge detection without 2-D DWT is also performed.
Keywords :2-dimensional wavelets, Edge detection, Machine vision, Image processing, Canny.
I. INTRODUCTION
PCBs are assembled using line production techniques in industries. The faulty IC pins are difficult to
identify during the production process unless it is fully automated. In this paper a novel image processing
method for detection of IC pins using wavelet pre-processed edge detection is proposed. The results are
compared with the conventional edge detection techniques used today.
A series of steps in wavelet pre-processed edge detection are performed in a systematic way which
detects the IC coming through. Edge detection is almost a prerequisite in various recognition tasks, like pins
recognition on an IC. Edge is a separation or a boundary between two homogeneous surfaces. Fig.1 shows the
image of an IC which was used for edge detection in the proposed method and the conventional edge-detection
methods (Sobel, Prewitt and Canny). Various conventional techniques for edge detection of IC’s are available in
literature[1]. Huang et al. (2011) proposes an improved algorithm for canny edge detection. It uses an improved
switch median filter algorithm instead of Gaussian filter algorithms for filtering. [2]Somyot et al.(2012) used
wavelet transforms to compress the image before edge detection.
In this paper, firstly the wavelet pre-processed edge detection results were analyzed and then compared
to edge detection results not subjected to wavelet pre-processing first. The success of the method is derived
based upon how efficiently the edges have been detected.
II. EDGE DETECTION
An edge is an abrupt change in the intensity level, wh ich characterizes high frequency component in an
image. Noise is an unwanted signal which can cause inefficiency in edge detection. The wavelet transform is an
effective tool which can be used before edge detection. The purpose of using wavelet transform is to remove
low frequency component and use only the high frequency components.
In practice due to imperfection in image acquisition or sampling, the edges get blurred and tend to
become thick. However the derivatives play an important role in detecting the edges and locating the edge pixels
in an image. The first derivative is positive at the point of intensity variation and zero in the areas of constant
intensity. The magnitude of first derivative can be used to detect the presence of an edge. The second derivative
is positive if the transition occurs on the dark side of an edge and it is negative if transition is on the light side of
an image. Hence, a second derivative can be used to locate the edge pixels. For edge detection second derivative
can also be used but its sensitivity towards noise limits its application in edge detection. In the subsequent
sections we will be discussing about the approximated first derivative operators that are used for edge detection
in the present investigation.
III. CONVENTIONAL EDGE DETECTION METHODS
The edge detection methods used in this paper are Sobel, Prewitt and Canny, which are compared to
each other and then the best one of them is compared to the proposed algorithm. The algorithms are compared](https://image.slidesharecdn.com/h0763638-150320005530-conversion-gate01/85/2-Dimensional-Wavelet-pre-processing-to-extract-IC-Pin-information-for-disarrangement-analysis-1-320.jpg)
![2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis
www.iosrjournals.org 37 | Page
based on how much amount of the pin data can they extract from the given image. So, first we should know
briefly what these methods are and how do they work. Next, we extract the pin information from the original
image as well as segmented edge-detected image in the form of number of pin-pixels and compare which
method extracts the maximum pin-information for analysis. In the original image, the no. of pixels contained by
the pins are 6689.
3.1 SOBEL
The Sobel edge detector is an approximated, first derivative two dimensional edge detector. It
calculates gradient in X and Y direction. It uses a convolutional mask to calculate the gradients as in equation
(1) and gradient directions as in equation (2). The masks are slid over the image and gradient values are
calculated. In Sobel the centre coefficient of the mask uses a weight of two, it is used so as to achieve a
smoothing by giving more weightage to the central term of the mask. The segmented image obtained by using a
Sobel operator is shown in Fig.2. The number of pin-pixels detected by this algorithm was 2031.
|G|=|GX|+|GY| (1)
Θ=tan-1
[
𝐺 𝑌
𝐺 𝑋
] (2)
3.2 PREWITT
Prewitt edge detector is also an approximated first derivative two dimensional edge detector. It uses
aconvolutional mask to calculate the gradient in X and Ydirections respectively. The segmented image obtained
by using Prewitt operator is shown in Fig.3. The number of pin-pixels detected by this algorithm was 2297.
3.3 CANNY
Canny edge detection is another method of edge detection. It follows a series of steps. In the first step it
eliminates the noise from the Image by filtering the Image using Gaussian filter. In the second step it calculates
the gradient and the edge direction of the Image using Sobel edge detection. In the third step it performs non-
maximum suppression. The pixels along the edge direction which do not satisfy (3) are set to 0 or considered as
non-edge pixel. Further suppression is done using hysteresis. Hysteresis uses two thresholds. T1 and T2. If the
magnitude is below the first threshold then it is set to 0 (non-edge pixel). If the magnitude is above threshold T2
then it is considered as an edge pixel. If the magnitude lies between T1 and T2 then dependin g upon the path
between the current pixel and the pixel with magnitude greater than T2 the pixel is considered as an edge pixel
or non-edge pixel. The segmented image obtained by using a canny edge detector is shown in Fig.4. The number
of pin-pixels detected by this algorithm was 3651.
IV. ProposedMethod
In the proposed method, the image is first pre-processed using wavelets before being subjected to the
edgedetection algorithms. Wavelets are a small portion of the wave. Wavelet transform uses wavelets to capture
different frequency components of the signal whose resolution matches up with its scale. This technique is
known as multi-resolution Analysis. It comprises of a scaling function and a wavelet function. Scaling function
gives the series of approximation of the signal, where each approximated signal differs by a factor of two.
Wavelet functions are used to add the detailed information in the difference of the two neighbouring
approximations. Hence in wavelet analysis we get the approximated part and the detailed part of the signal.
In case of Images the wavelet analysis is carried out in two dimensions. In X and Y direction
respectively, the two dimensional wavelet decomposition is shown in the formof an image in Fig. 5. It is known
as filter bank analysis. It consists of high pass and low pass filters. First the analysis is done along the columns
and then along the rows. The output of the low pass filter gives the approximated coefficients and the output of
the high pass filter gives detailed coefficients. The approximated coefficients at scale j+1 are used to construct
the detailed and approximated coefficients at scale j. In case of two dimensions we get three sets of detailed
coefficients (rest three squares) and one set of approximated coefficient (upper left square).
Now, in the proposed method, we have first subjected the image to a 2-Dimensional discrete wavelet
transform (2-D DWT). Doing this, we get a set of 4 images, one is the set of approximated coefficients and the
other three are set of detailed coefficients. We ignore the approximated coefficient and reconstruct the image
using the set of detailed coefficients, i.e. we take inverse 2-D DWT. The image is now ready to be edge-detected
using any conventional algorithm like Sobel. So, we choose the best one of the conventional methods, which
comes out to be Canny and then compare it with our proposed method in Fig. 6. The number of pin-pixels
detected by this algorithm was 5636, i.e. 84.25% of the pin-information is accurately extracted.](https://image.slidesharecdn.com/h0763638-150320005530-conversion-gate01/85/2-Dimensional-Wavelet-pre-processing-to-extract-IC-Pin-information-for-disarrangement-analysis-2-320.jpg)
![2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis
www.iosrjournals.org 38 | Page
V. Figures
Fig.1 Original IC image. Fig.2Pin segmentation on Sobel edge-detected image.
Fig.3 Pin segmentation on Prewitt edge- Fig.4 Pin segmentation on Canny edge-
detected image. detected image.
Fig.5 2-D DWT illustration. Fig.6 Pin segmentation on Wavelet pre-
processed Canny edge-detected image.
VI. Conclusion
Based on the results the following inferences can be made. When wavelet pre-processing was not
performed, canny edge detection, Fig.4 was found to be the most efficient method followed by Prewitt, Fig.3
and Sobel, Fig.2. When wavelet pre-processing was used, the results obtained are as shown in Fig. 6 which were
more accurate than the results obtained without using wavelet pre-processing as in Fig. 2, 3 and 4. On using
wavelet pre-processing the low frequency component of the image was removed and high frequency
components were retained during reconstruction. The edges which comprises of high frequencies were
efficiently detected. Thus the choice of using wavelet pre-processing made edge detection more efficient. Better
and efficient extraction of IC pin information was achieved.
The IC manufacturing industry will benefit greatly from this approach. The number of man-hours will
be greatly reduced and the results would be more accurate than any of the current methods. This method could
be easily implemented using basic hardware.
References:
[1] Ying Huang,QiPan,QiLiu,XinPengHe,YunFengLiu,YongQuan Yu, “Application of Improved Canny Algorithm on the IC Chip pin
Inspection”,AdvancedMaterials Research Vols. 317-319 (2011) pp 854-858.
[2] K. Somyot, S. Anakapon and K. Anantawat, “Pattern recognition technique for IC pins inspection using wavelet transform with
chain code discrete FourierTransform and signal correlation”, International Journal of Physical Sciences, Vol.7 (9), pp. 1326-1332,
23 February 2012.
[3] Tim Edwards, “Discrete Wavelet Transform: Implementation andtheory”, Stanford University, September 1991.
[4] Rafael C. Gonzalez, Richard E. Woods Digital ImageProcessing (ISBN-13: 978-0131687288,3rd
Edition, 2007)](https://image.slidesharecdn.com/h0763638-150320005530-conversion-gate01/85/2-Dimensional-Wavelet-pre-processing-to-extract-IC-Pin-information-for-disarrangement-analysis-3-320.jpg)
2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis
- 1. IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-ISSN: 2278-2834,p- ISSN: 2278-8735. Volume 7, Issue 6 (Sep. - Oct. 2013), PP 36-38 www.iosrjournals.org www.iosrjournals.org 36 | Page 2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis Kushal Kumar1 , Anamika Yadav2 , Himanshi Rani3 , Yashasvi Nijhawan4 , Sudha Radhika5 1 (Electronics and Communication Engineering, Jaypee University of Engineering and Technology,Guna, India, 2013) 2 (Electronics and Communication Engineering, Bhagwan Parshuram Institute of Technology, Delhi, India, 2012) 3 (Electronics and Communication Engineering, Vellore Institute of Technology, Chennai, India, 2015) 4 (Electronics and Communication Engineering, Jaypee University of Information Technology, India, 2013) 5 (ECE Department, Jaypee University of Engineering and Technology, India) Abstract: Due to higher processing power to cost ratio, it is now possible to replace the manual detection methods used in the IC (Integrated Circuit) industry by Image-processing based automated methods, to detect a broken pin of an IC connected on a PCB during manufacturing, which will make the process faster, easier and cheaper. In this paper an accurate and fast automatic detection method is used where the top view camera shots of PCBs are processed using advanced methods of 2-dimensional discrete wavelet pre-processing before applying edge-detection. Comparison with conventional edge detection methods such as Sobel, Prewitt and Canny edge detection without 2-D DWT is also performed. Keywords :2-dimensional wavelets, Edge detection, Machine vision, Image processing, Canny. I. INTRODUCTION PCBs are assembled using line production techniques in industries. The faulty IC pins are difficult to identify during the production process unless it is fully automated. In this paper a novel image processing method for detection of IC pins using wavelet pre-processed edge detection is proposed. The results are compared with the conventional edge detection techniques used today. A series of steps in wavelet pre-processed edge detection are performed in a systematic way which detects the IC coming through. Edge detection is almost a prerequisite in various recognition tasks, like pins recognition on an IC. Edge is a separation or a boundary between two homogeneous surfaces. Fig.1 shows the image of an IC which was used for edge detection in the proposed method and the conventional edge-detection methods (Sobel, Prewitt and Canny). Various conventional techniques for edge detection of IC’s are available in literature[1]. Huang et al. (2011) proposes an improved algorithm for canny edge detection. It uses an improved switch median filter algorithm instead of Gaussian filter algorithms for filtering. [2]Somyot et al.(2012) used wavelet transforms to compress the image before edge detection. In this paper, firstly the wavelet pre-processed edge detection results were analyzed and then compared to edge detection results not subjected to wavelet pre-processing first. The success of the method is derived based upon how efficiently the edges have been detected. II. EDGE DETECTION An edge is an abrupt change in the intensity level, wh ich characterizes high frequency component in an image. Noise is an unwanted signal which can cause inefficiency in edge detection. The wavelet transform is an effective tool which can be used before edge detection. The purpose of using wavelet transform is to remove low frequency component and use only the high frequency components. In practice due to imperfection in image acquisition or sampling, the edges get blurred and tend to become thick. However the derivatives play an important role in detecting the edges and locating the edge pixels in an image. The first derivative is positive at the point of intensity variation and zero in the areas of constant intensity. The magnitude of first derivative can be used to detect the presence of an edge. The second derivative is positive if the transition occurs on the dark side of an edge and it is negative if transition is on the light side of an image. Hence, a second derivative can be used to locate the edge pixels. For edge detection second derivative can also be used but its sensitivity towards noise limits its application in edge detection. In the subsequent sections we will be discussing about the approximated first derivative operators that are used for edge detection in the present investigation. III. CONVENTIONAL EDGE DETECTION METHODS The edge detection methods used in this paper are Sobel, Prewitt and Canny, which are compared to each other and then the best one of them is compared to the proposed algorithm. The algorithms are compared
- 2. 2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis www.iosrjournals.org 37 | Page based on how much amount of the pin data can they extract from the given image. So, first we should know briefly what these methods are and how do they work. Next, we extract the pin information from the original image as well as segmented edge-detected image in the form of number of pin-pixels and compare which method extracts the maximum pin-information for analysis. In the original image, the no. of pixels contained by the pins are 6689. 3.1 SOBEL The Sobel edge detector is an approximated, first derivative two dimensional edge detector. It calculates gradient in X and Y direction. It uses a convolutional mask to calculate the gradients as in equation (1) and gradient directions as in equation (2). The masks are slid over the image and gradient values are calculated. In Sobel the centre coefficient of the mask uses a weight of two, it is used so as to achieve a smoothing by giving more weightage to the central term of the mask. The segmented image obtained by using a Sobel operator is shown in Fig.2. The number of pin-pixels detected by this algorithm was 2031. |G|=|GX|+|GY| (1) Θ=tan-1 [ 𝐺 𝑌 𝐺 𝑋 ] (2) 3.2 PREWITT Prewitt edge detector is also an approximated first derivative two dimensional edge detector. It uses aconvolutional mask to calculate the gradient in X and Ydirections respectively. The segmented image obtained by using Prewitt operator is shown in Fig.3. The number of pin-pixels detected by this algorithm was 2297. 3.3 CANNY Canny edge detection is another method of edge detection. It follows a series of steps. In the first step it eliminates the noise from the Image by filtering the Image using Gaussian filter. In the second step it calculates the gradient and the edge direction of the Image using Sobel edge detection. In the third step it performs non- maximum suppression. The pixels along the edge direction which do not satisfy (3) are set to 0 or considered as non-edge pixel. Further suppression is done using hysteresis. Hysteresis uses two thresholds. T1 and T2. If the magnitude is below the first threshold then it is set to 0 (non-edge pixel). If the magnitude is above threshold T2 then it is considered as an edge pixel. If the magnitude lies between T1 and T2 then dependin g upon the path between the current pixel and the pixel with magnitude greater than T2 the pixel is considered as an edge pixel or non-edge pixel. The segmented image obtained by using a canny edge detector is shown in Fig.4. The number of pin-pixels detected by this algorithm was 3651. IV. ProposedMethod In the proposed method, the image is first pre-processed using wavelets before being subjected to the edgedetection algorithms. Wavelets are a small portion of the wave. Wavelet transform uses wavelets to capture different frequency components of the signal whose resolution matches up with its scale. This technique is known as multi-resolution Analysis. It comprises of a scaling function and a wavelet function. Scaling function gives the series of approximation of the signal, where each approximated signal differs by a factor of two. Wavelet functions are used to add the detailed information in the difference of the two neighbouring approximations. Hence in wavelet analysis we get the approximated part and the detailed part of the signal. In case of Images the wavelet analysis is carried out in two dimensions. In X and Y direction respectively, the two dimensional wavelet decomposition is shown in the formof an image in Fig. 5. It is known as filter bank analysis. It consists of high pass and low pass filters. First the analysis is done along the columns and then along the rows. The output of the low pass filter gives the approximated coefficients and the output of the high pass filter gives detailed coefficients. The approximated coefficients at scale j+1 are used to construct the detailed and approximated coefficients at scale j. In case of two dimensions we get three sets of detailed coefficients (rest three squares) and one set of approximated coefficient (upper left square). Now, in the proposed method, we have first subjected the image to a 2-Dimensional discrete wavelet transform (2-D DWT). Doing this, we get a set of 4 images, one is the set of approximated coefficients and the other three are set of detailed coefficients. We ignore the approximated coefficient and reconstruct the image using the set of detailed coefficients, i.e. we take inverse 2-D DWT. The image is now ready to be edge-detected using any conventional algorithm like Sobel. So, we choose the best one of the conventional methods, which comes out to be Canny and then compare it with our proposed method in Fig. 6. The number of pin-pixels detected by this algorithm was 5636, i.e. 84.25% of the pin-information is accurately extracted.
- 3. 2-Dimensional Wavelet pre-processing to extract IC-Pin information for disarrangement analysis www.iosrjournals.org 38 | Page V. Figures Fig.1 Original IC image. Fig.2Pin segmentation on Sobel edge-detected image. Fig.3 Pin segmentation on Prewitt edge- Fig.4 Pin segmentation on Canny edge- detected image. detected image. Fig.5 2-D DWT illustration. Fig.6 Pin segmentation on Wavelet pre- processed Canny edge-detected image. VI. Conclusion Based on the results the following inferences can be made. When wavelet pre-processing was not performed, canny edge detection, Fig.4 was found to be the most efficient method followed by Prewitt, Fig.3 and Sobel, Fig.2. When wavelet pre-processing was used, the results obtained are as shown in Fig. 6 which were more accurate than the results obtained without using wavelet pre-processing as in Fig. 2, 3 and 4. On using wavelet pre-processing the low frequency component of the image was removed and high frequency components were retained during reconstruction. The edges which comprises of high frequencies were efficiently detected. Thus the choice of using wavelet pre-processing made edge detection more efficient. Better and efficient extraction of IC pin information was achieved. The IC manufacturing industry will benefit greatly from this approach. The number of man-hours will be greatly reduced and the results would be more accurate than any of the current methods. This method could be easily implemented using basic hardware. References: [1] Ying Huang,QiPan,QiLiu,XinPengHe,YunFengLiu,YongQuan Yu, “Application of Improved Canny Algorithm on the IC Chip pin Inspection”,AdvancedMaterials Research Vols. 317-319 (2011) pp 854-858. [2] K. Somyot, S. Anakapon and K. Anantawat, “Pattern recognition technique for IC pins inspection using wavelet transform with chain code discrete FourierTransform and signal correlation”, International Journal of Physical Sciences, Vol.7 (9), pp. 1326-1332, 23 February 2012. [3] Tim Edwards, “Discrete Wavelet Transform: Implementation andtheory”, Stanford University, September 1991. [4] Rafael C. Gonzalez, Richard E. Woods Digital ImageProcessing (ISBN-13: 978-0131687288,3rd Edition, 2007)