SlideShare a Scribd company logo
Object Detection on Dental X-ray
Images using Region Based
Convolutional Neural Networks
Rakib Hossen, Minhazul Arefin and Mohammed Nasir Uddin
INTERNATIONAL CONFERENCE ON
MACHINE INTELLIGENCE & DATA
SCIENCE APPLICATIONS
(MIDAS 2021)
Date: December 26-27, 2021
Overview
Problem Statement
Introduction
Objectives
Proposed Methodology
Result
Conclusion
Future Work
Introduction
Add Text
 Object detection is a computer vision technique that
allows us to identify and locate objects in an image or
video.
 Tooth decay, also known as dental caries or cavities,
is the breakdown of teeth due to acids made by
bacteria.
 Root canal is a dental procedure involving the removal
of the soft center of the tooth, the pulp.
Introduction
Add Text
 In 2020, the WHO estimated that about 50% of the world
population is affected by dental caries.
 In some Asian-Pacific countries, the incidence of oral cancer is
within the top 3 of all cancers.
 Dental caries are cavities or holes (a type of structural damage)
in the teeth.
 Root canal causes due to inflammation or infection in the roots of
a tooth.
Problem Statement
Add Text
 Manual feature extraction for the detection of caries and root
canal
 Difficulties in generating hierarchical features
 Inaccurate Region Of Interest (ROI) detection and edge
detection
 Difficulties in training model with good convergence
Objectives
Add Text
 To develop a framework that extracts features efficiently
 To design an efficient deep learning approach that can
aid in the automatic detection of objects in dental X-rays
 To classify the detected objects in the dental x-ray
images into caries and root canal.
Contributions
Add Text
 Using state-of-the-art model
 Parameterizing the four co-ordinates of the detected
object in the multi scale training
 Using 12 anchors in the RPN
Proposed Methodology
Add Text
Image Acquisition
Add Text
Source: Digital Dental Periapical X-Ray Dataset
Two categories: Caries and Root canal
Type: Dental Periapical images
80% for training and 20% for testing
Model pre-training
Add Text
 Pre-train the model on COCO dataset
 Fine tune the model
 Train the model on Digital Dental Periapical
X-Ray Dataset
 Fine tune the model again
Hard negative mining
Add Text
 Boosts performance especially object detection
 Hard negatives are the regions where the network has failed
to make correct prediction
 Fed into the network again as a reinforcement for improving
trained model
 Towards fewer false positives and better classification
performance
Number of anchors
Add Text
 Smaller items such as implants seem to be quite frequent in object
detection tasks
 We uses two conditions to assign a positive label to an anchor
𝐿(𝑝𝑖, 𝑡𝑖) =
1
𝑁𝑐𝑙𝑠
𝑖
𝐿𝑐𝑙𝑠 𝑝𝑖, 𝑝𝑖
∗
+ 𝜆
1
𝑁𝑟𝑒𝑔
𝑖
𝑝𝑖
∗
𝐿𝑟𝑒𝑔 𝑡𝑖, 𝑡𝑖
∗
 A mini-batch has an anchor 𝑖, and 𝑝𝑖 is a projected probability that
anchor 𝑖 will be a real item
Number of anchors
Add Text
 Most Crucial Part in RPN
 Traditional Faster R-CNN uses 9 anchors
 Sometimes fails to detect smaller object
 In this study we used 12 anchors
Multi-scale training
Add Text
 Resizes the images to a random scale
 The detector will be able to learn features across a wide range of sizes
 Improves the performance towards scale invariance
 We compute the bounding box regression by parameterized the four
co-ordinates of the detected object. It is shown in equation:
𝑡𝑝 = (𝑝 − 𝑝𝑎)/𝑟𝑎, 𝑡𝑞 = (𝑞 − 𝑞𝑎)/𝑠𝑎
𝑡𝑟 = 𝑙𝑜𝑔
𝑟
𝑟𝑎
, 𝑡𝑠 = 𝑙𝑜𝑔
𝑠
𝑠𝑎
𝑡𝑝
∗
=
𝑝∗
− 𝑝𝑎
𝑟𝑎
, 𝑡𝑞
∗
=
𝑞∗
− 𝑞𝑎
𝑠𝑎
𝑡𝑟
∗
= 𝑙𝑜𝑔
𝑟∗
𝑟𝑎
, 𝑡𝑠
∗
= 𝑙𝑜𝑔
𝑠∗
𝑠𝑎
Feature Concatenation
Add Text
 Feature concatenation is an effective way to add different features
together to enhance the classification process.
 Features are RoI-pooled and L2-normalized from several lower-level
convolution layers accordingly.
 These characteristics are then concatenated and rescaled as if the
original scale of the features had not been adopted.
 A 1×1 convolution is done to match the original network’s number of
channels.
Feature Concatenation
Add Text
 Features from multiple convolutional layers
 Convolutional layers: lower level & higher level
 Features: ROI pooled & L2 normalized
Object Detection
Add Text
 Assign some labels to an object based on their
features using soft-max classifier
 Detect objects in dental x-rays image
successfully
Result
Add Text
 The overlap between two borders is measured by the IoU.
 The overlap between our anticipated border and the ground reality is
then calculated (the real object boundary).
 Let 𝑛𝑖,𝑗 be the number of pixels of class 𝑖 predicted to belong to class 𝑗,
where there are 𝑛𝑐𝑙 different classes, and let 𝑡𝑖 = 𝑗 𝑛𝑖𝑗 be the total
number of pixels of class 𝑖.
 Mean IoU is defined as:
𝑀𝑒𝑎𝑛𝐼𝑜𝑈 =
1
𝑛𝑐𝑙
𝑖
𝑛𝑖𝑖
𝑡𝑖 + 𝑠𝑢𝑚𝑗 𝑛𝑗𝑖 − 𝑛𝑖𝑖
Result
Add Text
 All ground truth boxes with an IoU ratio
less than 0.3 will be labeled as negative
 Total Loss function per epoc (in thousand)
Comparison
RFCN Resnet 101 68.3% Add Text
GoogleNet Inception V3 55.01% Content Here
SSD Inception V1 73.56% Add Text
Our study 83.45% Content Here
Accuracy Error Rate
Model
Comparison
Conclusion
Add Text
 Successfully detects dental caries and root canal
 Improvement of Faster R-CNN framework for generic
object detection
 Performs better than other standalone methods
 Good convergence with better local minima
Future Works
Add Text
 Will work on huge dataset
 GPU implementation
 To build a real time model that can detect dental objects
from videos considering the clinical parameters
References
Add Text
[1] M. M. Lakshmi and P. Chitra, ”Classification of Dental Cavities from X-ray images
using Deep CNN algorithm,” 2020 4th International Conference on Trends in Electronics
and In-formatics (ICOEI), 2020.
[2]. J.H. Lee, D.H. Kim, S.N. Jeong and S.H. Choi, ”Diagnosis and prediction of period on
tally compromised teeth using a deep learning-based convolutional neural network
algorithm” ,Journal of periodontal implant science, vol. 48, no. 2, pp. 114-123, 2018.
[3]. A.A. Al Kheraif, A.A. Wahba and H. Fouad, ”Detection of dental diseases from
radiographic2d dental image using hybrid graph-cut technique and convolutional neural
network”, Mea-surement, vol. 146, pp. 333-342, 2019.
[4]. Oralhealth, https://www.who.int/news-room/fact-sheets/detail/oral-health. Last
accessed 19 Aug 2021.
[5]. J.-H. Lee, D.-H. Kim, S.-N. Jeong, and S.-H. Choi, “Detection and diagnosis of dental
caries using a deep learning-based convolutional neural network algorithm,” Journal of
dentistry, vol.77, pp. 106–111, 2018.
THANK YOU

More Related Content

PPTX
CNN Machine learning DeepLearning
PDF
IoT and LoRaWAN
PPTX
Alteryx Architecture
PPTX
Tutorial on Object Detection (Faster R-CNN)
PPTX
Cone beam computed tomography
PPTX
Object detection with deep learning
PDF
Prototyping Online Components(Part 01)_Internet of Things
PPTX
CNN Machine learning DeepLearning
IoT and LoRaWAN
Alteryx Architecture
Tutorial on Object Detection (Faster R-CNN)
Cone beam computed tomography
Object detection with deep learning
Prototyping Online Components(Part 01)_Internet of Things

What's hot (20)

PPTX
Object detection
PPTX
Image feature extraction
PPTX
AGE AND GENDER DETECTION.pptx
PPTX
Human age and gender Detection
PDF
Content Based Image Retrieval
PPTX
Object detection
PPTX
Real Time Object Tracking
PPTX
Active contour segmentation
PPT
Image pre processing
PDF
Introduction to object detection
PDF
Sensor Cloud
PPTX
Pattern recognition and Machine Learning.
PDF
Digital Image Processing Notes - Akshansh
PDF
Credit card fraud detection using python machine learning
PPT
Thresholding.ppt
PDF
Online Transaction Fraud Detection System Based on Machine Learning
PPTX
Object Detection using Deep Neural Networks
PPTX
Chest X-ray Pneumonia Classification with Deep Learning
PDF
Depth Fusion from RGB and Depth Sensors by Deep Learning
PPT
Sismulmed 04 b. image processing intro
Object detection
Image feature extraction
AGE AND GENDER DETECTION.pptx
Human age and gender Detection
Content Based Image Retrieval
Object detection
Real Time Object Tracking
Active contour segmentation
Image pre processing
Introduction to object detection
Sensor Cloud
Pattern recognition and Machine Learning.
Digital Image Processing Notes - Akshansh
Credit card fraud detection using python machine learning
Thresholding.ppt
Online Transaction Fraud Detection System Based on Machine Learning
Object Detection using Deep Neural Networks
Chest X-ray Pneumonia Classification with Deep Learning
Depth Fusion from RGB and Depth Sensors by Deep Learning
Sismulmed 04 b. image processing intro
Ad

Similar to Object Detection on Dental X-ray Images using R-CNN (20)

PDF
Issues in AI product development and practices in audio applications
PDF
Dental caries detection using faster region-based convolutional neural networ...
PDF
IRJET - Object Detection using Deep Learning with OpenCV and Python
PDF
CV _Manoj
PDF
IRJET- A Survey on Medical Image Interpretation for Predicting Pneumonia
PDF
A Literature Survey on Image Linguistic Visual Question Answering
PDF
IRJET - Automatic Lip Reading: Classification of Words and Phrases using Conv...
PDF
Final Year IEEE Project 2013-2014 - Digital Image Processing Project Title a...
PDF
Modelling Framework of a Neural Object Recognition
PPTX
Image classification with Deep Neural Networks
PDF
最近の研究情勢についていくために - Deep Learningを中心に -
PDF
imageclassification-160206090009.pdf
PDF
IEEE MultiMedia 2016 Title and Abstract
PDF
Robust Tracking Via Feature Mapping Method and Support Vector Machine
PDF
Off-line English Character Recognition: A Comparative Survey
PDF
ANIMAL SPECIES RECOGNITION SYSTEM USING DEEP LEARNING
PPTX
major project ppt final (SignLanguage Detection)
PDF
Partial Object Detection in Inclined Weather Conditions
PDF
IRJET - Object Detection using Hausdorff Distance
PDF
Saliency Based Hookworm and Infection Detection for Wireless Capsule Endoscop...
Issues in AI product development and practices in audio applications
Dental caries detection using faster region-based convolutional neural networ...
IRJET - Object Detection using Deep Learning with OpenCV and Python
CV _Manoj
IRJET- A Survey on Medical Image Interpretation for Predicting Pneumonia
A Literature Survey on Image Linguistic Visual Question Answering
IRJET - Automatic Lip Reading: Classification of Words and Phrases using Conv...
Final Year IEEE Project 2013-2014 - Digital Image Processing Project Title a...
Modelling Framework of a Neural Object Recognition
Image classification with Deep Neural Networks
最近の研究情勢についていくために - Deep Learningを中心に -
imageclassification-160206090009.pdf
IEEE MultiMedia 2016 Title and Abstract
Robust Tracking Via Feature Mapping Method and Support Vector Machine
Off-line English Character Recognition: A Comparative Survey
ANIMAL SPECIES RECOGNITION SYSTEM USING DEEP LEARNING
major project ppt final (SignLanguage Detection)
Partial Object Detection in Inclined Weather Conditions
IRJET - Object Detection using Hausdorff Distance
Saliency Based Hookworm and Infection Detection for Wireless Capsule Endoscop...
Ad

More from Minhazul Arefin (9)

PPTX
LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning ...
PPTX
pic2code: Generating HTML Code from Handwritten Picture.pptx
PPTX
Controlling Home Appliances adopting Chatbot using Machine Learning Approach
PPTX
Natural Language Query to SQL conversion using Machine Learning Approach
PPTX
Efficient estimation of word representations in vector space (2013)
PPTX
Semantic scaffolds for pseudocode to-code generation (2020)
PPTX
Recurrent neural networks (rnn) and long short term memory networks (lstm)
PPTX
SPoC: search-based pseudocode to code
PPTX
The rise of “Big Data” on cloud computing
LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning ...
pic2code: Generating HTML Code from Handwritten Picture.pptx
Controlling Home Appliances adopting Chatbot using Machine Learning Approach
Natural Language Query to SQL conversion using Machine Learning Approach
Efficient estimation of word representations in vector space (2013)
Semantic scaffolds for pseudocode to-code generation (2020)
Recurrent neural networks (rnn) and long short term memory networks (lstm)
SPoC: search-based pseudocode to code
The rise of “Big Data” on cloud computing

Recently uploaded (20)

PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
PPTX
CH1 Production IntroductoryConcepts.pptx
DOCX
573137875-Attendance-Management-System-original
PPTX
Artificial Intelligence
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PDF
composite construction of structures.pdf
PPTX
Geodesy 1.pptx...............................................
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPT
introduction to datamining and warehousing
PDF
Model Code of Practice - Construction Work - 21102022 .pdf
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
Foundation to blockchain - A guide to Blockchain Tech
PPTX
Sustainable Sites - Green Building Construction
PPTX
Construction Project Organization Group 2.pptx
PPTX
OOP with Java - Java Introduction (Basics)
PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PDF
R24 SURVEYING LAB MANUAL for civil enggi
PPTX
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
PPTX
Safety Seminar civil to be ensured for safe working.
Automation-in-Manufacturing-Chapter-Introduction.pdf
CH1 Production IntroductoryConcepts.pptx
573137875-Attendance-Management-System-original
Artificial Intelligence
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
composite construction of structures.pdf
Geodesy 1.pptx...............................................
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
introduction to datamining and warehousing
Model Code of Practice - Construction Work - 21102022 .pdf
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
UNIT-1 - COAL BASED THERMAL POWER PLANTS
Foundation to blockchain - A guide to Blockchain Tech
Sustainable Sites - Green Building Construction
Construction Project Organization Group 2.pptx
OOP with Java - Java Introduction (Basics)
CYBER-CRIMES AND SECURITY A guide to understanding
R24 SURVEYING LAB MANUAL for civil enggi
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
Safety Seminar civil to be ensured for safe working.

Object Detection on Dental X-ray Images using R-CNN

  • 1. Object Detection on Dental X-ray Images using Region Based Convolutional Neural Networks Rakib Hossen, Minhazul Arefin and Mohammed Nasir Uddin INTERNATIONAL CONFERENCE ON MACHINE INTELLIGENCE & DATA SCIENCE APPLICATIONS (MIDAS 2021) Date: December 26-27, 2021
  • 3. Introduction Add Text  Object detection is a computer vision technique that allows us to identify and locate objects in an image or video.  Tooth decay, also known as dental caries or cavities, is the breakdown of teeth due to acids made by bacteria.  Root canal is a dental procedure involving the removal of the soft center of the tooth, the pulp.
  • 4. Introduction Add Text  In 2020, the WHO estimated that about 50% of the world population is affected by dental caries.  In some Asian-Pacific countries, the incidence of oral cancer is within the top 3 of all cancers.  Dental caries are cavities or holes (a type of structural damage) in the teeth.  Root canal causes due to inflammation or infection in the roots of a tooth.
  • 5. Problem Statement Add Text  Manual feature extraction for the detection of caries and root canal  Difficulties in generating hierarchical features  Inaccurate Region Of Interest (ROI) detection and edge detection  Difficulties in training model with good convergence
  • 6. Objectives Add Text  To develop a framework that extracts features efficiently  To design an efficient deep learning approach that can aid in the automatic detection of objects in dental X-rays  To classify the detected objects in the dental x-ray images into caries and root canal.
  • 7. Contributions Add Text  Using state-of-the-art model  Parameterizing the four co-ordinates of the detected object in the multi scale training  Using 12 anchors in the RPN
  • 9. Image Acquisition Add Text Source: Digital Dental Periapical X-Ray Dataset Two categories: Caries and Root canal Type: Dental Periapical images 80% for training and 20% for testing
  • 10. Model pre-training Add Text  Pre-train the model on COCO dataset  Fine tune the model  Train the model on Digital Dental Periapical X-Ray Dataset  Fine tune the model again
  • 11. Hard negative mining Add Text  Boosts performance especially object detection  Hard negatives are the regions where the network has failed to make correct prediction  Fed into the network again as a reinforcement for improving trained model  Towards fewer false positives and better classification performance
  • 12. Number of anchors Add Text  Smaller items such as implants seem to be quite frequent in object detection tasks  We uses two conditions to assign a positive label to an anchor 𝐿(𝑝𝑖, 𝑡𝑖) = 1 𝑁𝑐𝑙𝑠 𝑖 𝐿𝑐𝑙𝑠 𝑝𝑖, 𝑝𝑖 ∗ + 𝜆 1 𝑁𝑟𝑒𝑔 𝑖 𝑝𝑖 ∗ 𝐿𝑟𝑒𝑔 𝑡𝑖, 𝑡𝑖 ∗  A mini-batch has an anchor 𝑖, and 𝑝𝑖 is a projected probability that anchor 𝑖 will be a real item
  • 13. Number of anchors Add Text  Most Crucial Part in RPN  Traditional Faster R-CNN uses 9 anchors  Sometimes fails to detect smaller object  In this study we used 12 anchors
  • 14. Multi-scale training Add Text  Resizes the images to a random scale  The detector will be able to learn features across a wide range of sizes  Improves the performance towards scale invariance  We compute the bounding box regression by parameterized the four co-ordinates of the detected object. It is shown in equation: 𝑡𝑝 = (𝑝 − 𝑝𝑎)/𝑟𝑎, 𝑡𝑞 = (𝑞 − 𝑞𝑎)/𝑠𝑎 𝑡𝑟 = 𝑙𝑜𝑔 𝑟 𝑟𝑎 , 𝑡𝑠 = 𝑙𝑜𝑔 𝑠 𝑠𝑎 𝑡𝑝 ∗ = 𝑝∗ − 𝑝𝑎 𝑟𝑎 , 𝑡𝑞 ∗ = 𝑞∗ − 𝑞𝑎 𝑠𝑎 𝑡𝑟 ∗ = 𝑙𝑜𝑔 𝑟∗ 𝑟𝑎 , 𝑡𝑠 ∗ = 𝑙𝑜𝑔 𝑠∗ 𝑠𝑎
  • 15. Feature Concatenation Add Text  Feature concatenation is an effective way to add different features together to enhance the classification process.  Features are RoI-pooled and L2-normalized from several lower-level convolution layers accordingly.  These characteristics are then concatenated and rescaled as if the original scale of the features had not been adopted.  A 1×1 convolution is done to match the original network’s number of channels.
  • 16. Feature Concatenation Add Text  Features from multiple convolutional layers  Convolutional layers: lower level & higher level  Features: ROI pooled & L2 normalized
  • 17. Object Detection Add Text  Assign some labels to an object based on their features using soft-max classifier  Detect objects in dental x-rays image successfully
  • 18. Result Add Text  The overlap between two borders is measured by the IoU.  The overlap between our anticipated border and the ground reality is then calculated (the real object boundary).  Let 𝑛𝑖,𝑗 be the number of pixels of class 𝑖 predicted to belong to class 𝑗, where there are 𝑛𝑐𝑙 different classes, and let 𝑡𝑖 = 𝑗 𝑛𝑖𝑗 be the total number of pixels of class 𝑖.  Mean IoU is defined as: 𝑀𝑒𝑎𝑛𝐼𝑜𝑈 = 1 𝑛𝑐𝑙 𝑖 𝑛𝑖𝑖 𝑡𝑖 + 𝑠𝑢𝑚𝑗 𝑛𝑗𝑖 − 𝑛𝑖𝑖
  • 19. Result Add Text  All ground truth boxes with an IoU ratio less than 0.3 will be labeled as negative  Total Loss function per epoc (in thousand)
  • 20. Comparison RFCN Resnet 101 68.3% Add Text GoogleNet Inception V3 55.01% Content Here SSD Inception V1 73.56% Add Text Our study 83.45% Content Here Accuracy Error Rate Model
  • 22. Conclusion Add Text  Successfully detects dental caries and root canal  Improvement of Faster R-CNN framework for generic object detection  Performs better than other standalone methods  Good convergence with better local minima
  • 23. Future Works Add Text  Will work on huge dataset  GPU implementation  To build a real time model that can detect dental objects from videos considering the clinical parameters
  • 24. References Add Text [1] M. M. Lakshmi and P. Chitra, ”Classification of Dental Cavities from X-ray images using Deep CNN algorithm,” 2020 4th International Conference on Trends in Electronics and In-formatics (ICOEI), 2020. [2]. J.H. Lee, D.H. Kim, S.N. Jeong and S.H. Choi, ”Diagnosis and prediction of period on tally compromised teeth using a deep learning-based convolutional neural network algorithm” ,Journal of periodontal implant science, vol. 48, no. 2, pp. 114-123, 2018. [3]. A.A. Al Kheraif, A.A. Wahba and H. Fouad, ”Detection of dental diseases from radiographic2d dental image using hybrid graph-cut technique and convolutional neural network”, Mea-surement, vol. 146, pp. 333-342, 2019. [4]. Oralhealth, https://www.who.int/news-room/fact-sheets/detail/oral-health. Last accessed 19 Aug 2021. [5]. J.-H. Lee, D.-H. Kim, S.-N. Jeong, and S.-H. Choi, “Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm,” Journal of dentistry, vol.77, pp. 106–111, 2018.