SlideShare a Scribd company logo
Automated image
analysis: rescue for
diffusion-MRI of
threat to radiologists?
Dr. Erik Ranschaert
erik.ranschaert@gmail.com
Automated Image Analysis: what is it about?
Automatic reading of
images by A.I.
Big Data & Deep Learning
Radiological &
non-radiological images
Imaging Biomarkers
Radiomics
Radiogenomics
Personalised Disease Evolution
• What do we want to know for each patient?
– Is a tumor present?
– Is it aggressive?
– Is it focally treatable?
– Is it radiosensitive?
– Will it metastasize?
• Evidence based medicine
– has succeeded in defining effective therapeutics for large populations
– is lacking when applied to small subpopulations (“precision medicine”)
– is insufficient when applied to the individual level (“personalized medicine”).Krishnaraj A et al. The future of imaging biomarkers in radiologic practice.
J Am Coll Radiol 2014;11:20-23
Genetics
Clinical
manifestation
TreatmentEtiology
LINK
Shift to Personalised Medicine
Predisposition to disease development and responsiveness to treatment
depends on information enclosed in genoma.
Biobanks are crucial
Long-term storage and retrieval of tissue samples is needed in biobanks.
Human biobanks include biological material of healthy subjects and patients with specific
pathologies, most cancer-related.
Data from radiological imaging are not included in the human biobanks.
Association between phenotype (imaging) and genotype will become possible by means of
imaging biomarkers.
Quantitative medical imaging with identification of imaging biomarkers represents a crucial part
of personalised medicine.
Several imaging biobank projects have been started.
Radiomics vs. Radiogenomics
RADIOMICS
Automated extraction, storage and
analysis of a large amount of imaging
features (morphology and imaging
biomarkers)
Cloud-based deep-learning techniques
Conversion of images to mineable data, in
order to create accessible databases
(biobanks)
...and to reveal quantitative predictive or
prognostic associations between images
and medical outcomes.
RADIOGENOMICS
Imaging findings can be considered as the
phenotypic expression of a patient,
which can be correlated to the
genotype.
Radiogenomics is the extension of
radiomics, aiming to identify a link
between genotype and phenotype
imaging.
“To explore the full
potential of radiomics, we
have to enter the era of
big data, team science and,
most of all, the new age of
imaging bioinformatics”
Dr. Hricak
Imaging Biobanks
QIBA
Founded in 2007 by RSNA
Mission: to improve the value and practicality of
quantitative imaging biomarkers by reducing
variability across devices, patients, and time.
Support from volunteer committee members from
academia, medical device, pharmaceutical and other
business sectors, and government.
4 Modality-based committees: Q-CT, Q-MR, Q-NM, Q-US
10 Biomarker committees
EIBALL
Founded by ESR in March 2015
Coordination of ESR activities concerning
imaging biomarkers
Merging of activities of
ESR Subcommittee on Imaging
Biomarkers
ESR Working Group on Personalised
Medicine
ESR-EORTC Working Group
QIBA
10 Biomarker committees
DWI as biomarker of cancer
Toronto 2008: Consensus and Recommendations on use of DW-MRI as
cancer imaging biomarker
DWI-MRI should be tested as imaging biomarker in clinical trials
DWI-MRI measurements should be compared with histologic indices
Standards for measurement, analysis and display are needed
Annotated data should be made available
MRI vendors should be engaged in processPadhani AR, Liu G, Mu-Koh D, et al. Diffusion-Weighted Magnetic Resonance Imaging as a Cancer Biomarker: Consensus and Recommendations.
Neoplasia (New York, NY). 2009;11(2):102-125.
Advantages of DWI-MRI
Improved tissue characterisation (malignant vs. benign)
Monitoring of treatment after chemotherapy or radiation
DD of post-therapeutic changes from residual active tumor
Detection of recurrent cancer
Prediction of treatment outcome
Tumour staging
Detection of lymph node involvement
Remaining challenges for DWI to assess cancer
Divergence among and between vendors on data measurements/analysis
No accepted standards for measurements and analysis
Multiple data acquisition protocols depending on body part and usage of data
Qualitative to quantitative assessments
Lack of understanding of DW-MRI at a microscopic level
Incomplete validation and documentation of reproducibility
Divergent nomenclature and symbols
Lack of multicenter working methodologies, accepted quality assurance (QA)
standards, and physiologically realistic phantoms
Biomarkers - ratio metrics
SI ratio’s
Hybrid imaging: PET/MRI vs. PET/CT
Current Status of Hybrid PET/MRI in Oncologic Imaging
Andrew B. Rosenkrantz et al., American Journal of Roentgenology 2016 206:1, 162-172
85-year-old man with prostate cancer who underwent initial staging workup that showed metastases to bone.
Standard bone scan shows one metastatic lesion in left acetabulum (solid arrow) and small subtle lesion in upper
thoracic spine (dashed arrow) which was attributed to degenerative spine disease. ANT = anterior view, POS =
posterior view.
NaF PET/MR image
obtained 3 weeks later
reveals nine metastatic
lesions (circles), showing
higher sensitivity of
PET/MRI.
Lesion in T2 spinous process on PET/MRI (dashed
arrows) corresponds to small subtle lesion on
bone scan
Radiologists of the future
Medisch Contact, 5 dec 2016
Healthcare in Europe, 28 nov 2016
“Machine learning can discover whether certain
image data point towards certain diseases; it can
discover correlations as yet unknown, or confirm
suspected correlations respectively by analysing the
large amounts of data.”
Are biomarkers and A.I. threatening radiology?
“Automatic reading of images by A.I. is not developed enough to replace
the trained and experienced observer with his/her ability to interpret and
judge during image reading sessions”
“Nevertheless, subjective, and therefore, qualitative interpretations are
observer dependent and highly variable, and variability inevitably
degrades outcomes in healthcare in general”
“Extracting objective, quantitative results from medical images is one way
to reduce the variability...and thus will improve patient outcomes”.
Siegfried Trattnig, Chair of EIBALL
12 Opinion Leaders’ ideas
Paul M. Parizel
Geraldine McGinty
Lluis Donoso Bach
Luis Marti-Bonmati
Nicola Strickland
Koenraad Mortele
Wiro Niessen
Charles Kahn
Marion Smits
Peter Mildenberger
Mario Maas
Vasileios Katsaros
Redefinition of radiology
Copyright Dr. E. R. Ranschaert
•Multidisciplinary integration, expert consultancy, therapy guidance
•Disease-focused approach, gatekeeping, lean approach
Workflow
management
•Deal with errors, reduce failure and mistake
•Measure outcomes & improve performanceQuality management
•Embrace power of digital networks, cloud services, big data, deep
learning & Artificial IntelligenceImaging Informatics
•Structured reporting (+ coding), multimedia, actionable reports
•Patient-oriented approach, lay-language, open notesCommunication
Precision medicine
• Functional imaging & imaging biomarkers, radiomics & radiogenomics,
integrated diagnostics
• Image-guided interventions
Automated image analysis: rescue for diffusion-MRI of threat to radiologists?

More Related Content

PPTX
Information Technology and Radiology: challenges and future perspectives
PPTX
Clinical Trial Accrual Challenges: Is Social Media Here to Help? (A. Denicoff)
PPTX
From Big Data to Precision Medicine
PPTX
Support & information for radiotherapy patients: how can social media help?
PDF
The Value of Multimedia-Enhanced Radiology Reporting
PPTX
Digital pathology in developing country
PDF
[대한병리학회] 의료 인공지능 101: 병리를 중심으로
PDF
Twenty Years of Whole Slide Imaging - the Coming Phase Change
Information Technology and Radiology: challenges and future perspectives
Clinical Trial Accrual Challenges: Is Social Media Here to Help? (A. Denicoff)
From Big Data to Precision Medicine
Support & information for radiotherapy patients: how can social media help?
The Value of Multimedia-Enhanced Radiology Reporting
Digital pathology in developing country
[대한병리학회] 의료 인공지능 101: 병리를 중심으로
Twenty Years of Whole Slide Imaging - the Coming Phase Change

What's hot (20)

PDF
The reality of moving towards precision medicine
PPTX
Genomics and Computation in Precision Medicine March 2017
PPT
UCSF Informatics Day 2014 - Keith R. Yamamoto, "Precision Medicine"
PDF
14 technologies that will shape the future of cancer care
PPT
Towards Digitally Enabled Genomic Medicine: the Patient of The Future
PDF
Turning Big Data into Precision Medicine
PPTX
Digital Pathology, FDA Approval and Precision Medicine
PPTX
ICBO 2014, October 8, 2014
PDF
PDF
Integrating Genomic Medicine into Patient Care with Trish Brown, MS, CGC
PPT
Kibbe One Voice Against Cancer 20170605
PDF
The roles of a medical technologist from the covid 19 pandemic
PDF
Could this change how radiology residents record their clinical output?
PDF
PDF
BioData West 2017 Brochure.PDF
PDF
Precision Medicine: Research Presentation
PDF
The pleasures and pitfalls of rendering interpretations in layperson’s language
PPT
From Digitally Enabled Genomic Medicine to Personalized Healthcare
PPTX
Oncoset symposium kibbe 201704
The reality of moving towards precision medicine
Genomics and Computation in Precision Medicine March 2017
UCSF Informatics Day 2014 - Keith R. Yamamoto, "Precision Medicine"
14 technologies that will shape the future of cancer care
Towards Digitally Enabled Genomic Medicine: the Patient of The Future
Turning Big Data into Precision Medicine
Digital Pathology, FDA Approval and Precision Medicine
ICBO 2014, October 8, 2014
Integrating Genomic Medicine into Patient Care with Trish Brown, MS, CGC
Kibbe One Voice Against Cancer 20170605
The roles of a medical technologist from the covid 19 pandemic
Could this change how radiology residents record their clinical output?
BioData West 2017 Brochure.PDF
Precision Medicine: Research Presentation
The pleasures and pitfalls of rendering interpretations in layperson’s language
From Digitally Enabled Genomic Medicine to Personalized Healthcare
Oncoset symposium kibbe 201704
Ad

Similar to Automated image analysis: rescue for diffusion-MRI of threat to radiologists? (20)

PDF
IMAGING BIOMARKER PANELS AND MULTI-OMICS AI MODELS FOR OUTCOMES PREDICTION
PDF
CHIME Lead Forum 2015 - NYC
PPTX
985061_slides in English language .pptx
PPT
Imaging biobanks, report from the european society of radiology
PPTX
TCIA Update
PDF
Radiomics: Novel Paradigm of Deep Learning for Clinical Decision Support towa...
PDF
Carlos Perez Castillo - Imaging biomarkers automated structured
PDF
Lec2: Digital Images and Medical Imaging Modalities
PPTX
Radiomics in Oncology
PPTX
Hedvig Hricak & Imaging Prostate Cancer
PDF
Diagnostic medical imaging
PDF
PET/MRI Current & Future Status
DOCX
PERSONALIZED MEDICINE 66515 2013Molecular Imaging .docx
DOCX
Clinical and biomedical applications of imaging therapy
PDF
PPTX
Why Big Image Analytics is essential for Imaging Biobanks: An Osteoporosis Ra...
PPTX
MEDICAL IMAGE PROCESSING
PDF
AI In Medical Imaging.pdf
PDF
Clin Rad Artificial Intelligence Special Issue
PDF
Clin Rad Artificial Intelligence Special Issue
IMAGING BIOMARKER PANELS AND MULTI-OMICS AI MODELS FOR OUTCOMES PREDICTION
CHIME Lead Forum 2015 - NYC
985061_slides in English language .pptx
Imaging biobanks, report from the european society of radiology
TCIA Update
Radiomics: Novel Paradigm of Deep Learning for Clinical Decision Support towa...
Carlos Perez Castillo - Imaging biomarkers automated structured
Lec2: Digital Images and Medical Imaging Modalities
Radiomics in Oncology
Hedvig Hricak & Imaging Prostate Cancer
Diagnostic medical imaging
PET/MRI Current & Future Status
PERSONALIZED MEDICINE 66515 2013Molecular Imaging .docx
Clinical and biomedical applications of imaging therapy
Why Big Image Analytics is essential for Imaging Biobanks: An Osteoporosis Ra...
MEDICAL IMAGE PROCESSING
AI In Medical Imaging.pdf
Clin Rad Artificial Intelligence Special Issue
Clin Rad Artificial Intelligence Special Issue
Ad

More from Erik R. Ranschaert, MD, PhD (20)

PPTX
Les réseaux sociaux en radiologie
PPTX
A.I. in Radiology: Hype or Hope?
PPTX
Social Networks and Collaborative Platforms for Data Sharing in Radiology
PPTX
Wat betekent A.I. voor de radiologie?
PPTX
What's in WhatsApp for Radiologists?
PPTX
Protection of patient data in EU vs. US
PPTX
IT en Radiologie
PPTX
Security and ethical issues of mobile device technology
PPTX
IT changes communication for radiologists
PPT
The impact of Information Technology on Radiology Services
PPTX
Use of Social Media in Radiology
PPTX
Mobile (tele)radiology
PPTX
Comparison of ESR & ACR Teleradiology White Papers
PPTX
iPad for (tele)radiology, a critical appraisal
PPTX
Teleradiology White Paper
PPTX
State-of-the-art Cardiac CT of the coronary arteries
PDF
Radiologie anno 2012
PPTX
Radiologie in 2012: hollen of stilstaan?
PPTX
Teleradiology, European perspective
PPT
Ct Cardiac Nvmbr2012
Les réseaux sociaux en radiologie
A.I. in Radiology: Hype or Hope?
Social Networks and Collaborative Platforms for Data Sharing in Radiology
Wat betekent A.I. voor de radiologie?
What's in WhatsApp for Radiologists?
Protection of patient data in EU vs. US
IT en Radiologie
Security and ethical issues of mobile device technology
IT changes communication for radiologists
The impact of Information Technology on Radiology Services
Use of Social Media in Radiology
Mobile (tele)radiology
Comparison of ESR & ACR Teleradiology White Papers
iPad for (tele)radiology, a critical appraisal
Teleradiology White Paper
State-of-the-art Cardiac CT of the coronary arteries
Radiologie anno 2012
Radiologie in 2012: hollen of stilstaan?
Teleradiology, European perspective
Ct Cardiac Nvmbr2012

Recently uploaded (20)

PPTX
Understanding The Self : 1Sexual health
PPTX
Obstetric management in women with epilepsy.pptx
DOCX
ch 9 botes for OB aka Pregnant women eww
PDF
health promotion and maintenance of elderly
PPTX
ACUTE CALCULAR CHOLECYSTITIS: A CASE STUDY
PPTX
Nancy Caroline Emergency Paramedic Chapter 4
PPTX
Nancy Caroline Emergency Paramedic Chapter 17
PPTX
Public Health. Disasater mgt group 1.pptx
PPTX
OSTEOMYELITIS and OSTEORADIONECROSIS.pptx
PDF
Back node with known primary managementt
PPTX
Nancy Caroline Emergency Paramedic Chapter 7
PDF
Fundamentals Final Review Questions.docx.pdf
PPTX
Benign prostatic hyperplasia, uro anaesthesia
PPTX
guidance--unit 1 semester-5 bsc nursing.
PPTX
Full Slide Deck - SY CF Talk Adelaide 10June.pptx
PPTX
Nancy Caroline Emergency Paramedic Chapter 15
PDF
Zuri Health Pan-African Digital Health Innovator.pdf
PDF
Medical_Biology_and_Genetics_Current_Studies_I.pdf
PPTX
Arthritis Types, Signs & Treatment with physiotherapy management
PPTX
Nancy Caroline Emergency Paramedic Chapter 16
Understanding The Self : 1Sexual health
Obstetric management in women with epilepsy.pptx
ch 9 botes for OB aka Pregnant women eww
health promotion and maintenance of elderly
ACUTE CALCULAR CHOLECYSTITIS: A CASE STUDY
Nancy Caroline Emergency Paramedic Chapter 4
Nancy Caroline Emergency Paramedic Chapter 17
Public Health. Disasater mgt group 1.pptx
OSTEOMYELITIS and OSTEORADIONECROSIS.pptx
Back node with known primary managementt
Nancy Caroline Emergency Paramedic Chapter 7
Fundamentals Final Review Questions.docx.pdf
Benign prostatic hyperplasia, uro anaesthesia
guidance--unit 1 semester-5 bsc nursing.
Full Slide Deck - SY CF Talk Adelaide 10June.pptx
Nancy Caroline Emergency Paramedic Chapter 15
Zuri Health Pan-African Digital Health Innovator.pdf
Medical_Biology_and_Genetics_Current_Studies_I.pdf
Arthritis Types, Signs & Treatment with physiotherapy management
Nancy Caroline Emergency Paramedic Chapter 16

Automated image analysis: rescue for diffusion-MRI of threat to radiologists?

  • 1. Automated image analysis: rescue for diffusion-MRI of threat to radiologists? Dr. Erik Ranschaert erik.ranschaert@gmail.com
  • 2. Automated Image Analysis: what is it about? Automatic reading of images by A.I. Big Data & Deep Learning Radiological & non-radiological images Imaging Biomarkers Radiomics Radiogenomics
  • 3. Personalised Disease Evolution • What do we want to know for each patient? – Is a tumor present? – Is it aggressive? – Is it focally treatable? – Is it radiosensitive? – Will it metastasize? • Evidence based medicine – has succeeded in defining effective therapeutics for large populations – is lacking when applied to small subpopulations (“precision medicine”) – is insufficient when applied to the individual level (“personalized medicine”).Krishnaraj A et al. The future of imaging biomarkers in radiologic practice. J Am Coll Radiol 2014;11:20-23
  • 4. Genetics Clinical manifestation TreatmentEtiology LINK Shift to Personalised Medicine Predisposition to disease development and responsiveness to treatment depends on information enclosed in genoma.
  • 5. Biobanks are crucial Long-term storage and retrieval of tissue samples is needed in biobanks. Human biobanks include biological material of healthy subjects and patients with specific pathologies, most cancer-related. Data from radiological imaging are not included in the human biobanks. Association between phenotype (imaging) and genotype will become possible by means of imaging biomarkers. Quantitative medical imaging with identification of imaging biomarkers represents a crucial part of personalised medicine. Several imaging biobank projects have been started.
  • 6. Radiomics vs. Radiogenomics RADIOMICS Automated extraction, storage and analysis of a large amount of imaging features (morphology and imaging biomarkers) Cloud-based deep-learning techniques Conversion of images to mineable data, in order to create accessible databases (biobanks) ...and to reveal quantitative predictive or prognostic associations between images and medical outcomes. RADIOGENOMICS Imaging findings can be considered as the phenotypic expression of a patient, which can be correlated to the genotype. Radiogenomics is the extension of radiomics, aiming to identify a link between genotype and phenotype imaging.
  • 7. “To explore the full potential of radiomics, we have to enter the era of big data, team science and, most of all, the new age of imaging bioinformatics” Dr. Hricak
  • 8. Imaging Biobanks QIBA Founded in 2007 by RSNA Mission: to improve the value and practicality of quantitative imaging biomarkers by reducing variability across devices, patients, and time. Support from volunteer committee members from academia, medical device, pharmaceutical and other business sectors, and government. 4 Modality-based committees: Q-CT, Q-MR, Q-NM, Q-US 10 Biomarker committees EIBALL Founded by ESR in March 2015 Coordination of ESR activities concerning imaging biomarkers Merging of activities of ESR Subcommittee on Imaging Biomarkers ESR Working Group on Personalised Medicine ESR-EORTC Working Group
  • 10. DWI as biomarker of cancer Toronto 2008: Consensus and Recommendations on use of DW-MRI as cancer imaging biomarker DWI-MRI should be tested as imaging biomarker in clinical trials DWI-MRI measurements should be compared with histologic indices Standards for measurement, analysis and display are needed Annotated data should be made available MRI vendors should be engaged in processPadhani AR, Liu G, Mu-Koh D, et al. Diffusion-Weighted Magnetic Resonance Imaging as a Cancer Biomarker: Consensus and Recommendations. Neoplasia (New York, NY). 2009;11(2):102-125.
  • 11. Advantages of DWI-MRI Improved tissue characterisation (malignant vs. benign) Monitoring of treatment after chemotherapy or radiation DD of post-therapeutic changes from residual active tumor Detection of recurrent cancer Prediction of treatment outcome Tumour staging Detection of lymph node involvement
  • 12. Remaining challenges for DWI to assess cancer Divergence among and between vendors on data measurements/analysis No accepted standards for measurements and analysis Multiple data acquisition protocols depending on body part and usage of data Qualitative to quantitative assessments Lack of understanding of DW-MRI at a microscopic level Incomplete validation and documentation of reproducibility Divergent nomenclature and symbols Lack of multicenter working methodologies, accepted quality assurance (QA) standards, and physiologically realistic phantoms
  • 13. Biomarkers - ratio metrics SI ratio’s
  • 14. Hybrid imaging: PET/MRI vs. PET/CT Current Status of Hybrid PET/MRI in Oncologic Imaging Andrew B. Rosenkrantz et al., American Journal of Roentgenology 2016 206:1, 162-172
  • 15. 85-year-old man with prostate cancer who underwent initial staging workup that showed metastases to bone. Standard bone scan shows one metastatic lesion in left acetabulum (solid arrow) and small subtle lesion in upper thoracic spine (dashed arrow) which was attributed to degenerative spine disease. ANT = anterior view, POS = posterior view.
  • 16. NaF PET/MR image obtained 3 weeks later reveals nine metastatic lesions (circles), showing higher sensitivity of PET/MRI. Lesion in T2 spinous process on PET/MRI (dashed arrows) corresponds to small subtle lesion on bone scan
  • 17. Radiologists of the future Medisch Contact, 5 dec 2016 Healthcare in Europe, 28 nov 2016 “Machine learning can discover whether certain image data point towards certain diseases; it can discover correlations as yet unknown, or confirm suspected correlations respectively by analysing the large amounts of data.”
  • 18. Are biomarkers and A.I. threatening radiology? “Automatic reading of images by A.I. is not developed enough to replace the trained and experienced observer with his/her ability to interpret and judge during image reading sessions” “Nevertheless, subjective, and therefore, qualitative interpretations are observer dependent and highly variable, and variability inevitably degrades outcomes in healthcare in general” “Extracting objective, quantitative results from medical images is one way to reduce the variability...and thus will improve patient outcomes”. Siegfried Trattnig, Chair of EIBALL
  • 19. 12 Opinion Leaders’ ideas Paul M. Parizel Geraldine McGinty Lluis Donoso Bach Luis Marti-Bonmati Nicola Strickland Koenraad Mortele Wiro Niessen Charles Kahn Marion Smits Peter Mildenberger Mario Maas Vasileios Katsaros
  • 20. Redefinition of radiology Copyright Dr. E. R. Ranschaert •Multidisciplinary integration, expert consultancy, therapy guidance •Disease-focused approach, gatekeeping, lean approach Workflow management •Deal with errors, reduce failure and mistake •Measure outcomes & improve performanceQuality management •Embrace power of digital networks, cloud services, big data, deep learning & Artificial IntelligenceImaging Informatics •Structured reporting (+ coding), multimedia, actionable reports •Patient-oriented approach, lay-language, open notesCommunication Precision medicine • Functional imaging & imaging biomarkers, radiomics & radiogenomics, integrated diagnostics • Image-guided interventions