www.medradiology.moscow
Professor	Sergey	Morozov
Eketerina Guseva
Big data and AI
in radiologist’s
reading room
Atlas	– June	16,	2017
www.medradiology.moscow
Agenda
• Radiology	trends
• How	to	measure	imaging	quality
• Moscow	URIS
• How	to	manage	changes
• AI/ML	for	imaging	data	analysis
www.medradiology.moscow
www.medradiology.moscow
Whole-body	
imaging
www.medradiology.moscow
Radiology	trends
• From	modalities	(CT,	MRI,	X-Ray,	etc.)	to	
clinical	sections
• From	analog	to	digital
• From	a	dark	room	to	open	space
• From	jack-of-all-trades	to	labor	division
• From	separated	to	integrated	clinical	facilities
• From	art	to	craft	and	skills
• From	unique	services	to	mass	production
www.medradiology.moscow
6
morozov@npcmr.ru
www.medradiology.moscow
Clinical Radiology	
spider	web	(J.Reekers)
www.medradiology.moscow
Structure	+	process	+	team	=
=	value	for	the	patient
Technician
Radiologist
Administrator
Head	of	department
Consultant
Nurse
Referring	
physician
www.medradiology.moscow
MRI
CT
US
NM
Digitizer
PACS
DB
Server
Short-term
archive
Long-term archive
Diagnostic workstations
Web
server
Clinical Web-
clients
RIS server
RIS client
PACS
RIS
RIS clients
Printing
DicomIzer
Mammo
X-ray
Cloud-based imaging
All formats
image sharing
www.medradiology.moscow
Imaging	3.0
Standardization,	consistency,	interoperability
www.medradiology.moscow
Familiar	problems?
• Shortage	of	qualified	staff
• Low	motivation
• “Cherry	picking” principle
• High	staff	turnover
• Slow	implementation	of	new	methods
France, Imaging management, 2009
www.medradiology.moscow
Quality	problem
• IoM,	USA:	100	000	deaths/year	of	medical	
errors
• Russia:	…..?
12
Original	report
According	to	CT,	the	tumor	of	the	middle	pole	of	the	
left	kidney. Cyst	of	the	left	kidney.	Multiple	myomas
in	the	uterus.
Peer-review
Cyst	of	the	left	kidney.	Multiple	myomas in	the	
uterus.
False	positive	CT	diagnosis	of	renal	cancer
www.medradiology.moscow
Radiology	Team	=	
“Defensive	Radiology”
www.medradiology.moscow
www.medradiology.moscow
Quality	Domains
§ Appropriateness
§ Diagnostic	accuracy	
§ Safety	
§ Actionable	reporting	
§ Communication	
Measuring	Radiologist’s	
Value	Add
www.medradiology.moscow
Patients’	satisfaction	measurements
HOW	TO	GET	A	5	STAR
RATING	AS	AN	UBER	DRIVER
16
www.medradiology.moscow
Moscow	Radiology	nowadays
166	CT 101	MRI2147	RG 27 SPECT+PET193	MMG
2634	eq
12,5	MM 707	K 641 K 222 K 215 K
14,3 MM	exams
(per	2015	year)
+22%+26%-1% +7%+8%
www.medradiology.moscow
77 med centers
62 CT
40 MRI140
radiologists
+ 22 experts
RPC Medical Radiology
26 mammo
United RIS (Radiology Information Service)
3 PET/CT
Administrative department:
+ ORACLE dashboard
Teaching and consulting dpt:
+ Teleaudit
+ Moodle CME
15 X-Ray5 fluorograph
> 700 000 studies
www.medradiology.moscow
URIS	Coordination	center
Real-time	monitoring	of	imaging	
departments
Dashboard	Microsoft	PowerBI è Oracle
www.medradiology.moscow
Data	availability	and	structuring
• Mapping	of	insurance	codes,	imaging	services	
nomenclature	(Min.	of	Health)
• Translation:	
– “any	6-hours	interval	with	at	least	1	study	
uploaded	to	URIS” =	”shift”
– ”absence	of	images	from	a	scanner	at	9am”	=	
possibly	out-of-order
• Pilot	automation	of	Statistics	Report	#30	– successful	
for	CT	and	MRI
• Develop	unified	methodology	of	calculating	numbers	
of	studies,	procedures,	visits,	referrals,	etc.
www.medradiology.moscow
Patient	safety
Quality	of	images
Quality	of	reports
Department's	
effectiveness
Patient	routing
Patient	wait	
times	(WIP)
With	uRIS we	can	control
www.medradiology.moscow
Teleaudit of CT, MRI, mammo
Reports
Ratings
Bonuses
Webinars
CME
Random	5%	
selection	of	
studies
Anonymized	
remote	
viewing
Expert’s	
detection	of	
errors
www.medradiology.moscow
Teleaudit =	peer-review	
Classification	of	errors	by	experts
18
Clinically significant?
www.medradiology.moscow
9,4
22,6 20,5
47,5
4,6
14
10,4
69
0
10
20
30
40
50
60
70
80
Клинически	
значимые	
расхождения
Клинически	не	
значимые	
расхождения
Замечания	
общего	
характера
Полное	
соответствие
I	кв.	2016 I	кв.	2017
Out-patient	medical	centers
Teleaudit results
24
Clinically
significant
Not clinically
significant
General
remarks and
recommx
No remarks
www.medradiology.moscow
Reports	and	ratings
TAT	=	report	turn-around	time	
Healthcare	
facility
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Presentation	to
CMO
Head of radiology department
Healthcare
Department
Avg. report turnaround
time decrease by 80%
(from 53 to 8 hours)
TAT	CT	QIV’15
TAT	CT	
QI’16
CHANGE
25
www.medradiology.moscow
CT	with	contrast	enhancement
(East	District,	West	District,	Central	District	of	Moscow)	
26
KPI	of	radiology	productivity
www.medradiology.moscow
27
Competition	among	
CMOs	of	hospitals
Positive	motivation	
to	achieve	the	
effectiveness	goals
Managing results by ratings
ГБУЗ	"ГП	№	64	ДЗМ"
ГБУЗ	"ГП	№	66	ДЗМ"
ГБУЗ	"ГП	№	69	ДЗМ"
ГБУЗ	"КДЦ	№	2	ДЗМ"
ГБУЗ	"ГП	№	195	ДЗМ"
ГБУЗ	"ГП	№	209	ДЗМ"
ГБУЗ	"ГП	№	212	ДЗМ"
ГБУЗ	"ГП	№	8	ДЗМ"
ГБУЗ	"КДЦ	№	4	ДЗМ"
ГБУЗ	"ГП	№	45	ДЗМ"
ГБУЗ	"ГП	№	6	ДЗМ"
www.medradiology.moscow
Quality	management	in	radiology
Act
Plan
Check
Do
28
Set	a	goal:	less	errors,	
develop	KPIs
Actions:	URIS,	teach	
and	train,	recommx
Root	cause	analysis:,	
system	changes,	KPIs	
correction
KPIs	monitoring,	5-
10%	peer-review
www.medradiology.moscow
Target	audience
• Radiologists
• Clinicians
• Technicians
03-2016 05-2017
0
50
100
150
200
250
300
350
Jan	– Apr	2017
• 45	webinars
• 6885	attendees	from	20	
regions	of	Russia
Webinars	of	RPC	Medical	Radiology
I.Trofimenko
i.trofimenko@rpcmr.org.ru
Free	webinars	of	RPCMR
www.medradiology.moscow
What’s	next?
www.medradiology.moscow
• “Does	your	work	feed	into	the	
field	of	artificial	intelligence?”
• “Not	really,	we	study	natural	
stupidity	instead	of	AI”
Amos	Tversky
www.medradiology.moscow
Healthcare	automatization
• Общий	технический	потенциал	≈	36%
• Питание	пациентов,	распределение	
медикаментов	>	75%
• Сбор	информации	от	пациентов	>	50%
• Анализ	снимков	≈ 30%
• Медсестра	<	30%
• Стоматолог-гигиенист	≈ 13% 32morozov@npcmr.ru
www.medradiology.moscow
Р/лаб
УЗИ/лаб
ПЭТ/лаб
МРТ-КТ/лаб
Рентгенолог
Потенциал	автоматизации	труда
http://www.visualcapitalist.com/charting-automation-potential-of-u-s-jobs/
www.medradiology.moscow
#AIHealth
DIAGNOSTICS AND
RISK ANALYTICS DRAW
MOST DEALS IN 2016
Imaging & diagnostics
dominated 2015, and is
at par with insights &
risk analytics so far this
year.
Deals to lifestyle
management &
monitoring picked up in
2015.
Virtual assistants, and AI
startups in mental health
still have room for
further investment
activity.
www.cbinsights.com 16
AI IN HEALTHCARE: CATEGORY HEATMAP
2012-2016 (as of 8/30/2016)
No. of deals
Min Max
CATEGORY 2012 2013 2014 2015 2016YTD
Insights & Risk Analytics
Lifestyle Management & Monitoring
Imaging & Diagnostics
Drug Discovery
Emergengy Room & Hospital Management
Wearables
Virtual Assistants
Mental Health
Research
Nutrition
Miscellaneous
www.cbinsights.com	
Investments in AI/ML for
imaging
34
morozov@npcmr.ru
Enlitiс.com
develops AI/ML
• X-ray/CT/MR
• CXR AUC 0.92
• Radiologist’s
AUC 0.5-0.72
Automatic lung nodes detection,
measurement, classification, and
reporting
www.medradiology.moscow
Adverse events
• PACS è less communications between
radiology and clinical departments
• Mobile images è commoditization
• Shared workflow è confidentiality breaches
• Turf battles between radiologists and
cardiologists, orthopedic surgeons,
neurologists
• CAD/AI/ML è decrease of radiologist’s role
• «Digital jungle aboriginals» è new principles
of teaching and work
www.medradiology.moscow
Self-driving	MRI?
Self-driving	Radiology	
department?
www.medradiology.moscow
AI/ML business
model – yet to
be defined
www.medradiology.moscow
Infrastructure
readiness is
required
www.medradiology.moscow
Healthcare	preparedness	for	change?
www.medradiology.moscow
Special	challenges	in	working	with	
physicians	
• High	need	for	autonomy	
• Sensitivity	to	criticism	
• Perfectionistic	&	compulsive	
• Want	to	direct;	resist	control	
• Arrogance	often	indicates	low	self	esteem	
From	Barbara	Linney &	Kent	Neff	MD,	ACPE;	also	Valliant,	Gabbard,	Dawson
www.medradiology.moscow41
www.medradiology.moscow
How to motivate?
Change management:
– Team involvement
– Motivation
– Emotions
– Habit
– Persistence
www.medradiology.moscow
Perspectives for 2017-2019
• Further healthcare standardization
• Competitive advantages
– Service, results availability, quality, expert’s
availability
• Expert as a service
– Telereporting – B2B
• AI/ML-based services for mass imaging
analysis (lung Ca screening, mammoDx)
– Automation of routine tasks of doctors: overall
potential of 36%
www.medradiology.moscow
www.ndkt.ru
www.pet-omc.ru
www.медрадиология.москва
www.medradiology.moscow
Automaton	Video

More Related Content

PPTX
Artificial intelligence-in-radiology
PPTX
An Introduction to Artificial Intelligence for the Everyday Radiologist
PPTX
A.I. in Radiology: Hype or Hope?
PDF
Artificial Intelligence in Medicine
PPTX
Artificial intelligence in radiology
PDF
5 Reasons Why Radiology Needs Artificial Intelligence
PPTX
The Patient Journey with AI
PPT
Artificial Intelligence and Diagnostics
Artificial intelligence-in-radiology
An Introduction to Artificial Intelligence for the Everyday Radiologist
A.I. in Radiology: Hype or Hope?
Artificial Intelligence in Medicine
Artificial intelligence in radiology
5 Reasons Why Radiology Needs Artificial Intelligence
The Patient Journey with AI
Artificial Intelligence and Diagnostics

What's hot (20)

PPTX
The rise of AI in medical imaging
PPTX
Frankie Rybicki slide set for Deep Learning in Radiology / Medicine
PPT
Role of artificial intellegence (a.i) in radiology department nitish virmani
PDF
Artificial Intelligence in Medical Imaging
PPTX
Information Technology and Radiology: challenges and future perspectives
PPTX
Big Data Provides Opportunities, Challenges and a Better Future in Health and...
PPTX
Accure ai healthcare offering v4
PDF
CT & AI Making An Impact
PDF
(2017/06)Practical points of deep learning for medical imaging
PPTX
The Life-Changing Impact of AI in Healthcare
PPTX
Deep-learning-or-health-informatics-recent-trends-and-future-directions By Ra...
PPTX
"Challenges for AI in Healthcare" - Peter Graven Ph.D
PDF
Case Study: Advanced analytics in healthcare using unstructured data
PPTX
Wat betekent A.I. voor de radiologie?
PDF
Machine Learning and Prediction in Medicine
PDF
인공지능은 의료를 어떻게 혁신할 것인가 (ver 2)
PDF
Biomedical Signal Origin and Dynamics
PPTX
AI in Health Care: How to Implement Medical Imaging using Machine Learning?
PPTX
Dark Side and Bright Side of AI in Medicine
PPT
Computer Aided Diagnosis in Pathology: Pros & Cons by Dr. Liron Pantanowitz
The rise of AI in medical imaging
Frankie Rybicki slide set for Deep Learning in Radiology / Medicine
Role of artificial intellegence (a.i) in radiology department nitish virmani
Artificial Intelligence in Medical Imaging
Information Technology and Radiology: challenges and future perspectives
Big Data Provides Opportunities, Challenges and a Better Future in Health and...
Accure ai healthcare offering v4
CT & AI Making An Impact
(2017/06)Practical points of deep learning for medical imaging
The Life-Changing Impact of AI in Healthcare
Deep-learning-or-health-informatics-recent-trends-and-future-directions By Ra...
"Challenges for AI in Healthcare" - Peter Graven Ph.D
Case Study: Advanced analytics in healthcare using unstructured data
Wat betekent A.I. voor de radiologie?
Machine Learning and Prediction in Medicine
인공지능은 의료를 어떻게 혁신할 것인가 (ver 2)
Biomedical Signal Origin and Dynamics
AI in Health Care: How to Implement Medical Imaging using Machine Learning?
Dark Side and Bright Side of AI in Medicine
Computer Aided Diagnosis in Pathology: Pros & Cons by Dr. Liron Pantanowitz
Ad

Similar to Big data and AI in a radiologist's reading room (20)

PPTX
case study on how MGH is using Ai (1).pptx
PDF
ExaMode: Building Multi-modal Knowledge Graph for Better Diagnostics
PDF
AI in Healthcare
PPTX
Lecture 2_Artificial Intelligence.pptx my
PDF
Personalized health knowledge graph ckg workshop - iswc 2018 (2)
PDF
RIS Automates Specialty Workflows Across the Enterprise with Mach7 EIP
PDF
[DSC Adria 23]Franko Hrzic Challenges in Medical Image Diagnostics.pdf
PPTX
AI in Healthcare
PPTX
Artificial intelligence in medical imaging and radio diagnostic
PDF
Current Trends of Wearable Technology Devices in Clinical Diagnostics
PPTX
ICACR 2023 final (1).pptx
PDF
2024-10-21 HUPO 2024, Alain van Gool.pdf
PPTX
[DSC Europe 24] Stevan Vrbaski - DSC 2024 Belgrade Vinaver Medical.pptx
PDF
Generative AI in Healthcare: Benefits, Use Cases & Challenges
DOCX
RDIF invests in innovative cancer diagnostics developer Oncobox
PPTX
AI.pptx
PPTX
NCI HTAN, cancer trajectories, precision oncology
PDF
DH-The_Changing_Role_of_the_Radiologist_in_the_Age_of_AI_1800000006639286 (1)...
PPTX
Artificial-Intelligence-in-Healthcare-Part-1 3.pptx
PPTX
Yoga_anddatascience
case study on how MGH is using Ai (1).pptx
ExaMode: Building Multi-modal Knowledge Graph for Better Diagnostics
AI in Healthcare
Lecture 2_Artificial Intelligence.pptx my
Personalized health knowledge graph ckg workshop - iswc 2018 (2)
RIS Automates Specialty Workflows Across the Enterprise with Mach7 EIP
[DSC Adria 23]Franko Hrzic Challenges in Medical Image Diagnostics.pdf
AI in Healthcare
Artificial intelligence in medical imaging and radio diagnostic
Current Trends of Wearable Technology Devices in Clinical Diagnostics
ICACR 2023 final (1).pptx
2024-10-21 HUPO 2024, Alain van Gool.pdf
[DSC Europe 24] Stevan Vrbaski - DSC 2024 Belgrade Vinaver Medical.pptx
Generative AI in Healthcare: Benefits, Use Cases & Challenges
RDIF invests in innovative cancer diagnostics developer Oncobox
AI.pptx
NCI HTAN, cancer trajectories, precision oncology
DH-The_Changing_Role_of_the_Radiologist_in_the_Age_of_AI_1800000006639286 (1)...
Artificial-Intelligence-in-Healthcare-Part-1 3.pptx
Yoga_anddatascience
Ad

More from Sergey Morozov, MD, PhD, MPH (10)

PDF
Основные принципы обеспечения работоспособности диагностического оборудования
PDF
Биостатистика для врачей
PDF
Как выступать с докладом на European Congress of Radiology?
PDF
Moscow Radiology 2015-2016
PDF
Скрининг методами лучевой диагностики
PDF
How to identify radiology productivity bottlenecks?
PDF
PDF
Knee MRI pitfalls
PDF
Philips presentation
Основные принципы обеспечения работоспособности диагностического оборудования
Биостатистика для врачей
Как выступать с докладом на European Congress of Radiology?
Moscow Radiology 2015-2016
Скрининг методами лучевой диагностики
How to identify radiology productivity bottlenecks?
Knee MRI pitfalls
Philips presentation

Recently uploaded (20)

PDF
ENT MedMap you can study for the exam with this.pdf
PPTX
Obstetric management in women with epilepsy.pptx
PPTX
Understanding The Self : 1Sexual health
DOCX
PT10 continues to explose your mind right after reading
PPTX
Arthritis Types, Signs & Treatment with physiotherapy management
PDF
Culturally Sensitive Health Solutions: Engineering Localized Practices (www....
PPTX
Nancy Caroline Emergency Paramedic Chapter 16
PPTX
Acute renal failure.pptx for BNs 2nd year
PDF
Medical_Biology_and_Genetics_Current_Studies_I.pdf
PPTX
Nancy Caroline Emergency Paramedic Chapter 18
PPTX
POSTURE.pptx......,............. .........
DOCX
ch 9 botes for OB aka Pregnant women eww
PPTX
Public Health. Disasater mgt group 1.pptx
PDF
health promotion and maintenance of elderly
PPTX
OSTEOMYELITIS and OSTEORADIONECROSIS.pptx
PDF
Fundamentals Final Review Questions.docx.pdf
PDF
cerebral aneurysm.. neurosurgery , anaesthesia
PPTX
Nancy Caroline Emergency Paramedic Chapter 15
PPT
Pyramid Points Lab Values Power Point(11).ppt
PDF
Essentials of Hysteroscopy at World Laparoscopy Hospital
ENT MedMap you can study for the exam with this.pdf
Obstetric management in women with epilepsy.pptx
Understanding The Self : 1Sexual health
PT10 continues to explose your mind right after reading
Arthritis Types, Signs & Treatment with physiotherapy management
Culturally Sensitive Health Solutions: Engineering Localized Practices (www....
Nancy Caroline Emergency Paramedic Chapter 16
Acute renal failure.pptx for BNs 2nd year
Medical_Biology_and_Genetics_Current_Studies_I.pdf
Nancy Caroline Emergency Paramedic Chapter 18
POSTURE.pptx......,............. .........
ch 9 botes for OB aka Pregnant women eww
Public Health. Disasater mgt group 1.pptx
health promotion and maintenance of elderly
OSTEOMYELITIS and OSTEORADIONECROSIS.pptx
Fundamentals Final Review Questions.docx.pdf
cerebral aneurysm.. neurosurgery , anaesthesia
Nancy Caroline Emergency Paramedic Chapter 15
Pyramid Points Lab Values Power Point(11).ppt
Essentials of Hysteroscopy at World Laparoscopy Hospital

Big data and AI in a radiologist's reading room