SlideShare a Scribd company logo
www.cir-strategy.com/events 	
Alex	Kendall	
WAYVE
Building intelligent robots
Building intelligent robots
Building intelligent robots
Part	I:		Computer	Vision
1.  Infant	Vision:	Birth	to	24	Months	of	Age.	
https://www.aoa.org/patients-and-public/good-vision-throughout-life/childrens-vision/infant-vision-birth-to-24-months-of-age?
Building intelligent robots
Deep	Learning	for	Computer	Vision	
•  Powerful	framework	for	understanding	high	dimensional	data	like	
images,	videos,	speech,	text	
•  With	enough	training	data,	they	outperform	human	baselines	for	
recognition	tasks	
•  Typically	computer	vision	models	contain	~10	million	parameters,	
take	3+	days	to	train	on	a	GPU
Alex	Kendall,	Yarin	Gal	and	Roberto	Cipolla.	Multi-Task	Learning	Using	Uncertainty	to	Weigh	Losses	for	Scene	Geometry	and	
Semantics.	In	Submission,	2017.
Alex	Kendall	and	Roberto	Cipolla.	VideoSegNet:	Self-Supervised	Motion	and	Depth	for	Video	Semantic	Segmentation.		
In	Submission,	2017.
Building intelligent robots
Part	II:		Ethics	&	Safety
1.  The	Trolley	Problem,	Wikipedia.	https://en.wikipedia.org/wiki/Trolley_problem	
2.  Rowan	McAllister,	Yarin	Gal,	Alex	Kendall,	Mark	van	der	Wilk,	Amar	Shah,	Roberto	Cipolla,	and	Adrian	Weller.	Concrete	Problems	for	Autonomous	
Vehicle	Safety:	Advantages	of	Bayesian	Deep	Learning.	IJCAI,	2017.	
The	Trolley	Problem	 Do you…
1.  Do nothing, and the
trolley kills the five
people on the main
track.
2.  Pull the lever, diverting
the trolley onto the side
track where it will kill
one person.
Which is the most ethical
choice?
Examples	of	Un-Ethical	AI,	Today	
•  US	Justice	System	Re-Offending	Rate	algorithm..	Biased	against	
minorities	
https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing	
•  Google’s	speech	recognition	system	is	better	at	male	voices	
https://makingnoiseandhearingthings.com/2016/07/12/googles-speech-recognition-has-a-gender-bias/	
•  Many	self-driving	cars	only	work	in	California	
https://www.ft.com/content/4377b4c0-0479-11e7-aa5b-6bb07f5c8e12
Concrete	Problems	for	AI	Safety	
•  Trust	
•  Improve	model	performance	and	accuracy	
•  Models	understanding	uncertainty	in	decisions	
•  Fairness	
•  Improve	data	efficiency	and	reduce	bias	
•  Algorithms	which	require	less	training	data	and	generalise	better	
•  Honesty	
•  Interpretability	of	results	and	model	saliency	
•  Causal	reasoning		
•  Avoid	reward	hacking	
1.  Rowan	McAllister,	Yarin	Gal,	Alex	Kendall,	Mark	van	der	Wilk,	Amar	Shah,	Roberto	Cipolla,	and	Adrian	Weller.	Concrete	Problems	for	Autonomous	
Vehicle	Safety:	Advantages	of	Bayesian	Deep	Learning.	IJCAI,	2017.
1.  Alex	Kendall	and	Yarin	Gal.	What	Uncertainties	Do	We	Need	in	Bayesian	Deep	Learning	for	Computer	Vision?	Advances	in	Neural	Information	
Processing	Systems	(NIPS),	2017.	
Input	Video	 Semantic	Segmentation	 Uncertainty
Conclusions	
•  We	need	machine	learning	to	scale	to	hard	problems	with	intelligent	
robots	–	hand	engineering	isn’t	good	enough	
•  We	can	learning	to	perceive	and	act	from	data	with	deep	learning	
•  We	cannot	explicitly	reason	about	ethical	situations	on	a	case-by-case	
basis	–	our	models	need	to	understand	ethics	themselves	
•  Computer	vision	is	holding	back	robotics	from	real-world	applications
alexgkendall.com/publica8ons/

@alexgkendall

agk34@cam.ac.uk

Thank you to the amazing people who made this work possible:
Roberto Cipolla, Vijay Badrinarayanan, Yarin Gal, Tom Roddick, MaMhew Grimes,
Adrian Weller, Amar Shah, Hayk Mar8rosyan, Saumitro Dasgupta, Peter Henry,
Ryan Kennedy, Abe Bachrach, Adam Bry

More Related Content

PPTX
10 esminių informatikos idėjų. Valentina DAGIENĖ
PDF
IRJET- Privacy Issues in Content based Image Retrieval (CBIR) for Mobile ...
PPTX
Lifelogging, egocentric vision and health: how a small wearable camera can he...
PDF
Visualisatie voor transparante beslissingen - Big Data Expo 2019
PDF
Object Classification and recognition using deep learning methods
PDF
Thesis Studio I - Midterm
PPT
Practical Problem Solving Using Mobile Technology
PPTX
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...
10 esminių informatikos idėjų. Valentina DAGIENĖ
IRJET- Privacy Issues in Content based Image Retrieval (CBIR) for Mobile ...
Lifelogging, egocentric vision and health: how a small wearable camera can he...
Visualisatie voor transparante beslissingen - Big Data Expo 2019
Object Classification and recognition using deep learning methods
Thesis Studio I - Midterm
Practical Problem Solving Using Mobile Technology
Deep Learning for Data Scientists - Data Science ATL Meetup Presentation, 201...

Similar to Building intelligent robots (20)

PDF
Validating AI for Healthcare
PDF
PDF
PPTX
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
PDF
Age and Gender Prediction and Human count
PDF
Infrastructure for digital pathology in a tissue bank
PPTX
face mask detection ppt66 (1)M M.pptx
PPTX
Week1- Introduction.pptx
PDF
Raai 2019 clinical unmet needs and its solutions of deep learning in medicine3
PDF
project report on A Learning Framework for Morphological Operators using Coun...
PPTX
Group 7 (midterm)
PDF
Group7midterm 200404081547
PDF
Cloud Accelerated Genomics
PDF
20170315 Cloud Accelerated Genomics - Tel Aviv / Phoenix
PDF
Exploring Advanced Deep Learning Projects.pdf
PPTX
CARE-KNOW-DO AI climate action SDG13 Climate Action
PPTX
Huawei STW 2018 public
PPTX
Ahishek Intership PPT.pptx
PPTX
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
PDF
control room design.pdf
Validating AI for Healthcare
Classrooms of the Future: How to Add Mixed Reality and Robotics to a Schools ...
Age and Gender Prediction and Human count
Infrastructure for digital pathology in a tissue bank
face mask detection ppt66 (1)M M.pptx
Week1- Introduction.pptx
Raai 2019 clinical unmet needs and its solutions of deep learning in medicine3
project report on A Learning Framework for Morphological Operators using Coun...
Group 7 (midterm)
Group7midterm 200404081547
Cloud Accelerated Genomics
20170315 Cloud Accelerated Genomics - Tel Aviv / Phoenix
Exploring Advanced Deep Learning Projects.pdf
CARE-KNOW-DO AI climate action SDG13 Climate Action
Huawei STW 2018 public
Ahishek Intership PPT.pptx
698642933-DdocfordownloadEEP-FAKE-PPT.pptx
control room design.pdf
Ad

More from Justin Hayward (20)

PDF
Grid-scale energy storage
PDF
Life Sciences Investment Platform
PDF
Polymer Applications
PDF
Flexible Organic LCD
PDF
Grand challenges for engineering
PDF
Inkjet in advanced manufacturing
PDF
Materials, energy, storage and heat transfer
PDF
Graphene@Manchester
PDF
Scaling Stories
PDF
Flying better
PDF
Ready for take off
PDF
Materials and processes
PDF
Connectivity and IoT Ecosystems
PDF
Top 5 breakthroughs in energy storage materials
PDF
Graphene heating for wearable devices
PDF
Industry digitalisation
PDF
Energy storage materials
PDF
AI and automation
PDF
Breakthroughs in new materials
PDF
15th Anniversary HVM Conference
Grid-scale energy storage
Life Sciences Investment Platform
Polymer Applications
Flexible Organic LCD
Grand challenges for engineering
Inkjet in advanced manufacturing
Materials, energy, storage and heat transfer
Graphene@Manchester
Scaling Stories
Flying better
Ready for take off
Materials and processes
Connectivity and IoT Ecosystems
Top 5 breakthroughs in energy storage materials
Graphene heating for wearable devices
Industry digitalisation
Energy storage materials
AI and automation
Breakthroughs in new materials
15th Anniversary HVM Conference
Ad

Recently uploaded (20)

PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
1_Introduction to advance data techniques.pptx
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PDF
Foundation of Data Science unit number two notes
PPTX
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
PPTX
Major-Components-ofNKJNNKNKNKNKronment.pptx
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PDF
Launch Your Data Science Career in Kochi – 2025
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPTX
Database Infoormation System (DBIS).pptx
PPTX
Global journeys: estimating international migration
PPT
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
PPT
Reliability_Chapter_ presentation 1221.5784
PPTX
STUDY DESIGN details- Lt Col Maksud (21).pptx
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PDF
Introduction to Business Data Analytics.
PDF
Clinical guidelines as a resource for EBP(1).pdf
PPT
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
1_Introduction to advance data techniques.pptx
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
Foundation of Data Science unit number two notes
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
Major-Components-ofNKJNNKNKNKNKronment.pptx
Acceptance and paychological effects of mandatory extra coach I classes.pptx
Launch Your Data Science Career in Kochi – 2025
Introduction-to-Cloud-ComputingFinal.pptx
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
Database Infoormation System (DBIS).pptx
Global journeys: estimating international migration
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
Reliability_Chapter_ presentation 1221.5784
STUDY DESIGN details- Lt Col Maksud (21).pptx
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
Introduction to Business Data Analytics.
Clinical guidelines as a resource for EBP(1).pdf
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn

Building intelligent robots