SlideShare a Scribd company logo
🤖 Fun Machine Learning 🤖
🍎 Now on iOS 🍎
🎉 Yay 🎉
Machine Learning on iOS
with Core ML
@josephhosford
Developer w/ Music Loft Apps
musicloftapps.com
josephhosford.com
I make music apps
And dabble in image classification
in ML.
🤖 Machine Learning 🤖
🍎 ML on iOS 🍎
Two Parts
What is machine learning?
🤖
Great overview video
https://www.youtube.com/watch?v=NOjUaY0Qn3g
🤖
“Machine Learning is about making decision based
on trial and error …a more application oriented
version of statistics.
The basic idea is to make decisions based on
certain amount of information you have.“
-Anonymous via Quora
🤖
Let us break down some ML terms:
“ML got levels to it”
Kendrick LaML
Model
Neural Networks
Supervised & Unsupervised Learning
Common Tools & Libraries
🤖
Model
🤖
Neural Networks
If you want to learn more about the math behind NNs:
read ACC Coolen’s paper (link in the resources)
Modeled loosely on the human brain,a neural
net consists of thousands or even millions of
simple processing nodes that are densely
interconnected.
- MIT
For a more detailed and basic overview:
“A Quick Introduction to Neural Networks” (link in the resources)
🤖
Supervised & Unsupervised Learning
Supervised algorithms can apply what has been
learned in the past to new data.
Unsupervised algorithms can draw inferences
from datasets.
🤖
Common ML Tools & Libraries
🤖
Let us walkthrough building a basic
image classification ML model with Tensorflow
HT: Google Codelabs “Tensorflow for Poets”
and
Siraj Raval on YouTube
🤖
Conclusion:
Machine Learning is totes powerful…
a bit complicated…
and often requires training and patience.
🤖
Note: Machine Learning isn’t perfect.
Machine Learning on iOS
with Core ML
🍎
What is Core ML?
🍎
A Framework that allows us to use
ML Models in iOS 11 (an inference engine)
Built on low-level tech (e.g.Metal & Accelerate)
Utilizes ML Models with a new .MLModel file
Ability to convert models from popular ML libraries
Supported Libraries by CoreML
🍎
The ML Stack on iOS
🍎🍎
Models with .MLModel
🍎🍎
Models with .MLModel
🍎🍎
🍎🍎
Core ML
The Good
🍎🍎
Very little iOS code
Easy to implement
Potential for powerful mobile experiences
ML Tools and .MLModel Filetype are open source
🍎🍎
Requires lot of ML training
Only supports supervised learning
Not a lot of easy / beginner resources to
help in creating Core ML models
Almost all ML libraries are in Python
making it harder to just start experimenting
Core ML
The Bad
🍎🍎
No on device training of the model
.MLModel file is unencrypted
Potential for huge file sizes
No direct Tensorflow support (yet)
Core ML
The Ugly
For more detailed criticism see:
“Why Core ML will not work for your app (most likely)” (link in the resources)
🍎🍎
Core ML Models aren’t the only way
to do ML on iOS
You can roll your own ML with
Metal Performance Shaders and Accelerate.
There are open sources libraries that implement
ML on iOS.
Check out Alex Sosnovshchenko’s
frequently updated list:
“Machine Learning for iOS”
(link in resources)
Thanks for your time!
@josephhosford
RESOURCES
IOS ML
Machine Learning for iOS
(Curated ML list of resources for iOS developers)
http://alexsosn.github.io/ml/2015/11/05/iOS-ML.html
CORE ML
Core ML Product Page
https://developer.apple.com/machine-learning/
Core ML Python Tools
https://pypi.python.org/pypi/coremltools
Why Core ML will not work for your app (most likely)
http://alexsosn.github.io//ml/2017/06/09/Core-ML-will-not-Work-for-Your-
App.html
NEURAL NETWORKS
A Quick Introduction to Neural Networks
https://ujjwalkarn.me/2016/08/09/quick-intro-neural-networks/
A Beginner's Guide to the Mathematics of Neural Networks by ACC Coolen
http://citeseerx.ist.psu.edu/viewdoc/download?
doi=10.1.1.161.3556&rep=rep1&type=pdf
Explained: Neural networks [MIT]
http://news.mit.edu/2017/explained-neural-networks-deep-learning-0414
ML TUTORIALS
Tensorflow for Poets
https://codelabs.developers.google.com/codelabs/tensorflow-for-poets/
Building powerful image classification models using very little data
https://blog.keras.io/building-powerful-image-classification-models-using-
very-little-data.html
Learning AI if You Suck at Math
https://hackernoon.com/learning-ai-if-you-suck-at-math-8bdfb4b79037

More Related Content

PDF
CoreML
PDF
Software Testing Principles
 
PPTX
Generic Software Process Models
PPT
Ch2 theory
PPTX
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
PPTX
Test Case Design
PDF
ISTQB CTAL - Test Analyst
PPTX
Risk-based Testing
CoreML
Software Testing Principles
 
Generic Software Process Models
Ch2 theory
Software Testing - Part 1 (Techniques, Types, Levels, Methods, STLC, Bug Life...
Test Case Design
ISTQB CTAL - Test Analyst
Risk-based Testing

What's hot (20)

PPTX
Testing ppt
PPTX
Software testing and process
PPT
Unit 8-risk manaegement (1) -
PPTX
Framework For Automation Testing Practice Sharing
PPT
Chapter 13
PDF
Introduction to Robot Framework (external)
 
PDF
Requirements Management for Safety-Critical Products
PPTX
Test design techniques
PPTX
Architectural structures and views
PPTX
Software Engineering- Types of Testing
PPTX
Software quality assurance
PPSX
Principles of Software testing
PPTX
Introduction to Software Quality & its' Challenges
PPTX
Software Risk Management
PPTX
Software testing principles
PPT
requirements analysis and design
PDF
PPTX
Unit Testing Using N Unit
PPTX
NUnit Features Presentation
PPTX
Software quality assurance
Testing ppt
Software testing and process
Unit 8-risk manaegement (1) -
Framework For Automation Testing Practice Sharing
Chapter 13
Introduction to Robot Framework (external)
 
Requirements Management for Safety-Critical Products
Test design techniques
Architectural structures and views
Software Engineering- Types of Testing
Software quality assurance
Principles of Software testing
Introduction to Software Quality & its' Challenges
Software Risk Management
Software testing principles
requirements analysis and design
Unit Testing Using N Unit
NUnit Features Presentation
Software quality assurance
Ad

Similar to Machine Learning on iOS with Core ML (20)

PDF
The State of ML for iOS: On the Advent of WWDC 2018 🕯
PDF
Add Machine Learning to your iOS 11 App Using Core ML
PPTX
Core ML
PPTX
Machine Learning in iOS_ Core ML and its Applications.pptx
PDF
Practical MLOps: Operationalizing Machine Learning Models 1st Edition Noah Gift
PPTX
Machine Learning for SEOs - MozCon 2018
PPTX
Build with AI - 2025- AI is Future .pptx
PDF
Practical MLOps: Operationalizing Machine Learning Models 1st Edition Noah Gift
PDF
Introduction To TensorFlow
PPT
Collaborative Ontology Building Project
PPTX
Intro to deep learning
PPTX
Lecture 2 Prompt Engineering Nile University.pptx
PDF
Using CoreML to Push the Limits of your App
PDF
Shortcut in learning iOS
PDF
Semantic web, python, construction industry
PPTX
Journey of Generative AI
PDF
Quick Start Guide To Large Language Models Second Edition Sinan Ozdemir
PPTX
Demystifying Ml, DL and AI
PDF
Beware the monolith
PPTX
THE MECHANICS AND APPLICATIONS OF LARGE LANGUAGE MODELS.pptx
The State of ML for iOS: On the Advent of WWDC 2018 🕯
Add Machine Learning to your iOS 11 App Using Core ML
Core ML
Machine Learning in iOS_ Core ML and its Applications.pptx
Practical MLOps: Operationalizing Machine Learning Models 1st Edition Noah Gift
Machine Learning for SEOs - MozCon 2018
Build with AI - 2025- AI is Future .pptx
Practical MLOps: Operationalizing Machine Learning Models 1st Edition Noah Gift
Introduction To TensorFlow
Collaborative Ontology Building Project
Intro to deep learning
Lecture 2 Prompt Engineering Nile University.pptx
Using CoreML to Push the Limits of your App
Shortcut in learning iOS
Semantic web, python, construction industry
Journey of Generative AI
Quick Start Guide To Large Language Models Second Edition Sinan Ozdemir
Demystifying Ml, DL and AI
Beware the monolith
THE MECHANICS AND APPLICATIONS OF LARGE LANGUAGE MODELS.pptx
Ad

Recently uploaded (20)

PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
PPTX
Machine Learning_overview_presentation.pptx
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Cloud computing and distributed systems.
PPTX
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Encapsulation theory and applications.pdf
PDF
Machine learning based COVID-19 study performance prediction
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
NewMind AI Weekly Chronicles - August'25-Week II
Dropbox Q2 2025 Financial Results & Investor Presentation
MYSQL Presentation for SQL database connectivity
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Reach Out and Touch Someone: Haptics and Empathic Computing
Machine Learning_overview_presentation.pptx
Programs and apps: productivity, graphics, security and other tools
Network Security Unit 5.pdf for BCA BBA.
Big Data Technologies - Introduction.pptx
Cloud computing and distributed systems.
ACSFv1EN-58255 AWS Academy Cloud Security Foundations.pptx
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Mobile App Security Testing_ A Comprehensive Guide.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Encapsulation theory and applications.pdf
Machine learning based COVID-19 study performance prediction
gpt5_lecture_notes_comprehensive_20250812015547.pdf

Machine Learning on iOS with Core ML

  • 1. 🤖 Fun Machine Learning 🤖 🍎 Now on iOS 🍎 🎉 Yay 🎉
  • 2. Machine Learning on iOS with Core ML @josephhosford Developer w/ Music Loft Apps musicloftapps.com josephhosford.com
  • 3. I make music apps And dabble in image classification in ML.
  • 4. 🤖 Machine Learning 🤖 🍎 ML on iOS 🍎 Two Parts
  • 5. What is machine learning? 🤖 Great overview video https://www.youtube.com/watch?v=NOjUaY0Qn3g
  • 6. 🤖 “Machine Learning is about making decision based on trial and error …a more application oriented version of statistics. The basic idea is to make decisions based on certain amount of information you have.“ -Anonymous via Quora
  • 7. 🤖 Let us break down some ML terms: “ML got levels to it” Kendrick LaML Model Neural Networks Supervised & Unsupervised Learning Common Tools & Libraries
  • 9. 🤖 Neural Networks If you want to learn more about the math behind NNs: read ACC Coolen’s paper (link in the resources) Modeled loosely on the human brain,a neural net consists of thousands or even millions of simple processing nodes that are densely interconnected. - MIT For a more detailed and basic overview: “A Quick Introduction to Neural Networks” (link in the resources)
  • 10. 🤖 Supervised & Unsupervised Learning Supervised algorithms can apply what has been learned in the past to new data. Unsupervised algorithms can draw inferences from datasets.
  • 12. 🤖 Let us walkthrough building a basic image classification ML model with Tensorflow HT: Google Codelabs “Tensorflow for Poets” and Siraj Raval on YouTube
  • 13. 🤖 Conclusion: Machine Learning is totes powerful… a bit complicated… and often requires training and patience.
  • 14. 🤖 Note: Machine Learning isn’t perfect.
  • 15. Machine Learning on iOS with Core ML 🍎
  • 16. What is Core ML? 🍎 A Framework that allows us to use ML Models in iOS 11 (an inference engine) Built on low-level tech (e.g.Metal & Accelerate) Utilizes ML Models with a new .MLModel file Ability to convert models from popular ML libraries
  • 17. Supported Libraries by CoreML 🍎
  • 18. The ML Stack on iOS 🍎🍎
  • 22. Core ML The Good 🍎🍎 Very little iOS code Easy to implement Potential for powerful mobile experiences ML Tools and .MLModel Filetype are open source
  • 23. 🍎🍎 Requires lot of ML training Only supports supervised learning Not a lot of easy / beginner resources to help in creating Core ML models Almost all ML libraries are in Python making it harder to just start experimenting Core ML The Bad
  • 24. 🍎🍎 No on device training of the model .MLModel file is unencrypted Potential for huge file sizes No direct Tensorflow support (yet) Core ML The Ugly For more detailed criticism see: “Why Core ML will not work for your app (most likely)” (link in the resources)
  • 25. 🍎🍎 Core ML Models aren’t the only way to do ML on iOS You can roll your own ML with Metal Performance Shaders and Accelerate. There are open sources libraries that implement ML on iOS. Check out Alex Sosnovshchenko’s frequently updated list: “Machine Learning for iOS” (link in resources)
  • 26. Thanks for your time! @josephhosford
  • 28. IOS ML Machine Learning for iOS (Curated ML list of resources for iOS developers) http://alexsosn.github.io/ml/2015/11/05/iOS-ML.html CORE ML Core ML Product Page https://developer.apple.com/machine-learning/ Core ML Python Tools https://pypi.python.org/pypi/coremltools Why Core ML will not work for your app (most likely) http://alexsosn.github.io//ml/2017/06/09/Core-ML-will-not-Work-for-Your- App.html
  • 29. NEURAL NETWORKS A Quick Introduction to Neural Networks https://ujjwalkarn.me/2016/08/09/quick-intro-neural-networks/ A Beginner's Guide to the Mathematics of Neural Networks by ACC Coolen http://citeseerx.ist.psu.edu/viewdoc/download? doi=10.1.1.161.3556&rep=rep1&type=pdf Explained: Neural networks [MIT] http://news.mit.edu/2017/explained-neural-networks-deep-learning-0414 ML TUTORIALS Tensorflow for Poets https://codelabs.developers.google.com/codelabs/tensorflow-for-poets/ Building powerful image classification models using very little data https://blog.keras.io/building-powerful-image-classification-models-using- very-little-data.html Learning AI if You Suck at Math https://hackernoon.com/learning-ai-if-you-suck-at-math-8bdfb4b79037

Editor's Notes

  • #13: curl -O https://raw.githubusercontent.com/tensorflow/tensorflow/r1.1/tensorflow/examples/image_retraining/retrain.py tensorboard --logdir training_summaries & python retrain.py \ --bottleneck_dir=bottlenecks \ --how_many_training_steps=500 \ --model_dir=inception \ --summaries_dir=training_summaries/basic \ --output_graph=retrained_graph.pb \ --output_labels=retrained_labels.txt \ —image_dir=star_wars