SlideShare a Scribd company logo
Cloud Native Night Feb/21
A coding demo
"Machine Learning made easy”
Ian Schröder, Solution Specialist Middleware, jschroed@redhat.com
Keith Tenzer, Solutions Architect, ktenzer@redhat.com
21 February 2019
AGENDA
2
What is Machine Learning?
3 important Points
DEMO
3
ABOUT KEITH AND IAN
20 Linux/Storage Admin, Developer, Architect
1 http://keithtenzer.com
15 Joined Red Hat
47 Years experience working with people
1 Deinecholeben.blogspot.de
18 Joined Red Hat
4
WHAT IS MACHINE LEARNING?
Deep Learning
Machine Learning
Artificial Intelligence
Algorithms that parse data,
learn from the data and then
apply learning to make
informed decisions.
A broad field where machines
are cognitive, able to analyze
environment in order to make
decisions.
A subset of machine
learning, algorithms can
determine on their own if
prediction is accurate or
not, meaning they learn
without supervision.
5
● Machine learning is open for everyone
○ Machine Learning is not a proprietary offering from
the major cloud providers
● Machine learning needs access to Data and
Runtimes
Take control with Container
○ Agile microservice frameworks, Apps and runtimes
offers flexibility
○ Cloud-to-Cloud and On-Premise, mash your own
network
○ Connect data-lakes to find information in your data
● Machine learning can be easy
THREE IMPORTANT POINTS
6
MACHINE LEARNING EXAMPLES...
7
CONTAINER MAKE ML easy
Python
Compilers
Polyglot
Applications
Datasets
Models
CI/CD
GPUs
Lots of
memory
Lots of Data
ML
Frameworks
Lots of decoupled
moving parts
API´s
8
MACHINE LEARNING GETTING STARTED...
9
HOW MACHINE LEARNING WORKS
Choose Use Case Categorize Data Label Data
Setup layers
(neural network)
Accuracy, optimize
and training
metrics
Compile model
Train model with
training dataset
Evaluate accuracyImprove
Training Cycle
Application Data Ingestion
Analyze dataset
based on model
Predictions,
Findings and
Decisions
Run Cycle
DEMO
“Build a Siri/Echo/Alexa”
11
MACHINE LEARNING AREA 2 START
Anomaly Detection =
Predictive
12
● GitHub Repository -
https://github.com/ktenzer/openshift-ml-demo
● Blog -
https://keithtenzer.com/2018/12/14/getting-started-with-machi
ne-learning/
RESOURCES
Q&A
Keith Tenzer
Senior Solution Architect
Red Hat GmbH
ktenzer@redhat.com
+49 151 44051401
linkedin.com/company/red-hat
youtube.com/user/RedHatVideos
facebook.com/redhatinc
twitter.com/RedHat
Ian Schroeder
Solution Specialist Middleware
Red Hat GmbH
ian.schroeder@redhat.com
+49 172 8471401
BACKUP SLIDES
16
DEMO APPLICATION ROLLOUT
PodContainer
Fedora Base
C++ Dev tools
Python + devel
Python modules
Nodejs
BUILD DEPLOY RUN
Container
Fedora Base
C++ Dev tools
Python + devel
Python modules
Nodejs
/deepspeech
https://github.com/ktenzer/openshift-ml-demo
Download
model
Start Nodejs
8080
Start Script
Registry
OpenShift
17
OPENSHIFT: OUR FOUNDATION FOR AI / MLLEVERAGE OPTIMAL CLOUD-NATIVE APP DEV CAPABILITIES
AWS Microsoft Azure Google CloudOpenStackDatacenterLaptop
APPLICATION LIFECYCLE MANAGEMENT
ENTERPRISE CONTAINER HOST (RHEL)
CONTAINER ORCHESTRATION AND MANAGEMENT
(KUBERNETES)
Much more than just RHEL + Docker + K8S:
● Security + CI/CD pipelines + hybrid cloud
management + container-native storage +
networking
● Microservices infrastructure: Istio service mesh
for routing & traffic control, security,
availability, and identity services
● Certified plugin/interoperability with leading
storage, network vendors
● Available & optimized for private & public clouds
in self-managed or RHT managed offerings
● Fully integrated with RHT middleware platforms
& services
18
GPU SUPPORT IN OPENSHIFT
● Joint collaboration with strategic
partners for drivers, plugins and
container images
● Device Manager GA
● Scheduler: Priority and preemption
● Seamless install experience of drivers,
plugins and dependencies
● Container images in RHCC/ISV Registry
● Certifications and support
RHEL Host
Device Manager
plugin
Kublet Device
Manager
Kubernetes
SchedulerRHEL base image +
Vendor libraries for
GPUs +
Frameworks for
AI/ML such as
Tensorflow or
Pytorch
Device drivers
for GPU
19
Upstream Community Project with Google, RedHat, Microsoft, Intel, Caicloud and others
Democratizing AI with Machine Learning for Everyone
Challenges in ML that Kubeflow is addressing: Composability, Portability, Scalability
KUBEFLOW
20
End-to-End Kubeflow Workflow
Experiment
with
Jupyter
Deploy
Kubeflow on
OpenShift
Deploy
TensorFlow,
PyTorch, Caffe2,
Horovod to build
model
Katib for
Hyperparameter
Tuning
Kubeflow
Volume
Controller
Model Serving and
Inference with
TensofFlowServing or
SeldonCore
Data Scientists
S3 Object Store
Build
container
image of
model
Integrate model
with your
application
Operators
App
Developers
Consumers
Argo for workflow
design

More Related Content

PPTX
LinuxCon 2015: A recap in 8 images
PDF
DevOps, continuous delivery, & the new composable enterprise
PDF
Miguel Angel Diaz - Red Hat - OSL19
PPTX
Cloud Native: what is it? Why?
PDF
RHTE 2016 - Get your App Dev on in the Cloud
PDF
Gustavo Homem - Solid Angle - OSL19
PDF
The new stack isn’t a stack: Fragmentation and terraforming 
the service layer
PPTX
Building with containers: How containers will drive cloud services
LinuxCon 2015: A recap in 8 images
DevOps, continuous delivery, & the new composable enterprise
Miguel Angel Diaz - Red Hat - OSL19
Cloud Native: what is it? Why?
RHTE 2016 - Get your App Dev on in the Cloud
Gustavo Homem - Solid Angle - OSL19
The new stack isn’t a stack: Fragmentation and terraforming 
the service layer
Building with containers: How containers will drive cloud services

What's hot (20)

PDF
How microservices are redefining modern application architecture
PDF
Cloud interoperability and open standards for digital india open infrasummit
PDF
From an idea to an apache tlp
PPTX
Going Cloud Native - It Takes a Platform
PDF
Microservices 101: From DevOps to Docker and beyond
PPTX
10 predictions for cloud native in 2021
PDF
AGILE: Building the Open Gateway for IoT
PPTX
DevOps 101
PPTX
Reality Check: How much influence do developers really have?
PDF
IoTShow.in Bangalore 2019 - a Recap on 'IoT and Edge' Talk.
PDF
Opening Remarks
PDF
Event specifications, state of the serverless landscape, and other news from ...
PPTX
DevOps 101+: From collaboration to microservices
PPTX
Cloud Native: A dose of reality
PDF
Meetup talk Red Hat OpenShift service mesh
PDF
How OpenStack is paralleling Linux adoption (and how it isn't)
PPTX
OpenStack: The Linux of Cloud hosted by LPI
PDF
OpenPOWER Workshop at IIT Roorkee
PPTX
Cloud Native Demystified: Build Once, Run Anywhere!
How microservices are redefining modern application architecture
Cloud interoperability and open standards for digital india open infrasummit
From an idea to an apache tlp
Going Cloud Native - It Takes a Platform
Microservices 101: From DevOps to Docker and beyond
10 predictions for cloud native in 2021
AGILE: Building the Open Gateway for IoT
DevOps 101
Reality Check: How much influence do developers really have?
IoTShow.in Bangalore 2019 - a Recap on 'IoT and Edge' Talk.
Opening Remarks
Event specifications, state of the serverless landscape, and other news from ...
DevOps 101+: From collaboration to microservices
Cloud Native: A dose of reality
Meetup talk Red Hat OpenShift service mesh
How OpenStack is paralleling Linux adoption (and how it isn't)
OpenStack: The Linux of Cloud hosted by LPI
OpenPOWER Workshop at IIT Roorkee
Cloud Native Demystified: Build Once, Run Anywhere!
Ad

Similar to Machine Learning made easy (20)

PDF
DDDP 2019 - Brown to Green
PPTX
Bahrain ch9 introduction to docker 5th birthday
PPTX
Painless containerization in your very own private Cloud
PDF
Choreo: Empowering the Future of Enterprise Software Engineering
PDF
Transforming Application Delivery with PaaS and Linux Containers
PDF
Red Hat OpenShift Enterprise 2 Launch Webcast Slides Dec 3, 2013
PPTX
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
PDF
Why Pay for Open Source Linux? Avoid the Hidden Cost of DIY
PDF
ansible_rhel_90.pdf
PDF
Securing Red Hat OpenShift Containerized Applications At Enterprise Scale
PDF
IAU workshop 2018 day one
PDF
Hands on-intro to Node-RED
PDF
Leveraging IoT as part of your digital transformation
PDF
CHIPS Alliance_Object Automation Inc_workshop
PPTX
Crash Course in Open Source Cloud Computing
PDF
Despliegue Cloud-Native Simplificado: Infraestructura, Servicios y GenAI en m...
PDF
Red Hat Enterprise Linux 8 Workshop
PDF
Accelerating Enterprise Software Engineering with Platformless
PDF
Efficient platform engineering with Microk8s & gopaddle.pdf
PPTX
Developing multi-platform microservices using .NET core
DDDP 2019 - Brown to Green
Bahrain ch9 introduction to docker 5th birthday
Painless containerization in your very own private Cloud
Choreo: Empowering the Future of Enterprise Software Engineering
Transforming Application Delivery with PaaS and Linux Containers
Red Hat OpenShift Enterprise 2 Launch Webcast Slides Dec 3, 2013
Red Hat Forum Poland 2019 - Red Hat Open Hybrid Cloud (keynote)
Why Pay for Open Source Linux? Avoid the Hidden Cost of DIY
ansible_rhel_90.pdf
Securing Red Hat OpenShift Containerized Applications At Enterprise Scale
IAU workshop 2018 day one
Hands on-intro to Node-RED
Leveraging IoT as part of your digital transformation
CHIPS Alliance_Object Automation Inc_workshop
Crash Course in Open Source Cloud Computing
Despliegue Cloud-Native Simplificado: Infraestructura, Servicios y GenAI en m...
Red Hat Enterprise Linux 8 Workshop
Accelerating Enterprise Software Engineering with Platformless
Efficient platform engineering with Microk8s & gopaddle.pdf
Developing multi-platform microservices using .NET core
Ad

More from QAware GmbH (20)

PDF
QAware_Mario-Leander_Reimer_Architecting and Building a K8s-based AI Platform...
PDF
Frontends mit Hilfe von KI entwickeln.pdf
PDF
Mit ChatGPT Dinosaurier besiegen - Möglichkeiten und Grenzen von LLM für die ...
PDF
50 Shades of K8s Autoscaling #JavaLand24.pdf
PDF
Make Agile Great - PM-Erfahrungen aus zwei virtuellen internationalen SAFe-Pr...
PPTX
Fully-managed Cloud-native Databases: The path to indefinite scale @ CNN Mainz
PDF
Down the Ivory Tower towards Agile Architecture
PDF
"Mixed" Scrum-Teams – Die richtige Mischung macht's!
PDF
Make Developers Fly: Principles for Platform Engineering
PDF
Der Tod der Testpyramide? – Frontend-Testing mit Playwright
PDF
Was kommt nach den SPAs
PDF
Cloud Migration mit KI: der Turbo
PDF
Migration von stark regulierten Anwendungen in die Cloud: Dem Teufel die See...
PDF
Aus blau wird grün! Ansätze und Technologien für nachhaltige Kubernetes-Cluster
PDF
Endlich gute API Tests. Boldly Testing APIs Where No One Has Tested Before.
PDF
Kubernetes with Cilium in AWS - Experience Report!
PDF
50 Shades of K8s Autoscaling
PDF
Kontinuierliche Sicherheitstests für APIs mit Testkube und OWASP ZAP
PDF
Service Mesh Pain & Gain. Experiences from a client project.
PDF
50 Shades of K8s Autoscaling
QAware_Mario-Leander_Reimer_Architecting and Building a K8s-based AI Platform...
Frontends mit Hilfe von KI entwickeln.pdf
Mit ChatGPT Dinosaurier besiegen - Möglichkeiten und Grenzen von LLM für die ...
50 Shades of K8s Autoscaling #JavaLand24.pdf
Make Agile Great - PM-Erfahrungen aus zwei virtuellen internationalen SAFe-Pr...
Fully-managed Cloud-native Databases: The path to indefinite scale @ CNN Mainz
Down the Ivory Tower towards Agile Architecture
"Mixed" Scrum-Teams – Die richtige Mischung macht's!
Make Developers Fly: Principles for Platform Engineering
Der Tod der Testpyramide? – Frontend-Testing mit Playwright
Was kommt nach den SPAs
Cloud Migration mit KI: der Turbo
Migration von stark regulierten Anwendungen in die Cloud: Dem Teufel die See...
Aus blau wird grün! Ansätze und Technologien für nachhaltige Kubernetes-Cluster
Endlich gute API Tests. Boldly Testing APIs Where No One Has Tested Before.
Kubernetes with Cilium in AWS - Experience Report!
50 Shades of K8s Autoscaling
Kontinuierliche Sicherheitstests für APIs mit Testkube und OWASP ZAP
Service Mesh Pain & Gain. Experiences from a client project.
50 Shades of K8s Autoscaling

Recently uploaded (20)

PPTX
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
PPTX
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
PPT
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPTX
STUDY DESIGN details- Lt Col Maksud (21).pptx
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PDF
Launch Your Data Science Career in Kochi – 2025
PPTX
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
PPTX
IB Computer Science - Internal Assessment.pptx
PPT
Quality review (1)_presentation of this 21
PPTX
Supervised vs unsupervised machine learning algorithms
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PPTX
climate analysis of Dhaka ,Banglades.pptx
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PDF
Introduction to Business Data Analytics.
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
DISORDERS OF THE LIVER, GALLBLADDER AND PANCREASE (1).pptx
Chapter 3 METAL JOINING.pptnnnnnnnnnnnnn
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
Data_Analytics_and_PowerBI_Presentation.pptx
IBA_Chapter_11_Slides_Final_Accessible.pptx
STUDY DESIGN details- Lt Col Maksud (21).pptx
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
Launch Your Data Science Career in Kochi – 2025
05. PRACTICAL GUIDE TO MICROSOFT EXCEL.pptx
IB Computer Science - Internal Assessment.pptx
Quality review (1)_presentation of this 21
Supervised vs unsupervised machine learning algorithms
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
climate analysis of Dhaka ,Banglades.pptx
oil_refinery_comprehensive_20250804084928 (1).pptx
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
Introduction to Business Data Analytics.

Machine Learning made easy

  • 1. Cloud Native Night Feb/21 A coding demo "Machine Learning made easy” Ian Schröder, Solution Specialist Middleware, jschroed@redhat.com Keith Tenzer, Solutions Architect, ktenzer@redhat.com 21 February 2019
  • 2. AGENDA 2 What is Machine Learning? 3 important Points DEMO
  • 3. 3 ABOUT KEITH AND IAN 20 Linux/Storage Admin, Developer, Architect 1 http://keithtenzer.com 15 Joined Red Hat 47 Years experience working with people 1 Deinecholeben.blogspot.de 18 Joined Red Hat
  • 4. 4 WHAT IS MACHINE LEARNING? Deep Learning Machine Learning Artificial Intelligence Algorithms that parse data, learn from the data and then apply learning to make informed decisions. A broad field where machines are cognitive, able to analyze environment in order to make decisions. A subset of machine learning, algorithms can determine on their own if prediction is accurate or not, meaning they learn without supervision.
  • 5. 5 ● Machine learning is open for everyone ○ Machine Learning is not a proprietary offering from the major cloud providers ● Machine learning needs access to Data and Runtimes Take control with Container ○ Agile microservice frameworks, Apps and runtimes offers flexibility ○ Cloud-to-Cloud and On-Premise, mash your own network ○ Connect data-lakes to find information in your data ● Machine learning can be easy THREE IMPORTANT POINTS
  • 7. 7 CONTAINER MAKE ML easy Python Compilers Polyglot Applications Datasets Models CI/CD GPUs Lots of memory Lots of Data ML Frameworks Lots of decoupled moving parts API´s
  • 9. 9 HOW MACHINE LEARNING WORKS Choose Use Case Categorize Data Label Data Setup layers (neural network) Accuracy, optimize and training metrics Compile model Train model with training dataset Evaluate accuracyImprove Training Cycle Application Data Ingestion Analyze dataset based on model Predictions, Findings and Decisions Run Cycle
  • 11. 11 MACHINE LEARNING AREA 2 START Anomaly Detection = Predictive
  • 12. 12 ● GitHub Repository - https://github.com/ktenzer/openshift-ml-demo ● Blog - https://keithtenzer.com/2018/12/14/getting-started-with-machi ne-learning/ RESOURCES
  • 13. Q&A
  • 14. Keith Tenzer Senior Solution Architect Red Hat GmbH ktenzer@redhat.com +49 151 44051401 linkedin.com/company/red-hat youtube.com/user/RedHatVideos facebook.com/redhatinc twitter.com/RedHat Ian Schroeder Solution Specialist Middleware Red Hat GmbH ian.schroeder@redhat.com +49 172 8471401
  • 16. 16 DEMO APPLICATION ROLLOUT PodContainer Fedora Base C++ Dev tools Python + devel Python modules Nodejs BUILD DEPLOY RUN Container Fedora Base C++ Dev tools Python + devel Python modules Nodejs /deepspeech https://github.com/ktenzer/openshift-ml-demo Download model Start Nodejs 8080 Start Script Registry OpenShift
  • 17. 17 OPENSHIFT: OUR FOUNDATION FOR AI / MLLEVERAGE OPTIMAL CLOUD-NATIVE APP DEV CAPABILITIES AWS Microsoft Azure Google CloudOpenStackDatacenterLaptop APPLICATION LIFECYCLE MANAGEMENT ENTERPRISE CONTAINER HOST (RHEL) CONTAINER ORCHESTRATION AND MANAGEMENT (KUBERNETES) Much more than just RHEL + Docker + K8S: ● Security + CI/CD pipelines + hybrid cloud management + container-native storage + networking ● Microservices infrastructure: Istio service mesh for routing & traffic control, security, availability, and identity services ● Certified plugin/interoperability with leading storage, network vendors ● Available & optimized for private & public clouds in self-managed or RHT managed offerings ● Fully integrated with RHT middleware platforms & services
  • 18. 18 GPU SUPPORT IN OPENSHIFT ● Joint collaboration with strategic partners for drivers, plugins and container images ● Device Manager GA ● Scheduler: Priority and preemption ● Seamless install experience of drivers, plugins and dependencies ● Container images in RHCC/ISV Registry ● Certifications and support RHEL Host Device Manager plugin Kublet Device Manager Kubernetes SchedulerRHEL base image + Vendor libraries for GPUs + Frameworks for AI/ML such as Tensorflow or Pytorch Device drivers for GPU
  • 19. 19 Upstream Community Project with Google, RedHat, Microsoft, Intel, Caicloud and others Democratizing AI with Machine Learning for Everyone Challenges in ML that Kubeflow is addressing: Composability, Portability, Scalability KUBEFLOW
  • 20. 20 End-to-End Kubeflow Workflow Experiment with Jupyter Deploy Kubeflow on OpenShift Deploy TensorFlow, PyTorch, Caffe2, Horovod to build model Katib for Hyperparameter Tuning Kubeflow Volume Controller Model Serving and Inference with TensofFlowServing or SeldonCore Data Scientists S3 Object Store Build container image of model Integrate model with your application Operators App Developers Consumers Argo for workflow design