Kubernetes and Container Technologies from Cloud Native Computing Foundation

CNCF Overview
Dan Kohn, Executive Director, @dankohn1
This presentation is available at:
https://github.com/cncf/presentations

© 2018 Cloud Native Computing Foundation2
Cloud Native Computing Foundation
• Non-profit, part of the Linux Foundation; founded Dec 2015
• Platinum members:
Orchestration
Incubating Sandbox
Service Mesh
StorageNetworking
API
Service DiscoveryDistributed
Tracing
Service Mesh Software
Update Spec
StorageSecurity
Logging Remote
Procedure Call
Monitoring Distributed
Tracing API
Container
Runtime
Messaging
Identity
Spec
Identity
Policy
Graduated
Serverless Tooling
Container
Runtime

Today the Linux Foundation is much more than Linux
We are helping
global privacy
and security
through a
program to
encrypt the
entire internet.
Security Networking
We are creating
ecosystems around
networking to
improve agility in the
evolving software-
defined datacenter.
Cloud
We are creating a
portability layer for
the cloud, driving de
facto standards and
developing the
orchestration layer
for all clouds.
Automotive
We are creating the
platform for
infotainment in the
auto industry that
can be expanded
into instrument
clusters and
telematics systems.
Blockchain
We are creating a
permanent, secure
distributed ledger
that makes it easier
to create cost-
efficient,
decentralized
business networks.
We are regularly adding projects; for the most up-to-date listing of all projects visit tlfprojects.org
Web
We are providing the
application
development
framework for next
generation web,
mobile, serverless,
and IoT applications.

52 Companies in the End User Community
Plus 4 non-public members

Kubernetes in Search Trends
Google Trends WeChat
Kubernetes OpenStack
Dec 2017 Jan 2018
Feb 2018

https://www.cncf.io/blog/2017/06/05/30-highest-velocity-open-source-projects
30 Highest Velocity Open Source Projects
2016-11 to 2017-10
Commits

CNCF Project Maturities
INNOVATORS
“TECHIES”
EARLY
MAJORITY
“PRAGMATISTS”
LAGGARDS
“SKEPTICS”
“THE CHASM”
LATE MAJORITY
“CONSERVATIVES”
SANDBOX
GRADUATION
INCUBATION
EARLY
ADOPTERS
“VISIONARIES”

CNCF Structure
Technical
Oversight
Committee
Governing
Board
End User
Community
• Mainly vendors
• Fund the organization
• Marketing and strategic
direction
• 9 top technical architects
• Admit new projects
• Acts as a resource to
projects
• Real end users of these technologies
• Communicate back requirements
• And good and bad experiences
Marketing
Committee

220+ Members and Growing
Platinum Members
End User Supporters
Gold Members
End User Members Academic/Nonprofit

Cloud Native Computing Foundation10
220+ Members and Growing (Silver 1)

220+ Members and Growing (Silver 2)

Migrating Legacy Monoliths to
Cloud Native Microservices
Architectures on Kubernetes
Dan Kohn, Executive Director
This presentation is available at:
https://github.com/cncf/presentations

Non-Virtualized Servers: Sun (2000)
• Launching a new application? Buy
a new server; or a rack of them!
• Building block of your application is
physical servers
2000
Non-
Virtualized
Hardware

Virtualization: VMWare (2001)
• Releases for server market in 2001
• Popularizes virtual machines (VMs)
• Run many VMs on one physical machine,
meaning you can buy fewer servers!
• Architectural building block becomes a VM
2000 2001
Virtualiza-
tion
Non-
Virtualized
Hardware

IaaS: AWS (2006)
• Amazon Web Services (AWS) creates the
Infrastructure-as-a-Service market by
launching Elastic Compute Cloud (EC2) in 2006
• Rent servers by the hour
• Convert CapEx to OpEx
• Architectural building block is also a VM,
called an Amazon Machine Image (AMI)
2000 2001 2006
Virtualiza-
tion
Non-
Virtualized
Hardware
IaaS

PaaS: Heroku (2009)
• Heroku popularizes Platform-as-a-Service (PaaS)
with their launch in 2009
• Building block is a buildpack, which enables
containerized 12-factor applications
– The process for building the container is opaque, but:
– Deploying new version of an app is just: git push heroku
PaaSIaaS
2000 2001 2006 2009
Virtualiza-
tion
Non-
Virtualized
Hardware

Open Source IaaS: OpenStack (2010)
•OpenStack brings together an extraordinarily
diverse group of vendors to create an open
source Infrastructure-as-a-Service (IaaS)
•Competes with AWS and VMWare
•Building block remains a VM
Open
Source
IaaS
PaaS
2000 2001 2006 2009 2010
Non-
Virtualized
Hardware
Virtualiza-
tion
IaaS

Open Source PaaS: Cloud Foundry (2011)
•Pivotal builds an open source alternative
to Heroku’s PaaS and launches the Cloud
Foundry Foundation in late 2014
•Building block is Garden containers, which
can hold Heroku buildpacks, Docker
containers and even non-Linux OSes
Open
Source
IaaS
PaaS
Open
Source
PaaS
2000 2001 2006 2009 2010 2011
Non-
Virtualized
Hardware
Virtualiza-
tion
IaaS

Containers
Containers: Docker (2013)
•Docker combines LXC, Union File System and
cgroups to create a containerization standard
adopted by millions of developers around the world
•Fastest uptake of a developer technology ever
•Enables isolation, reuse and immutability
Open
Source
IaaS
PaaS
Open
Source
PaaS
2000 2001 2006 2009 2010 2011
Non-
Virtualized
Hardware
2013
Virtualiza-
tion
IaaS

Containers
Cloud
Native
Cloud Native: CNCF (2015)
•Cloud native computing uses an open source
software stack to:
– segment applications into microservices,
– packaging each part into its own container
– and dynamically orchestrating those
containers to optimize resource utilization
Open
Source
IaaS
PaaS
Open
Source
PaaS
Virtualiza-
tion
2000 2001 2006 2009 2010 2011
Non-
Virtualized
Hardware
2013 2015
IaaS

What Have We Learned?
• Core Building Block:
– Servers ➡ Virtual Machines ➡ Buildpacks ➡ Containers
• Isolation Units
– From heavier to lighter weight, in spin-up time and size
• Immutability
– From pets to cattle
• Provider
– From closed source, single vendor to open source, cross-
vendor

22

Avoid Vendor Lock-in
Open source software stack enables deployment
on any public, private cloud or hybrid cloud

Enable Unlimited Scalability
Scales from several nodes on your laptop to tens
of thousands of self-healing multi-tenant nodes

Increase Agility and Maintainability
By splitting applications into microservices
with explicitly described dependencies

Improve Efficiency and Resource Utilization
Via a central orchestrating process that dynamically
manages and schedules microservices

Achieve Resiliency
To failures of individual containers, machines, and
even data centers and to varying levels of demand

Cloud Native Enables High Performance
2016 State of DevOps Report Infographic from Puppet
High-performing teams deploy
more frequently and have
much faster lead times.
They make changes with fewer
failures, and recover faster
from failures.
200x more frequent
deployments
2,555x shorter lead
times
3x lower
change failure rate
24x faster
recovery from failures
200x
2,555x 3x
24x

Greenfield Applications
Cloud Native application architectures are the
default choice for greenfield applications

Greenfield Application Design
• The leading choice for cloud native
orchestration is:
– Selected by top enterprises and startups like Bloomberg, Box,
Reddit and the New York Times
– One of the highest development velocity projects in
the history of open source
– Amazing group of technology giants and startups
cooperating to rapidly improve

In the long run we are all dead. Economists set themselves too
easy, too useless a task, if in tempestuous seasons they can only
tell us, that when the storm is long past, the ocean is flat again.
– John Maynard Keynes

…too easy, too useless a task…

The Real World Consists of Brownfield Applications
The gross world product is about $100 trillion
and almost all of it flows through brownfield
applications, which are generally monoliths

Nearly All Production Applications Are Monoliths

How About a Rewrite?
• The Second System Syndrome
says that many rewrites end in
failure
• The existing system evolves faster
than the second one can catch
up

Monoliths Are the Antithesis of Cloud Native
Inflexible, tightly-coupled, brittle

Step One Is to Stop Digging

Step Two is Lift-and-Shift Your Monolith
StatefulSets are helpful for providing stable, persistent
storage and unique network identifiers to your monolith

Chip Away at the Monolith
As different parts of your monolith need upgrades
or improvements, consider chipping away at that
functionality and moving it to its own microservice

New Functionality Can Go in New Apps
Write new functionality in separate applications
optimized for it, such as Node.js for OAuth
or Go for performance sensitive tasks

Start with Stateless Services
Kubernetes delivers the largest immediate value today for
stateless services, such as application front end servers
that need resiliency, load-balancing, autoscaling, etc.

Transition Your Data Stores Last
Supporting stateful services like Postgres or Redis
remains the most challenging part of working with
Kubernetes and should likely go last in any transition

Consider Complementary Projects
Consider the constellation of CNCF projects
(and their competitors) to provide related services
Prometheus OpenTracing Fluentd Linkerd gRPC CoreDNS rktcontainerd CNI Envoy Jaeger NotaryTUF

Evolving Your Monolith into a Microservice

And Eventually You Have a Collection

Kubernetes and Greenfield
Avoid the “soft bigotry of low expectations”
of thinking that you need to do a greenfield
rewrite to get the benefits of cloud native

Kubernetes and Brownfield
brownfield applications

More Info on Evolving Monoliths
• Box
– https://architecht.io/box-co-founder-on-moving-to-microservices-and-the-promise-of-
kubernetes-a49f01b1c0c0
• Key Bank
– https://developers.redhat.com/blog/2016/10/27/the-fast-moving-monolith-how-we-
sped-up-delivery-from-every-three-months-to-every-week/
• TicketMaster
– https://www.linux.com/news/learn/kubernetes/ticketmaster-chooses-kubernetes-stay-
ahead-competition
• Wikipedia
– https://kubernetes.io/case-studies/wikimedia/
• GitHub
– https://githubengineering.com/kubernetes-at-github/

HOW GOOD IS
OUR CODE?
Dan Kohn
Executive Director, CNCF

Cloud Native Computing Foundation52 https://www.youtube.com/watch?v=5lutHF5HhVA

“I haven’t tasted tap water in a long time….” Doug Evans
said. “You have to be agile and tactile, and be available
to experiment. Literally, you have to carry bottles of water
through the dark.”

OUR SOFTWARE IS NOT AS GOOD AS SQLITE
Developed mainly by one highly-regarded
developer, Richard Hipp
100% branch test coverage
Millions of test cases
1,000 times as much test code as product code
https://www.sqlite.org/
testing.html

AMERICAN FUZZY LOP
58
Software fuzzer built
by Michał Zalewski that
uses genetic algorithms
to find bugs

SQLITE STILL HAS BUGS!
When Zalewski ran
American Fuzzy Lop against
SQLite, he found 22 bugs(!!!)
in 30 minutes of work
Note that SQLite quickly fixed all of the
bugs and incorporated AFL into their
release process
But our code is not
as good as SQLite’s!

LINUX
LINUX
17 M SLOCs

DEPLOYMENT PLATFORM
KUBERNETES
35 M SLOCs

FRAMEWORK
NODE.JS
12.3 M SLOCs

3RD PARTY LIBRARIES
3RD PARTY LIBRARIES
2.5 M SLOCs

OUR CODE IS ONLY 40 K SLOCS
OUR CODE
INTERACTIVE
LANDSCAPE
40 K SLOCs

OUR APPLICATION SOFTWARE STACK

OUR CODE IS <0.1% OF OUR SOFTWARE STACK

ALL OF THIS CODE IS VULNERABLE
NODE.JS
12.3 M SLOCs
KUBERNETES
35 M SLOCs
LINUX
17 M SLOCs
3RD PARTY LIBRARIES
2.5 M SLOCs
OUR CODE
40 K SLOCs

SPECTRE & MELTDOWN IN LINUX
DivideConcept
NODE.JS
12.3 M SLOCs
3RD PARTY LIBRARIES
2.5 M SLOCs
OUR CODE
40 K SLOCs
KUBERNETES
35 M SLOCs
LINUX
17 M SLOCs

Heartbleed
DivideConcept
NODE.JS
12.3 M SLOCs
3RD PARTY LIBRARIES
2.5 M SLOCs
OUR CODE
40 K SLOCs
KUBERNETES
35 M SLOCs
LINUX
17 M SLOCs

Heartbleed
subPath
DivideConcept
NODE.JS
12.3 M SLOCs
3RD PARTY LIBRARIES
2.5 M SLOCs
OUR CODE
40 K SLOCs
KUBERNETES
35 M SLOCs
LINUX
17 M SLOCs

Spectre and Meltdown
Heartbleed
subPath
DivideConcept
NODE.JS
12.3 M SLOCs
3RD PARTY LIBRARIES
2.5 M SLOCs
OUR CODE
40 K SLOCs
KUBERNETES
35 M SLOCs
LINUX
17 M SLOCs

The power of open source is the
ability to leverage thousands of
other developers that are finding
bugs and making fixes to the
software we depend on

But a software patch does
not help until we have
deployed it into production

How can we have the confidence
that that deployment won’t break
anything?

The Answer is
CONTINUOUS
INTEGRATION
(CI)
But a software patch does
not help until we have
deployed it into production
How can we have the confidence
that that deployment won’t break
anything?
The power of open source is the
ability to leverage thousands of
other developers that are finding
bugs and making fixes to the
software we depend on

WHAT KIND
OF TESTS
SHOULD CI
RUN?

WHAT KIND OF TESTS SHOULD CI RUN?
Unit testing of
individual
portions of our
source code in
isolation?

Integration
testing, where we
work with
external systems
like a database?
Unit testing of
individual
portions of our
source code in
isolation?

Regression
testing, where
we add a test
after a failure
Unit, testing
individual
portions of our
source code in
isolation?
Integration
testing, where we
work with
external systems
like a database?

Smoke testing,
also known as
build verification
testing?
Unit, testing
individual
portions of our
source code in
isolation?
Integration
testing, where we
work with
external systems
like a database?
Regression
testing, where
we add a test
after a failure?

All of the above.
Unit, testing
individual
portions of our
source code in
isolation?
Integration
testing, where we
work with
external systems
like a database?
Regression
testing, where
we add a test
after a failure?
Smoke testing,
also known as
build verification
testing?

HOW GOOD IS OUR CODE?
NOT GOOD ENOUGH
We need to build in the systems
and processes that enable us to
continuously improve it

CONTINUOUS INTEGRATION (CI)
But what is
testing?
Continuous
integration (CI)
just means
constant testing

TESTING IS LIKE SCIENCE
We have a hypothesis
of what we believe our
code should do, but we
don’t know for sure until we
test against objective reality

Karl Popper
defined science as
BEING TESTABLE
AND FALSIFIABLE
91

What do Continuous Integration, Science,
and Entrepreneurship all have in common?
92

What do Continuous Integration, Science,
and Entrepreneurship all have in common?
They each require comparing an
idealized conception to the often
brutal truth of objective reality
93

HOW DOES CONTINUOUS
INTEGRATION FIT INTO THE CLOUD
NATIVE JOURNEY?
94

CLOUD NATIVE
TRAIL MAP

PLEASE TRY THE
INTERACTIVE
LANDSCAPE NOW:
l.cncf.io
98

© 2018 Cloud Native Computing Foundation
10
0
Certified Kubernetes Conformance
• CNCF launched a software conformance
program for Kubernetes
– Implementations run conformance tests and
upload results
– New mark and more flexible use of
Kubernetes trademark for conformant
implementations
– Taking submissions now for K8s 1.9 & 1.10
– https://www.cncf.io/certification/software-
conformance/

10
1
58 Certified Kubernetes Partners

10
2
CNCF MOOC and Online Training
• Free Introduction to Kubernetes self-paced course
offered with edX
• Kubernetes Fundamentals course
– Content maps to Certified Kubernetes Administrator (CKA) exam
– $299, intermediate level
• Open source curriculum available for companies
offering training
– CKA Exam coupons available with a bulk discount

10
3
Online, Proctored Kubernetes Exams
• Certified Kubernetes Administrator (CKA)
– Over 1,500 registrations already
– https://www.cncf.io/certification/expert/cka/
• Certified Kubernetes Application Developer
(CKAD)
– Certifies that users can design, build, configure, and expose
cloud native applications for Kubernetes
– https://www.cncf.io/certification/expert/cka/ckad/
• Both tests
– Tests consist of a set of scenarios to resolve from the command
line over 3 hours; there is no multiple choice
– Each exam is $300
– Quarterly exam updates to match K8s releases

10
4
Kubernetes Certified Service Provider
A pre-qualified tier of vetted service providers who have deep experience helping enterprises
successfully adopt Kubernetes through support, consulting, professional services and/or training.
Benefits
• Placement at the top of https://kubernetes.io/partners/
• Monthly private meetings with cloud native project leaders, TOC members, and
representatives from the Governing Board
• Access to leads from the kubernetes.io for end users looking for support
Requirements
• Three or more certified engineers
• Demonstrable activity in the Kubernetes community including active contribution
• Business model to support enterprise end users
https://www.cncf.io/certification/kcsp/

10
5
44 KCSP Partners

Cloud Native Computing Foundation
10
6
KubeCon + CloudNativeCon
• China
– Shanghai: November 14-15, 2018
– Sponsorships open
• North America
– Seattle: December 11 - 13, 2018
– Sponsorships open
• Europe
– Barcelona: May 21 - 23, 2018

10
7
KubeCon + CloudNativeCon Attendees

10
8
Joining the CNCF is easy!
Join now: https://cncf.io/join
or
General Inquiries: info@cncf.io
PR: pr@cncf.io
Event Sponsorships: sponsor@cncf.io
Membership: memberships@cncf.io

Kubernetes and Container Technologies from Cloud Native Computing Foundation

More Related Content

What's hot (20)

Similar to Kubernetes and Container Technologies from Cloud Native Computing Foundation (20)

More from Cloud Standards Customer Council (14)

Recently uploaded (20)

Kubernetes and Container Technologies from Cloud Native Computing Foundation