SlideShare a Scribd company logo
🐳+💧
UPPING YOUR NIFI GAME WITH DOCKER
29 OCTOBER 2015
Aldrin Piri
@aldrinpiri
WHAT IS DOCKER?
A line of khakis, pants and casual clothing
It’s an obscure open source project
WHAT IS DOCKER?
“Docker is an open platform for building, shipping and
running distributed applications. It gives programmers,
development teams and operations engineers the common
toolbox they need to take advantage of the distributed and
networked nature of modern applications.”
DOCKER IS AN
ECOSYSTEM
Docker Hub https://hub.docker.com/
• A registry of available images
Tooling
• Linux provides a native experience
• Windows & OS X make use of a VM and
associated tools
People and Organizations
GLOSSARY FOR THE
TALK
Image
• Binary representation of a filesystem
Container
• Instance of an image
Copy on Write
• Images are untouched until changes are needed, at which
point a new copy is created
Volumes
• Bridge the external host world into the container
ENVIRONMENT
OS X 10.10
Docker Toolbox
• https://www.docker.com/docker-toolbox
Docker, Docker Machine, & Docker Compose
DOCKER-MACHINE
Provisions Docker environments
• Locally: Native Docker daemon, VirtualBox
• Cloud: Amazon EC2, Azure, DigitalOcean…
Establishes command line for communicating with instances
DOCKER
• Run images to create containers
• The lifespan of a container is tied to the process that originates it
• Defaults specified via ENTRYPOINT or CMD
• Specify arguments on run inclusive of providing
• Volumes
• Links to other running containers (unidirectional network mappings
via an alias)
• Environment variables
• Exposed Ports
• Alternate ENTRYPOINT/CMD
• If an image is present, it will attempt to be pulled from the Docker
Hub and locally cached
OUR BASE DOCKER
IMAGE
aldrin/apache-nifi
• Docker Hub
• https://hub.docker.com/r/aldrin/apache-nifi/
• Source
• https://github.com/apiri/dockerfile-apache-nifi
WHERE DOES IT ALL
COME FROM?
Dockerfile is our source code
WHERE DOES IT ALL
COME FROM?
An image is our compiled binary
DOCKER FOR
DEVELOPING
Volumes allow mapping libraries directly into the
environment
Links allow interacting with services at defined aliases
CLUSTERING
DOCKER NETWORK
Docker’s libnetwork makes great strides in increasing the
networking model
• Service Discovery
• Pluggable drivers
Unfortunately, it has not been released
• Coming soon: ~1.9.0
There are a few ways to handle this with the current release
inclusive of running a DNS server/service discovery, but we
are going a simple route for ease.

ENTER
AMBASSADORS
Provides service/container portability as links are hardcoded
Manager Node
Manager
Ambassador
Node
Ambassador
INTRODUCING
DOCKER COMPOSE
• Originally a project called fig
• Provides the definition and running of multi-container
applications
• YAML descriptor files
• docker-compose drives controlling the application

DOCKER-COMPOSE.YML

RESOURCES
Docker
• https://www.docker.com/
Visualizing Docker Containers and Images
• http://merrigrove.blogspot.com/2015/10/visualizing-docker-containers-
and-images.html
Jess Frazelle - Dockerize everything
• Container Hacks and Fun Images Presentation
• https://www.youtube.com/watch?v=1qlLUf7KtAw
• https://github.com/jfrazelle
Source Code and “Script”
• https://github.com/apiri/docker-with-nifi
THANKS!

More Related Content

PDF
Kafka Summit SF Apr 26 2016 - Generating Real-time Recommendations with NiFi,...
PDF
NiFi Developer Guide
PPTX
Best practices and lessons learnt from Running Apache NiFi at Renault
PDF
Apache Nifi Crash Course
PDF
Apache NiFi: latest developments for flow management at scale
PDF
Dataflow Management From Edge to Core with Apache NiFi
PDF
Introduction to Apache NiFi 1.11.4
PDF
Apache Nifi Crash Course
Kafka Summit SF Apr 26 2016 - Generating Real-time Recommendations with NiFi,...
NiFi Developer Guide
Best practices and lessons learnt from Running Apache NiFi at Renault
Apache Nifi Crash Course
Apache NiFi: latest developments for flow management at scale
Dataflow Management From Edge to Core with Apache NiFi
Introduction to Apache NiFi 1.11.4
Apache Nifi Crash Course

What's hot (20)

PDF
Meet HBase 2.0 and Phoenix 5.0
PDF
Apache NiFi User Guide
PDF
You Can't Search Without Data
PPTX
State of the Apache NiFi Ecosystem & Community
PDF
Running Apache NiFi with Apache Spark : Integration Options
PDF
BYOP: Custom Processor Development with Apache NiFi
PDF
Apache NiFi SDLC Improvements
PDF
Local Apache NiFi Processor Debug
PPTX
Data at Scales and the Values of Starting Small with Apache NiFi & MiNiFi
PDF
The First Mile -- Edge and IoT Data Collection with Apache NiFi and MiNiFi
PPTX
Integrating NiFi and Apex
PPTX
Extending the Yahoo Streaming Benchmark + MapR Benchmarks
PDF
Hadoop Operations - Past, Present, and Future
PPTX
The Avant-garde of Apache NiFi
PPTX
Apache Zeppelin + Livy: Bringing Multi Tenancy to Interactive Data Analysis
PDF
Pulsar summit asia 2021 apache pulsar with mqtt for edge computing
PPTX
Apache Nifi - Custom Processor
PPTX
MiNiFi 0.0.1 MeetUp talk
PPTX
Integrating NiFi and Flink
PPTX
AMIS SIG - Introducing Apache Kafka - Scalable, reliable Event Bus & Message ...
Meet HBase 2.0 and Phoenix 5.0
Apache NiFi User Guide
You Can't Search Without Data
State of the Apache NiFi Ecosystem & Community
Running Apache NiFi with Apache Spark : Integration Options
BYOP: Custom Processor Development with Apache NiFi
Apache NiFi SDLC Improvements
Local Apache NiFi Processor Debug
Data at Scales and the Values of Starting Small with Apache NiFi & MiNiFi
The First Mile -- Edge and IoT Data Collection with Apache NiFi and MiNiFi
Integrating NiFi and Apex
Extending the Yahoo Streaming Benchmark + MapR Benchmarks
Hadoop Operations - Past, Present, and Future
The Avant-garde of Apache NiFi
Apache Zeppelin + Livy: Bringing Multi Tenancy to Interactive Data Analysis
Pulsar summit asia 2021 apache pulsar with mqtt for edge computing
Apache Nifi - Custom Processor
MiNiFi 0.0.1 MeetUp talk
Integrating NiFi and Flink
AMIS SIG - Introducing Apache Kafka - Scalable, reliable Event Bus & Message ...
Ad

Viewers also liked (20)

PPTX
Apache NiFi Crash Course - San Jose Hadoop Summit
PPTX
Hortonworks Data in Motion Webinar Series Part 7 Apache Kafka Nifi Better Tog...
PDF
Simplereach: Counters at Scale: A Cautionary Tale
PPTX
Apache con big data 2015 magellan
PDF
What's new with Apache Tika?
PDF
Nifi workshop
PPTX
Big Data at Tube: Events to Insights to Action
PDF
Big Data Applications
PPTX
Using Time Window Compaction Strategy For Time Series Workloads
PPTX
2016 Cybersecurity Analytics State of the Union
PDF
Cross Datacenter Replication in Apache Solr 6
PPT
Introduction to Spark Streaming
PPTX
Rebuilding Solr 6 examples - layer by layer (LuceneSolrRevolution 2016)
PPTX
Apache Spot
PDF
How to Run Solr on Docker and Why
PPTX
Evolving HDFS to a Generalized Storage Subsystem
PDF
Webinar: Solr 6 Deep Dive - SQL and Graph
PPTX
Apache NiFi Crash Course Intro
PPTX
Big Data Testing: Ensuring MongoDB Data Quality
PPTX
Apache Metron: Community Driven Cyber Security
Apache NiFi Crash Course - San Jose Hadoop Summit
Hortonworks Data in Motion Webinar Series Part 7 Apache Kafka Nifi Better Tog...
Simplereach: Counters at Scale: A Cautionary Tale
Apache con big data 2015 magellan
What's new with Apache Tika?
Nifi workshop
Big Data at Tube: Events to Insights to Action
Big Data Applications
Using Time Window Compaction Strategy For Time Series Workloads
2016 Cybersecurity Analytics State of the Union
Cross Datacenter Replication in Apache Solr 6
Introduction to Spark Streaming
Rebuilding Solr 6 examples - layer by layer (LuceneSolrRevolution 2016)
Apache Spot
How to Run Solr on Docker and Why
Evolving HDFS to a Generalized Storage Subsystem
Webinar: Solr 6 Deep Dive - SQL and Graph
Apache NiFi Crash Course Intro
Big Data Testing: Ensuring MongoDB Data Quality
Apache Metron: Community Driven Cyber Security
Ad

Similar to Upping your NiFi Game with Docker (20)

PPTX
Cohesion Techsessie Docker - Daniel Palstra
PPTX
Dockerize the World
PDF
IBM Bluemix Paris Meetup #14 - Le Village by CA - 20160413 - Introduction à D...
PPTX
2014, April 15, Atlanta Java Users Group
PPTX
Evotalks Docker Presentation
PPTX
Docker.pptx
PDF
Docker for the Rubyist
PPTX
You, and Me, and Docker Makes Three
PDF
Docker from A to Z, including Swarm and OCCS
PPTX
Docker - the what why and hows
PDF
Docker - Hack Salem! - November 2014
PDF
From Docker Swarm to OCCS and Wercker: Live-hacking at Oracle CODE Mexico 2017
PPTX
Docker and Microservice
PPTX
DockerCon EU 2015 Barcelona
PDF
Docker in the Oracle Universe / WebLogic 12c / OFM 12c
PDF
Oracle CODE 2017 San Francisco: Docker on Raspi Swarm to OCCS
PPTX
docker : how to deploy Digital Experience in a container drinking a cup of co...
PPTX
.docker : how to deploy Digital Experience in a container drinking a cup of c...
PPTX
Docker lxc win
PDF
Docker slides
Cohesion Techsessie Docker - Daniel Palstra
Dockerize the World
IBM Bluemix Paris Meetup #14 - Le Village by CA - 20160413 - Introduction à D...
2014, April 15, Atlanta Java Users Group
Evotalks Docker Presentation
Docker.pptx
Docker for the Rubyist
You, and Me, and Docker Makes Three
Docker from A to Z, including Swarm and OCCS
Docker - the what why and hows
Docker - Hack Salem! - November 2014
From Docker Swarm to OCCS and Wercker: Live-hacking at Oracle CODE Mexico 2017
Docker and Microservice
DockerCon EU 2015 Barcelona
Docker in the Oracle Universe / WebLogic 12c / OFM 12c
Oracle CODE 2017 San Francisco: Docker on Raspi Swarm to OCCS
docker : how to deploy Digital Experience in a container drinking a cup of co...
.docker : how to deploy Digital Experience in a container drinking a cup of c...
Docker lxc win
Docker slides

Recently uploaded (20)

PDF
Understanding Forklifts - TECH EHS Solution
PDF
Odoo Companies in India – Driving Business Transformation.pdf
PPTX
Why Generative AI is the Future of Content, Code & Creativity?
PPTX
CHAPTER 2 - PM Management and IT Context
PDF
Product Update: Alluxio AI 3.7 Now with Sub-Millisecond Latency
PPTX
Transform Your Business with a Software ERP System
PDF
Nekopoi APK 2025 free lastest update
PDF
Upgrade and Innovation Strategies for SAP ERP Customers
PDF
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
PDF
PTS Company Brochure 2025 (1).pdf.......
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PPTX
Log360_SIEM_Solutions Overview PPT_Feb 2020.pptx
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
PDF
System and Network Administraation Chapter 3
PDF
Softaken Excel to vCard Converter Software.pdf
PPTX
assetexplorer- product-overview - presentation
PDF
Digital Systems & Binary Numbers (comprehensive )
PDF
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
PDF
System and Network Administration Chapter 2
Understanding Forklifts - TECH EHS Solution
Odoo Companies in India – Driving Business Transformation.pdf
Why Generative AI is the Future of Content, Code & Creativity?
CHAPTER 2 - PM Management and IT Context
Product Update: Alluxio AI 3.7 Now with Sub-Millisecond Latency
Transform Your Business with a Software ERP System
Nekopoi APK 2025 free lastest update
Upgrade and Innovation Strategies for SAP ERP Customers
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
PTS Company Brochure 2025 (1).pdf.......
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
Log360_SIEM_Solutions Overview PPT_Feb 2020.pptx
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
System and Network Administraation Chapter 3
Softaken Excel to vCard Converter Software.pdf
assetexplorer- product-overview - presentation
Digital Systems & Binary Numbers (comprehensive )
T3DD25 TYPO3 Content Blocks - Deep Dive by André Kraus
System and Network Administration Chapter 2

Upping your NiFi Game with Docker

  • 1. 🐳+💧 UPPING YOUR NIFI GAME WITH DOCKER 29 OCTOBER 2015 Aldrin Piri @aldrinpiri
  • 2. WHAT IS DOCKER? A line of khakis, pants and casual clothing It’s an obscure open source project
  • 3. WHAT IS DOCKER? “Docker is an open platform for building, shipping and running distributed applications. It gives programmers, development teams and operations engineers the common toolbox they need to take advantage of the distributed and networked nature of modern applications.”
  • 4. DOCKER IS AN ECOSYSTEM Docker Hub https://hub.docker.com/ • A registry of available images Tooling • Linux provides a native experience • Windows & OS X make use of a VM and associated tools People and Organizations
  • 5. GLOSSARY FOR THE TALK Image • Binary representation of a filesystem Container • Instance of an image Copy on Write • Images are untouched until changes are needed, at which point a new copy is created Volumes • Bridge the external host world into the container
  • 6. ENVIRONMENT OS X 10.10 Docker Toolbox • https://www.docker.com/docker-toolbox Docker, Docker Machine, & Docker Compose
  • 7. DOCKER-MACHINE Provisions Docker environments • Locally: Native Docker daemon, VirtualBox • Cloud: Amazon EC2, Azure, DigitalOcean… Establishes command line for communicating with instances
  • 8. DOCKER • Run images to create containers • The lifespan of a container is tied to the process that originates it • Defaults specified via ENTRYPOINT or CMD • Specify arguments on run inclusive of providing • Volumes • Links to other running containers (unidirectional network mappings via an alias) • Environment variables • Exposed Ports • Alternate ENTRYPOINT/CMD • If an image is present, it will attempt to be pulled from the Docker Hub and locally cached
  • 9. OUR BASE DOCKER IMAGE aldrin/apache-nifi • Docker Hub • https://hub.docker.com/r/aldrin/apache-nifi/ • Source • https://github.com/apiri/dockerfile-apache-nifi
  • 10. WHERE DOES IT ALL COME FROM? Dockerfile is our source code
  • 11. WHERE DOES IT ALL COME FROM? An image is our compiled binary
  • 12. DOCKER FOR DEVELOPING Volumes allow mapping libraries directly into the environment Links allow interacting with services at defined aliases
  • 14. DOCKER NETWORK Docker’s libnetwork makes great strides in increasing the networking model • Service Discovery • Pluggable drivers Unfortunately, it has not been released • Coming soon: ~1.9.0 There are a few ways to handle this with the current release inclusive of running a DNS server/service discovery, but we are going a simple route for ease. 
  • 15. ENTER AMBASSADORS Provides service/container portability as links are hardcoded Manager Node Manager Ambassador Node Ambassador
  • 16. INTRODUCING DOCKER COMPOSE • Originally a project called fig • Provides the definition and running of multi-container applications • YAML descriptor files • docker-compose drives controlling the application 
  • 18. RESOURCES Docker • https://www.docker.com/ Visualizing Docker Containers and Images • http://merrigrove.blogspot.com/2015/10/visualizing-docker-containers- and-images.html Jess Frazelle - Dockerize everything • Container Hacks and Fun Images Presentation • https://www.youtube.com/watch?v=1qlLUf7KtAw • https://github.com/jfrazelle Source Code and “Script” • https://github.com/apiri/docker-with-nifi