Gdg using docker to streamline development
- 1. Streamline Your Development Process with Docker Trond Marius Øvstetun trondmo@mesan.no GDG DevFest 2014 © Mesan AS
- 2. Streamline with Docker © Mesan AS
- 3. About me • Trond Marius Øvstetun • CTO in Mesan • Developer, Architect, Tech-lead +++ • 10+ years of experience building applications © Mesan AS
- 4. How we build systems Modern challenges © Mesan AS
- 5. © Mesan AS
- 6. Challenges © Mesan AS • One big lump of software • Scales as one • Deploys as one • Updates as one • Develops as one
- 7. Breaking the Monolith © Mesan AS
- 8. © Mesan AS
- 9. © Mesan AS
- 10. A new set of challenges • Interdependencies • Implicit ones - keys shared across systems © Mesan AS
- 11. From a developers perspective © Mesan AS • Dependencies change • add more systems • systems change • different kinds of deps • search/messaging/storage/cachin g… • How do we deal with this? • try to run deps locally? • export/import data • the “shared development environment” • moar, moar environments
- 12. © Mesan AS
- 13. What is Docker? “Docker is an open platform for developers and sysadmins to build, ship, and run distributed applications.” • Deploying and shipping software consistently is too hard • Dependencies, libraries, configuration • Consistency across environments (local, test, QA, production) • A new abstraction – introduce the Container © Mesan AS
- 14. What is a container? © Mesan AS
- 15. What is a container? © Mesan AS • Lightweight linux environment • Hermetically sealed, deployable • Isolation • Portability • Raising the level of abstraction • VMs = Idealized hardware • Container = Idealized OS (+hardware)
- 16. Demos © Mesan AS
- 17. Basic examples • Docker Hello World! $ docker run hello-world • Interactive running in a container (or two!) $ docker run -it ubuntu bash • Running basic nginx in a container $ docker run -d nginx © Mesan AS
- 18. Building a container manually • Run commands in interactive mode • Commit changes • Takes time – boring, manual & error prone • What about reproducability? © Mesan AS $ docker run -i -t ubuntu bash root@171950c2cf9d:/# touch my.conf root@171950c2cf9d:/# vi my.conf root@171950c2cf9d:/# apt-get install my-package Reading package lists... Done Building dependency tree Reading state information... Done $ docker commit 171950c2cf9d ovstetun/my
- 19. Dockerfile © Mesan AS my Dockerfile + env $ docker build . $ docker build -t mynginx .
- 20. Exposing ports as Services • Expose ports from a container in the Dockerfile EXPOSE 3000 • Open ports on the server $ docker run -p 4000:3000 mynginx © Mesan AS
- 21. Linking containers • Declare dependency and link docker run --link 1bc1:mysql nginx • Available as environment variables MYSQL_PORT_3306_TCP_ADDR=xxx MYSQL_PORT_3306_TCP_PORT=xxx © Mesan AS
- 22. Sharing containers © Mesan AS • Docker Hub • Official reusable images • Your own! $ docker push ovstetun/mynginx
- 23. Developing using Docker Exemplifying a workflow and setup © Mesan AS
- 24. Example system © Mesan AS
- 25. Setting up your system for Docker • Depend on Services, not Resources or computers • Run the same, identical container everywhere • Docker links to Services • Automate changes • Database refactorings • Search index updates • … © Mesan AS
- 26. Setting up your system for Docker • One process per container • Reuse (your own) base images • Repeatable builds – use Dockerfiles • Automate everything © Mesan AS
- 27. Workflow © Mesan AS
- 28. Working with dependencies • Do some work in Ingredients module • Run dependencies in Docker • search + database © Mesan AS $ docker run -p 3306:3306 --name some-mysql -e MYSQL_ROOT_PASSWORD=pwd -d o/ftdb:2 $ docker run -p 9300:9300 --name elastic -d o/ftelastic:2
- 29. © Mesan AS • Automatic linking and management • Simple configuration
- 30. Demo © Mesan AS
- 31. Deploying to the Cloud © Mesan AS
- 32. © Mesan AS
- 33. Kubernetes • Master & Minions • Pods • collection of containers, run as a unit • ReplicationControllers • controllable • Services • proxy layer and load balancing – “dynamic Docker links” © Mesan AS
- 34. Kubernetes © Mesan AS
- 35. The future? • The future lies in containers • continue to see more examples of use cases • Docker is the leader today • The momentum is gigantic • google, Microsoft, RedHat, Rackspace +++ © Mesan AS
- 36. Q & A © Mesan AS
- 37. Thank you trondmo@mesan.no github.com/ovstetun/jz14 @ovstetun © Mesan AS
Editor's Notes
- #3: Q&A section at the end - BUT SHOUT OUT DURING THE PRESENTATION The way we build applications Docker Development workflow Deployment (in the Cloud)
- #5: a BRIEF history How we USED to build systems -> how we build them today…
- #6: build in hver komponent..
- #8: Transforming into a Microservice architecture
- #9: Adding more components + extra stuff needed in the form of messaging, search engines, synchronization-add-ons etc
- #10: Example
- #20: What is it, how to define one Building a container committing tagging
- #24: Setting up your system for containerization Dependencies between containers a deeper dive into an example using a docker instance as (shared) data source and several docker-instances using this data source
- #29: commandline + demo running in IDEA+postman of course - there is a better opion -> FIG
- #31: Demo Fix bug in update in scala backend missing indexing Build, tag Run nginx, implement Edit
- #32: BEEN MISSING: Orchestration & monitoring Changed: the momentum is HUGE and Everyone is doing “something” now Example: using Kubernetes & google compute engine
- #33: Figure: Kubernetes - Where do the applications go
- #35: vizualiser
- #37: 5 mins
- #38: Reach out to me on the Mesan stand or wherever!