Kuby, ActiveDeployment for Rails Apps
0 likes97 views
Cameron Dutro introduces Kuby, which is an ActiveDeployment tool for Rails applications that packages and deploys apps into a Kubernetes cluster. Kuby aims to make deployment easy with minimal configuration, while also supporting major cloud providers and being native to Rails. It handles tasks like provisioning databases and acquiring SSL certificates automatically. The talk outlines the history of deployment methods and why Kubernetes provides an extensible platform. Kuby builds on concepts from tools like Capistrano but abstracts more details by treating servers collectively in a Kubernetes cluster.
![RR 403: Rails Needs Active Deployment
with Stefan Wintermeyer
March 12th, 2019
β β
I believe that we lose quite a lot of
companies and new developers on this
step. Because everything else [is] so much
easier with Rails⦠but that last step - and
itβs a super important step - is still super
complicated.
- Stefan Wintermeyer](https://image.slidesharecdn.com/kubyactivedeploymentforrails-220608045539-d3432eef/85/Kuby-ActiveDeployment-for-Rails-Apps-8-320.jpg)
![Starter config
Kuby.define('Railsconf') do
environment(:production) do
docker do
credentials do
username app_creds[:DOCKER_USERNAME]
password app_creds[:DOCKER_PASSWORD]
email app_creds[:DOCKER_EMAIL]
end
image_url "docker.pkg.github.com/camertron/railsconf/railsconf"
end
kubernetes do
add_plugin :rails_app
provider :linode do
cluster_id app_creds[:LINODE_CLUSTER_ID]
access_token app_creds[:LINODE_ACCESS_TOKEN]
end
end
end
end](https://image.slidesharecdn.com/kubyactivedeploymentforrails-220608045539-d3432eef/85/Kuby-ActiveDeployment-for-Rails-Apps-37-320.jpg)
Kuby, ActiveDeployment for Rails Apps
- 1. Cameron C. Dutro Kuby: ActiveDeployment forRails Apps
- 2. Welcome!
- 3. Who is this guy? β’ Cameron Dutro β’ I work at GitHub β’ He/him/his β’ Go Seahawks!
- 4. Rails is awesome β’ Easy for beginners! β’ Simple database tools! β’ Super-fast development experience! β’ A right place for every fi le! β’ Generators! Gems! Community! β’ Take that, Java! βOOPS!β
- 6. Rails has no official tool orguide to aide in deploying an app into production. THE UNFORTUNATE TRUTH IS,
- 7. RR 403: Rails Needs Active Deployment with Stefan Wintermeyer March 12th, 2019 β β In my experience, deployment is one of the major problems of normal Rails usersβ¦ it is a big pain to set up a deployment system for a Rails application, and I donβt see anything out there that makes it easier. - Stefan Wintermeyer
- 8. RR 403: Rails Needs Active Deployment with Stefan Wintermeyer March 12th, 2019 β β I believe that we lose quite a lot of companies and new developers on this step. Because everything else [is] so much easier with Railsβ¦ but that last step - and itβs a super important step - is still super complicated. - Stefan Wintermeyer
- 9. Our options β’ Heroku? Expensive β’ EC2 instance + capistrano? Dif fi cult β’ EC2 instance + Chef/Puppet/Ansible? So much to learn β’ Render, Fly, Cloud 66 Easy but vendor lock-in
- 11. Todayβs journey Cameron circa 2000 β’ What do we mean by βdeploymentβ? β’ How deployment has changed in the last ~20 years β’ The state-of-the-art in Rails land β’ ActiveDeployment (a.k.a. Kuby)
- 12. What is deployment? β’ Youβve built a great website and you want to put it online β’ Need a computer to run it on β’ (Ideally not your laptop) β’ Need to install software that listens for requests, invokes your code, and sends back the response β’ Might need a domain name (mycoolsite.com) β’ Might need persistent storage like a database
- 13. CCM Glass β’ In 2002 I built my fi rst website β’ Pure hand-coded HTML β’ Deployed to free hosting provider β’ Free hosting, powered by ads β’ Files deployed via FTP
- 14. PHP (2004 - 2010) β’ More dynamic β’ Able to store and retrieve data from MySQL β’ Still deploying via FTP
- 15. Fluther (2010) β’ First job out of college β’ Django app (Python) β’ MySQL database β’ Solr full-text search β’ Deployed using Capistrano βDr. Jellyβ
- 16. Twitter (2011) β’ Thousands of app servers β’ Deployments too slow using Capistrano β’ Wrote our own deployment tool β’ Servers pull code from each other via BitTorrent β’ First server seeds new version
- 17. Twitter β’ In 2013, Twitter switched to Apache Mesos β’ βProgram against your datacenter like itβs a single pool of resourcesβ β’ Many distinct services (geolocation, photos, twitter.com, etc) β’ Services isolated from each other on the same host β’ Resource allocation, ports, etc con fi gured declaratively
- 18. Lumos Labs β’ 2014: VPSes in Softlayer β’ Bespoke Capistrano setup + Chef β’ Deployed via in-house web app called Catapult β’ 2015: EC2 instances in AWS, still Capistrano β’ 2016: Docker + ECS (Elastic Container Service) β’ Deployed using in-house tool called Broadside β’ 2017: Kubernetes
- 19. GitHub (2022) β’ Dotcom β’ Kubernetes, deployed via chat-ops β’ Other services β’ Self-service Kubernetes-based framework called Moda β’ Kubernetes is the platform β’ Tooling abstracts away the details
- 20. 2O YEARS FTP Docker + Kubernetes
- 21. Rails has no official tool orguide to aide in deploying an app into production. TO REITERATE,
- 22. ActiveRecord ActionText ActiveJob ActionMailbox ActiveStorage ActionCable ActiveDeployment ? ? ? ?
- 23. What I want from ActiveDeployment β’ Launches my app. Runs my app on a remote server β’ Ease of use. Con fi g should be easy to grok β’ BYOS. Bring our own servers β’ Endemicity. Rails-native
- 24. These would be nice too β’ SSL/TLS certi fi cates installed/rotated automatically β’ Managed database instance β’ Sidekiq workers β’ Static asset server β’ No vendor lock-in
- 25. as turnkey as Heroku, as unrestricted as Capistrano BASICALLY I WANT IT TO BE
- 26. Planet Argonβs Ruby Community Survey Results, 2020
- 27. Who here uses Capistrano? π
- 28. Capistrano β’ Server automation tool written in Ruby β’ Servers managed via remote SSH connections β’ Uses Rake tasks under the hood
- 29. Why Capistrano? β’ Simple. Itβs just rake tasks + SSH β’ Flexible. No limits on what you can do β’ Established. Weβve got years of prior art to guide us β’ Independent. No vendor lock-in β’ Ruby. Written in the language we all love
- 30. Why not Capistrano? β’ Bespoke. You have to do a lot of things yourself β’ Imperative. Is your server really in the state you think itβs in? β’ Not portable. Does everything still work if you upgrade the OS? β’ Server-focused. Thinks of servers as individual machines
- 31. Layers of abstraction WE ARE HERE FTP + SSH Capistrano Chef/Puppet Docker Kubernetes
- 32. Layers of abstraction WE β¨ COULD BE HERE FTP + SSH Capistrano Chef/Puppet Docker Kubernetes
- 33. Why Kubernetes? β’ Extensible. Provides a true platform β’ Declarative. Tell Kubernetes what, not how β’ Portable. Deploy to any cloud provider with no con fi g changes β’ Cluster-focused. Servers are treated collectively as a single resource β’ Resilient. Restarts failed processes automatically β’ Scalable. Can scale on-demand
- 35. Introducing Kuby β’ Kuby is ActiveDeployment for Rails apps β’ Packages and deploys your app into a Kubernetes cluster β’ Minimal, easy-to-read con fi guration β’ Supports major cloud providers β’ DigitalOcean, Linode, EKS (Amazon), Azure
- 36. Introducing Kuby β’ Rails-native β’ Deploys the secrets in credentials.yml β’ Automatically provisions a database instance β’ Creates a static asset server β’ Acquires SSL/TLS certi fi cates for your domain
- 37. Starter config Kuby.define('Railsconf') do environment(:production) do docker do credentials do username app_creds[:DOCKER_USERNAME] password app_creds[:DOCKER_PASSWORD] email app_creds[:DOCKER_EMAIL] end image_url "docker.pkg.github.com/camertron/railsconf/railsconf" end kubernetes do add_plugin :rails_app provider :linode do cluster_id app_creds[:LINODE_CLUSTER_ID] access_token app_creds[:LINODE_ACCESS_TOKEN] end end end end
- 38. Your first deploy $> bundle exec kuby -e production build $> bundle exec kuby -e production push $> bundle exec kuby -e production deploy $> bundle exec kuby -e production setup
- 40. Kubernetes is a true platform BUT REMEMBER,
- 41. Plugins β’ kuby-redis: stand up Redis instances β’ kuby-sidekiq: easily add background job workers β’ kuby-prebundler: speed up bundle install β’ kuby-previews: deploy a copy of your app per pull request β’ kuby-anycable: deploys anycableβs go-based RPC components
- 42. Add Sidekiq require "kuby/sidekiq"β¨ add_plugin(:sidekiq) do replicas 2 # run two workers end In your Kuby con fi g:
- 43. Add Sidekiq if Rails.env.production ? Sidekiq.configure_server do |config | config.redis = Kuby.environment.kubernetes.plugin(:sidekiq).connection_param s end Sidekiq.configure_client do |config | config.redis = Kuby.environment.kubernetes.plugin(:sidekiq).connection_param s end end In con fi g/initializers/sidekiq.rb:
- 44. Deploy Sidekiq $> bundle exec kuby -e production build $> bundle exec kuby -e production push $> bundle exec kuby -e production deploy $> bundle exec kuby -e production setup (because we added a plugin)
- 45. The Platform β’ Capistrano: β’ Machine running FTP server or SSH daemon β’ Kubernetes: β’ Container scheduler, scaling, fault tolerance β’ Networking, load-balancing, ingress/egress β’ Persistent storage β’ Role-based access control
- 46. Other things you can do β’ kuby logs: Get logs from a web pod β’ kuby remote shell: Like SSH - start an interactive shell in a web pod β’ kuby remote console: Like rails console β’ kuby remote dbconsole: Like rails dbconsole β’ kuby kubectl: Run arbitrary kubectl commands β’ β¦ and much more
- 47. Resources β’ getkuby.io β’ github.com/getkuby β’ github.com/getkuby/kuby-core Also, I need help! Letβs make Kuby awesome together.
- 49. Thank you!
- 50. Questions?