Building a Kubernetes Powered Central Go Modules Repository
- 1. Go, go, kubernetes Building a Kubernetes Powered Central Go Modules Repository
- 2. Let’s go on a trip through history @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 3. A quick history of go Go 1.0 First major milestone as a long term stable release 2012 2015 Go 1.5 First release to no longer use C (except for cgo) Support for Vendoring 2017 Go 1.8 Introduction of Go plugins 2018 Go 1.10 Changes to the toolchain, runtime, and libs @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 4. Dependency Management… One thing missing @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 5. “Tis impossible to be sure of anything but Death and Taxes” - Christopher Bullock @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 6. Official Dependency Management No more GOPATH In one single tool So, what are modules? @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 7. In software Immutable and repeatable are really important The best way to guarantee issues is force push Immutable dependencies Who doesn’t remember left-pad with Node.js? Lost Dependencies Do you trust your colleagues? What about the rest of the Internet? Trust @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 8. • Developer Advocate • Passionate about Serverless, Containers, and all things Cloud • I love dadjokes, cheesecake and APIs Who am i? @LeonStigter Leon Stigter, Developer Advocate @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 9. Slides LinksComments Ratings shownotes https://jfrog.com/shownotes @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 10. What is gocenter actually?#1 @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 11. What is gocenter actually? @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 12. How we got to kubernetes#2 @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 13. Why did we choose kubernetes? • Make use of a proven orchestration platform • Leverage out-of-the- box features @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 14. Where could you start? • Look at tutorials • Think about a local dev environment • Managed Kubernetes! @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 15. Most mature Kubernetes offering Easy to deploy using existing tools and techniques Lots of troubleshooting tools like BigQuery and StackDriver Running on google cloud platform Most mature Kubernetes offering Easy to deploy using existing tools and techniques Lots of troubleshooting tools like BigQuery and StackDriver Running on google cloud platform @LeonStigter | jfrog.com/shownotes | gocenter.io
- 16. 1. Codebase 2. Dependencies 3. Config 4. Backing services 5. Build, release, run 6. Processes 7. Port binding 8. Concurrency 9. Disposability 10. Dev/Prod parity 11. Logs 12. Admin processes Who needs state anyway? @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 17. But we didn’t build everything ourselves Dependencies@JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 18. • Helm Charts are versioned • Separate value files per environment • Having one of the co- founders of Helm at our company also doesn’t hurt Deployments using helm Config@JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 19. Some other best practices we learned while building Limits & Labels Secrets Namespaces & Clusters Portbinding, Concurrency & Disposability@JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 20. How we built our infrastructure#3 @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 21. We’re big on those pipelines and promotions concepts CI SERVER Integration System Testing If quality requirments are hit If quality requirments are hit If quality requirments are hit Staging - Quality gates - Production 1 2 3 4 * @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 22. Number of clusters currently running 5Dev/Prod Parity@JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 23. Discovery Notifier Processor Running a few microservices @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 24. Validator UI Backend UI Running a few microservices @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 25. This is what our cluster looks like @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 26. Load testing • UI: 10K users with 100 requests per second • Backend: Load 10K modules… twice @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 27. Chaos engineering for the poor @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 28. Running at scale#4 @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 29. Node pools, cause even nodes have to relax? @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 30. Deployments using helm Build, release, run https://hub.helm.sh @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 31. Keeping a close eye on container health • FluentD • Prometheus • Grafana Live Dashboard Logs@JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 32. Our containers might get a little lonely @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 33. We keep in touch with our nodes Kube-Slack Jenkins Logs & Build, release, run @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 34. Scaling on many levels Run more microservices Compute Scaling based on queue depth Messaging What goes up must come down… usually Up and Down Provision nodes when needed Node Concurrency@JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 35. • https://jfrog.com/shownotes • @JFrog • @LeonStigter Q&A Some ads and Q&A @JFrog | @LeonStigter | jfrog.com/shownotes | #GoCenter
- 36. Thank you! See you next time, at