State of Builder and Buildkit by Tonis Tiigi (Docker)
Download as PPTX, PDF0 likes1,560 views
BuildKit is an open-source toolkit for software building, designed to improve development experience and execution efficiency through a new low-level architecture and advanced caching model. It enables fully concurrent builds, features a defined dependency graph, and supports various exporters and remote work capabilities. Users can contribute to multiple areas of BuildKit, enhancing its functionality and performance.
State of Builder and Buildkit by Tonis Tiigi (Docker)
- 2. • Toolkit for building software • Open Source development • Based on containerd/OCI BuildKit
- 3. Improve: • Development experience • Builder capabilities • Execution efficiency • Pluggability New low-level architecture
- 4. • Fully concurrent solver • Real dependency graph • New intermediate format (LLB) Concurrency Source Exec Nested Build Copy LLB operation types: op op op op op op op op op op op op op result op op op op op op opop op
- 5. • New caching model • Much more accurate • Both definition and content based • Capable of import/export from remote sources Build cache
- 6. • Automatic build cache GC • Simple view and control of used data • Results need to be exported to guarantee persistence Storage management
- 7. LLB • concurrent execution • instruction caching • automatic storage management • cache import/export • tbd: remote workers Frontends • Dockerfile • … Exporters • image • local files • oci image • oci bundle • vm • registry • …
- 8. demo
- 9. • Helpers for defining LLB state • Uses chaining model • Any part of the chain can be marshaled to LLB LLB client package https://godoc.org/github.com/moby/buildkit/client/llb vtx := llb.Image(“alpine:latest"). AddEnv("FOO", "BAR"). Dir("/dir"). Run(llb.Shlex("ls -l"), llb.AddEnv("key", “val")) dt, err := vtx.Marshal()
- 10. demo
- 11. • Remote workers / Distributed build • Custom frontends • Distribute components from images • Vertex scheduling constraints • New exporters Get involved • HTTP remote source • GC control tools • HTTP proxy cache • Improve performance • Privileged operation support • LLB helper packages Many areas to where to contribute https://github.com/moby/buildkit