Open Discussion: Nephio Test-infra project
0 likes33 views
The document discusses the Nephio project's test infrastructure, highlighting tools and scripts for functionality verification, including CI management and sandbox provisioning. It outlines areas for improvement such as implementing the Kuttl framework and using the Doc Detective tool for documentation synchronization. Additionally, it covers the need for extracting Ansible roles and replacing Metallb in cloud environments.
Open Discussion: Nephio Test-infra project
- 1. Open discussion on Test-Infra Victor Morales Samsung
- 2. • Project overview • Miscellaneous folders • e2e folder • Pre-bake VM image • Cloud CI management • Sandbox provision • Areas for improvement • Extract Ansible Roles • Implement KUTTL Framework • Use Doc Detective tool • Replace MetalLB for KinD cloud provider • Use Ephemeral Docker image registry Agenda
- 4. Overview https://github.com/nephio-project/test-infra/ Test Infrastructure provide tools and scripts to guarantee the proper functionality of Nephio Components • Provides scripts to install requirements used by the Test Cases (ansible bootstrap role). • Installs Nephio components (ansible install role). • Contains a kpt Ansible module. • Provisions a local/remote Nephio Sandbox through a Vagrantfile. • Provides Terraform scripts utilized by CI. • Stores Dockerfiles for CI artifacts. • Contains bash scripts used during the execution of the End-To-End testing.
- 5. Miscellaneous folders GitHub PR templates (eventually GitHub actions) Images used by the Wiki Docker image definitions for CI artifacts Prow configuration Python scripts for dependabot and release GitHub actions
- 6. e2e folder – Pre-bake VM image Call for action: • Expose “nephio-pre-baked-*” images for consumption • Implement cleanup procedure to avoid cloud costs
- 8. e2e folder – Cloud CI mgmt. https://github.com/nephio-project/test-infra/blob/main/e2e/terraform/modules/gcp/main.tf#L103
- 10. e2e folder – Sandbox provision (1/3) https://github.com/nephio-project/test-infra/blob/main/e2e/provision/install_sandbox.sh
- 12. e2e folder – Sandbox provision (2/3) Provides two main Ansible roles: 1. bootstrap – Validate host requirements, loads kernel modules, creates a KinD management cluster, installs gitea, resource-backend, cluster- api, cert-manager and metalLB packages in parallel. 2. install – Provides a local or remote installation of the Nephio components in parallel. Integration testing kpt ansible module
- 14. e2e folder – Sandbox provision (3/3) https://github.com/nephio-project/test-infra/blob/main/e2e/e2e.sh Test cases resources
- 16. Checkpoint/Restore KinD containers Provide Nephio management checkpoints for fasters startups https://criu.org $ docker checkpoint create kind-nephio 20240105 https://packages.ubuntu.com/jammy/criu https://packages.fedoraproject.org/pkgs/criu/criu/ Pros Cons Avoid cold starts Experimental feature Ubuntu 22.04+ and Fedora38+ packages Reutilization of code
- 17. Extract Ansible Roles The following Ansible role needs their own repository: • https://github.com/nephio-project/test-infra/tree/main/e2e/provision/playbooks/roles/bootstrap • https://github.com/nephio-project/test-infra/tree/main/e2e/provision/playbooks/roles/install • https://github.com/nephio-project/test-infra/tree/main/e2e/provision/playbooks/roles/kpt • https://github.com/nephio-project/test-infra/tree/main/e2e/provision/playbooks/roles/upgrade Pros Cons Major visibility kpt Ansible module dependency Faster development cycles Complex troubleshooting Reutilization of code
- 18. Implement KUTTL Framework (1/2) Replace the bash scripts for the KUbernetes Test TooL (https://kuttl.dev/) framework for validation of Test Cases (Free5Gc & OAI) • https://github.com/nephio-project/test-infra/tree/main/e2e/tests/free5gc • https://github.com/nephio-project/test-infra/tree/main/e2e/tests/oai Pros Cons KRM testing approach Learning curve Easy to declare the expected state KREW plugin requirement Reduce instructions and complexity https://github.com/nephio- project/nephio/issues/593
- 19. Implement KUTTL Framework (2/2) https://github.com/electrocucaracha/nephio- pocs/commit/7a26a9a712d4e4049921c7ae5b9aee9175017c7d
- 20. Use Doc detective tool Docs as Tests (https://www.docsastests.com/) seems to offer a new approach to keep documentation synchronized with the changes on the project. The Doc Detective (https://doc-detective.com/) tool may provide a simple and easy solution to be implemented. Pros Cons Easy way to keep docs and tests in sync Learning curve Non-intrusive tool Requires further investigation (requirements and License)
- 21. Replace MetalLB for KinD cloud provider Kubernetes Cloud Provider for KIND (https://sigs.k8s.io/cloud-provider-kind ) mimics the functionality offered by CSPs. This project could benefit the Nephio Sandbox. Pros Cons Reduces components on the Nephio management cluster Early stages of the tool Simulates a more realistic scenario Dynamic IP allocation configured on Docker default_address_pools https://github.com/electrocucaracha/nephio-pocs/commit/7643a4faaeb1c7b0db77440e7f4519fe9115e320
- 22. Use Ephemeral Docker image registry We can use a Ephemeral Docker image registry in the CI (http://ttl.sh/ ) to replicate CI environments locally Pros Cons Sharing temporal Docker images External service (increase network traffic or delays) Delegates the responsibility to manage temporal build images Additional dependencies
- 23. More ideas?