cncf/k8s-conformance

Certified Kubernetes Conformance Program

Eligible vendors are invited to submit conformance testing results for review and certification by the CNCF. If your company provides software based on Kubernetes, we encourage you to get certified today. For more information please checkout cncf.io/ck.

Prepare

Learn about the certification requirements and technical instructions to prepare your product for certification.

Run the tests

The submission requires four files, two of which need to be generated from either of the following two applications.

Sonobuoy

For a number of years Sonobuoy has been used to generate both the e2e.log and junit_01.xml. Please follow the documentation provided in instructions.md.

Hydrophone

A lightweight runner for kubernetes tests. Uses the conformance image(s) released by the kubernetes release team to either run individual tests or the entire Conformance suite. Check out the project README to learn more.

PR Submit

Please check the instructions for details about how to prepare your PR. Also, note that any submission made to this repo will need to first pass a number of checks that are verified by the verify conformance bot before its reviewed by the CNCF.

Relocating Historical Conformance Files

In our ongoing effort to optimize the k8s-conformance repository size and enhance the user experience, we have relocated older conformance files to the archive repository. This ensures smoother navigation and access to current content. Details about how this was done can be found in the CNCF blog post, Scaling down a Git repo. A tidy up of cncf/k8s-conformance.

Helpful Resources

kubernetes/community: sig-architecture

Reviewing, approving, and driving changes to the conformance test suite; reviewing, guiding, and creating new conformance profiles.

• Conformance Tests
• Conformance Testing in Kubernetes

Conformance Tests per Release

To help the Kubernetes community understand the range of tests required for a release to be conformant. Each KubeConformance release document contains a list of conformance tests required for that release of Kubernetes. Refer to SIG-Architecture: Conformance Testing in Kubernetes for details around the testing requirements.

Verify conformance bot

The bot checks several scenarios and updates the PR with the results. This automation provides timely feedback and reduces the time required by the CNCF to confirm that the PR meets all policy requirements.

APIsnoop

APISnoop tracks the testing and conformance coverage of Kubernetes by analyzing the audit logs created by e2e test runs.