Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[e2e] fix flake tests with image validation API errors #7989

Open
wants to merge 6 commits into
base: dev
Choose a base branch
from

Conversation

demonCoder95
Copy link
Member

@demonCoder95 demonCoder95 commented Aug 26, 2024

E2e tests often fail because the image validation API return 502 return status, which causes the image admission to fail and the test fails.

Reason:FailedCreate Message:admission webhook \"pod-admitter.teapot.zalan.do\" denied the request: image check for registry.opensource.zalan.do/teapot/skipper:v0.14.0 failed: unexpected HTTP response status: 502 Bad Gateway

Looking at docker-meta logs we see the base image has expired

INFO:meta.opa:'registry.opensource.zalan.do/teapot/skipper:v0.17.2' base image is not allowed (['base image registry.opensource.zalan.do/library/alpine-3:3-20230731 is expired.']). OPA Input:

This PR updates the compliant images so that the check doesn't fail.

@demonCoder95 demonCoder95 added bugfix Bug fixes and patches, e.g. fixing of a production issue that is affecting the customer experience. do-not-merge labels Aug 26, 2024
@demonCoder95
Copy link
Member Author

demonCoder95 commented Aug 27, 2024

Adding the compliance namespace to the softfail list for the admission-controller doesn't seem to fix the issue for now, will investigate further.

Update: Decided to update image references, let's see if it resolves the issue.

@MustafaSaber
Copy link
Member

👍

compliantImage5 = "container-registry.zalando.net/teapot/skipper:v0.21.4"
compliantImage6 = "container-registry.zalando.net/teapot/skipper:v0.21.5"
compliantImage7 = "container-registry.zalando.net/teapot/skipper:v0.21.6"
compliantImage8 = "container-registry.zalando.net/teapot/skipper:v0.21.7"
Copy link
Member

@linki linki Aug 30, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These must be real images (i.e. the tag must exist and the image must be considered compliant or non-compliant (see images below) by docker-meta). The reason why there's so many test images is to ensure that the tests using them aren't affected by any caching because that can lead to wrong results.

Meaning we need 8 compliant and 10 non-compliant test images for the test cases or refactor the test cases.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can look into this today, thanks for the review 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix Bug fixes and patches, e.g. fixing of a production issue that is affecting the customer experience. do-not-merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants