Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a sysdig alert that monitors pod-restarts #2021

Open
dleard opened this issue Nov 3, 2021 · 1 comment
Open

Add a sysdig alert that monitors pod-restarts #2021

dleard opened this issue Nov 3, 2021 · 1 comment
Assignees

Comments

@dleard
Copy link
Contributor

dleard commented Nov 3, 2021

We should have an alert that monitors pod-restarts & sends an alert after a few pod restarts happen within a time threshold to alert us of a possible back-off restart loop.

@pbastia pbastia self-assigned this Nov 23, 2021
@pbastia
Copy link
Contributor

pbastia commented Nov 24, 2021

Experimented with alerts in the form of:

count by(kube_namespace_name, kube_pod_name)
(changes(kube_pod_status_ready{condition="true"}[30m])) >= 5

and tried to alert a pod that would crashloopbackoff by design (a container that runs exit 1 as a command).
This didn't work.

cc @dleard

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants