Skip to content

Adjust ownership of alerts related to the observability-stack and add alert for Prometheus restarting #14195

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Oct 27, 2022

Conversation

ArthurSens
Copy link
Contributor

Description

This PR does 2 things:

  • Move alerts for the observability stack to a folder owned by @gitpod-io/engineering-delivery-operations-experience
  • Add one alert that notifies #team-delivery-operations-experience-alerts in slack when Prometheus restarts

@liam-j-bennett, I'm curious about what do you think about this new alert since I'm also unsure about it 😬.

This won't give us any false-positive, but will only trigger after a problem occurs. It's a reactive approach. Do we want something that is more proactive? I'm not sure about how we'd avoid false positives here

Related Issue(s)

Fixes #

How to test

Release Notes

NONE

Documentation

Werft options:

  • /werft with-local-preview
    If enabled this will build install/preview
  • /werft with-preview
  • /werft with-large-vm
  • /werft with-integration-tests=all
    Valid options are all, workspace, webapp, ide

@roboquat roboquat merged commit 6e6c78e into main Oct 27, 2022
@roboquat roboquat deleted the as/prometheus-restarting-alert branch October 27, 2022 18:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants