You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Why this is needed:
In MetalK8s UI, we need to display the monitoring pipeline status.
For this, we check the Watchdog alert, but this alert is only fired once every 12h, meaning we can end up with a broken monitoring for few hours before noticing it.
What should be done:
We should reduce the interval between sending 2 Watchdog alerts.
Implementation proposal (strongly recommended):
In salt/metalk8s/addons/prometheus-operator/config/alertmanager.yaml, we must create a new route to handle only the Watchdog alert and lower the repeat interval to something like 1m, e.g:
Component: salt, monitoring
Why this is needed:
In MetalK8s UI, we need to display the monitoring pipeline status.
For this, we check the Watchdog alert, but this alert is only fired once every 12h, meaning we can end up with a broken monitoring for few hours before noticing it.
What should be done:
We should reduce the interval between sending 2 Watchdog alerts.
Implementation proposal (strongly recommended):
In
salt/metalk8s/addons/prometheus-operator/config/alertmanager.yaml
, we must create a new route to handle only the Watchdog alert and lower the repeat interval to something like1m
, e.g:Bonus, we could also lower the global repeat interval as the actual value is a bit high:
Test plan:
The text was updated successfully, but these errors were encountered: