Commit graph

16 commits

Author SHA1 Message Date
June 4cac84e7ec
prometheus: have different disk alerts for physical and virtual hosts
Have more relaxed read/write alerts for physical hosts as they are
probably hypervisors and regular high read/writes are more common.
Also differentiate between physical and virtual hosts for IO alerts and
allow for hard disks to spend more time in IO.
2024-10-05 17:22:45 +02:00
June f721dd9fea
prometheus: make opnsense-ccchh job not fail half the time
The scrape seems to take around a second to complete and with the
configured timeout of 1s that failed half the time. Therefore use the
default, more relaxed scrape interval and timeout and have it be
reliable.
2024-10-05 17:22:45 +02:00
June 0a05cad0a1
prometheus & alertmanager: add self-alerting
Add self-alerting for Prometheus and Alertmanager using rules from
https://samber.github.io/awesome-prometheus-alerts/rules
2024-10-02 04:13:37 +02:00
June 2e29b78f6a
prometheus: move Jitsis node exporter target to hosts job 2024-10-02 03:45:56 +02:00
June 30876f821c
prometheus, alertmanager: use Prometheus alerts with Alertmanager
For now introduce node-exporter/hosts alert rules, which got taken from
https://samber.github.io/awesome-prometheus-alerts/rules
However with the labels removed from the description, since they don't
render correctly (at least in Telegram) and don't seem to provide much
value, as we render the labels in the notification anyway.

Also only have Telegram as the notification channel for now, as it was
the easiest to set up.
2024-10-02 03:36:30 +02:00
June 803b19de0a
prometheus: add job for node exporter (for the NixOS VMs for now) 2024-10-01 20:09:42 +02:00
June 29d2d2926f
prometheus: don't duplicate scrape interval and timeout 2024-10-01 01:59:33 +02:00
Stefan Bethke 0f732833de Grafana-Config für PVE dazu 2024-02-26 22:29:02 +01:00
Stefan Bethke e2a0b9e74c grafana: add chaosknoten 2024-01-30 23:23:13 +01:00
Stefan Bethke 2431b455c2 Use prometheus-jitsi-meet-exporter 2024-01-29 21:13:22 +01:00
Stefan Bethke 3184154f7b Add jitsi video bridge stats 2024-01-29 20:31:12 +01:00
Stefan Bethke e0ebe2c720 Add jitsi as target 2024-01-28 07:52:46 +01:00
Stefan Bethke 79ac891c30 Add metrics for club OPNsense 2024-01-26 19:28:09 +01:00
Stefan Bethke 0307ad6c9f proxy access to metrics through nginx 2024-01-24 19:36:21 +01:00
Stefan Bethke a68edb81c4 Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00
Stefan Bethke 5fcbe5cfab Add grafana 2023-12-19 18:37:24 +01:00