ansible-infra/playbooks/files/chaosknoten/configs/grafana/docker_compose/prometheus.yml

global:
  scrape_interval: 15s
  scrape_timeout: 10s
  evaluation_interval: 15s

alerting:
  alertmanagers:
  - scheme: http
    timeout: 10s
    static_configs:
    - targets:
      - "alertmanager:9093"

rule_files:
  - "/etc/prometheus/rules/*.rules.yaml"

scrape_configs:
- job_name: prometheus
  honor_timestamps: true
  metrics_path: /metrics
  scheme: http
  static_configs:
  - targets:
    - localhost:9090
- job_name: alertmanager
  honor_timestamps: true
  metrics_path: /metrics
  scheme: http
  static_configs:
  - targets:
    - alertmanager:9093
- job_name: c3lingo
  honor_timestamps: true
  scrape_interval: 5s
  scrape_timeout: 1s
  metrics_path: /mumblestats/metrics
  scheme: https
  static_configs:
  - targets:
    - mumble.c3lingo.org:443
- job_name: mumble
  honor_timestamps: true
  scrape_interval: 5s
  scrape_timeout: 1s
  metrics_path: /metrics
  scheme: https
  static_configs:
  - targets:
    - mumble.hamburg.ccc.de:443
- job_name: opnsense-ccchh
  honor_timestamps: true
  metrics_path: /metrics
  scheme: http
  static_configs:
  - targets:
    - 185.161.129.132:9100
- job_name: jitsi
  honor_timestamps: true
  scrape_interval: 5s
  scrape_timeout: 1s
  metrics_path: /metrics
  scheme: http
  static_configs:
  - targets:
    - jitsi.hamburg.ccc.de:9888 # Jitsi Video Bridge
- job_name: 'pve'
  static_configs:
    - targets:
      - 212.12.48.126  # chaosknoten
  metrics_path: /pve
  params:
    module: [default]
    cluster: ['1']
    node: ['1']
  relabel_configs:
    - source_labels: [__address__]
      target_label: __param_target
    - source_labels: [__param_target]
      target_label: instance
    - target_label: __address__
      replacement: pve-exporter:9221
- job_name: hosts
  static_configs:
    # Wieske Chaosknoten VMs
    - labels:
        site: wieske
        type: virtual_machine
        hypervisor: chaosknoten
      targets:
        - netbox-intern.hamburg.ccc.de:9100
        - matrix-intern.hamburg.ccc.de:9100
        - public-web-static-intern.hamburg.ccc.de:9100
        - git-intern.hamburg.ccc.de:9100
        - forgejo-actions-runner-intern.hamburg.ccc.de:9100
        - eh22-wiki-intern.hamburg.ccc.de:9100
        - nix-box-june-intern.hamburg.ccc.de:9100
        - mjolnir-intern.hamburg.ccc.de:9100
        - woodpecker-intern.hamburg.ccc.de:9100
        - penpot-intern.hamburg.ccc.de:9100
        - jitsi.hamburg.ccc.de:9100
        - onlyoffice-intern.hamburg.ccc.de:9100
        - ccchoir-intern.hamburg.ccc.de:9100
        - tickets-intern.hamburg.ccc.de:9100
        - keycloak-intern.hamburg.ccc.de:9100
        - onlyoffice-intern.hamburg.ccc.de:9100
        - pad-intern.hamburg.ccc.de:9100
        - wiki-intern.hamburg.ccc.de:9100
        - zammad-intern.hamburg.ccc.de:9100
    - labels:
        site: wieske
        type: physical_machine
      targets:
        - chaosknoten.hamburg.ccc.de:9100
Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00			`global:`
			`scrape_interval: 15s`
			`scrape_timeout: 10s`
			`evaluation_interval: 15s`
prometheus, alertmanager: use Prometheus alerts with Alertmanager For now introduce node-exporter/hosts alert rules, which got taken from https://samber.github.io/awesome-prometheus-alerts/rules However with the labels removed from the description, since they don't render correctly (at least in Telegram) and don't seem to provide much value, as we render the labels in the notification anyway. Also only have Telegram as the notification channel for now, as it was the easiest to set up. 2024-10-02 03:36:30 +02:00
Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00			`alerting:`
			`alertmanagers:`
prometheus, alertmanager: use Prometheus alerts with Alertmanager For now introduce node-exporter/hosts alert rules, which got taken from https://samber.github.io/awesome-prometheus-alerts/rules However with the labels removed from the description, since they don't render correctly (at least in Telegram) and don't seem to provide much value, as we render the labels in the notification anyway. Also only have Telegram as the notification channel for now, as it was the easiest to set up. 2024-10-02 03:36:30 +02:00			`- scheme: http`
Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00			`timeout: 10s`
prometheus, alertmanager: use Prometheus alerts with Alertmanager For now introduce node-exporter/hosts alert rules, which got taken from https://samber.github.io/awesome-prometheus-alerts/rules However with the labels removed from the description, since they don't render correctly (at least in Telegram) and don't seem to provide much value, as we render the labels in the notification anyway. Also only have Telegram as the notification channel for now, as it was the easiest to set up. 2024-10-02 03:36:30 +02:00			`static_configs:`
			`- targets:`
			`- "alertmanager:9093"`

			`rule_files:`
			`- "/etc/prometheus/rules/*.rules.yaml"`

Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00			`scrape_configs:`
			`- job_name: prometheus`
			`honor_timestamps: true`
			`metrics_path: /metrics`
			`scheme: http`
			`static_configs:`
			`- targets:`
			`- localhost:9090`
prometheus & alertmanager: add self-alerting Add self-alerting for Prometheus and Alertmanager using rules from https://samber.github.io/awesome-prometheus-alerts/rules 2024-10-02 04:13:37 +02:00			`- job_name: alertmanager`
			`honor_timestamps: true`
			`metrics_path: /metrics`
			`scheme: http`
			`static_configs:`
			`- targets:`
			`- alertmanager:9093`
Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00			`- job_name: c3lingo`
			`honor_timestamps: true`
			`scrape_interval: 5s`
			`scrape_timeout: 1s`
			`metrics_path: /mumblestats/metrics`
			`scheme: https`
			`static_configs:`
			`- targets:`
			`- mumble.c3lingo.org:443`
			`- job_name: mumble`
			`honor_timestamps: true`
			`scrape_interval: 5s`
			`scrape_timeout: 1s`
proxy access to metrics through nginx 2024-01-24 19:36:21 +01:00			`metrics_path: /metrics`
			`scheme: https`
Add Grafana/Prometheus config 2024-01-24 19:12:43 +01:00			`static_configs:`
			`- targets:`
proxy access to metrics through nginx 2024-01-24 19:36:21 +01:00			`- mumble.hamburg.ccc.de:443`
Add metrics for club OPNsense 2024-01-26 19:28:09 +01:00			`- job_name: opnsense-ccchh`
			`honor_timestamps: true`
			`metrics_path: /metrics`
			`scheme: http`
			`static_configs:`
			`- targets:`
			`- 185.161.129.132:9100`
Add jitsi as target 2024-01-28 07:52:42 +01:00			`- job_name: jitsi`
			`honor_timestamps: true`
			`scrape_interval: 5s`
			`scrape_timeout: 1s`
			`metrics_path: /metrics`
			`scheme: http`
			`static_configs:`
			`- targets:`
Use prometheus-jitsi-meet-exporter 2024-01-29 21:13:22 +01:00			`- jitsi.hamburg.ccc.de:9888 # Jitsi Video Bridge`
Grafana-Config für PVE dazu 2024-02-26 22:29:02 +01:00			`- job_name: 'pve'`
			`static_configs:`
			`- targets:`
			`- 212.12.48.126 # chaosknoten`
			`metrics_path: /pve`
			`params:`
			`module: [default]`
			`cluster: ['1']`
			`node: ['1']`
			`relabel_configs:`
			`- source_labels: [__address__]`
			`target_label: __param_target`
			`- source_labels: [__param_target]`
			`target_label: instance`
			`- target_label: __address__`
			`replacement: pve-exporter:9221`
prometheus: add job for node exporter (for the NixOS VMs for now) 2024-10-01 20:09:42 +02:00			`- job_name: hosts`
			`static_configs:`
prometheus & alertmanager: add self-alerting Add self-alerting for Prometheus and Alertmanager using rules from https://samber.github.io/awesome-prometheus-alerts/rules 2024-10-02 04:13:37 +02:00			`# Wieske Chaosknoten VMs`
prometheus: add job for node exporter (for the NixOS VMs for now) 2024-10-01 20:09:42 +02:00			`- labels:`
			`site: wieske`
			`type: virtual_machine`
			`hypervisor: chaosknoten`
			`targets:`
			`- netbox-intern.hamburg.ccc.de:9100`
			`- matrix-intern.hamburg.ccc.de:9100`
			`- public-web-static-intern.hamburg.ccc.de:9100`
			`- git-intern.hamburg.ccc.de:9100`
			`- forgejo-actions-runner-intern.hamburg.ccc.de:9100`
			`- eh22-wiki-intern.hamburg.ccc.de:9100`
			`- nix-box-june-intern.hamburg.ccc.de:9100`
			`- mjolnir-intern.hamburg.ccc.de:9100`
			`- woodpecker-intern.hamburg.ccc.de:9100`
			`- penpot-intern.hamburg.ccc.de:9100`
prometheus: move Jitsis node exporter target to hosts job 2024-10-02 03:45:56 +02:00			`- jitsi.hamburg.ccc.de:9100`
Add prometheus-node-exporter role and add it to most hosts 2024-11-03 21:23:27 +01:00			`- onlyoffice-intern.hamburg.ccc.de:9100`
			`- ccchoir-intern.hamburg.ccc.de:9100`
			`- tickets-intern.hamburg.ccc.de:9100`
			`- keycloak-intern.hamburg.ccc.de:9100`
			`- onlyoffice-intern.hamburg.ccc.de:9100`
			`- pad-intern.hamburg.ccc.de:9100`
			`- wiki-intern.hamburg.ccc.de:9100`
			`- zammad-intern.hamburg.ccc.de:9100`
prometheus & alertmanager: add self-alerting Add self-alerting for Prometheus and Alertmanager using rules from https://samber.github.io/awesome-prometheus-alerts/rules 2024-10-02 04:13:37 +02:00			`- labels:`
			`site: wieske`
			`type: physical_machine`
			`targets:`
Add prometheus-node-exporter role and add it to most hosts 2024-11-03 21:23:27 +01:00			`- chaosknoten.hamburg.ccc.de:9100`