altermanager告警分组

Posted 2023-03-24 泉love水

promethues里面配置了很多项目监控，不同项目或者不同分组告警信息发送给不同接收人，可以通过配置altermanager来实现。

altermanager部分配置示例

route:
  receiver: \'default\' #默认分组，未匹配到都会发送到此分组
  group_wait: 10s
  group_interval: 1m
  repeat_interval: 1m
  group_by: [\'alertname\']
  routes:
  - receiver: \'op\' #标签service为java或者python的告警发送到op分组
    group_wait: 10s
    match_re:
      service: java|python
    #match:
    #   service: java

inhibit_rules:
- source_match:
    severity: \'critical\'
  target_match:
    severity: \'warning\'
  equal: [\'alertname\', \'instance\']

receivers:
- name: \'default\'
  webhook_configs:
  - url: \'http://127.0.0.1:8080/prometheus\'
    send_resolved: true

- name: \'op\'
  webhook_configs:
  - url: \'http://127.0.0.1:8081/prometheus\'
    send_resolved: true

prometheus数据采集配置例子

- targets:
    - 127.0.0.1:8080
  labels:
    group: test
    module: test
    service: java

这里的service:java就会被altermanager的op这个路由匹配到，当次主机有告警时就会发送到name为op对应的webhook地址