On-call integrations

Grafana alerting

Send Grafana alert rules to an escalation policy with a webhook contact point.

Start with a test incident API key. Test incidents never call an email, SMS, voice or chat provider.

Create the contact point

  1. Create an incident API key with incidents:ingest and incidents:write.
  2. In Grafana, add a contact point of type Webhook, method POST, with this URL. Copy your own from the on-call configuration page; the last UUID identifies this Grafana instance, so generate it once and keep it.
  3. Under optional settings, set the authorization header scheme to Bearer with the key as its credentials, and keep resolved notifications enabled.
  4. Group so each notification carries at most twenty alerts, then use Test on the contact point with the test key.
https://api.transmit.dev/v1/integrations/grafana/00000000-0000-4000-8000-000000000001/00000000-0000-4000-8000-000000000002/00000000-0000-4000-8000-000000000003

How alerts map

Each Grafana alert is identified by its fingerprint. The title comes from the summary annotation, then the rule name. A severity label of critical, medium, low or info sets severity; anything else is high. Firing opens or joins an incident; resolved closes it and cancels pending escalation. Ordering, retries and late recoveries behave exactly as in the Alertmanager integration.