Webhook notifications

Configure reusable destinations under Project settings → Notifications, then attach a rule to an individual check.

Destinations

EvalCanary supports two destination kinds:

• Slack incoming webhook
• Microsoft Teams webhook

Each destination has a name and an HTTPS webhook URL. Query parameters are allowed; credentials and fragments are not. The URL must resolve to a public network target. EvalCanary encrypts it at rest and does not reveal it after saving.

Rules

A check rule selects one destination and configures:

• failureThreshold: consecutive non-passing runs before the first failure delivery, from 1 to 10;
• maxFailureNotifications: maximum failure deliveries during the open incident, from 1 to 10; and
• notifyOnRecovery: whether to deliver one recovery after a notified incident returns to Pass.

Failed, Indeterminate, and Error are all problem outcomes. A passing run closes the incident. Recovery is delivered only when the incident had reached its failure threshold.

Delivery formats

Slack receives its native text payload. Teams receives an Adaptive Card with the check result and a View run action.

Return any 2xx status after accepting the event. EvalCanary retries network failures, HTTP 408, 425, 429, and 5xx responses, with up to three total sends. It honors a bounded Retry-After value. Other 4xx responses and redirects are permanent failures.

The run page shows the destination, current delivery state, HTTP status when available, and bounded error details.