Assistance getting Slack Alerts setup

[nathanwong91]

Following along with the documentation and I've set all options that I want

    alerting: ["slack"] 
    alerting_threshold: 300 # sends alerts if requests hang for 5min+ and responses take 5min+
    alerting_args:
      outage_alert_ttl: 60
      region_outage_alert_ttl: 60
      minor_outage_alert_threshold: 5 
      major_outage_alert_threshold: 10
      max_outage_alert_list_size: 1000
      log_to_console: false

    alert_types: [
      "llm_exceptions",
      "llm_too_slow",
      "llm_requests_hanging",
      "outage_alerts",
      "region_outage_alerts",
      "daily_reports"
    ] 

And I've set the Slack webhook url which is visible from the UI

I've tested the slack webhook url directly and it comes up fine in my slack channel however when I tried to do so via litellm

curl -X GET 'https://URL/health/services?service=slack' \
-H "Authorization: Bearer sk-1234"

I get

{"status":"success","alert_types":["llm_exceptions","llm_too_slow","llm_requests_hanging","outage_alerts","region_outage_alerts","daily_reports"],"message":"Mock Slack Alert sent, verify Slack Alert Received on your channel"}%

But nothing comes up in the slack channel. Even the button from UI to test alerts show nothing in the channel.

Logs from the pod show

"GET /health/services?service=slack HTTP/1.1" 200 OK

Have I done something wrong here?

[nathanwong91]

I got it working by setting alert_to_webhook_url for each of the alert_types I've set. Feels a bit much though? Should be an optional thing config than a requirement, if its not set just use the default slack url...