Elevated Errors for our Support Chat Services

Incident
22 March 2024, 21:36 UTC

Elevated Errors for our Support Chat Services

Status: closed
Start: 22 March 2024, 19:24 UTC
End: 22 March 2024, 21:36 UTC
Duration: 2 hours 11 minutes
Affected Components:
Customer Services Support Ticketing System
Affected Groups:
All Public Users
Update

22 March 2024, 19:24 UTC

22 March 2024, 19:24 UTC

We are investigating an elevated error rate within our Slack-based support ticket response systems. Chat system commands to create new tickets work but updates from our Support team may be delayed or fail to return to the Slack support channel.

Our network availability and all other services are unaffected.

Identified

22 March 2024, 20:08 UTC

22 March 2024, 20:08 UTC

We have confirmed an issue with our chat service provided, and are monitoring their status page for mitigation efforts.

Subscribers can reference their status page at: https://status.ext.foqal.io/?start=20240322&end=20240322 

Monitoring

22 March 2024, 20:10 UTC

22 March 2024, 20:10 UTC

Our chat service provider has reported a gradual recovery for Support Chat services. We will continue to monitor their progress through their status page post, and will resolve this incident once they have reported full recovery.

All other services are unaffected by this incident.

Resolved

22 March 2024, 21:36 UTC

22 March 2024, 21:36 UTC

This event has been resolved.