Historical Stats Elevated Errors

Incident

13 November 2023, 07:06 UTC

Status: closed

Start: 13 November 2023, 03:23 UTC

End: 13 November 2023, 07:06 UTC

Duration: 3 hours 43 minutes

Affected Components:

Observability Historical Stats

Affected Groups:

All Public Users

Investigating

13 November 2023, 03:23 UTC

We're investigating elevated errors in Historical Stats.

All other locations and services are unaffected

Investigating

13 November 2023, 04:23 UTC

We're still investigating elevated errors in Historical Stats.

During this time, customers may experience 5xx errors when accessing the Historical Stats endpoint.

All other locations and services are unaffected

Identified

13 November 2023, 06:36 UTC

This issue has been identified and a fix is being implemented.

Monitoring

13 November 2023, 06:49 UTC

A fix has been implemented and we are monitoring the results.

We've observed a significant decrease in 5xx errors, but are currently monitoring for logs that may have failed to deliver during this incident.

Resolved

13 November 2023, 07:06 UTC

This incident has been resolved and no further impacts have been observed.