Sauce Labs Maintenance Window
We are currently experiencing a slight reduction in available public and private iOS devices in the EU-Central Data Center. We expect to restore full availability for all iOS users in the EU-Central Data Center by tomorrow, Thursday, July 3, 2025, end of day

2021-March-20 Service Incident

Incident Report for Sauce Labs

Postmortem

Dates

Monday, March 22, 6:24am UTC - Monday, March 22nd, 2:32pm UTC

What happened:

Sauce Visual tests during this timeframe queued but did not run, making builds timeout and fail.

Why it happened:

The service in charge of managing jobs queues was hanging in a loop state after reaching an edge case introduced by a new feature.

How we fixed it:

The issue was remediated and an update was deployed.

What we are doing to prevent it from happening again:

We’re increasing system visibility and robustness by adding new alerts and health checks for the failing service.

Posted Apr 01, 2021 - 18:32 UTC

Resolved

This incident has been resolved.
Posted Mar 22, 2021 - 14:34 UTC

Monitoring

A fix has been implemented. Previously queued tests will have failed but new Visual tests are running correctly We are continuing to monitor the situation.
Posted Mar 22, 2021 - 14:20 UTC

Investigating

Visual tests are queued up and are currently not running. We are investigating.
Posted Mar 22, 2021 - 13:51 UTC
This incident affected: Visual Testing (Visual Testing Hub, Visual Testing Infrastructure, Visual Testing REST API).