Partially Degraded Service
We are currently experiencing a slight reduction in available public and private iOS devices in the EU-Central Data Center. We expect to restore full availability for all iOS users in the EU-Central Data Center by tomorrow, Thursday, July 3, 2025, end of day
2021-Dec-01 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Friday December 1st 2021, 02:40 - 04:24 UTC
What happened:
Tests running on iOS simulators, Android emulators, and desktop browser/OSs in our US-West and EU-Central data centers experienced high wait times and errors.
Why it happened:
Unforeseen issues in our deployment flow caused the cloud capacity to become unavailable. Safeguards were not in place to prevent this from rolling out to both the EU and US.
How we fixed it:
Services were restarted to restore capacity. Some Mac/iOS tests were terminated to expedite recovery in the US-West data center.
What we are doing to prevent it from happening again:
We are introducing safeguards and adding additional checks in our services to increase resiliency while at the same time working with our cloud providers to improve traffic flows.
Resolved
iOS Simulators and MacOS Desktop tests have fully recovered in US Data Center. All services are fully operational.
Investigating
Our US and EU Regions experienced high wait times and errors between 02:40 - 03:10 UTC and have since recovered.
iOS Simulators and MacOS Desktop tests are still experiencing high wait times in US Data Center. During this time, tests may fail to start. We are taking remedial action.
iOS Simulators and MacOS Desktop tests are still experiencing high wait times in US Data Center. During this time, tests may fail to start. We are taking remedial action.
This incident affected: Automated Browser Testing (US-West), Automated Virtual Mobile Device Testing (US-West), Live Browser Testing (US-West), Live Virtual Mobile Device Testing (US-West), and Native Framework Mobile App Testing (US-West).