Maintenance Windows for Sauce Labs
Customers may experience intermittent errors during automated browser and virtual mobile device tests in our US-West-1 datacenter. We are closely monitoring and investigating the affected services.
2024-February-12 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Sunday February 11th 2024, 13:35 - Monday February 12th 2024, 09:00 UTC
What happened:
Over the course of the incident, iOS 17 device availability decreased until all devices were unavailable.
Why it happened:
A change in behavior in Xcode resulted in non-exiting child processes that eventually caused the app to become unresponsive.
How we fixed it:
Child processes were reaped across the service’s fleet.
What we are doing to prevent it from happening again:
We are working to improve the reliability of services involved in managing iOS 17 real devices.
Resolved
After taking remedial action, we are seeing iOS 17 Real devices are now available again. This incident is resolved.
Investigating
iOS 17 Real devices are currently unavailable in the US-West-1 and EU-Central-1 data centers. We are investigating.
This incident affected: Automated Real Device Testing (US-West, EU-Central), Live Real Device Testing (US-West, EU-Central), and Native Framework Mobile App Testing (US-West, EU-Central).