Maintenance Windows for Sauce Labs
Customers may experience intermittent errors during automated browser and virtual mobile device tests in our US-West-1 datacenter. We are closely monitoring and investigating the affected services.
2021-February-22 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Monday, February 22, 2021, 15:30 - 16:50 PST
What happened:
Customers were unable to start Mac desktop browser tests and iOS Simulator tests in the EU datacenter.
Why it happened:
The primary link to the Mac cloud went into a maintenance window and the connection was not successfully failed over to the secondary link.
How we fixed it:
The connection was manually failed over to the secondary link.
What are we doing to prevent it from happening again:
The fail-over configuration has been updated to catch additional scenarios which will lead to successful hand-off in future cases where the primary link becomes unusable.
Resolved
macOS and iOS tests are back to normal. All services fully operational.
Update
We have taken remedial action and see MacOS and iOS tests starting successfully. We are monitoring
Update
Tests are continuing to fail, your iOS simulator and desktop tests may not start. We are continuing to monitor and investigate.
Monitoring
We have taken remedial actions. We are monitoring but Mac iOS simulator and desktop tests should be fully operational.
Update
We are continuing to investigate this issue.
Investigating
The Mac cloud is experiencing errors, iOS simulator tests and Mac Desktop tests will not start. We are investigating and taking remedial action.
This incident affected: Automated Virtual Mobile Device Testing (EU-Central), Live Browser Testing (EU-Central), Live Virtual Mobile Device Testing (EU-Central), and Automated Browser Testing (EU-Central).