Maintenance Windows for Sauce Labs
Customers may experience intermittent errors during automated browser and virtual mobile device tests in our US-West-1 datacenter. We are closely monitoring and investigating the affected services.
2021-May-18 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Tuesday May 18 2021, 12:21 - 16:29 UTC
What happened:
Users were unable to create new accounts in our US-West-1 data center.
Why it happened:
One of our database nodes became overloaded due to a prior data migration. Some services were not able to connect to the database due to timeouts.
How we fixed it:
We performed a failover to another healthy database node.
What we are doing to prevent it from happening again:
We are improving observability & monitoring of critical paths in our system like user registration so that we can react more quickly.
Resolved
We have taken remedial action and accounts are now created successfully. All services are fully operational.
Investigating
We have received reports of not being able to create accounts on sign up and for existing organizations on our us-west-1 datacenter. We are investigating.
This incident affected: Sauce Labs Dashboard (US-West).