Maintenance Windows for Sauce Labs
We are currently performing maintenance that will affect the initiation of new Sauce Connect tunnel instances. The maintenance is expected to be completed by 2:00 PM PST. We appreciate your understanding and patience as we work to enhance our service.
2024-April-17 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Monday April 17th 2024, 15:50 - 16:55 UTC
What happened:
Automated and live tests for virtual and real device clouds in the US West region failed.
Why it happened:
An invalid configuration was deployed that prevented connections from being accepted. Additionally, following the change being reverted, an internal component was unable to appropriately handle the sudden surge in traffic.
How we fixed it:
We rolled back the configuration to the previous version and restarted an internal service.
What we are doing to prevent it from happening again:
We are evaluating strategies for more rapidly scaling the affected internal service.
Resolved
After taking remedial action, all services are operating as normal. This incident is resolved.
Update
We are continuing to investigate this issue.
Update
We are continuing to investigate this issue.
Investigating
We are aware of reports of intermittent errors when attempting to start automated and live tests in our US-West-1 data center. We are investigating.
This incident affected: Automated Browser Testing (US-West), Automated Virtual Mobile Device Testing (US-West), Automated Real Device Testing (US-West), Live Browser Testing (US-West), Live Virtual Mobile Device Testing (US-West), Live Real Device Testing (US-West), and Native Framework Mobile App Testing (US-West).