Maintenance Windows for Sauce Labs
We are currently performing maintenance that will affect the initiation of new Sauce Connect tunnel instances. The maintenance is expected to be completed by 2:00 PM PST. We appreciate your understanding and patience as we work to enhance our service.
2025-January-8 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Wednesday 8 January 2025, 11:00 - 12:25 UTC
What happened:
We were experiencing intermittent issues with Virtual device tests missing test assets in the US-West-1 region
Why it happened:
The asset uploader service was experiencing Http errors uploading assets to our backend storage.
How we fixed it:
The 3rd-party provider resolved an issue with their infrastructure.
What we are doing to prevent it from happening again:
We are improving the caching and retry logic of the asset uploader service to prevent further occurrence.
Resolved
After taking remedial action, test assets are being retained successfully in all tests. This incident is resolved.
Update
We are currently seeing intermittent issues with test assets not being retained for Virtual device tests in our US-West-1 data center. We are investigating.
Update
We are continuing to investigate this issue.
Update
We are currently seeing Live and Automated test results are not being retained for Virtual Device tests intermittently in our US-West-1 data centers. We are investigating.
Investigating
We are currently seeing Live and automated test results are not being retained intermittently in our US-West-1 data centers. We are investigating.
This incident affected: Automated Browser Testing (US-West), Automated Virtual Mobile Device Testing (US-West), Automated Real Device Testing (US-West), Live Browser Testing (US-West), Live Virtual Mobile Device Testing (US-West), Live Real Device Testing (US-West), Insights (US-West), and Sauce Orchestrate (US-West).