Sauce Labs Maintenance Windows for Sauce Labs
Customers may experience intermittent errors during automated browser and virtual mobile device tests in our US-West-1 datacenter. We are closely monitoring and investigating the affected services.
2023-Feb-14 Resolved Service Incident
Incident Report for Sauce Labs
Postmortem

Dates:

Tuesday February 14th 2023, 21:00 - 23:32 UTC

What happened:

Throughout the incident, several customers could not resolve ondemand.saucelabs.com, which caused any API calls to that URL for those impacted customers to fail.

Why it happened:

Adding a third DNS provider coincided with a few customers reporting that they could not resolve ondemand.saucelabs.com. The new DNS provider was removed out of caution; further investigation did not reveal a direct link from this change to the outage. 

How we fixed it:

No specific restorative action was taken. A DNS change made during the incident was reverted out of caution. 

What we are doing to prevent it from happening again:

In our first maintenance window of March, we successfully added the new DNS provider and have not seen any issues.

Posted Mar 21, 2023 - 12:37 UTC

Resolved
Between 20:45 - 22:15 UTC, a configuration change on our side resulted in name resolution issue reaching ondemand.us-west-1.saucelabs.com causing test startup failures. We have identified the issue and taken remedial action.
Posted Feb 15, 2023 - 00:04 UTC