Maintenance Windows for Sauce Labs
We are currently performing maintenance that will affect the initiation of new Sauce Connect tunnel instances. The maintenance is expected to be completed by 2:00 PM PST. We appreciate your understanding and patience as we work to enhance our service.
2024-June-7 Service Incident
Incident
Report for Sauce Labs
Postmortem
Dates:
Friday June 7 2024, 12:16 - 13:54 UTC
What happened:
SC4 tunnels were intermittently not starting in US-WEST.
Why it happened:
An unexpected, intermittent DNS resolution failure began occurring after upgrading a hypervisor on which the primary DNS server was running.
How we fixed it:
We repaired the primary DNS server and returned it back to service.
What we are doing to prevent it from happening again:
We’re evaluating an alternative DNS deployment.
Resolved
After taking remedial action, Sauce Connect 4 tunnels are starting successfully in our US-West data center. All services are fully operational.
Monitoring
We have fixed the root cause, and Sauce Connect 4 tunnels are starting successfully in our US-West data center. We are monitoring.
Identified
We have identified the root cause and are working on implementing a fix.
Investigating
Sauce Connect 4 tunnels are intermittently failing to start in our US-West data center. We are investigating.
This incident affected: Sauce Connect (US-West).