Dates:
Thursday July 4th, 2024 13:13 - 14:06 UTC
An incident occurred due to I/O errors on the database node, causing connectivity issues within our infrastructure. This affected Virtual jobs and Tunnel services in the US-West region, leading to disruptions in Sauce Labs products.
Why it happened:
Our job orchestration service failed to connect to a backend data store.
How we fixed it:
The data store issues were resolved, restoring connectivity.
We’re undertaking several initiatives including process improvements and enhanced monitoring, outlining steps to fix the issue and prevent it from happening again,