Tuesday September 12th 2023, 16:03 - 16:29 UTC
Customers could not start tests in the EU-Central region and, after 15 minutes, in the US-West region.
Tests failed to start due to an issue with starting the virtual machines they run on. The service responsible for creating the virtual machines had a bug that introduced a cyclical dependency, which prevented it from starting correctly.
How we fixed it:
To restore normal operation, we performed the following:
We addressed the bug, tested it, and released the original intended change back in Production.