Sunday September 19th 2021, 15:42 - 16:35 UTC
Automated and Live Mac and iOS tests in our EU-Central-1 data center were failing to start.
We experienced a combination of router software failure caused by a third-party bug as well as with a failure to properly route traffic.
The issue was resolved by initiating a manual failover of traffic to the secondary circuit.
We are investigating potential options to avoid the failure to automatically failover traffic routing in the future. Additionally, we are removing a configuration from our edge routers to ensure we do not hit this particular software bug again.