Monday October 23rd 2023, 10:21 - 15:12 UTC
For the duration of the incident, customers running Live Tests experienced issues with device interactions. Device interaction issues were experienced in all regions and device types for customers with browser resolutions set to anything other than 100%.
Customers could not interact with devices due to a bug in our Web UI that caused a scaling issue when displaying the canvas on a device. The scaling issue led to failures on the WebSocket that used to handle device interactions. The WebSocket failures ultimately led to the connection closing, leading to all device interactions no longer working.
We performed a rollback of our Web UI to the previously known working version.
After restoring service, we fixed the underlying bug that caused the scaling issues. We are also adding more thorough unit testing for this case.