US Cloud Network

Partial outage affecting subset of customers

Postmortem

Our data center provider in Silicon Valley has confirmed the root cause of the issue today was a core networking switch failed and all connectivity to a number of our servers was lost. We run redundant systems in the backend of simPRO to mitigate the risk of specific servers going offline, however the impact was so widespread within the data center that the majority of the redundant systems were also taken offline. Our cloud engineering team will plan to implement more redundancy where possible to prevent a similar outage occurring again in the future. We apologise for the inconvenience caused by the outage.

Resolved

All systems have returned to normal operation with no further impact expected.

We will continue to work with our data center provider to analyze the root cause of the issue. A further update will be posted here when more information is available.

Our cloud engineering team will work to mitigate the risk of a similar event in the future. We apologise for the inconvenience.

Investigating

Our cloud engineering team is aware of an issue impacting a subset of users. We are currently investigating the root cause and will work to resolve it as soon as possible. Further updates will be provided here as they become available.