Cluster 1

Slowness accessing Simpro for some customers in ANZ

Postmortem

A single database cluster encountered performance issues causing slow response times for users and brief outages.

The incident’s root cause was attributed to elevated load on the infrastructure, resulting from the execution of a background process related to database performance analysis within the AWS platform. The situation was addressed and resolved upon completion of the analysis. We do not have visibility of this analysis or ability to stop it while it is running.

To mitigate any chances of this occurring again, we are going to disable this analysis engine completely.

We apologise once again for any inconvenience caused today.

Resolved

Normal operations have been restored for the past hour with no anticipated further disruptions. We sincerely apologize for any inconvenience experienced today and will provide a post-incident analysis as soon as we can.

Updated

Investigations into the root cause of the slowness is continuing with AWS engineers. We apologise for the delay in getting this issue resolved.

Investigating

We are continuing to work with the AWS engineers on resolving the root cause and a fix will be implemented as soon as possible.

Updated

We are continuing to work on the underlying root cause of the slowness. We apologise for any inconvenience caused.

Investigating

Our engineering team is aware of some users in ANZ experiencing slowness when accessing Simpro at the moment. We are investigating with the highest urgency and will post further updates here as they become available.