Some services are down
Resolved
Jun 21 at 02:49pm CEST
All services are running.
Two data nodes got stuck with bulk queue resolution. We had to redeploy the ElasticSearch cluster in AWS managed service manually.
Affected services
BranchIS UI
BranchIS Cron
Updated
Jun 21 at 02:04pm CEST
UI is accessible now. We are finalizing and starting a further investigation with AWS.
Scheduling will be enabled soon
Affected services
BranchIS UI
BranchIS Cron
Updated
Jun 21 at 01:36pm CEST
We are checking the cluster health before pushing to production again
Affected services
BranchIS UI
BranchIS API
BranchIS Cron
Updated
Jun 21 at 11:40am CEST
We are experiencing an incident
Our AWS OpenSearch cluster is stuck with a growing bulk queue. It is an Amazon-managed service, so we are waiting for AWS support for the solution.
We believe in fully operational status in an hour or less.
We appreciate your patience.
Affected services
BranchIS UI
BranchIS API
BranchIS Cron
Created
Jun 21 at 10:06am CEST
APUtime Cron went down.
Affected services
BranchIS Cron