Build / Provisionning
North America
Europe
Asia–Pacific - APAC
Third Party: Docker → Registry
Feb 2024
Logs components is back online.Some logs might have been discarded during the outage (between 12:10 to 12:40 UTC).
Jan 2024
This incident has been resolved.
We implemented a fix and are currently monitoring the result.
We had to perform an unplanned maintenance (involving a restart) on some LB components.
Some services may have experience 502 errors during the maintenance.
The root cause has been identified.
We are continuing to work on a fix for this incident.
We noticed a delay when provisioning or re deploying services. We are currently investigating this incident.
Dec 2023
We believe we found the root cause of the issue, more investigation is required, it seems to be related to one of the load-balancing components misbehaving under a certain load.
There is currently an elevated rate of 502 errors when requesting some services, we are currently investigating the root cause of the issue.
The cluster is now back online and the builds should be able to restart.
We tried to re-route the builds to another region during the outage, but we were sadly not able.
We are still trying to understand the root cause of the issue. And we will try to understand why the re-routing of the build was not possible during the outage.
We have identified some provisioning delay for builds and deployments in the Frankfurt region.
Our engineering team is investigating.
Dec 2023 to Feb 2024