This incident has been resolved.
We successfully recovered the impacted servers.
Some workload are still being recovered automatically.
We identified the root cause of the issue, some of the physical servers are lost because of high load, it seems that some reschedule of the impacted workload triggered a cascaded failure on other nodes.
We are actively trying to recover access to the impacted servers.
Some workload are still impacted and will soon recover.
New build and container start are also impacted.
We are seing a high increase of container restart and container boot failure in FRA.
We are currently investigating this incident.
No notices reported this month
This issue has been fixed by the Github team, see more detail here https://github.com/orgs/community/discussions/61291#discussioncomment-6501848
We implemented a fix and are currently monitoring the result.
We identified the issue and are working on a fix to mitigate it.
This issue seem to be triggered by an internal update at Github, we found this threads where we can see that other companies are impacted by this.
We are experiencing issues preventing users to install the GitHub app on Koyeb.
We are currently investigating the issue.
Build and runtime logs emitted between 8:00AM CET and 9:55 CET will not be recovered.
We're experience instabilities with build and runtime logs. We are currently looking into the issue.
Jul 2023 to Sep 2023