All systems operational

Show current status

Resolved
Critical host failure in FRA

Started
September 05, 2023 at 4:33 PM
Status
Resolved after about 5 hours

Impact

Partial outage
Affected
Europe
  • Resolved
    Resolved

    This incident has been resolved.

  • Monitoring
    Monitoring

    We successfully recovered the impacted servers.

    Some workload are still being recovered automatically.

  • Identified
    Identified

    We identified the root cause of the issue, some of the physical servers are lost because of high load, it seems that some reschedule of the impacted workload triggered a cascaded failure on other nodes.

    We are actively trying to recover access to the impacted servers.

    Some workload are still impacted and will soon recover.
    New build and container start are also impacted.

  • Investigating
    Investigating

    We are seing a high increase of container restart and container boot failure in FRA.

    We are currently investigating this incident.