Koyeb - Services down due to multiple hypervisor failure – Incident details

Services down due to multiple hypervisor failure

ResolvedMajor outage1 hour 19 minutes

Affected

Europe

Major outage from 7:39 AM to 8:59 AM

Frankfurt - FRA

Major outage from 7:39 AM to 8:59 AM

  • ResolvedUTC

    This incident has been resolved.

  • MonitoringUTC

    We implemented a fix and are currently monitoring the result.

  • IdentifiedUTC

    We are continuing to work on a fix for this incident.

    Some services are still experiencing issues and are not re-scheduled yet.

  • InvestigatingUTC

    Multiple services services deployed in Frankfurt are unavailable due to a failure of the underlying hypervisors.

    Hypervisors failures happen and services should be automatically migrated - in this case they didn’t automatically recover.

    We are also seeing increase of 502 error due to some load balancer failure.

    Our engineering team is investigating.