Koyeb - Deployments failing for services using secrets with uppercase names – Incident details

All systems operational

Show current status

Deployments failing for services using secrets with uppercase names

ResolvedPartial outage 30%4 hours 42 minutes

Affected

API

Partial outage from 2:55 PM to 5:38 PM, Operational from 5:38 PM to 6:58 PM, Partial outage from 6:58 PM to 7:37 PM

Build / Provisioning

Partial outage from 2:55 PM to 5:38 PM, Operational from 5:38 PM to 6:58 PM, Partial outage from 6:58 PM to 7:37 PM

  • ResolvedUTC

    This incident has been resolved.

  • IdentifiedUTC

    We are continuing to work on a fix for this incident.

  • ResolvedUTC
    This incident has been resolved.
  • MonitoringUTC

    Between 15:55 and 17:19 UTC on November 11, some new deployments failed with the error

    "Secrets do not exist". This affected deployments that reference a secret whose name contains uppercase letters, even though the secret exists.

    We identified the cause as a recent change to how secret references are validated, and rolled it back at 17:19 UTC. New deployments are now working normally.

    Services that were already running were not interrupted. If one of your deployments failed with "Secrets do not exist" during this window, please redeploy the service. No changes to your secrets or configuration are needed.

  • InvestigatingUTC
    We implemented a fix and are currently monitoring the result.