Puzzle ITC - Interruption of Kubernetes Cluster – Incident details

Experiencing minor outage

Show current status

Interruption of Kubernetes Cluster

ResolvedMajor outage1 hour 4 minutes

Affected

Puzzle Services

Major outage from 1:08 PM to 2:13 PM

Puzzle SSO (Keycloak)

Major outage from 1:08 PM to 2:13 PM

Project Management

Major outage from 1:08 PM to 2:13 PM

CodiMD

Major outage from 1:08 PM to 2:13 PM

  • ResolvedUTC

    Stable again. Closing incident

  • MonitoringUTC

    The master node remains stable, we continue to monitor. All applications running on the k8s cluster are up and running

  • IdentifiedUTC

    One of the master nodes was not ready anymore. This resulted in short outage of the Kubernetes control plane. This then (for yet unknwon reason) also affected some of the applicactions. I'm currently investigating what exacly happened. I rebooted the vm and it seems stable again.

  • InvestigatingUTC

    Our Kubernetes Cluster has currently trouble which seems to affect some application. So far we see outages on SSO and Codi, possible more applications.

    investigation started