Puzzle ITC - Notice history

Operational

OpenShift 4 Cluster cloudscale.ch - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

OpenShift 4 Cluster LPG1 cloudscale.ch - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026
Operational

Puzzle Website - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

PuzzleTime - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Puzzle SSO (Keycloak) - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

PuzzleSkills - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Harbor - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Grafana - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Puzzle News Site - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Zammad - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

CardDAV - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Argo CD - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Vault - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Loki - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

LDAP - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Puzzle Docs - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Odoo - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Netbox - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

PostgreSQL - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026
Operational

Network Office-Bern - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 99.72%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Network Office-Zürich - Operational

Google Meet Hardware - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Telephone Setup - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026
Operational

cloudscale.ch - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Amazon AWS - Operational

100% - uptime
Feb 2026 · 100.0%Mar · 100.0%Apr · 100.0%
Feb 2026
Mar 2026
Apr 2026

Notice history

Apr 2026

Update Openproject
Localized Meteorological Interference
  • Resolved
    Resolved

    We are pleased to announce that the Variable-Width Character Drifting incident has been fully resolved. All .md files have been successfully coaxed down from the ceiling of the server rack using a combination of Digital Paperweights and a strongly-worded comment in the codebase.

    ## Root Cause (Final)

    After extensive consultation with the Meteorological Office, it was confirmed that a rogue target="_blank" window left open over the long weekend had created a sustained indoor draft of approximately 4.2 on the Beaufort Scale. This caused a localized low-pressure zone in the CodiMD cluster, which — as any senior infrastructure engineer will tell you — is a classic Spring Syntax Migration Event.

    ## Resolution Steps Taken

    - All open target="_blank" windows have been closed. A company-wide policy on Responsible Window Management is being drafted (in CodiMD, naturally).

    - The Servicegedanken module has returned from the supply closet with a broom and is fully operational.

    - Digital Paperweights have been deployed cluster-wide and are performing admirably.

    - Markdown Pressure has been restored to nominal seasonal levels.

    ## User Impact

    Productivity has returned to its pre-incident baseline. This remains statistically indistinguishable from a standard Wednesday, but we consider that a success.

    ## Lessons Learned

    We have learned nothing. However, we *have* updated our runbook to include a section on Meteorological Incident Response, which we feel reflects our commitment to continuous improvement.

    ---

    *We apologize for any inconvenience caused. As always, if you experience any further atmospheric anomalies, please open a ticket — or a window, but not target="_blank".*

    🌬️ Stay grounded. Keep your Markdown pressure stable.

  • Investigating
    Investigating

    Summary

    At approximately 08:00 AM, our monitoring systems detected a significant drop in Markdown Pressure within the CodiMD cluster. It appears the application layer has been compromised by a localized high-pressure system, causing "Variable-Width Character Drifting."

    Current Observations

    • Packet Loss: Several .md files have been reported hovering near the ceiling of the server rack.

    • Infrastructure Impact: The "Servicegedanken" module is currently unresponsive. We suspect it may be looking for a broom or a windbreaker.

    • User Impact: Users may experience a total lack of productivity, though this is currently indistinguishable from a standard Wednesday morning.

    Root Cause Analysis (In Progress)

    Initial logs suggest that someone forgot to close the target="_blank" windows in the frontend code, allowing a draft to enter the database. Our DevOps team is currently attempting to deploy Digital Paperweights to secure the remaining notes.

    Next Steps

    1. Consulting with the local Meteorological Office for a patch.

    2. Waiting for the "Servicegedanken" to manifest in physical form.

    3. Monitoring the Beaufort scale for any increase in syntax errors.


Mar 2026

Performance Drop in Backlogs since OpenProject 17.2.2
  • Monitoring
    Monitoring

    OpenProject is actively working on a bug fix for the issue we’ve been experiencing. Progress has been made, and we can expect a patch in the near future.

    If you are experiencing performance issues with OpenProject due to large backlogs, we recommend using "Arbeitspakete" (Work Packages) view and disabling the option "Show versions folded" to mitigate the issue.

  • Identified
    Identified

    We have observed a significant drop in performance in the Backlogs module after updating to OpenProject 17.2.2.
    The following issues are particularly noticeable:

    1. Slow loading times:

      • Initial loading of backlogs takes considerably longer than in previous versions.

      • Opening individual features/stories within the backlog is delayed (2–3 seconds per interaction).

    2. Undesired GUI behavior:

      • Certain interactions (e.g., drag-and-drop sorting) exhibit unexpected delays or visual glitches, even though the backlog content itself remains unaffected.

    Context:

    • The issues emerged after the 17.2.0 update, which introduced the Primer Design System and Turbo/StimulusJS for dynamic updates in the Backlogs module.

    • The problems are reproducible with large backlogs and persist in 17.2.2.

    Workaround:

    • Disabling "Show versions folded" in user settings mitigates the drag-and-drop issue, but is not a sustainable solution due to usability concerns.

    We are currently investigating potential solutions and will keep you updated on our progress.

Feb 2026

Feb 2026 to Apr 2026

Next