Harness outage, 29 September 2026

Prod2: CV is failing with errors for all customers

Started
Resolved
29 Sept 2026, 18:49 UTC (after 4 h 8 min)
Impact
Minor
Affected
Continuous Delivery - Next Generation (CDNG)

Last update from Harness

**Summary** Customers on Prod-2 experienced elevated failure rates in Continuous Verification pipelines. Verification jobs failed to complete or reported errors because CV data-collection workers could not communicate with the platform service that coordinates their work. This was caused by an unexpected traffic spike to one of our backend systems.  Service was restored by scaling out the affected platform component. No data loss or corruption occurred. ‌ **Customer Impact** Customers using Continuous Verification on Prod-2 saw verification pipeline jobs fail or time out during the incident window. A significant fraction of verification job instances that ran during this period ended in...

2 Oct 2026, 05:37 UTC

Read the full incident on the official Harness status page

Is Harness down now?

This page is the record of one past incident. For the live status, see Is Harness down right now? - it reads the official status page every 2 minutes.

Other Harness incidents

  1. Degraded performance in UI execution graph in prod3

  2. Degraded performance in UI execution graph in prod3

  3. Prod1: Intermittent issue with IACM stages in some pipelines

  4. Harness CI Cloud build issues when accessing Maven Central

  5. Prod1: IACM Stages are failing and pipelines are intermittently failing to start.

  6. Prod2 Pipelines with verify step failing intermittently

  7. Single Customer: IaCM pipeline executions failing intermittently in Prod 1

  8. Hosted MCP Logins W/ SSO Failing

All recorded Harness incidents