Mezmo outage, 2 June 2022

Log lines not ingested

Started
Resolved
2 Jun 2022, 22:05 UTC (after 21 min)
Impact
Critical
Affected
Log Ingestion (Agent/REST API/Code Libraries), Log Ingestion (Heroku), Log Ingestion (Syslog)

Last update from Mezmo

**Dates:** Start Time: Thursday, June 2, 2022, at 20:25 UTC End Time: Thursday, June 2, 2022, at 20:50 UTC Duration: 00:25 **What happened:** The ingestion of logs was halted for about 25 minutes. During that time, newly submitted logs were never ingested and therefore not available for Alerting, Searching, Live Tail, Graphing, Timelines, and Archiving. **Why it happened:** We manually reverted our ingester service to an older version \(to solve a minor problem unrelated to this incident\). During the procedure, the version of the container was reverted, but not the container’s configuration. Because of this versioning mismatch, logs from the ingester stopped being accepte...

3 Jun 2022, 22:49 UTC

Read the full incident on the official Mezmo status page

Is Mezmo down now?

This page is the record of one past incident. For the live status, see Is Mezmo down right now? - it reads the official status page every 2 minutes.

Other Mezmo incidents

  1. Impact of AWS Issues

  2. Search performance issues

  3. Problems with Search

  4. Issue with Search

  5. Intermittent issues

  6. Log availability and search performance temporarily degraded

  7. Issues accessing logs in boards and screens

  8. Intermittent Pipeline Service Degradation

All recorded Mezmo incidents