Mezmo outage, 6 February 2023

Intermittent delays loading Web UI and running searches

Started
Resolved
7 Feb 2023, 02:07 UTC (after 5 h 18 min)
Impact
Major
Affected
Web App, Search, Livetail

Last update from Mezmo

**Dates:** Start Time: Monday, February 6, 2023, at 20:05 UTC End Time: Tuesday, February 7, 2023, at 00:30 UTC Duration: 4 hours and 25 minutes **What happened:** Searches returned results slowly or not at all. Our Web UI was intermittently unresponsive, particularly for pages like Live Tail, Graphing, and Timelines. No data was lost and ingestion was not halted. **Why it happened:** We initiated an upgrade of all nodes in our service, including the nodes that store logs. Pods were gradually moved to other nodes and restarted, so as to prevent any interruption in service. A single pod that stores logs did not restart normally. Upon investigation, we found that it had...

7 Feb 2023, 23:44 UTC

Read the full incident on the official Mezmo status page

Is Mezmo down now?

This page is the record of one past incident. For the live status, see Is Mezmo down right now? - it reads the official status page every 2 minutes.

Other Mezmo incidents

  1. Impact of AWS Issues

  2. Search performance issues

  3. Problems with Search

  4. Issue with Search

  5. Intermittent issues

  6. Log availability and search performance temporarily degraded

  7. Issues accessing logs in boards and screens

  8. Intermittent Pipeline Service Degradation

All recorded Mezmo incidents