Flagsmith outage, 4 July 2024

Core API Outage

Started
Resolved
4 Jul 2024, 08:36 UTC
Impact
Not stated

Last update from Flagsmith

Our Core API was overwhelmed by massive traffic spike, causing the core SQL database to become extremely slow. This led to ECS tasks failing the health checks, prompting the load balancer to start and stop new tasks, which in turn added more load to the already maxed-out database. We tried several approaches to rate limiting the source of the traffic, but eventually had to temporarily stop traffic at the load balancer for 2 minutes in order to stabilise the system. We are working on implementing AWS API Gateway to include rate limiting at the gateway level to avoid these sort of incidents in the future.

4 Jul 2024, 08:36 UTC

Read the full incident on the official Flagsmith status page

Is Flagsmith down now?

This page is the record of one past incident. For the live status, see Is Flagsmith down right now? - it reads the official status page every 2 minutes.

Other Flagsmith incidents

  1. Delays processing flag changes

  2. Numeric values incorrectly being converted to numbers in environment documents

  3. Data parsing issues in Edge API

  4. Task processor down

  5. Delayed asynchronous task processing

  6. Flagsmith dashboard not loading

  7. Public Website Down

  8. Small number of intermittent requests to Edge API failing

All recorded Flagsmith incidents