Previous incidents

Redis servers got slowed down making them reach OOM state, resulting in clients not being able to connect to queue to empty the jobs from it.

Server has been re-started allowing clients to connect again to empty the queue, no data has been lost, all jobs were processed.

We found that a node (1 out of 8) was noon responsive and causing the blank pages to show, once removed from the scale cluster system went back to normal.

SSL had expired and auto-renewal had failed, this has been fixed so that future renewals will not fail again.