Resolved -
We will continue to monitor the platform to ensure that the queue will not get saturated tomorrow.
Mar 23, 22:00 PDT
Update -
The queue has fully drained, so most of the functionality should be as normal in Kalix.
We are still analyzing the usage and making improvements to the performance of the site.
Mar 23, 17:09 PDT
Monitoring -
The queue is currently draining, so functionality should start to restore. Previously queued items will be processed first, and the delay of new tasks will start to shorten.
Mar 23, 15:12 PDT
Update -
We are currently working on some database indexes to help fix up the queue (and make Kalix faster too). This process is slow though, as we identify the correct indexes to use.
Please note that incoming SMS are handled in the queue, so will also be delayed.
Mar 23, 13:44 PDT
Update -
If you are seeing an error when trying to load the 'Messaging' -> 'Inbox' page, try to change the filter to 'Last 6 Months' or 'Last Month' to reduce the amount of data that needs to load.
Mar 23, 11:59 PDT
Identified -
Notifications are currently not working and the queue is delayed. This means that messages will take a while to send, outgoing batches will be pending, and other fields may take a while to update. These will eventually be processed, but it will take some time until the queue is cleared.
This issue is also affecting notifications, so if you want to see unread notifications, check the 'Messaging' -> 'Inbox' page directly.
Mar 23, 11:47 PDT