Resolved – Connection issues
Nov 7 2:40AM MST – The processing of the backlog of chats in the waiting queue from yesterday’s outage has been cleared at this point.The chat queuing management is back to normal now, without further side effects of yesterday’s outage.
Nov 7 1:30AM MST – The real time platform has been back to normal for the past 10 hours, but the systems are still cleaning up queued chats that accumulated and were not processed during the outage. The rate of processing is much lower than we anticipated, and we are working to accelerate this cleanup. For clients having the chat auto disabled when the queue size reaches a threshold, it is advised to turn this option off until the catch-up has been completed.
Nov 6 3:44PM MST – The issue has been resolved as of 3:34pm and we will continue to monitor. Users may experience slowness as the systems process some backlog of data.
Nov 6 3:33PM MST – The Google Engineering Team believes they have identified the root cause of the errors and is working to mitigate. We are starting to see chats come through on SnapEngage.com and we will continue to monitor and update this post. We recommend having agents clear their cache and cookies and don’t forget to re-enable the online button if you disabled it.
Nov 6 2:37PM MST – We are still waiting for a fix from Google App Engine If you would like to disable the online button and just display the offline button you can do so in the admin dashboard by going to Settings > Agent Settings and scroll down and uncheck Enable Chat. This will just show the offline button to visitors. *Make sure to recheck it once the issue is resolved.
Nov 6 2017 2:00PM MST – We are getting reports of chats not going through. This issue is linked to a Google Cloud memcache issue and we are working with Google to get the latest information. Stay tuned for updates. We apologize for the inconvenience.