tag:status.yasoon.com,2005:/historyyasoon Status - Incident History2024-03-28T11:01:57+01:00yasoontag:status.yasoon.com,2005:Incident/203866902024-03-28T09:00:00+01:002024-03-28T11:01:57+01:00API Services not available for DataCenter Products<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>09:00</var> CET</small><br><strong>Resolved</strong> - Due to an invalid deployment, the Cloud services for our Data Center products were not reachable.<br />Timeline:<br />9:00 am, start of the invalid deployment<br />9:25 am, error mentoring caught the error and informed the incident team<br />9:40 am, operations team intiated an rollback to the previous version<br />9:50 am, got confirmations about the resolution of the incident</p>tag:status.yasoon.com,2005:Incident/190327412023-11-16T16:26:00+01:002023-12-04T17:07:20+01:00Outlook Calendars for Confluence app inactive and cannot be activated<p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>16:26</var> CET</small><br><strong>Resolved</strong> - We have successfully worked with Atlassian to re-enable Outlook Calendars for Confluence on all instances, so no manual activation should be necessary anymore. Sorry for the disruption, we'll make sure to post a post mortem in a timely manner.</p><p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>11:06</var> CET</small><br><strong>Update</strong> - We are still working with Atlassian to bulk-enable the app for all instances again. It's still possible to manually enable the app again, so we are lowering the impact.</p><p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>09:44</var> CET</small><br><strong>Update</strong> - After monitoring the situation, it appears that the app will not re-enable itself automatically, but this can be done manually via "Manage apps". We are working with Atlassian to re-enable the app for all customers.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>16:33</var> CET</small><br><strong>Update</strong> - A fix has been implemented. Currently a manual update of the app is required via "Manage apps", but should be picked up automatically after 24h.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>16:32</var> CET</small><br><strong>Monitoring</strong> - A fix has been implemented. Currently a manual update of the app is required via "Manage apps", but should be picked up automatically after 24h.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>10:15</var> CET</small><br><strong>Identified</strong> - We have identified a deployment issue with our Outlook calendar app. The app can currently not be used, as it cannot be activated since the last update. We are working to provide an update today that will fix the issue.</p>tag:status.yasoon.com,2005:Incident/186112632023-09-26T13:30:00+02:002023-09-26T14:44:11+02:00JSM chat notifications not posted<p><small>Sep <var data-var='date'>26</var>, <var data-var='time'>13:30</var> CEST</small><br><strong>Resolved</strong> - Some JSM chat notifications could not be delivered due to a misconfigured Azure Bot.</p>tag:status.yasoon.com,2005:Incident/182468172023-08-24T18:04:37+02:002023-08-24T18:04:37+02:00Todo & Smart Connect for Jira not reacting to Jira changes<p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>18:04</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>17:59</var> CEST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>17:56</var> CEST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>16:30</var> CEST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p>tag:status.yasoon.com,2005:Incident/182459892023-08-24T10:00:00+02:002023-08-24T15:13:30+02:00Webhooks reliability issues<p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>10:00</var> CEST</small><br><strong>Resolved</strong> - Webhook handling was degraded by some workers with incorrect initialization.<br /><br />Affected dates<br />2023/08/23 2pm-4pm UTC<br />2023/08/24 8am-11am UTC<br /><br />Impact:<br />Roughly 20% of handled webhooks have been affected by the incident. That lead to missing Todos synced or missing channel notifications in Teams.<br /><br />Fix:<br />Initialization script has been updated and made more robust. We are monitoring the situation</p>tag:status.yasoon.com,2005:Incident/174803942023-06-05T21:16:55+02:002023-06-05T21:16:55+02:00Microsoft Graph services outtage<p><small>Jun <var data-var='date'> 5</var>, <var data-var='time'>21:16</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'> 5</var>, <var data-var='time'>18:04</var> CEST</small><br><strong>Identified</strong> - Microsoft is currently experiencing an outage across multiple services, which also impacts our integrations. You might not be able to create Microsoft Teams chats or channel conversations and other areas might be impacted as well.<br /><br />https://admin.microsoft.com/Adminportal/Home#/servicehealth/:/alerts/MO571683</p>tag:status.yasoon.com,2005:Incident/174719762023-06-04T23:48:47+02:002023-06-04T23:48:47+02:00Database upgrade and migration<p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>23:48</var> CEST</small><br><strong>Completed</strong> - Maintenance has been completed successfully.<br />If you have issues with your login, data are missing or your connection seems to be broken, please restart your browser to clear the caches.</p><p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>23:47</var> CEST</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>21:00</var> CEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'> 4</var>, <var data-var='time'>20:58</var> CEST</small><br><strong>Scheduled</strong> - Apps will be set into a read-only mode during the maintenance.</p>tag:status.yasoon.com,2005:Incident/172887062023-05-18T14:33:15+02:002023-05-18T14:33:15+02:00Teams and potentially other functions interrupted<p><small>May <var data-var='date'>18</var>, <var data-var='time'>14:33</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>May <var data-var='date'>18</var>, <var data-var='time'>11:05</var> CEST</small><br><strong>Monitoring</strong> - Since our morning deployment around 8AM CEST, we have been observing increased errors when working with the Teams functionality of our app. We have not yet identified the root cause, but have rolled back the change and everything should be working again.</p>tag:status.yasoon.com,2005:Incident/160921822023-02-12T09:17:23+01:002023-02-12T09:17:23+01:00Calendar not accessible in Microsoft 365 for Jira<p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>09:17</var> CET</small><br><strong>Resolved</strong> - A fix for this incident has been released on Friday and should be available for everyone as of now - sorry for the inconveniences.</p><p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>17:55</var> CET</small><br><strong>Identified</strong> - We have identified an issue with our calendar view in our Microsoft 365 for Jira app. An fix is currently being deployed and should be available in the next 24 hours.</p>tag:status.yasoon.com,2005:Incident/158093932023-01-10T13:31:12+01:002023-01-10T13:31:12+01:00Viewing shared chats & creating calendar events in shared calendars is currently impacted<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>13:31</var> CET</small><br><strong>Resolved</strong> - We have released a fix for this issue.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>11:37</var> CET</small><br><strong>Identified</strong> - We have located the cause of the issue and are in the process of rolling out a fix</p>tag:status.yasoon.com,2005:Incident/137813522022-11-27T15:04:15+01:002022-11-28T20:00:01+01:00Server outtage<p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>15:04</var> CET</small><br><strong>Resolved</strong> - We are still investigating the root cause of the Redis issue but the service has been fully restored for now.</p><p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>09:11</var> CET</small><br><strong>Monitoring</strong> - We have identified an out of memory error in our main Redis instance, resulting in a cascading error. We have temporarily increased the memory to restore the service and will be starting to look into the root cause.</p><p><small>Nov <var data-var='date'>27</var>, <var data-var='time'>08:20</var> CET</small><br><strong>Investigating</strong> - Our apps are currently unavailable due to an outtage - we are looking into it and will provide an update asap.</p>tag:status.yasoon.com,2005:Incident/126040792022-10-24T16:30:00+02:002022-10-25T11:34:55+02:00Teams for Jira not accessible<p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>16:30</var> CEST</small><br><strong>Resolved</strong> - Using the Teams features in Jira currently only shows “The page has expired, please reload the page.”</p>tag:status.yasoon.com,2005:Incident/120119242022-10-14T12:09:33+02:002022-10-14T12:09:33+02:00App not active in Jira Cloud for some customers<p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>12:09</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>12:07</var> CEST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>12:07</var> CEST</small><br><strong>Monitoring</strong> - We have implemented a fix and it should be working again for all customers.</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>11:32</var> CEST</small><br><strong>Update</strong> - We are still working on a fix - as a manual workaround you can go to the admin settings and activate the app features manually</p><p><small>Oct <var data-var='date'>14</var>, <var data-var='time'>11:04</var> CEST</small><br><strong>Identified</strong> - We are currently working on a fix that all the apps are not active in Jira Cloud (except Teams).</p>tag:status.yasoon.com,2005:Incident/90242492022-01-07T16:11:43+01:002022-01-07T16:11:43+01:00Creating and updating Confluence calendars is currently not possible<p><small>Jan <var data-var='date'> 7</var>, <var data-var='time'>16:11</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'> 7</var>, <var data-var='time'>11:03</var> CET</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.yasoon.com,2005:Incident/65373442021-03-16T07:02:00+01:002021-03-16T07:02:00+01:00Login issues due to Microsoft outage<p><small>Mar <var data-var='date'>16</var>, <var data-var='time'>07:02</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>21:04</var> CET</small><br><strong>Identified</strong> - AzureAD is currently having a major outage, and it's not possible to login / work with our apps. Please follow @AzureStatus on Twitter or check your Microsoft 365 dashboard for updates.</p>tag:status.yasoon.com,2005:Incident/64517382021-03-04T16:38:28+01:002021-03-04T16:38:28+01:00Authentication issues with Jira Cloud<p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>16:38</var> CET</small><br><strong>Resolved</strong> - The issue has mostly been resolved, please follow the Atlassian Statuspage for more info.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>13:20</var> CET</small><br><strong>Identified</strong> - The issue is related to an Atlassian outage, please follow their status page as well: https://jira-software.status.atlassian.com/</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>11:06</var> CET</small><br><strong>Investigating</strong> - We are currently investigating an issue where users are not able to login from Outlook.</p>tag:status.yasoon.com,2005:Incident/52245592020-10-01T12:46:05+02:002020-10-01T12:46:05+02:00Partial Microsoft Exchange outage<p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>12:46</var> CEST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 1</var>, <var data-var='time'>09:34</var> CEST</small><br><strong>Investigating</strong> - Affecting Outlook Meetings for Jira and others<br />---<br />Users can't access Exchange Online<br />EX223208, EX223231, EX223235</p>