Performance issues in Jira
Incident Report for Jira Software
Postmortem

SUMMARY

On March 7, 2024, between 12:02 pm UTC and 12:21 pm UTC, some Atlassian customers using Jira in the EU-Central region were unable to interact with core experiences of the product, and some customers using Confluence in the EU-Central region had a degraded experience. This was caused by unexpected traffic and recent changes to automated scaling policies which resulted in nodes not being able to scale up quickly enough. The incident was detected within two minutes by automated monitoring and was mitigated by manually scaling up nodes which put Atlassian systems into a known good state. The total time to resolution was 19 minutes.

IMPACT

The overall impact was on March 7, 2024, between 12:02 pm UTC and 12:21 pm UTC, on Jira and Confluence products. The incident caused service disruption to some customers accessing the EU-central region. For Jira, the disruption caused core experiences of the product to be unavailable during this time. For Confluence, some non-core experiences were affected during this time.

ROOT CAUSE

This incident was caused by unexpected traffic and recent changes to automated scaling policies which resulted in nodes not being able to scale up quickly enough in the EU-Central region. As a result, the Atlassian GraphQL Gateway could not service all requests in EU-Central, leading to parts of Jira being unavailable for some customers and degradation of non-core features in Confluence in the incident time period.

REMEDIAL ACTIONS PLAN & NEXT STEPS

We understand that outages impact your productivity.

We have already implemented improvement actions to avoid repeating this type of incident and reduce the time to recovery. We have improved scaling out policies to be substantially more aggressive. This will help mitigate many different types of incidents.

We apologize to customers whose services were impacted during this incident; we are taking immediate steps to improve the platform’s performance and availability.

Thanks,

Atlassian Customer Support

Posted Mar 15, 2024 - 21:00 UTC

Resolved
Between 12:00 March 7th and 12-25 March 7th UTC, we faced performance problems with the Jira Issue View for some EU customers. The issue has been resolved and the service is operating normally.

We are closing this incident for now.
Posted Mar 07, 2024 - 14:24 UTC
Investigating
We have identified ongoing performance problems with the Jira Issue View for some EU customers. We are actively working to resolve this issue as quickly as possible.
Posted Mar 07, 2024 - 13:14 UTC
This incident affected: Viewing content, Create and edit, Administration, and Automation for Jira.