Manage Release Management KPIs Dashboard

Release Management KPIs Dashboard allows enterprises to track key metrics and past performance across Releases.

Why Use this Dashboard?

KPIs are a retrospective tool, which helps enterprises look at their past performance. Using the Release Management KPIs Dashboard, you can find out:

  • How your enterprise has performed historically.
  • How trends have changed over time.
  • How this year’s performance compares with last year or the year before.

Questions Answered

The Release Management KPIs Dashboard is designed to answer the following questions:

  • How many releases have we completed?

  • How long does it take to complete each release and phase of the release?

  • How many releases result in incidents, defects, or issues in production?

  • How much many changes are we delivering in each release?

  • How many of those changes are new features, defect fixes, or technical debt?

  • How many unplanned releases (for example, hotfixes) did we do compared to planned releases (for example, value adding)?

Expected Value and Outcomes

The Release Management KPIs Dashboard aims to:

  • Take a retrospective look at past releases and identify positive and negative trends including:

    • Increases in planned release frequency.

    • Reductions in emergency release frequency.

    • Increases in the number of epics and stories.

    • Reductions in the number of defects.

    • Reductions in the number of incidents and impacts to service availability.

  • The report shows where you need to improve and indicates whether or not prior improvements have resulted in positive trends.

Location

To locate the Release Management KPIs dashboard:

  1. Go to Dashboard > Release Management KPIs.

Layout

Filters

The Release Management KPIs Dashboard has the following filters:

Select one or more filters, then click Apply Filter to see the data:

  • Dates:
    • By default, the current date to the previous 6 months is loaded.
    • The maximum date range is 2 years.
      • Days outside the date range are grayed out.
      • If a range of more than 2 years is selected, it will not save after clicking Submit.
  • Portfolio:
    • By default, All is selected.
    • Click to select one or more checkboxes.
    • If you select a parent portfolio, the children are automatically selected.
  • Release Type:
    • By default, All is selected.
    • Click to select one or more checkboxes.
    • Click Select All to toggle whether all checkboxes are selected or not.
  • Release Status:
    • By default, All is selected.
    • Click Select All to toggle whether all checkboxes are selected or not.

Widgets

Releases Over Time

  • The columns show Releases over time by Release Type. For example, Hotfix, or Patch. 
  • The black line shows the number of Changes delivered.
  • A positive trend to look for would be an increase in planned release types and Changes per Release and a decrease in unplanned release types.
  • Filter by Portfolio to compare production between portfolios.
  • If the filter duration is less than or equal to 30 days, the x-axis time period will be days.
  • If the filter duration is greater than 30 days and less than or equal to 90 days, the x-axis time period will be weeks.
  • If the filter duration is greater than 90 days, the x-axis time period will be months.

Releases by Type

  • Releases by Release Type, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to Releases Over Time widget’s view by time.

Releases by Portfolio

  • Releases divided by portfolio, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to Releases Over Time widget’s view by time.

Releases by Risk Level

  • Releases divided by Risk Level, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to Releases Over Time widget’s view by time.

Average Release Duration Over Time

  • See the duration and Release Type of your Releases over time.
  • You would expect Major and Enterprise Releases to have a much longer duration than a Patch or a Hotfix.
  • You would also want to see a downward trend, showing that Releases are becoming more frequent.
  • If the filter duration is less than or equal to 30 days, the x-axis time period will be days.
  • If the filter duration is greater than 30 days and less than or equal to 90 days, the x-axis time period will be weeks.
  • If the filter duration is greater than 90 days, the x-axis time period will be months.

Average Phase and Gate Duration

  • Compares the average duration of Phases and Gates per Release Type.
  • Short duration: Medium Blue.
  • Medium duration: Light Blue.
  • Long duration: Purple.

Changes Over Time

  • Shows how many deliverable scope items are being delivered over time and by Change Type, and what is the breakdown of these items, and who is delivering the most by portfolio?
  • This widget can be particularly useful if Change Type is used to record epics, features, stories, defects, tech debt, and so on.
  • If the filter duration is less than or equal to 30 days, the x-axis time period will be days.
  • If the filter duration is greater than 30 days and less than or equal to 90 days, the x-axis time period will be weeks.
  • If the filter duration is greater than 90 days, the x-axis time period will be months.

Changes by Portfolio

  • Changes divided by portfolio, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to Changes Over Time widget’s view by time.

Changes by Type

  • Changes divided by Change Type, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to Changes Over Time widget’s view by time.

Changes by Theme

  • Changes divided by Change Theme, as a percentage from highest to lowest, starting clockwise from the right.
  • This widget can be particularly useful if Change Theme is used to record whether the change is for compliance, legislative, security, performance, retention, and so on.
  • Provides a view by overall percentage as opposed to Changes Over Time widget’s view by time.

PIR Items Over Time

  • Shows the number of incidents, defects, issues, and retrospective items over time and PIR Item Type.
  • The trend to be looking for is fewer items over time.
  • PIR Items are linked back to their Release’s Implementation Date so that reports made later are still tracked to their correct date.
  • The Total Impact to Service Availability summarizes the entire duration of impact to service availability for the filtered time period.
  • The Avg MTTR shows the entire duration of time to recover after an outage.
  • The user story for this widget could be: “As a Release Manager, what I am really concerned with is about release success and a KPI is how many incidents, defects, issues, or outages occurred in production?”
  • If the filter duration is less than or equal to 30 days, the x-axis time period will be days.
  • If the filter duration is greater than 30 days and less than or equal to 90 days, the x-axis time period will be weeks.
  • If the filter duration is greater than 90 days, the x-axis time period will be months.

PIR Items by Portfolio

  • PIR Item divided by portfolio, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to PIR Items Over Time widget’s view by time.

 

PIR Items by Type

  • Changes divided by PIR Item Type, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to PIR Items Over Time widget’s view by time.

PIR Items by Category

  • Changes divided by PIR Item Category, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to PIR Items Over Time widget’s view by time.

 

PIR Items by Theme

  • Changes divided by PIR Item Theme, as a percentage from highest to lowest, starting clockwise from the right.
  • Provides a view by overall percentage as opposed to PIR Items Over Time widget’s view by time.

Back to the top arrow

Be the first to find out about new features. Subscribe to the Release Notes email. Subscribe Now
Updated on June 15, 2021