These are the definitions for the various metrics being used in the doc
Metrics for Timeline
Metric
Definition
Metric
Definition
Total Bugs
Backlog - total number of not closed bugs of any priority
Total Bugs / Eng
Backlog - total number of not closed bugs of any priority divided by the number of engineers in the IA based on roster on the day the metric is calculated (if a person joins/leaves the team, this metric will see a step change on that day). Engineers on multiple IAs are counted as the according fractions.
P0/P1 Bugs
Backlog - total number of not closed P0 and P1 bugs
P0-P2 Bugs
Backlog - total number of not closed P0, P1 and P2 bugs
Old Bugs
Backlog - total number of not closed bugs of any priority that are older than 100 days
Untriaged Bugs
Backlog - currently untriaged bugs
Blocked Bugs
Backlog - current number of bugs with status
@Blocked
Bugs Filed (week)
Bug Load - new bugs filed against this IA during the last 7 days
Bugs Closed (week)
Bug Load - bugs that were closed during the last 7 days (
@Fixed (Closed)
or any other status that closes a bug like
@Duplicate (Closed)
, or
@Will not fix (Closed)
)
Bugs Fixed (week)
Bug Load - bugs fixed (reaching
@Fixed (Closed)
status) during the last 7 days
Net New Bugs (week)
Bugs Filed (week) - Bugs Closed (week)
Regressions (Current)
Regressions - current number of bugs that are marked as regressions and that are not closed
Regressions Triaged (day)
Regressions - Regressions that were triaged in last 24h and not closed during triage. Only measuring bugs that were still marked a regression after triage to have higher confidence it is actual regressions.
Regressions (Percentage)
Regressions (current) expressed as percentage of Total Bugs
Regressions (Added)
Regressions added in the last month (precisely: any status, and creation date is within 4 weeks)
Regressions (Fixed)
Regressions fixed in the last month (precisely: status is fixed, and close date is within 4 weeks)
Bug Age
Average age (days) of all triaged bugs that have not been closed yet (e.g. status is
@Not Started
or
@In Progress
or
@Blocked
)
Median Bug Resolution Time P1 / all
Of all bugs fixed in the last month, average time (days) from bug creation to reaching
@Fixed (Closed)
(this counts time to triage, time for an engineer to pick up the bug, and implementation time). Not counting bugs that were closed otherwise like via
@Will not fix (Closed)
. Month defined as 4 weeks
Median Implementation Time P1 / all
Of all bugs fixed in the last month, average time (days) to implement the fix (starting at status being changed from
@Not Started
ending at status being changed to
@Fixed (Closed)
). Month defined as 4 weeks
Out of SLO Bugs (Fix)
Number of not closed bugs that are out of the SLO associated with their priority as defined in