2 Day Agile and Scrum workshop · 2018. 11. 6. · Look for bottlenecks and wild variations and INSPECT and ADAPT Focus on shrinking lead time and cycle time across teams in the organization

Collecting the Right Metrics for the Right Reasons

Angela DuganDirector

Twitter: @OakParkGirl Email: [email protected]

mailto:[email protected]

Lines of Code

# Bugs Found# Bugs Fixed Velocity

Utilization

Lead Time

Bug Reactivations

Cyclomatic Complexity

# Features Delivered

WIP

Planned vs. Actual Budget Overrun

Sprint Burndown

Actuals vs Estimate

Build Quality

Code Coverage

@OakParkGirl

[email protected]: @OakParkGirl Email: [email protected]

http://www.polarissolutions.com/


Director

Agile coach

Change agent

ALM MVP

SAFe program Consultant

A *possibly* unhealthy love of Halloween



[email protected] Twitter: @OakParkGirl

Yes, this Polaris! ☺Not this Polaris! ☺


What are you trying to learn?



@OakParkGirl




@OakParkGirl




This Photo by Unknown Author is licensed under CC BY-SA-NC

https://vladimiraras.blog/2015/05/13/concluindo-a-serie-sobre-colaboracao-premiada/

https://creativecommons.org/licenses/by-nc-sa/3.0/



That which is measured will improve…

At a cost



When a measure becomes a target, it ceases to be a good

measure







What are we supposed to measure?!?



@OakParkGirl






organizational culture that values “being busy”

dependencies on other teams

team’s skill/confidence at saying no

people’s willingness/ability to swarm

unexpected outages and unplanned work



WIP at scale has awesome applications

Portfolio Kanban

Program Kanban

Team Kanban

Previously mentioned challenges are compounded!

@OakParkGirl

[email protected]://v4.scaledagileframework.com/metrics/


http://v4.scaledagileframework.com/metrics/



time poorly spent


team’s skill/confidence at estimating

too much WIP


People updating their remaining work on a consistent

basis







Burndown is hard to interpret at scale!

• Teams may not estimate tasks in hours

• Teams aren’t necessarily using same sprint cadences

• Burndown resets every sprint boundary

The only way to create a functioning organizational burndown is to pre-estimate everything everyone is ever going to work on!









@OakParkGirl

[email protected]

time poorly spent


team’s skill/confidence at estimating

too much WIP




Velocity is not useful across teams* at scale!

• Teams may not use same units

• Teams will have different scales

• Teams aren’t necessarily using same sprint cadences

At BEST you’re causing toxic competition, encouraging system gaming, and learning nothing useful



[email protected] Twitter:

@OakParkGirlTwitter: @OakParkGirl Email: [email protected]




Is effected by all of the same challenges as before

Look for bottlenecks and wild variations and INSPECT

and ADAPT

Focus on shrinking lead time and cycle time across

teams in the organization to reap huge benefits!



Most common ones are LAGGING indicators

They are not a reliable predictor for future performance

Asking for more/better metrics may come at a cost

Teams, products, and components are not interchangeable

Trends can be valuable, but can also be gamed







Is the team confident that they understand what they are being asked to deliver?

Is the team confident they have the support they neamfrom the groups they are dependant on?

Is the customer confident that the organization understands what they want?

Is the business confident they can deliver a high quality product on time to the customer?







Twitter: @OakParkGirl Email:

[email protected]

Reliability

Openness

Collaboration

Innovation

And not just for individual teams.

Measure it for business units, divisions, and the organization!




1. Job Satisfaction

a. Score: (1 - 10)

b. Biggest contributor to satisfaction?

c. Biggest detractor from satisfaction?

2. Compensation Satisfaction

a. Score: (1-10)

3. Push/Pull

a. What factors could push you away from our team/company?

b. What factors could pull you away from out team/company?

4. Career Goals (short and long term)

a. What are they?

b. Are you making progress toward them?

https://medium.com/@mmanela/quarterly-questions-e92cba9b2480

https://medium.com/@mmanela/quarterly-questions-e92cba9b2480

Measure

LOTS

of

things!



VersionOne - Annual State of Agile Report https://explore.versionone.com/state-of-agile/versionone-12th-annual-state-of-agile-report

https://explore.versionone.com/state-of-agile/versionone-12th-annual-state-of-agile-report

@OakParkGirl




1. Escape Velocity (via Lean Pub) by Doc Norton

2. Version One: State of Agile Report

3. Scaled agile team and organizational metrics:

https://www.scaledagileframework.com/metrics/


https://www.scaledagileframework.com/metrics/


Email: [email protected]

LinkedIn: https://www.linkedin.com/company/polaris-solutions/

Twitter: @TeamPolaris, @OakParkGirl

Polaris Solutions website - http://www.polarissolutions.com/

Meetups and Briefings: http://www.polarissolutions.com/events/

@OakParkGirl [email protected]


https://www.linkedin.com/company/polaris-solutions/



[email protected] Twitter:

@OakParkGirl

Documents

2 Day Agile and Scrum workshop · 2018. 11. 6. · Look for bottlenecks and wild variations and INSPECT and ADAPT Focus on shrinking lead time and cycle time across teams in the organization