Skip to content

Commit 7926b2a

Browse files
authored
Merge pull request #83 from paypal/pattern/introducing-metrics-in-innersource
Add pattern for discussion: first steps with metrics. Looks good, Daniel!
2 parents 5f68763 + 51002c3 commit 7926b2a

File tree

1 file changed

+118
-6
lines changed

1 file changed

+118
-6
lines changed

introducing-metrics-in-innersource.md

Lines changed: 118 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,128 @@
1-
**Note: This pattern is currently under development in [this Pull
2-
Request](https://github.com/paypal/InnerSourcePatterns/pull/83)**
1+
# Title
32

4-
## Title
3+
Introducing Metrics in InnerSource
54

6-
Introducing Metrics in the InnerSource Initiative
7-
8-
## Patlet
5+
# Patlet
96

107
Involve all stakeholders in designing and interpreting metrics to measure the
118
current status in terms of _health_ and performance of the InnerSource
129
initiative.
1310

11+
# Context
12+
13+
An organization is planning to apply or this is in the early stages of applying InnerSource. This would like to measure the current status in terms of 'health' and performance of the initiative, and if the expected outcomes such as an increase in the level of cross-divisional and cross-location collaboration are actually taking place.
14+
This pattern applies to early stages of the initiative or are small in their scope, but they may be mature in their initial process and steps.
15+
16+
17+
# Problem
18+
19+
This organization may already have qualitative feedback from the
20+
involved teams, but desire more objective information focused
21+
on development activities.
22+
23+
The organization does not really know where to start measuring
24+
things or what are the key parameters to measure.
25+
26+
Changes in the top level initiatives may affect the InnerSource program
27+
as they rely in the good will of some executive from the organization.
28+
29+
You may have a problem justifying the InnerSource effort when there is
30+
a change in business priorities or business leadership. Then you need
31+
something concrete to justify the program. A future problem you're
32+
guarding against.
33+
34+
If there's a change in the C-level, metrics might be helpful to convince
35+
them that InnerSource is useful.
36+
37+
38+
# Forces
39+
40+
People do not like to be tracked or measured.
41+
42+
There is not a proper monitoring infrastructure for the software
43+
development process and this is hard to build or to get funding
44+
for this.
45+
46+
There is not a culture of software development metrics.
47+
48+
Metrics are usually misunderstood if people have not received any
49+
training on those.
50+
51+
Organizations collect vanity of any other type of metrics that do not
52+
track business objectives' sucess or failure over time.
53+
54+
Metrics tend to become goals, will subsequently be gamed and thus meaningless.
55+
56+
Merging existing team metrics if another team has a way to measure how teams are doing; these new measurements could potentially conflict.
57+
58+
Some countries in some organizations may face extra complexity when introducing metrics as they may not allow to track individuals.
59+
60+
Tools and how they use them. There might be a learning curve in the discussion about metrics. And perhaps the tools do not support the metrics we're looking for.
61+
62+
# Solution
63+
64+
Bring developers, middle managers and C-level to have a discussion
65+
about metrics. And consider other roles out of the usual development process such as
66+
Human Resources, legal departments, product management, and others.
67+
68+
Let developers and middle managers know that these metrics or KPIs
69+
are not focused on tracking their personal performance, but to compare
70+
if the initiative is currently working as expected.
71+
72+
Consider third party and neutral player to produce such metrics.
73+
74+
Have specific training on the topic of metrics and good practices
75+
to use them. An example is to have a methodology to follow metrics such
76+
as the Goal-Question-Metric approach or the Objetives-KeyResults one.
77+
On the other hand, try to update the metrics used to the short-term
78+
and medium-term goals.
79+
80+
Bring specific discussions on the metrics to be used avoiding per
81+
developer granularity or at least anonymizing that info.
82+
83+
Produce a characterization of metrics as this might be helpful for others
84+
to understand and follow.
85+
86+
* Nearly always InnerSource is not a goal in-and-of itself but a proposal of how to improve some larger problem that the company is having. One class of metrics is around that larger goal (e.g. quality, interrupt-driven work, duplicated code, etc.) and how it is going for the company.
87+
* Another class of metrics is around how much InnerSourcing is happening. A raw definition of InnerSource based on code submission to a repository not owned by the submitter's team could be measurable in a few ways.
88+
* A third class of metrics are KPIs that we believe will improve the raw amount of InnerSourcing happening (e.g. mean-time-to-review, automated test run on PR, etc.).
89+
90+
Note: any proposed metric are just examples and not the ones that should be using. Depending on the selection of business goals to track, those will match with specific set of metrics.
91+
92+
93+
# Resulting Context
94+
95+
The organization builds a monitoring infrastructure where the agreed
96+
metrics will be the ones to be used.
97+
98+
Those metrics will help C-level to understand the current situation
99+
of the project and this will help to compare the status before
100+
applying inner source and after applying the inner source initiative.
101+
102+
Those metrics will help middle management to understand how the
103+
initiative evolves and help them with their daily work.
104+
105+
Those metrics will help developers to understand how the initiative
106+
evolves and help them with their daily work.
107+
108+
109+
# Known Instances
110+
111+
112+
# Authors
113+
114+
- Daniel Izquierdo
115+
- Tim Yao
116+
- Clint
117+
- Russ Rutledge
118+
- Tom
119+
120+
# Acknowledgement
121+
122+
- Georg
123+
- Bob
14124

125+
# State
15126

127+
Early Idea
16128

0 commit comments

Comments
 (0)