You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: introducing-metrics-in-innersource.md
+29-58Lines changed: 29 additions & 58 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,105 +4,76 @@ Introducing Metrics in InnerSource
4
4
5
5
## Patlet
6
6
7
-
Involve all stakeholders in designing and interpreting metrics to measure the
8
-
current status in terms of _health_ and performance of the InnerSource
9
-
initiative.
7
+
Involve all stakeholders in designing and interpreting metrics to measure the current status in terms of _health_ and performance of the InnerSource initiative.
10
8
11
9
## Context
12
10
13
-
An organization is planning to apply or this is in the early stages of applying InnerSource. This would like to measure the current status in terms of 'health' and performance of the initiative, and if the expected outcomes such as an increase in the level of cross-divisional and cross-location collaboration are actually taking place.
14
-
This pattern applies to early stages of the initiative or are small in their scope, but they may be mature in their initial process and steps.
11
+
An organization that is planning to apply or is in the early stages of applying InnerSource would like to measure the 'health' and performance of the initiative i.e. Is there an increase in cross-divisional and cross-location collaboration?
12
+
13
+
This pattern applies very widely from IS initiatives in their infancy stages to small or large scale IS initiatives that are already mature in their initial process and steps.
15
14
16
15
## Problem
17
16
18
-
This organization may already have qualitative feedback from the
19
-
involved teams, but desire more objective information focused
17
+
This organization may already have qualitative feedback from the involved teams, but desire more objective information focused
20
18
on development activities.
21
19
22
-
The organization does not really know where to start measuring
23
-
things or what are the key parameters to measure.
20
+
The organization does not really know where to start measuring things or what are the key parameters to measure.
24
21
25
-
Changes in the top level initiatives may affect the InnerSource program
26
-
as they rely in the good will of some executive from the organization.
22
+
Changes in the top level initiatives may affect the InnerSource program as they rely on the good will of some executive from the organization.
27
23
28
-
You may have a problem justifying the InnerSource effort when there is
29
-
a change in business priorities or business leadership. Then you need
30
-
something concrete to justify the program. A future problem you're
31
-
guarding against.
24
+
You may have a problem justifying the InnerSource effort when there is a change in business priorities or business leadership. Then you need something concrete to justify the program. A future problem you're guarding against.
32
25
33
-
If there's a change in the C-level, metrics might be helpful to convince
34
-
them that InnerSource is useful.
26
+
If there's a change in the C-level, metrics might be helpful to convince them that InnerSource is useful.
35
27
36
28
## Forces
37
29
38
30
People do not like to be tracked or measured.
39
31
40
-
There is not a proper monitoring infrastructure for the software
41
-
development process and this is hard to build or to get funding
42
-
for this.
32
+
There is no canonical monitoring infrastructure for the software development process. Furthermore, such infrastructure is hard to build
33
+
or to get funding for.
43
34
44
35
There is not a culture of software development metrics.
45
36
46
-
Metrics are usually misunderstood if people have not received any
47
-
training on those.
37
+
Metrics can be misunderstood especially if people have not received any training on the same.
48
38
49
-
Organizations collect vanity of any other type of metrics that do not
50
-
track business objectives' success or failure over time.
39
+
Organizations collect vanity of any other type of metrics that do not track business objectives' success or failure over time.
51
40
52
41
Metrics tend to become goals, will subsequently be gamed and thus meaningless.
53
42
54
-
Merging existing team metrics if another team has a way to measure how teams are doing; these new measurements could potentially conflict.
43
+
There is potential conflict in reconciling metrics on team effectiveness or productivity if teams within the organization have different versions of them.
55
44
56
-
Some countries in some organizations may face extra complexity when introducing metrics as they may not allow to track individuals.
45
+
Some organizations in some countries may face extra complexity when introducing metrics as the countries may not allow tracking individuals.
57
46
58
-
Tools and how they use them. There might be a learning curve in the discussion about metrics. And perhaps the tools do not support the metrics we're looking for.
47
+
There might be a learning curve in the discussion about metrics. And perhaps the tools do not support the IS metrics we're looking for.
59
48
60
49
## Solution
61
50
62
-
Bring developers, middle managers and C-level to have a discussion
63
-
about metrics. And consider other roles out of the usual development process such as
64
-
Human Resources, legal departments, product management, and others.
51
+
Bring developers, middle managers and C-level to have a discussion about metrics. And consider other roles out of the usual development process such as Human Resources, legal departments, product management, and others.
65
52
66
-
Let developers and middle managers know that these metrics or KPIs
67
-
are not focused on tracking their personal performance, but to compare
68
-
if the initiative is currently working as expected.
53
+
Let developers and middle managers know that these metrics or KPIs are not focused on tracking their personal performance, but to compare if the initiative is currently working as expected.
69
54
70
-
Consider third party and neutral player to produce such metrics.
55
+
Consider a third party that is seen as a neutral player to produce such metrics.
71
56
72
-
Have specific training on the topic of metrics and good practices
73
-
to use them. An example is to have a methodology to follow metrics such
74
-
as the Goal-Question-Metric approach or the Objectives-KeyResults one.
75
-
On the other hand, try to update the metrics used to the short-term
76
-
and medium-term goals.
57
+
Have specific training on the topic of metrics and good practices to use them. An example is to have a methodology to follow metrics such as the Goal-Question-Metric approach or the Objectives-KeyResults one. On the other hand, try to reflect the short-term and medium-term goals in the metrics to be used.
77
58
78
-
Bring specific discussions on the metrics to be used avoiding per
79
-
developer granularity or at least anonymizing that info.
59
+
Metrics when published or discussed should be done so in the aggregate without refering to specific people.
80
60
81
-
Produce a characterization of metrics as this might be helpful for others
82
-
to understand and follow.
61
+
Produce a characterization of metrics as this might be helpful for others to understand and follow.
83
62
84
-
* Nearly always InnerSource is not a goal in-and-of itself but a proposal of how to improve some larger problem that the company is having. One class of metrics is around that larger goal (e.g. quality, interrupt-driven work, duplicated code, etc.) and how it is going for the company.
85
-
* Another class of metrics is around how much InnerSourcing is happening. A raw definition of InnerSource based on code submission to a repository not owned by the submitter's team could be measurable in a few ways.
86
-
* A third class of metrics are KPIs that we believe will improve the raw amount of InnerSourcing happening (e.g. mean-time-to-review, automated test run on PR, etc.).
63
+
* Nearly always InnerSource is not a goal in-and-of itself but a proposal of how to improve some larger problem that the company is having. One class of metrics is around that larger goal (e.g. quality, interrupt-driven work, duplicated code, etc.) and reflects the company's progress towards it.
64
+
* Another class of metrics is around how much InnerSourcing is happening. A raw definition of InnerSource based on the number and frequency of code submissions to a repository not owned by the submitter's team could be measurable in a few ways.
65
+
* A third class of metrics are KPIs that we believe will improve the raw amount of InnerSourcing happening (e.g. mean-time-to-review, number of comments and/or frequency of 'changes requested' on PRs by trusted committers, automated test run on PR, etc.).
87
66
88
-
Note: any proposed metric are just examples and not the ones that should be using. Depending on the selection of business goals to track, those will match with specific set of metrics.
67
+
Note: The aforementioned metrics are some common examples. They aren't a one-size-fits-all. We expect the business goals of the organization to drive the metric selection process.
89
68
90
69
91
70
## Resulting Context
92
71
93
-
The organization builds a monitoring infrastructure where the agreed
94
-
metrics will be the ones to be used.
95
-
96
-
Those metrics will help C-level to understand the current situation
97
-
of the project and this will help to compare the status before
98
-
applying inner source and after applying the inner source initiative.
99
-
100
-
Those metrics will help middle management to understand how the
101
-
initiative evolves and help them with their daily work.
72
+
The organization builds a monitoring and reporting infrastructure for the metrics that flow directly from its business goals.
102
73
103
-
Those metrics will help developers to understand how the initiative
104
-
evolves and help them with their daily work.
74
+
Those metrics will provide visibility into the current situation of the project to the C-level executives. By comparing the metric measurements before applying inner source and to the metric measurements after applying the inner source initiative, it is possible to guage the effectiveness of the inner source initiave.
105
75
76
+
Continued monitoring of these metrics will help middle management and developers understand how the initiative evolves and will help them with their daily work.
0 commit comments