Skip to content

Commit 6bd653d

Browse files
authored
Update README.md
Updated questions to include capturing the self report rationale. Also, clarifying the goal of the Survey, which is Quantitative, not Qualitative data collection.
1 parent 80c3937 commit 6bd653d

File tree

1 file changed

+34
-5
lines changed

1 file changed

+34
-5
lines changed

README.md

Lines changed: 34 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -4,11 +4,11 @@
44
55
## App Objective
66

7-
As more companies adopt GitHub Copilot, it becomes increasingly important to measure the benefits it brings to the organization. While quantitative analysis is valuable for measuring usage patterns and adoption rates, it is equally essential to consider qualitative analysis. By combining both quantitative and qualitative approaches, we can gain a comprehensive understanding of the developer experience when using this tool.
7+
As more companies adopt GitHub Copilot, it becomes increasingly important to measure the benefits it brings to the organization. This survey is an effort to combine both quantitative and qualitative data. To improve validity of the quantitative responses, Developers are asked to document their rationale for the time-savings percentage they choose.
88

9-
Quantitative analysis provides valuable insights, but it alone cannot capture the full story of how developers truly feel about Copilot. This is particularly important because Copilot offers various ways for developers to interact with it and derive value, some of which may not be captured by current Key Performance Indicators (KPIs).
9+
Quantitative feedback from the Developer at the time of creating a PR provides valuable insights on the time savings experienced by the Developer. Time savings is needed first before other downstream impacts (like velocity increases, or other improvements can happen. The level of granularity provides multiple feedback opportunities for Developers and can capture a variety of PRs so we can understand adoption challenges and improvement opportunities. If helpful, the Survey results may also be combined with Key Performance Indicators (KPIs) that the product provides to further contextualize the survey responses.
1010

11-
To gain a deeper understanding of user satisfaction, we have designed this app a part of the DevOps lifecycle to facilitate qualitative surveys. The survey responses are stored in your private Azure SQL database to provide insights into how developers are using the tool, the value they perceive, and the challenges they encounter.
11+
The survey responses are stored in your private Azure SQL database to provide insights into how developers are using the tool, the value they report, and the challenges they encounter.
1212

1313
We hope that this project provides value to your organization, and we encourage you to contribute and build upon it. Your contributions can help further enhance the survey capabilities and provide even greater insights into the developer experience with Copilot.
1414

@@ -23,8 +23,37 @@ When a pull request is closed, the app automatically creates an issue that promp
2323
Note: *If the env file does not contain a Language API Key or Endpoint, the analysis will be skipped and the default language will always be English.*
2424

2525
### Sample screenshot of a survey
26+
### Copilot Usage Survey
2627

27-
![Sample screenshot of a survey](image.png)
28+
1. ***Did you use Copilot in developing this PR? (If you select No, just answer question 5***
29+
- [ ] No
30+
- [ ] Yes
31+
32+
2. Compared to your previous experience coding WITHOUT using Copilot,
33+
34+
***How much less time did the coding take during this PR with Copilot?***
35+
36+
(Example: The PR would normally take 5 days, but only took 4 days with Copilot then the answer is 20%)
37+
- [ ] 0%
38+
- [ ] > 0% but < 10%
39+
- [ ] > 11% but < 20%
40+
- [ ] > 21% but < 30%
41+
- [ ] ≥ 31% but < 40%
42+
- [ ] ≥ 41%
43+
44+
3. ***Describe your thought process for calculating (or estimating) the time saved in Question 2***
45+
46+
- [ replace this line with your answer. ]
47+
48+
4. ***How often did you use Copilot in this PR?***
49+
- [ ] All or most of the time
50+
- [ ] About Half of the time
51+
- [ ] Some of the time
52+
- [ ] Not very much
53+
54+
5. ***What other information can you share about Copilot's ability to save you time coding?***
55+
56+
- [ replace this line with your answer. ]
2857

2958
### Where does the app store surveys?
3059

@@ -89,4 +118,4 @@ For more, check out the [Contributing Guide](CONTRIBUTING.md).
89118

90119
## License
91120

92-
[ISC](LICENSE) © 2023 Mabel Geronimo
121+
[ISC](LICENSE) © 2023 Mabel Geronimo

0 commit comments

Comments
 (0)