Skip to content

Commit b1addca

Browse files
committed
Adding new survey question and updating logic for answers retrieval + documentation
1 parent 71d6108 commit b1addca

17 files changed

+645
-737
lines changed

README.md

Lines changed: 27 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@
66

77
As more companies adopt GitHub Copilot, it becomes increasingly important to measure the benefits it brings to the organization. This survey is an effort to combine both quantitative and qualitative data. To improve validity of the quantitative responses, Developers are asked to document their rationale for the time-savings percentage they choose.
88

9-
Quantitative feedback from the Developer at the time of creating a PR provides valuable insights on the time savings experienced by the Developer. Time savings is needed first before other downstream impacts (like velocity increases, or other improvements can happen. The level of granularity provides multiple feedback opportunities for Developers and can capture a variety of PRs so we can understand adoption challenges and improvement opportunities. If helpful, the Survey results may also be combined with Key Performance Indicators (KPIs) that the product provides to further contextualize the survey responses.
9+
Quantitative feedback from the Developer at the time of creating a PR provides valuable insights on the time savings experienced by the Developer. Time savings is needed first before other downstream impacts like velocity increases, or other improvements can happen. The level of granularity provides multiple feedback opportunities for Developers and can capture a variety of PRs so we can understand adoption challenges and improvement opportunities. If helpful, the Survey results may also be combined with Key Performance Indicators (KPIs) that the product provides to further contextualize the survey responses.
1010

1111
The survey responses are stored in your private Azure SQL database to provide insights into how developers are using the tool, the value they report, and the challenges they encounter.
1212

@@ -55,9 +55,16 @@ Note: *If the env file does not contain a Language API Key or Endpoint, the anal
5555

5656
- [ replace this line with your answer. ]
5757

58+
6. ***Where did you invest your Copilot Time Savings?***
59+
- [ ] Resolve vulnerabilites
60+
- [ ] Experiment, Learn and Wellness
61+
- [ ] Technical debt and refactorization
62+
- [ ] Work on other items in the backlog
63+
- [ ] Other. Please explain in the comment
64+
5865
### Where does the app store surveys?
5966

60-
As we receive edits on the issue, the App will validate the responses received (options selected) and once all questions have been answered, the issue will be closed automatically and the responses will be saved into a private SQL database.
67+
As we receive edits on the issue, the App will validate the responses received (options selected) and once all questions have been answered, the issue will be closed automatically and the responses will be saved into the configured SQL database.
6168

6269
## Setup. Deploy on your own environment
6370

@@ -85,30 +92,43 @@ npm install
8592
npm start
8693
```
8794

95+
Once the service is running, you will see a listening endpoint in your terminal. Please follow the link, and you will find a screen like the following image.
96+
97+
![Image for GitHub App Configuration Page](docs/GitHubAppConfigurationPage.png)
98+
8899
As a first time execution probot will prompt you for creating a new GitHub App or connect it with an existing App. As you complete the requested information, a .env file will get created in your local source code and all the private information regarding your GitHub App will be automatically written there. If you need guidance on how to configure your first GitHub App, please review this guide https://probot.github.io/docs/development/#configuring-a-github-app.
89100

90-
**Be careful!** If a webhook_URL variable is created, please delete it before deploying on your environment. This should only be used for testing purposes.
101+
> **Note**: Make sure to delete the `WEBHOOK_PROXY_URL` value from the env file and confirm that all details regarding the GitHub App are correct.
102+
103+
You will also need to provide the `DATABASE_CONNECTION_STRING` in your env file. Be sure to use your ODBC Connection String and substitue your password information.
104+
105+
![Image for Database Connection String setting in the Azure portal](docs/DabaseConnectionString.png)
106+
107+
Optionally if you'll be also using Application Ingishts please provide the value for `APPLICATIONINSIGHTS_CONNECTION_STRING`. You can search for this in your Azure Portal, going to the resource group you've created previously. Select the resource of type Application Insights and copy the Connection String in the Essentials section of the Overview page.
91108

92-
You will also need to provide the DATABASE_CONNECTION_STRING in your env file. Be sure to use your ODBC Connection String.
109+
![Image for Application Insigths setting in the Azure portal](docs/ApplicationInsightsSetting.png)
93110

94-
Optionally if you'll be also using Application Ingishts please provide the value for APPLICATIONINSIGHTS_CONNECTION_STRING. You can search for this in your Azure Portal, going to the resource group you've created previously. Select the resource of type Application Insights and copy the Connection String in the Essentials section of the Overview page.
111+
Optionally if you'll be also using Languange detection API please provide the value for `LANGUAGE_API_ENDPOINT`, `LANGUAGE_API_KEY`. You can search for this in your Azure Portal, going to the resource group you've created previously. Select the resource of type Language and go to Keys and Endpoint. Copy one of the keys and corresponding endpoint.
95112

96-
Optionally if you'll be also using Languange detection API please provide the value for LANGUAGE_API_ENDPOINT, LANGUAGE_API_KEY. You can search for this in your Azure Portal, going to the resource group you've created previously. Select the resource of type Language and go to Keys and Endpoint. Copy one of the keys and corresponding endpoint.
113+
![Image for Endpoint in Language Detection Service](docs/LanguageServiceEndpoint.png)
114+
![Image for Key in Language Detection Service](docs/LanguageServiceKeys.png)
97115

98116
To test your code, please run the following. You should see the 3 test cases pass.
99117

100118
```sh
119+
#Run the test cases!
101120
npm run test
102121
```
103122

104123
### Step 3. Deploy your App!
105124

106125
For a quick deployment you could open your Visual Studio Code and open the cloned project. Make sure you have the Azure Tools extension installed. If not, please install it https://marketplace.visualstudio.com/items?itemName=ms-vscode.vscode-node-azure-pack
107126

108-
Once you have the extension sign in to Azure with your credentials go to your Explorer view and right click in the file directory to select the option "Deploy to web app". Select the subscription in which you've created the resources in step 1. Select the name you chose for the App Service created in step 1.
127+
Once you have the extension sign in to Azure with your credentials go to your Explorer view and right click in the file directory to select the option `Deploy to web app`. Select the subscription in which you've created the resources in step 1. Select the name you chose for the App Service created in step 1.
109128

110129
Finally go to your GitHub App and update your webhook URL to reflect your App Service URL. Do not append "/probot".
111130

131+
![Alt text](docs/GitHubAppWebhookURL.png)
112132

113133
### Step 4. Test your App!
114134

287 KB
Loading

docs/DabaseConnectionString.png

161 KB
Loading
129 KB
Loading

docs/GitHubAppWebhookURL.png

65.4 KB
Loading

docs/LanguageServiceEndpoint.png

240 KB
Loading

docs/LanguageServiceKeys.png

255 KB
Loading

image.png

-90.8 KB
Binary file not shown.

0 commit comments

Comments
 (0)