Skip to content

Commit e5ad862

Browse files
dadlerjdadlerj
authored
Update analytics docs and add a page on PCW (#1020)
Pulled from https://docs.google.com/document/d/1QMnER7dfMOm3IA1o0zMBApbmMNpLLAxK3WMOIIDED1c/edit?tab=t.0#heading=h.9zwkph4mow2 --------- Co-authored-by: Dan Adler <[email protected]>
1 parent 4ad20ea commit e5ad862

File tree

2 files changed

+83
-39
lines changed

2 files changed

+83
-39
lines changed

‎docs/analytics/index.mdx‎

Lines changed: 47 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,8 @@ Self-hosted customers can also use this service, but they must
99

1010
Upgrade to a supported version of Sourcegraph (5.9+)
1111
Have fully enabled usage telemetry.
12-
- [Enablement instructions](/analytics/cloud#enablement)
12+
13+
- [Enablement instructions](/analytics/cloud#enablement)
1314

1415
![Sourcegraph-cloud-analytics](https://storage.googleapis.com/sourcegraph-assets/Docs/Sourcegraph-Analytics-2025-01-28.png)
1516

@@ -25,9 +26,16 @@ We provide a set of metrics that can be used to monitor Sourcegraph usage, engag
2526

2627
Learn more about how we think about [the ROI of Sourcegraph in our blog](https://sourcegraph.com/blog/measuring-the-impact-of-ai-coding-tools).
2728

28-
### User metrics available
29+
### Overview metrics
30+
31+
| Metric | Description |
32+
| ------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------ |
33+
| Percent of code written by Cody | Percentage of code written by Cody out of all code written during the selected time. [Learn more about this metric.](/analytics/pcw) |
34+
| Lines of code written by Cody | Total lines of code written by Cody during the selected time |
35+
36+
### User metrics
2937

30-
| Metric | Description |
38+
| Metric | Description |
3139
| --------------------------------------------------- | ----------------------------------------------------------------------------------------------------- |
3240
| Total active users | Total number of unique users who have used any Sourcegraph product during the selected time |
3341
| Average daily users | The average number of unique users who use Sourcegraph per day during the selected time |
@@ -43,60 +51,60 @@ Cody-only user metrics
4351

4452
Many of the metrics above are also available for Cody only. However, some user definitions are slightly different:
4553

46-
| User category | Description |
54+
| User category | Description |
4755
| ------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------- |
4856
| Authenticated users | All users signed in to Cody in an editor or interacted with Cody on the web during the selected period. [Read more](/admin/pricing#authenticated-users). |
4957
| Active users | All users who sign in to Cody in an editor or interact with Cody on the web during the period selected. [Read more](/admin/pricing#billable-active-users). |
5058

5159
### Code Search & navigation metrics
5260

53-
| Metric | Description |
54-
| ------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------ |
55-
| Total in-product searchers | Number of unique users who performed searches using the Sourcegraph search interface during the selected time |
56-
| Total result clicks | Count of times users clicked on search results to view files or other resources during the selected time |
57-
| Total file views | Number of times users viewed individual files through Sourcegraph during the selected time |
58-
| Daily in-product search activity | Count of search operations performed each day through the Sourcegraph interface |
59-
| Daily search users (in-product and API) | Number of unique users performing searches each day, including both UI and API usage |
60-
| All searches (in-product and API) by type | Breakdown of searches by category (e.g., literal, regex), including both UI and API usage |
61-
| Total code navigation actions | Count of all code navigation operations performed (e.g., go-to-definition, find references) during the selected time period |
62-
| Precise code navigation % | Percentage of code navigation actions that used precise intelligence rather than search-based results during the selected time |
63-
| Daily code navigation activity | Count of code navigation operations performed each day |
64-
| Daily code navigation users | Number of unique users utilizing code navigation features each day |
65-
| Precise vs. search-based code navigation actions by language | Comparison of precise vs. search-based navigation success rates broken down by programming language |
61+
| Metric | Description |
62+
| ------------------------------------------------------------ | -------------------------------------------------------------------------------------------------------------------------------------------- |
63+
| Total in-product searchers | Number of unique users who performed searches using the Sourcegraph search interface during the selected time |
64+
| Total result clicks | Count of times users clicked on search results to view files or other resources during the selected time |
65+
| Total file views | Number of times users viewed individual files through Sourcegraph during the selected time |
66+
| Hours saved | The number of hours saved by search and code navigation users, assuming 5 minutes saved per search and 30 seconds per code navigation action |
67+
| Daily in-product search activity | Count of search operations performed each day through the Sourcegraph interface |
68+
| Daily search users (in-product and API) | Number of unique users performing searches each day, including both UI and API usage |
69+
| All searches (in-product and API) by type | Breakdown of searches by category (e.g., literal, regex), including both UI and API usage |
70+
| Total code navigation actions | Count of all code navigation operations performed (e.g., go-to-definition, find references) during the selected time period |
71+
| Precise code navigation % | Percentage of code navigation actions that used precise intelligence rather than search-based results during the selected time |
72+
| Daily code navigation activity | Count of code navigation operations performed each day |
73+
| Daily code navigation users | Number of unique users utilizing code navigation features each day |
74+
| Precise vs. search-based code navigation actions by language | Comparison of precise vs. search-based navigation success rates broken down by programming language |
6675

6776
### Autocompletion metrics
6877

69-
| Metric | Description |
70-
| ------------------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
71-
| Total accepted completions | Count of completions accepted by users during the selected time |
72-
| Hours saved | The number of hours saved by Cody users, assuming 2 minutes saved per completion |
73-
| Completions by day | The number of completions suggested by day and by editor. |
74-
| Completion acceptance rate (CAR) | The percent of completions presented to a user for at least 750ms accepted by day, the editor, day, and month. |
78+
| Metric | Description |
79+
| ------------------------------------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
80+
| Total accepted completions | Count of completions accepted by users during the selected time |
81+
| Hours saved | The number of hours saved by Cody users, assuming 2 minutes saved per completion |
82+
| Completions by day | The number of completions suggested by day and by editor. |
83+
| Completion acceptance rate (CAR) | The percent of completions presented to a user for at least 750ms accepted by day, the editor, day, and month. |
7584
| Weighted completion acceptance rate (wCAR) | Similar to CAR, but weighted by the number of characters presented in the completion, by the editor, day, and month. This assigns more "weight" to accepted completions that provide more code to the user. |
76-
| Completion persistence rate | Percent of completions that are retained or mostly retained (67%+ of inserted text) after various time intervals. |
77-
| Average completion latency (ms) | The average milliseconds of latency before a user is presented with a completion suggestion by an editor. |
78-
| Acceptance rate by language | CAR and total completion suggestions broken down by editor during the selected time |
85+
| Completion persistence rate | Percent of completions that are retained or mostly retained (67%+ of inserted text) after various time intervals. |
86+
| Average completion latency (ms) | The average milliseconds of latency before a user is presented with a completion suggestion by an editor. |
87+
| Acceptance rate by language | CAR and total completion suggestions broken down by editor during the selected time |
7988

8089
### Chat and prompt metrics
8190

82-
| Metric | Description |
83-
| ---------------------------------------------------- | ------------------------------------------------------------------------------------------------------------- |
84-
| Total chat events | Total number of chat interactions with Cody during the selected time |
85-
| Minutes saved per chat | Average time saved per chat interaction with Cody during the selected time |
86-
| Hours saved by chats | Total hours saved through Cody chat interactions during the selected time , assuming 5 minutes saved per chat |
87-
| Cody chats by day | Daily count of chat interactions |
88-
| Cody chat users | Daily count of chat users |
89-
| Lines of code inserted | Lines of code generated by Cody in chat that get applied, inserted, or pasted into the editor. Only VS Code is included in this metric for now |
90-
| Insert rate | Percent of code generated by Cody in chat that gets applied, inserted, or pasted into the editor. Only VS Code is included in this metric for now |
91-
| Chat apply & insert persistence rate | Percent of code inserted by Apply and Insert actions that are retained or mostly retained (67%+ of inserted text) after various time intervals |
92-
| Prompts created, edited, and deleted by day | Daily count of prompt management activities, including creation, modification, and removal |
93-
| Users creating, editing, and deleting prompts by day | Number of unique users performing prompt management activities each day |
91+
| Metric | Description |
92+
| ---------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------- |
93+
| Total chat events | Total number of chat interactions with Cody during the selected time |
94+
| Hours saved by chats | Total hours saved through Cody chat interactions during the selected time , assuming 5 minutes saved per chat |
95+
| Cody chats by day | Daily count of chat interactions |
96+
| Cody chat users | Daily count of chat users |
97+
| Lines of code inserted | Lines of code generated by Cody in chat that get applied, inserted, or pasted into the editor. Only VS Code is included in this metric for now |
98+
| Insert rate | Percent of code generated by Cody in chat that gets applied, inserted, or pasted into the editor. Only VS Code is included in this metric for now |
99+
| Chat apply & insert persistence rate | Percent of code inserted by Apply and Insert actions that are retained or mostly retained (67%+ of inserted text) after various time intervals |
100+
| Prompts created, edited, and deleted by day | Daily count of prompt management activities, including creation, modification, and removal |
101+
| Users creating, editing, and deleting prompts by day | Number of unique users performing prompt management activities each day |
94102

95103
### Command metrics (deprecated)
96104

97105
_As of Sourcegraph version 5.10, commands are being deprecated in favor of our new feature, chat prompts. As a result, if your Sourcegraph instance is running version 5.10 or later, you may see decreased command usage. In the coming weeks, these command metrics will be deprecated and replaced with new prompt metrics on the Chats tab._
98106

99-
| Metric | Description |
107+
| Metric | Description |
100108
| ----------------------- | ----------------------------------------------------------------------------------------------------------- |
101109
| Total command events | Total number of command executions during the selected time |
102110
| Hours saved by commands | Total hours saved through command executions during the selected time, assuming 5 minutes saved per command |

0 commit comments

Comments
 (0)