Skip to content

Commit 0962d36

Browse files
algolia-botcdhawke
andcommitted
fix(specs): abtests metadata mean (#5121) (generated) [skip ci]
Co-authored-by: Christopher Hawke <[email protected]>
1 parent d059997 commit 0962d36

File tree

5 files changed

+47
-23
lines changed

5 files changed

+47
-23
lines changed

clients/algoliasearch-client-javascript/packages/abtesting/model/metricMetadata.ts

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,12 @@
55
*/
66
export type MetricMetadata = {
77
/**
8-
* Only present in case the metric is \'revenue\'. It is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance. It is tied to a per revenue-currency pair contrary to other global filter effects (such as outliers and empty search count).
8+
* Only present in case the metric is \'revenue\'. It is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance. It is tied to a per revenue-currency pair contrary to other global filter effects (such as outliers and empty search count).
99
*/
1010
winsorizedValue?: number | undefined;
11+
12+
/**
13+
* Mean value for this metric.
14+
*/
15+
mean?: number | undefined;
1116
};

clients/algoliasearch-client-javascript/packages/abtesting/model/metricResult.ts

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -13,12 +13,12 @@ export type MetricResult = {
1313
value: number;
1414

1515
/**
16-
* The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using either the relative ratio or relative difference between the metric values for the control and the variant. Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate), while relative difference is used for continuous metrics (e.g., revenue).
16+
* The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using either the relative ratio or relative difference between the metric values for the control and the variant. Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate), while relative difference is used for continuous metrics (e.g., revenue).
1717
*/
1818
valueCIHigh?: number | undefined;
1919

2020
/**
21-
* The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using either the relative ratio or relative difference between the metric values for the control and the variant. Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate), while relative difference is used for continuous metrics (e.g., revenue).
21+
* The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using either the relative ratio or relative difference between the metric values for the control and the variant. Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate), while relative difference is used for continuous metrics (e.g., revenue).
2222
*/
2323
valueCILow?: number | undefined;
2424

@@ -35,7 +35,7 @@ export type MetricResult = {
3535
metadata?: MetricMetadata | undefined;
3636

3737
/**
38-
* The value that was computed during error correction. It is used to determine significance of the metric pValue. The critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given configuration during the A/B test creation.
38+
* The value that was computed during error correction. It is used to determine significance of the metric pValue. The critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given configuration during the A/B test creation.
3939
*/
4040
criticalValue?: number | undefined;
4141

docs/bundled/abtesting-v3.json

Lines changed: 12 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -992,11 +992,18 @@
992992
"winsorizedValue": {
993993
"type": "number",
994994
"format": "double",
995-
"description": "Only present in case the metric is 'revenue'. \nIt is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance.\nIt is tied to a per revenue-currency pair contrary to other \nglobal filter effects (such as outliers and empty search count).\n"
995+
"description": "Only present in case the metric is 'revenue'.\nIt is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance.\nIt is tied to a per revenue-currency pair contrary to other\nglobal filter effects (such as outliers and empty search count).\n"
996+
},
997+
"mean": {
998+
"type": "number",
999+
"format": "double",
1000+
"description": "Mean value for this metric.",
1001+
"example": 53.7
9961002
}
9971003
},
9981004
"example": {
999-
"winsorizedValue": 888.8
1005+
"winsorizedValue": 888.8,
1006+
"mean": 53.7
10001007
}
10011008
},
10021009
"metricResult": {
@@ -1016,12 +1023,12 @@
10161023
"valueCIHigh": {
10171024
"type": "number",
10181025
"format": "double",
1019-
"description": "The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using \neither the relative ratio or relative difference between the metric values for the control and the variant.\nRelative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate), \nwhile relative difference is used for continuous metrics (e.g., revenue).\n"
1026+
"description": "The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using\neither the relative ratio or relative difference between the metric values for the control and the variant.\nRelative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),\nwhile relative difference is used for continuous metrics (e.g., revenue).\n"
10201027
},
10211028
"valueCILow": {
10221029
"type": "number",
10231030
"format": "double",
1024-
"description": "The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using \neither the relative ratio or relative difference between the metric values for the control and the variant.\nRelative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate), \nwhile relative difference is used for continuous metrics (e.g., revenue).\n"
1031+
"description": "The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using\neither the relative ratio or relative difference between the metric values for the control and the variant.\nRelative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),\nwhile relative difference is used for continuous metrics (e.g., revenue).\n"
10251032
},
10261033
"pValue": {
10271034
"type": "number",
@@ -1038,7 +1045,7 @@
10381045
"criticalValue": {
10391046
"type": "number",
10401047
"format": "double",
1041-
"description": "The value that was computed during error correction. It is used to determine significance of the metric pValue.\nThe critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given \nconfiguration during the A/B test creation.\n"
1048+
"description": "The value that was computed during error correction. It is used to determine significance of the metric pValue.\nThe critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given\nconfiguration during the A/B test creation.\n"
10421049
},
10431050
"significant": {
10441051
"type": "boolean",

docs/bundled/abtesting-v3.yml

Lines changed: 13 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1126,17 +1126,23 @@ components:
11261126
type: number
11271127
format: double
11281128
description: >
1129-
Only present in case the metric is 'revenue'.
1129+
Only present in case the metric is 'revenue'.
11301130
11311131
It is the amount exceeding the 95th percentile of global revenue
11321132
transactions involved in the AB Test. This amount is not considered
11331133
when calculating statistical significance.
11341134
1135-
It is tied to a per revenue-currency pair contrary to other
1135+
It is tied to a per revenue-currency pair contrary to other
11361136
11371137
global filter effects (such as outliers and empty search count).
1138+
mean:
1139+
type: number
1140+
format: double
1141+
description: Mean value for this metric.
1142+
example: 53.7
11381143
example:
11391144
winsorizedValue: 888.8
1145+
mean: 53.7
11401146
metricResult:
11411147
type: object
11421148
properties:
@@ -1153,13 +1159,13 @@ components:
11531159
format: double
11541160
description: >
11551161
The upper bound of the 95% confidence interval for the metric value.
1156-
The confidence interval is calculated using
1162+
The confidence interval is calculated using
11571163
11581164
either the relative ratio or relative difference between the metric
11591165
values for the control and the variant.
11601166
11611167
Relative ratio is used for metrics that are ratios (e.g.,
1162-
click-through rate, conversion rate),
1168+
click-through rate, conversion rate),
11631169
11641170
while relative difference is used for continuous metrics (e.g.,
11651171
revenue).
@@ -1168,13 +1174,13 @@ components:
11681174
format: double
11691175
description: >
11701176
The lower bound of the 95% confidence interval for the metric value.
1171-
The confidence interval is calculated using
1177+
The confidence interval is calculated using
11721178
11731179
either the relative ratio or relative difference between the metric
11741180
values for the control and the variant.
11751181
11761182
Relative ratio is used for metrics that are ratios (e.g.,
1177-
click-through rate, conversion rate),
1183+
click-through rate, conversion rate),
11781184
11791185
while relative difference is used for continuous metrics (e.g.,
11801186
revenue).
@@ -1198,7 +1204,7 @@ components:
11981204
determine significance of the metric pValue.
11991205
12001206
The critical value is calculated using Bonferroni or
1201-
Benjamini-Hochberg corrections, based on the given
1207+
Benjamini-Hochberg corrections, based on the given
12021208
12031209
configuration during the A/B test creation.
12041210
significant:

specs/bundled/abtesting-v3.yml

Lines changed: 13 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -796,17 +796,23 @@ components:
796796
type: number
797797
format: double
798798
description: >
799-
Only present in case the metric is 'revenue'.
799+
Only present in case the metric is 'revenue'.
800800
801801
It is the amount exceeding the 95th percentile of global revenue
802802
transactions involved in the AB Test. This amount is not considered
803803
when calculating statistical significance.
804804
805-
It is tied to a per revenue-currency pair contrary to other
805+
It is tied to a per revenue-currency pair contrary to other
806806
807807
global filter effects (such as outliers and empty search count).
808+
mean:
809+
type: number
810+
format: double
811+
description: Mean value for this metric.
812+
example: 53.7
808813
example:
809814
winsorizedValue: 888.8
815+
mean: 53.7
810816
metricResult:
811817
type: object
812818
properties:
@@ -823,13 +829,13 @@ components:
823829
format: double
824830
description: >
825831
The upper bound of the 95% confidence interval for the metric value.
826-
The confidence interval is calculated using
832+
The confidence interval is calculated using
827833
828834
either the relative ratio or relative difference between the metric
829835
values for the control and the variant.
830836
831837
Relative ratio is used for metrics that are ratios (e.g.,
832-
click-through rate, conversion rate),
838+
click-through rate, conversion rate),
833839
834840
while relative difference is used for continuous metrics (e.g.,
835841
revenue).
@@ -838,13 +844,13 @@ components:
838844
format: double
839845
description: >
840846
The lower bound of the 95% confidence interval for the metric value.
841-
The confidence interval is calculated using
847+
The confidence interval is calculated using
842848
843849
either the relative ratio or relative difference between the metric
844850
values for the control and the variant.
845851
846852
Relative ratio is used for metrics that are ratios (e.g.,
847-
click-through rate, conversion rate),
853+
click-through rate, conversion rate),
848854
849855
while relative difference is used for continuous metrics (e.g.,
850856
revenue).
@@ -868,7 +874,7 @@ components:
868874
determine significance of the metric pValue.
869875
870876
The critical value is calculated using Bonferroni or
871-
Benjamini-Hochberg corrections, based on the given
877+
Benjamini-Hochberg corrections, based on the given
872878
873879
configuration during the A/B test creation.
874880
significant:

0 commit comments

Comments
 (0)