Skip to content

Commit 24f8eef

Browse files
committed
feat(abtests) add metadata into metric
1 parent e6461d4 commit 24f8eef

File tree

1 file changed

+23
-13
lines changed

1 file changed

+23
-13
lines changed

specs/abtesting-v3/common/schemas/Variant.yml

Lines changed: 23 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ variant:
2828
metrics:
2929
$ref: "#/metrics"
3030
metadata:
31-
$ref: "#/metadata"
31+
$ref: "#/variantMetadata"
3232

3333
required:
3434
- index
@@ -60,14 +60,8 @@ metric:
6060
dimension:
6161
type: string
6262
description: Dimension defined during test creation
63-
winsorizedValue:
64-
type: number
65-
format: double
66-
description: |
67-
Only present in case the metric is 'revenue'.
68-
It is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance.
69-
It is tied to a per revenue-currency pair contrary to other
70-
global filter effects (such as outliers and empty search count).
63+
metadata:
64+
$ref: "#/metricMetadata"
7165
required:
7266
- name
7367
- updatedAt
@@ -84,19 +78,35 @@ metric:
8478
pValue: 0.004
8579
- name: revenue
8680
dimension: USD
87-
updatedAt": 2025-05-15T17:52:15.644906Z
81+
updatedAt: 2025-05-15T17:52:15.644906Z
8882
value: 1200.50
8983
pValue: 0.04
90-
example: 20.2
84+
metadata: { "winsorizedValue": 80.2 }
9185
- name: revenue
9286
dimension: EUR
9387
updatedAt: 2025-05-15T17:52:15.644906Z
9488
value: 999.66
9589
pValue: 0.04
96-
example: 888.44
90+
metadata: { "winsorizedValue": 888.8 }
9791

98-
metadata:
92+
variantMetadata:
9993
type: object
94+
description: Variant specific metadata
10095
properties:
10196
filterEffects:
10297
$ref: "../parameters.yml#/filterEffects"
98+
99+
metricMetadata:
100+
type: object
101+
description: Metric specific metadata
102+
properties:
103+
winsorizedValue:
104+
type: number
105+
format: double
106+
description: |
107+
Only present in case the metric is 'revenue'.
108+
It is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance.
109+
It is tied to a per revenue-currency pair contrary to other
110+
global filter effects (such as outliers and empty search count).
111+
example:
112+
winsorizedValue: 888.80

0 commit comments

Comments
 (0)