Skip to content

Commit e6461d4

Browse files
committed
feat(abtests) move filterEffects in metadata + add description to pValue
1 parent e3a544e commit e6461d4

File tree

1 file changed

+16
-8
lines changed

1 file changed

+16
-8
lines changed

specs/abtesting-v3/common/schemas/Variant.yml

Lines changed: 16 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -21,14 +21,15 @@ variant:
2121
2222
The A/B test configuration must include a `mininmumDetectableEffect` setting for this number to be included in the response.
2323
example: 0
24-
filterEffects:
25-
$ref: "../parameters.yml#/filterEffects"
2624
index:
2725
$ref: "../parameters.yml#/index"
2826
trafficPercentage:
2927
$ref: "../parameters.yml#/trafficPercentage"
3028
metrics:
3129
$ref: "#/metrics"
30+
metadata:
31+
$ref: "#/metadata"
32+
3233
required:
3334
- index
3435
- description
@@ -52,9 +53,10 @@ metric:
5253
value:
5354
type: number
5455
format: double
55-
pvalue:
56+
pValue:
5657
type: number
5758
format: double
59+
description: PValue for the first variant (control) will always be 0. For the other variants, pValue is calculated for the current variant based on the control.
5860
dimension:
5961
type: string
6062
description: Dimension defined during test creation
@@ -70,25 +72,31 @@ metric:
7072
- name
7173
- updatedAt
7274
- value
73-
- pvalue
75+
- pValue
7476
example:
7577
- name: addToCartCount
7678
updatedAt: 2025-06-15T15:06:44.400601Z
7779
value: 5
78-
pvalue: 0.01
80+
pValue: 0.01
7981
- name: clickThroughRate
8082
updatedAt: 2025-05-15T17:52:15.644906Z
8183
value: 0.20869847452125934
82-
pvalue: 0.004
84+
pValue: 0.004
8385
- name: revenue
8486
dimension: USD
8587
updatedAt": 2025-05-15T17:52:15.644906Z
8688
value: 1200.50
8789
pValue: 0.04
88-
winsorizedValue: 1123.45
90+
example: 20.2
8991
- name: revenue
9092
dimension: EUR
9193
updatedAt: 2025-05-15T17:52:15.644906Z
9294
value: 999.66
9395
pValue: 0.04
94-
winsorizedValue: 888.44
96+
example: 888.44
97+
98+
metadata:
99+
type: object
100+
properties:
101+
filterEffects:
102+
$ref: "../parameters.yml#/filterEffects"

0 commit comments

Comments
 (0)