Skip to content

Commit 25714ab

Browse files
committed
small better fix for fieller intervals math
1 parent be02958 commit 25714ab

File tree

2 files changed

+5
-4
lines changed

2 files changed

+5
-4
lines changed

cspell.json

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -746,7 +746,8 @@
746746
"IMDS",
747747
"resourcedetection",
748748
"llms",
749-
"LLMs"
749+
"LLMs",
750+
"mathrm"
750751
],
751752
"ignorePaths": [
752753
"node_modules/**",

docs/stats-engine/methodologies/fieller-intervals.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -26,11 +26,11 @@ We do this by calculating the parameter $\Large g$:
2626

2727
$$
2828
\Large
29-
g = \frac{Z_{\alpha/2}^2 \cdot var(X_C)}{(n_C-1) \cdot \overline{X_C}^2}
29+
g = \frac{Z_{\alpha/2}^2 \cdot \mathrm{var}(X_C)}{(n_C-1) \cdot \overline{X_C}^2}
3030
$$
3131

3232
Where:
33-
$\Large Z_{\alpha/2}$ is the critical value associated with the desired confidence level $\Large var(X_C)$ is the variance of the control group metric values $\Large n_C$ is the number of units in the control group $\Large \overline{X_C}$ is the mean of the control group metric values
33+
$\Large Z_{\alpha/2}$ is the critical value associated with the desired confidence level $\Large \mathrm{var}(X_C)$ is the variance of the control group metric values $\Large n_C$ is the number of units in the control group $\Large \overline{X_C}$ is the mean of the control group metric values
3434

3535
When $\Large g$ < 1, the control mean is significantly different from 0, and we can use Fieller intervals.
3636

@@ -40,7 +40,7 @@ Since the control and test group results are independent of each other, covarian
4040

4141
$$
4242
\Large
43-
CI(\% \Delta \overline{X} ) = \frac{1}{1-g} *(\frac{\overline{X_T}}{\overline{X_C}} \pm \frac{Z_{\alpha/2}}{\overline{X_C}} \sqrt{ \frac{\overline{X_T}^2}{\overline{X_C}^2} \cdot \frac{var(X_C)}{n_C-1} + (1-g)\frac{var(X_T)}{n_T-1} }) - 1
43+
CI(\% \Delta \overline{X} ) = \frac{1}{1-g} \left \frac{\overline{X_T}}{\overline{X_C}} \pm \frac{Z_{\alpha/2}}{\overline{X_C}} \sqrt{ \frac{\overline{X_T}^2}{\overline{X_C}^2} \cdot \frac{\mathrm{var}(X_C)}{n_C-1} + (1-g)\frac{\mathrm{var}(X_T)}{n_T-1} } \right - 1
4444
$$
4545

4646
### 2B: Edge Case: Control Mean not Statistically Distinct from Zero

0 commit comments

Comments
 (0)