|
2598 | 2598 | {
|
2599 | 2599 | "cell_type": "markdown",
|
2600 | 2600 | "id": "12f42fc8-2f18-48a7-be7a-ba913fa915e5",
|
2601 |
| - "metadata": {}, |
| 2601 | + "metadata": { |
| 2602 | + "jp-MarkdownHeadingCollapsed": true |
| 2603 | + }, |
2602 | 2604 | "source": [
|
2603 | 2605 | "### General\n",
|
2604 | 2606 | "- Basic:\n",
|
2605 |
| - " - total of 264 tests (0.19%) have different results\n", |
| 2607 | + " - total of 226 tests (0.19%) have different results\n", |
2606 | 2608 | " - subresourceloadingCOEP_img is the worst offender (mostly caused by random behavior Firefox bug!, has nothing to do with our test infrastructure)\n",
|
2607 | 2609 | " - apart from subresourceloadingCOEP_img seems to be mostly timeout related and thus should be \"fixed\" by majority voting\n",
|
2608 | 2610 | "- Parsing:\n",
|
2609 |
| - " - total of 1501 tests (0.06%) have different results\n", |
| 2611 | + " - total of 1306 tests (0.07%) have different results\n", |
2610 | 2612 | " - subresourceloadingCOEP_img worst offender\n",
|
2611 | 2613 | " - fetch_GET (Safari only), and upgrade_HSTS (several browsers) also occurs\n",
|
2612 | 2614 | " - Safari (MacOS + iPad) has slightly higher rates than the other browsers"
|
|
3584 | 3586 | {
|
3585 | 3587 | "cell_type": "markdown",
|
3586 | 3588 | "id": "12e83670-77c8-4c13-addf-c03253a62e59",
|
3587 |
| - "metadata": {}, |
| 3589 | + "metadata": { |
| 3590 | + "jp-MarkdownHeadingCollapsed": true |
| 3591 | + }, |
3588 | 3592 | "source": [
|
3589 | 3593 | "### Test groups that are the most unstable\n",
|
3590 | 3594 | "- Overall mean: 0.07% of tests have more than one outcome\n",
|
|
4861 | 4865 | {
|
4862 | 4866 | "cell_type": "markdown",
|
4863 | 4867 | "id": "45c8c774-4bbc-4d8b-beb6-03a820dc8cd8",
|
4864 |
| - "metadata": {}, |
| 4868 | + "metadata": { |
| 4869 | + "jp-MarkdownHeadingCollapsed": true |
| 4870 | + }, |
4865 | 4871 | "source": [
|
4866 | 4872 | "### Majority Voting\n",
|
4867 | 4873 | "- Perform majority voting\n",
|
|
0 commit comments