Skip to content

Commit 407e585

Browse files
author
hp23 Server
committed
Add Safari bug reports
1 parent 6e862bb commit 407e585

File tree

1 file changed

+94
-23
lines changed

1 file changed

+94
-23
lines changed

‎_hp/hp/tools/analysis/analysis_december_2024.ipynb‎

Lines changed: 94 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -21954,25 +21954,23 @@
2195421954
{
2195521955
"cell_type": "markdown",
2195621956
"id": "b2bbd3e0-73bf-4fa5-969a-73efbeb213df",
21957-
"metadata": {
21958-
"jp-MarkdownHeadingCollapsed": true
21959-
},
21957+
"metadata": {},
2196021958
"source": [
2196121959
"### Safari (MacOS 14.3.1) vs Safari (MacOS 15.2)\n",
2196221960
"- Start: 13:47\n",
2196321961
"- End: 16:06\n",
2196421962
"- Time taken: 1h30m\n",
2196521963
"- Total of 1866 diffs\n",
21966-
"- **TODO** ~3 new bug reports to WebKit!\n",
21964+
"- ~3 new bug reports to WebKit!\n",
2196721965
"- Changes:\n",
21968-
" - **TODO report** New behavior: `:<header>: <value>` is a network error in WebKit, was skipped before (and it other browsers)\n",
21969-
" - New WebKit behavior (related to row 3 and 1): `\\r<header> | <header>\\n` and similar are now network error in WebKit (before they were skipped and/or accepted which is still the case in other browsers)\n",
21970-
" - **TODO report** New behavior (bug?!): `<whitespace><header>: <value>` is now allowed in WebKit\n",
21966+
" - **[New report](https://bugs.webkit.org/show_bug.cgi?id=285661)** New behavior: `:<header>: <value>` is a network error in WebKit, was skipped before (and it other browsers)\n",
21967+
" - New WebKit behavior (related to row 3 and 1): `\\r<header> | <header>\\n | <header>: <val \\r ue>` and similar are now network error in WebKit (before they were skipped and/or accepted which is still the case in other browsers)\n",
21968+
" - **[New report](https://bugs.webkit.org/show_bug.cgi?id=285606)** New behavior (bug?!): `<whitespace><header>: <value>` is now allowed in WebKit (issue in underlying apple system)\n",
2197121969
" - New WebKit behavior (row 4): `<header>\\t: <value>` rows are now ignored (same as Firefox)\n",
2197221970
" - New WebKit behavior (row 8/9): mixed image autoupgrades (TAO and subresourceloading/CSP is affected)\n",
21973-
" - New WebKit behavior (row 28): TAO and 302 fixed\n",
21974-
" - New WebKit behavior (row 20): NULL and fetch fixed\n",
21975-
" - **TODO report** New WebKit behavior (bug?!): HSTS only works with devtools open??\n",
21971+
" - WebKit behavior (row 28): TAO and 302 fixed\n",
21972+
" - WebKit behavior (row 20): NULL and fetch fixed\n",
21973+
" - **[New report](https://bugs.webkit.org/show_bug.cgi?id=285660)** New WebKit behavior (bug?!): ~~HSTS only works with devtools open?~~; timing/race condition of setting HSTS and starting new requests\n",
2197621974
" - Some noise/strange results for subresourceloadingCORP_img: could be a caching (or timeout) issue in both new or old Safari or both"
2197721975
]
2197821976
},
@@ -22171,7 +22169,7 @@
2217122169
"# New general parsing change(s)\n",
2217222170
"# Related to 1-5 in Table 5\n",
2217322171
"# (no entry yet?, new behavior only in WebKit) :<header>: <value> is now \"network error\" in WebKit \"failed to load resource cannot parse response\", such rows are simply ignored/skipped in Firefox/Chrome (old WebKit)\n",
22174-
"# (similar to row 3 and 1, but network error) \\r<header> | <header>\\r | <head \\r er> | <header>\\n all now result in \"network error\"\n",
22172+
"# (similar to row 3 and 1, but network error) \\r<header> | <header>\\r | <head \\r er> | <header>\\n all now result in \"network error\" such rows are ignored or accepted in Firefox/Chrome (depends)\n",
2217522173
"# fullscreen_iframe_direct 30/30\n",
2217622174
"# fullscreen_iframe_child_allow 15/15\n",
2217722175
"# sniffing_script_direct 8/16 \n",
@@ -22224,7 +22222,7 @@
2222422222
"# upgradeHSTS_subdomain_subdomain: 8/291\n",
2222522223
"# upgradeHSTS_direct_direct: 8/828\n",
2222622224
"\n",
22227-
"# (no entry yet) HSTS caching issue? with devtools closed\n",
22225+
"# (no entry yet) HSTS race condition\n",
2222822226
"# Example upgradeHSTS_subdomain_subdomain_http_sub.headers.websec.saarland_https_sub.headers.websec.saarland_134_basic\n",
2222922227
"# upgradeHSTS_subdomain_subdomain ~270/291 (a small number of these belong to row 16 or row 4 instead)\n",
2223022228
"# upgradeHSTS_direct_direct ~800/828 (a small number of these belong to row 16 or row 4 instead)\n",
@@ -22236,19 +22234,19 @@
2223622234
},
2223722235
{
2223822236
"cell_type": "code",
22239-
"execution_count": 229,
22237+
"execution_count": 310,
2224022238
"id": "bdf73f36-3c44-426e-ba41-55c46dee9562",
2224122239
"metadata": {},
2224222240
"outputs": [
2224322241
{
2224422242
"data": {
2224522243
"application/vnd.jupyter.widget-view+json": {
22246-
"model_id": "4ea8d8f248d349b4a83ee4c3fee71baf",
22244+
"model_id": "ea3237424d9b49e1a64350428b9c804d",
2224722245
"version_major": 2,
2224822246
"version_minor": 0
2224922247
},
2225022248
"text/plain": [
22251-
"Tab(children=(Output(), Output(), Output(), Output()), selected_index=0, titles=('Group 0', 'Group 1', 'Group …"
22249+
"Tab(children=(Output(), Output()), selected_index=0, titles=('Group 0', 'Group 1'))"
2225222250
]
2225322251
},
2225422252
"metadata": {},
@@ -22257,7 +22255,7 @@
2225722255
],
2225822256
"source": [
2225922257
"browser_ids = [73, 51]\n",
22260-
"test_name = \"upgradeHSTS_direct\"\n",
22258+
"test_name = \"fullscreen_iframe\"\n",
2226122259
"#test_name = \"fetch_GET\"\n",
2226222260
"relation = None\n",
2226322261
"show_response_groups(test_name, browser_ids=browser_ids, relation=relation)"
@@ -22723,10 +22721,10 @@
2272322721
"- Total of 167 diffs\n",
2272422722
"- Framing: 38 + 19, code 300 (#7, fixed), XFO whitspace (#15, fixed)\n",
2272522723
"- SubresourceloadingCOEP: 6 (code 300, #7 fixed), 32 continuing random CORP caching (#35)\n",
22726-
"- perfAPI/TAO: 2 (code 300, #7 fixed), 16 related to #29 (not fixed but changed, **TODO update bug report?**, entry is still with the old URL but requestStart is 0 even though it should not be 0)\n",
22724+
"- perfAPI/TAO: 2 (code 300, #7 fixed), 16 related to #29 (not fixed but changed, **updated bug report**, entry is still with the old URL but requestStart is 0 even though it should not be 0)\n",
2272722725
"- fetch: 18 (code 300, #7 fixed)\n",
22728-
"- access_window: 8x changed handling of extra \\n in headers, before such responses were downloaded (null) now they are rendered as plaintext (related to #3 and #37), probably known?\n",
22729-
"- imgloading: 6 (code 300, #7 fixed), fullscreen_iframe: 6+3 (code 300, #7 fixed), referrer_iframe: 3 (code 300, #7 fixed), script_execution 2 (#7), \n",
22726+
"- access_window: 8x changed handling of extra \\n in headers, before such responses were downloaded (null) now they are rendered as plaintext (related to #3 and #36, #37), probably known?\n",
22727+
"- imgloading: 6 (code 300, #7 fixed), fullscreen_iframe: 6+3 (code 300, #7 fixed), referrer_iframe: 3 (code 300, #7 fixed), script_execution 2 (#7 fixed), \n",
2273022728
"- subresourceloadingCORP_img: 4 (code 300, #7 fixed), 1 better mixed content upgrades (related to #8, fixed?)\n",
2273122729
"- upgradeHSTS: 2 (#16, fixed), 1 (code 300, #7 fixed)"
2273222730
]
@@ -22915,19 +22913,19 @@
2291522913
},
2291622914
{
2291722915
"cell_type": "code",
22918-
"execution_count": 162,
22916+
"execution_count": 306,
2291922917
"id": "357813dd-3fc0-426f-bbc5-b8bc3814bf4e",
2292022918
"metadata": {},
2292122919
"outputs": [
2292222920
{
2292322921
"data": {
2292422922
"application/vnd.jupyter.widget-view+json": {
22925-
"model_id": "873714357bd349748174279c359bea70",
22923+
"model_id": "c79a5fbad30a4bfea0eaa1f2a5ba5600",
2292622924
"version_major": 2,
2292722925
"version_minor": 0
2292822926
},
2292922927
"text/plain": [
22930-
"Tab(children=(Output(), Output(), Output(), Output(), Output(), Output()), selected_index=0, titles=('Group 0'…"
22928+
"Tab(children=(Output(), Output(), Output(), Output()), selected_index=0, titles=('Group 0', 'Group 1', 'Group …"
2293122929
]
2293222930
},
2293322931
"metadata": {},
@@ -22938,10 +22936,83 @@
2293822936
"browser_ids = [61, 75]\n",
2293922937
"#browser_ids = [74, 75]\n",
2294022938
"#browser_ids = [74, 76]\n",
22941-
"test_name = \"upgradeHSTS_subdomain\"\n",
22939+
"test_name = \"perfAPI_img\"\n",
2294222940
"relation = None\n",
2294322941
"show_response_groups(test_name, browser_ids=browser_ids, relation=relation)"
2294422942
]
22943+
},
22944+
{
22945+
"cell_type": "code",
22946+
"execution_count": 305,
22947+
"id": "8408f925-c155-4e4b-ba12-99f61b9c60d8",
22948+
"metadata": {},
22949+
"outputs": [
22950+
{
22951+
"data": {
22952+
"text/html": [
22953+
"<div>\n",
22954+
"<style scoped>\n",
22955+
" .dataframe tbody tr th:only-of-type {\n",
22956+
" vertical-align: middle;\n",
22957+
" }\n",
22958+
"\n",
22959+
" .dataframe tbody tr th {\n",
22960+
" vertical-align: top;\n",
22961+
" }\n",
22962+
"\n",
22963+
" .dataframe thead th {\n",
22964+
" text-align: right;\n",
22965+
" }\n",
22966+
"</style>\n",
22967+
"<table border=\"1\" class=\"dataframe\">\n",
22968+
" <thead>\n",
22969+
" <tr style=\"text-align: right;\">\n",
22970+
" <th></th>\n",
22971+
" <th>browser</th>\n",
22972+
" </tr>\n",
22973+
" <tr>\n",
22974+
" <th>outcome_str</th>\n",
22975+
" <th></th>\n",
22976+
" </tr>\n",
22977+
" </thead>\n",
22978+
" <tbody>\n",
22979+
" <tr>\n",
22980+
" <th>{'window.open.opener': 'null'}</th>\n",
22981+
" <td>[brave Ubuntu 22.04 v1.62.156 (121.0.6167.139) selenium headless-new, brave Ubuntu 22.04 v1.73.101 (Chromium 131.0.6778.139) selenium headless-new, chrome Android 11 121.0.6167.180 intent real, chrome Ubuntu 22.04 120 selenium headless-new, chrome Ubuntu 22.04 121 selenium headless-new, chrome Ubuntu 22.04 122 selenium headless-new, chrome Ubuntu 22.04 131 selenium headless-new, firefox Ubuntu 22.04 121 selenium headless, firefox Ubuntu 22.04 122 selenium headless, firefox Ubuntu 22.04 123 selenium headless]</td>\n",
22982+
" </tr>\n",
22983+
" <tr>\n",
22984+
" <th>{'window.open.opener': 'object \"[object Window]\"'}</th>\n",
22985+
" <td>[brave Android 11 1.62.165_shield intent real, chrome iPadOS 17.3.1 122.0.6261.89 intent real, firefox Ubuntu 22.04 133 selenium headless, firefox_beta Android 11 123.0b9 intent real, safari macOS 14.3.1 17.3.1 selenium real, safari macOS 15.2 18.2 selenium real]</td>\n",
22986+
" </tr>\n",
22987+
" </tbody>\n",
22988+
"</table>\n",
22989+
"</div>"
22990+
],
22991+
"text/plain": [
22992+
" browser\n",
22993+
"outcome_str \n",
22994+
"{'window.open.opener': 'null'} [brave Ubuntu 22.04 v1.62.156 (121.0.6167.139) selenium headless-new, brave Ubuntu 22.04 v1.73.101 (Chromium 131.0.6778.139) selenium headless-new, chrome Android 11 121.0.6167.180 intent real, chrome Ubuntu 22.04 120 selenium headless-new, chrome Ubuntu 22.04 121 selenium headless-new, chrome Ubuntu 22.04 122 selenium headless-new, chrome Ubuntu 22.04 131 selenium headless-new, firefox Ubuntu 22.04 121 selenium headless, firefox Ubuntu 22.04 122 selenium headless, firefox Ubuntu 22.04 123 selenium headless]\n",
22995+
"{'window.open.opener': 'object \"[object Window]\"'} [brave Android 11 1.62.165_shield intent real, chrome iPadOS 17.3.1 122.0.6261.89 intent real, firefox Ubuntu 22.04 133 selenium headless, firefox_beta Android 11 123.0b9 intent real, safari macOS 14.3.1 17.3.1 selenium real, safari macOS 15.2 18.2 selenium real]"
22996+
]
22997+
},
22998+
"metadata": {},
22999+
"output_type": "display_data"
23000+
}
23001+
],
23002+
"source": [
23003+
"test_id = \"accesswindow_direct_direct_https_sub.headers.websec.saarland_https_headers.webappsec.eu_21640_parsing\"\n",
23004+
"test_id = \"accesswindow_direct_direct_https_sub.headers.websec.saarland_https_headers.webappsec.eu_23242_parsing\"\n",
23005+
"with pd.option_context(\"display.max_colwidth\", None):\n",
23006+
" display(tree_df.loc[tree_df[\"test_id\"] == test_id].groupby(\"outcome_str\")[\"browser\"].unique().to_frame())"
23007+
]
23008+
},
23009+
{
23010+
"cell_type": "code",
23011+
"execution_count": null,
23012+
"id": "c247df91-7ca3-4924-9242-a9163f3a6fa5",
23013+
"metadata": {},
23014+
"outputs": [],
23015+
"source": []
2294523016
}
2294623017
],
2294723018
"metadata": {

0 commit comments

Comments
 (0)