Some Playwright Chromium/Javascript URLs fail after v0.39.15

[freddieleeman]

Describe the bug
Some Playwright Chromium/Javascript URLs fail after upgrading to v0.39.16. Running changeditection.io:latest in docker, as well as browserless/chrome:latest. I have not changed anything to the Browserless docker.

Version
Exact version in the top right area: 0.39.16

To Reproduce

Steps to reproduce the behavior:

1. Add URL https://twitter.com/search?q=%22changedetection.io%22&src=typed_query&f=live
2. Click on 'Save & Preview'

Expected behavior
Results (see screenshots).

Screenshots

Additional context
I monitor 40 URLs and 5 fail (not just Twitter) after upgrading to 0.39.16

[freddieleeman]

Another example:

URL: https://1drv.ms/f/s!Ainhp1nBLzMJrEeyV5NOiKa8zDA3

[dgtlmoon]

whats in the [screenshot] part?

[freddieleeman]

0.39.15:

0.39.16:

[dgtlmoon]

Converted to discussion - please dont open issue queue items for this stuff, there are some changes but it's incredibly complex and I cannot do anything more than just offer general advice

try increasing this number to like 20 - twitter is a real pain

[freddieleeman]

Since this issue surfaced with the latest update, I think we can agree that this is due to code changes. Therefore, I would classify this as an issue, not a discussion.

[dgtlmoon]

but the whole stack is insanely complex, there are some changes, but "undoing" those changes will break other stuff and I will be awake for the next week trying to solve them, not you :)

so for now, i dont know what the solution is, and maybe the solution is some bigger picture stuff, like community shared settings per website or something.. unsure..

i'll make an issue when i can be more specific

[dgtlmoon]

btw - i can reproduce this on our paid setup too

[freddieleeman]

An issue isn't forcing you to do anything, and changing it to a discussion doesn't magically solve the issue. Issues can be resolved by other developers too and might save people, who experience the same issue, some time. Having issues is fine, don't let them keep you awake. ;)

[freddieleeman]

I tried 60, and that didn't change anything.

[dgtlmoon]

hmmm the playwright fetch backend can get some kind of result, but it's incredibly slow from twitter

hmmmm something is up but i dont know what, if its just twitter or what

[dgtlmoon]

Some Playwright Chromium/Javascript URLs

could you make a list? and be sure to test them .15 vs .16 ? maybe make a HTML markdown table?

we could use that table again when testing new releases!

[freddieleeman]

As I mentioned, it is not just Twitter, and I've included another URL in my second comment (#740 (comment)). Unfortunately, I cannot share the other URLs for privacy reasons.

[dgtlmoon]

#745

[freddieleeman]

ws://playwright-chrome:3000/?stealth=1&--disable-web-security=true

Appears to resolve this issue too.

[freddieleeman]

It solves the Twitter URL, but not the OneDrive URL.

[dgtlmoon]

Not sure what to expect from OneDrive, for me it loads but just says I have access denied