Browserless fetching stopped working overnight

[emeybee]

Describe the bug
Playwright (Browerless) fetching stopped working last week or the week before. It worked previously and I didn't make any changes to either ChangeDetection or Browserless between it working and not working, other than it possibly auto-updating. It was running fine one day and the next not.

I am currently using https://news.ycombinator.com/ to test, but it is the same error for all URLs: "Screenshot unavailable, page did not render fully in the expected time or page was too long - try increasing 'Wait seconds before extracting text'"

I have tried updating the setting mentioned to even 30 seconds and still get the same error. Browser Steps also does not work, returning "Error fetching screenshot and element data - a bytes-like object is required, not 'NoneType'"

When I use the Browserless debugger directly everything works fine, and I have also tried Browserless v2 and get the same error, so I believe the issue is on ChangeDetection's end.

Version
0.52.7

How did you install?
Docker (Linuxserver) on Unraid

To Reproduce
Click Recheck
https://changedetection.io/share/S2wq3rZxBGAa

Expected behavior
The website should be rechecked without error

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: Windows
• Browser: Firefox
• Version: 147.0.1

Additional context
Plaintext fetching still works, but doesn't serve my purposes. I am not using any proxies.

Logs from startup through checking:
https://pastebin.com/5C3h94tM

[dgtlmoon]

for now i'll park this in discussions, all the automated tests for exactly this pass

if you restart sockpuppetbrowser , does it work? can you paste your docker-compose.yml?

[emeybee]

I'm using browserless, not sockpuppetbrowser. But yes I've restarted many times in trying to diagnose, and also tried browserless v2 but same issue.

Unraid doesn't use docker compose but here are the settings from the GUI:

I just discovered this post though, so maybe it's specific to the linuxserver install?
linuxserver/docker-changedetection.io#31

[dgtlmoon]

Browerless we dont support, we use sockpuppetbrowser btw

[emeybee]

I don't believe sockpuppetbrowser is an option on Unraid, but I can work with Linuxserver instead if it's an issue on their end

[emeybee]

I switched to your repo and it works, so it's something specific to Linuxserver's repo. Not your issue, sorry.

[adamkobor]

I have the same issue, even after moving away from lsio's docker image :(

[miniragnarok]

I have the same issue and am also using Unraid and browserless-v2. I manually set the version to 0.51.4 as that's the last version that works for me and was hoping to see something in the recent updates to explain the cause but no luck. :(

[dgtlmoon]

Make sure the number of 'fetch workers' is less than your cpu cores, if you have 10 cores, set it to say 7 workers

[miniragnarok]

I've had it set to 1 for a long time now. The app is for my own personal use and I just don't have a need for any more.

[adamkobor]

I'm using a dead simple Docker compose setup with sockpuppetbrowser (pretty much the same as the docker compose example from the repo) and the error totally randomly comes and goes, and only affects one of my monitors (the one with browser steps).
When it fails, it always does at the same step, the log says that probably a navigation happened (there is no navigation, also the screenshot seems totally fine).

Step1: provide username to an input
Step2: provide password to an input
-- When the aforementioned error pops up, it always pops up here, before step
Step3: click on login button

Sometimes exactly the same monitor without any change works completely fine.