Javascript execution before change detection - Error "Unable to retrieve content because the page is navigating and changing the content."

[octavia2]

Describe the bug
Javascript execution before change detection generate an exception during page reload (login form): https://github.com/dgtlmoon/changedetection.io/wiki/Run-JavaScript-before-change-detection#login-to-some-portal-with-username-and-password

It' ok with 0.39.17.1 version.

Version
v0.39.19.1

To Reproduce

Steps to reproduce the behavior:

1. create a new change detection watch with this args :
   • Url : http://formation.upyupy.fr/html-xhtml/formulaires-html/
   • Request fetch method : Playwright Chromium/Javascript via 'ws://192.168.1.100:3000/?stealth=1&--disable-web-security=true'
     (with bcrowserless ip/port)
   • Execute JavaScript before change detection :
     document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(1) > input[type=radio]:nth-child(3)").click();
     document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(2) > input[type=text]").value="login";
     document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(3) > input[type=text]").value="password";
     document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(8) > input[type=submit]:nth-child(1)").click();

Expected behavior
With 0.39.17.1, result page is ok :

With v0.39.19.1, error :

Unable to retrieve content because the page is navigating and changing the content.

changedetection log :
ERROR:changedetectionio:Exception reached processing watch UUID: 2fee228a-fe04-4d8c-9355-10914a7e6f42 - Unable to retrieve content because the page is navigating and changing the content.

browserless log:
mRJOB3S2BCN4UIZU47NYWTFLP0G42PIIZ: Recording failed stat, cleaning up: "undefined"
at addChunk (node:internal/streams/readable:315:12)
at Socket.emit (node:events:513:28)
at Socket.ondata (node:internal/streams/readable:754:22)
at Socket.Writable.write (node:internal/streams/writable:336:10)
at _write (node:internal/streams/writable:332:10)
at writeOrBuffer (node:internal/streams/writable:391:12)
at Socket._write (node:net:886:8)
at Socket._writeGeneric (node:net:874:11)
at writeGeneric (node:internal/stream_base_commons:151:3)
at afterWriteDispatched (node:internal/stream_base_commons:160:15)
Error: write EPIPE
Error with inbound socket Error: write EPIPE

Screenshots

Desktop

• OS: Windows 11
• Browser : Chrome 105.0.5195.102
• 2 dockers on synology whith 2 versions but same parameters :
  PLAYWRIGHT_DRIVER_URL : ws://BROWSERLESS_IP:BROWSERLESS_PORT/?stealth=1&--disable-web-security=true
  WEBDRIVER_URL : http://SELENIUM_IP:SELENIUM_PORT/wd/hub/

[dgtlmoon]

hmm interesting
1 - please click 'share url' and paste the shareURL link here
2 - please add a delay of 5 seconds at Request > Wait seconds before extracting text, does it fix it?

converting to discussion for now

[octavia2]

1. https://changedetection.io/share/eFMP7-IkUcMa
2. same result.

the 3 first javascript instructions are ok :
document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(1) > input[type=radio]:nth-child(3)").click();
document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(2) > input[type=text]").value="login";
document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(3) > input[type=text]").value="password";

It's only during page reload with this instruction (send login form), error appears
document.querySelector("#content > div.in > div > div:nth-child(98) > form > p:nth-child(8) > input[type=submit]:nth-child(1)").click();

[dgtlmoon]

thanks

[octavia2]

I did others tests : this problem appears with version 0.39.18 (ok with 0.39.17.2)

[techc0de]

Hi,

I'm currently using v0.45.8.1 with Docker, and this error still persist.
I set 30 seconds Wait seconds before extracting text in the Global Settings , but it still giving me the same error.
Some watches are set to 10 seconds. Most of the watches had this issue.
Would the Global setting override the individual watches setting?
Any thoughts?

[dgtlmoon]

@techc0de as i wrote, dont use 30 seconds, use a max of 5 seconds

[techc0de]

Understood.
Would the Extracting Text Global Settings override the individual watches settings or the opposite?

[techc0de]

I removed all the individual watches time for Wait seconds before extracting text and updated the Global Settings to 5 seconds.
The Browser steps worked, but the error still showing.