Browser Steps - 'Response' object is not subscriptable

[mrnoisytiger]

Describe the bug
A clear and concise description of what the bug is.

When using Browser Steps, I get the error 'Response' object is not subscriptable from the browser.

ChangeDetection logs show:

Starting connection with playwright
Starting connection with playwright - done
24.1.30.104,172.22.0.1 - - [10/Jan/2024 18:56:04] "GET /browser-steps/browsersteps_start_session?uuid=4f9ddf86-9bd5-4d86-98a0-d98754761aec HTTP/1.1" 200 222 0.328140
Exception when calling step operation goto_url 'Response' object is not subscriptable
24.1.30.104,172.22.0.1 - - [10/Jan/2024 18:56:04] "POST /browser-steps/browsersteps_update?uuid=4f9ddf86-9bd5-4d86-98a0-d98754761aec&browsersteps_session_id=0371132f-97db-49fe-b6e0-cb251c59f7fe HTTP/1.1" 401 219 0.005911

Playwright docker does not show an error.

Version
v0.45.12

To Reproduce

Steps to reproduce the behavior:

1. Go to Edit
2. Click on BrowserSteps -> Click here to Start
3. See error

Expected behavior
Browser Steps will connect and appear.

Screenshots

Desktop (please complete the following information):

• OS: macOS Sonoma
• Browser: Edge
• Version: Latest?

Smartphone (please complete the following information):

• Device: N/A
• OS: N/A
• Browser: N/A
• Version: N/A

Additional context
Docker compose file for setup is:

version: "3.8"
services:
  changedetection:
    image: ghcr.io/dgtlmoon/changedetection.io:latest
    container_name: changedetection
    environment:
      - PUID=1000
      - PGID=1000
      - TZ=Americas/Example
      - BASE_URL=monitor.example.com
      - PLAYWRIGHT_DRIVER_URL="ws://playwright-chrome:3000/?stealth=1&--disable-web-security=true"
    volumes:
      - ./:/datastore
    ports:
      - 8083:5000
    restart: always
    depends_on:
      playwright-chrome:
          condition: service_started

  playwright-chrome:
    hostname: playwright-chrome
    container_name: playwright-chrome
    image: browserless/chrome
    restart: always
    ports:
      - 3000:3000
    environment:
      - SCREEN_WIDTH=1920
      - SCREEN_HEIGHT=1024
      - SCREEN_DEPTH=16
      - ENABLE_DEBUGGER=false
      - PREBOOT_CHROME=true
      - CONNECTION_TIMEOUT=300000
      - MAX_CONCURRENT_SESSIONS=10
      - CHROME_REFRESH_TIME=600000
      - DEFAULT_BLOCK_ADS=true
      - DEFAULT_STEALTH=true
      - DEFAULT_IGNORE_HTTPS_ERRORS=true

I get the error below from the browser console as well:

I've reviewed the issues #1627 and #1823 but they do not appear to give adequate solutions to the problem. I'm having the issue with both the full URL as well as the localhost URL. I do not have any authentication set up (with the full URL behind CF Access/Tunnels).

Thank you!

[dgtlmoon]

duplicate #1823

[dgtlmoon]

Its nearly always because your local docker network is not configured, as in, it cant find the "hostname" for your browserless/chrome browser

[mrnoisytiger]

Very interesting - I'll try it by directly specifying the browserless IP address. I ran nc -vz playwright-chrome 3000 from the changedetection container and it succeeded, but I'll try the direct IP address and see if it'll change.

[mrnoisytiger]

@dgtlmoon Nope, that did not make a difference either... I'm pretty sure the containers are able to connect with each other, so it's very strange...

Further, Visual Filter Selection is working perfectly without any issue at all, so not sure if Playwright connectivity really is the issue...

[dgtlmoon]

and if you restart it, does it work once atleast? or always the same? and what about logs?

[mrnoisytiger]

and if you restart it, does it work once atleast? or always the same? and what about logs?

@dgtlmoon Does not work at all, not even once immediately after a restart. Restarted all dockers, restarted the system. Logs from the most recent attempt are below. Identical error and the browser console logs look identical as well unfortunately.

ChangeDetection Container

// TRIGGERED BROWSER STEPS
Starting connection with playwright
Starting connection with playwright - done
24.1.30.104,172.22.0.1 - - [10/Jan/2024 22:50:53] "GET /browser-steps/browsersteps_start_session?uuid=c4b0b471-36e3-426c-a35a-bccb29043040 HTTP/1.1" 200 222 0.330513
Exception when calling step operation goto_url 'Response' object is not subscriptable
24.1.30.104,172.22.0.1 - - [10/Jan/2024 22:50:53] "POST /browser-steps/browsersteps_update?uuid=c4b0b471-36e3-426c-a35a-bccb29043040&browsersteps_session_id=c9593600-80a7-4b33-a493-0923b0cc41ab HTTP/1.1" 401 219 0.005727

// TRIGGERED VISUAL FILTER SELECTION
24.1.30.104,172.22.0.1 - - [10/Jan/2024 22:50:55] "GET /static/screenshot/c4b0b471-36e3-426c-a35a-bccb29043040?1704927054770 HTTP/1.1" 200 1160494 0.049599
24.1.30.104,172.22.0.1 - - [10/Jan/2024 22:50:55] "GET /static/visual_selector_data/c4b0b471-36e3-426c-a35a-bccb29043040 HTTP/1.1" 200 7924 0.019245

Playwright Docker

2024-01-10T22:51:55.804Z browserless:chrome-helper Chrome PID: 5273
2024-01-10T22:51:55.804Z browserless:chrome-helper Finding prior pages
2024-01-10T22:51:55.840Z browserless:chrome-helper Found 1 pages
2024-01-10T22:51:55.841Z browserless:chrome-helper Setting up page Unknown
2024-01-10T22:51:55.841Z browserless:chrome-helper Injecting download dir "/usr/src/app/workspace"
2024-01-10T22:51:55.841Z browserless:system Chrome launched 716ms
2024-01-10T22:51:55.842Z browserless:system Got chrome instance
2024-01-10T22:51:55.842Z browserless:job Q4OOZIP9DYL926BRMLT2OJMD5IPW37C4: Starting session.
2024-01-10T22:51:55.842Z browserless:job Q4OOZIP9DYL926BRMLT2OJMD5IPW37C4: Proxying request to /devtools/browser route: ws://127.0.0.1:44061/devtools/browser/51adfefe-dcdb-4a4d-98a7-c9fd30fe3829.
2024-01-10T22:51:55.845Z browserless:chrome-helper Setting up file:// protocol request rejection
2024-01-10T22:51:55.845Z browserless:chrome-helper Setting up page for ad-blocking
2024-01-10T22:51:56.202Z browserless:chrome-helper Setting up page Unknown
2024-01-10T22:51:56.202Z browserless:chrome-helper Injecting download dir "/usr/src/app/workspace"
2024-01-10T22:51:56.206Z browserless:chrome-helper Setting up file:// protocol request rejection
2024-01-10T22:51:56.206Z browserless:chrome-helper Setting up page for ad-blocking

[dgtlmoon]

what about removing the "'s

- PLAYWRIGHT_DRIVER_URL="ws://playwright-chrome:3000/?stealth=1&--disable-web-security=true"

- PLAYWRIGHT_DRIVER_URL=ws://playwright-chrome:3000/?stealth=1&--disable-web-security=true

and docker compose up again?

[mrnoisytiger]

Wow! I hate myself! That worked instantly........................................................

Sometimes it's the simplest things!

Thank you for your help! Really appreciate it!

[dgtlmoon]

hey dont hate yourself :) actually the software should filter that out, i'll check it out and add a fix

btw, if you love the app, please leave us some love at https://alternativeto.net/software/changedetection-io/ :)

[dgtlmoon]

#2100 PR

[dgtlmoon]

@mrnoisytiger theres already a comment there :)

changedetection.io/docker-compose.yml

Line 28 in 8be0029

# Alternative Playwright URL, do not use "'s or 's!