Selenium crashing in Dev Container

[davida72]

Sorry for all the messages.

Firstly, the good news. I'm running in the Dev Container and making some progress on the Broadland council webpage.

ukbc-py-env) vscode ➜ /workspaces/UKBinCollectionData (broadland) $ python uk_bin_collection/uk_bin_collection/collect_data.py BroadlandDistrictCouncil "https://area.southnorfolkandbroadland.gov.uk/FindAddress" -p "NR10 3FD" -n "1 Park View, Horsford, Norfolk, NR10 3FD" -w "http://localhost:4444"
Starting parse_data with parameters: postcode=NR10 3FD, paon=1 Park View, Horsford, Norfolk, NR10 3FD
Creating webdriver with: web_driver=http://localhost:4444, headless=True, user_agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36
Navigating to URL: https://area.southnorfolkandbroadland.gov.uk/FindAddress
Successfully loaded the page
Looking for postcode input field...
Found postcode input field, entering postcode: NR10 3FD
Looking for 'Find address' button...
Found 'Find address' button, clicking it...
Waiting for address dropdown to appear...
Found address dropdown
Available address options:
An error occurred: Message: unknown error: session deleted because of page crash

The Selenium driver seems to be crashing on me however I'm running it. Additionally I'm having to restart the Dev Container by restarting VS Code every 20 minutes. I'm on an Mac M1, if that's relevant.

Is there anything you see above that would say why that's happening?

Thank you!

[davida72]

I noticed docker-compose fires up four selenium browsers at 2GB each and I was running out of RAM.

I think I've fixed this by remarking out three of the four selenium browsers.

[robbrad]

Yeh that’s to allow parallel execution of Selenium- you did the right thing