ChangeDetection is eating up few hundred gigabytes of space

[privacyadmin]

Hi,

I noted that ChangeDetection has recently, for some reason been eating up huge amount of disk space and causing the entire LXC it is housed in to fail as it gobbles up all 100% of the bootdisk.

Is there a way to routinely clear up / or set an upper limit of how much space it can use?

dgtlmoon/changedetection.io#1919 suggest a similar problem but it is for selenium and I cannot find in the documentation how to setup such a cron job.

Appreciate some advice on how to fix this issue.

Thank you

[dgtlmoon]

Heya, do you mean the changedetection docker container, or do you mean the browser container? or how is it built/running exactly? can you provide more info about how its setup? we dont know anything about "LXC"

[privacyadmin]

The problem is specifically for dgtlmoon/sockpuppetbrowser

I deleted this container and ghcr.io/dgtlmoon/changedetection.io and restarted everything from scratch yesterday.

Initially sockpuppetbrowser was just taking maybe 2GB or less. Today it has grown to 9GB.

Previously I was running ChangeDetection in a VM on a Pi4B with 1TB microSD and perhaps that is why I did not notice that sockpuppetbrowser was eating up disk space every day. Due to performance issue, I recreated it on a LXC couple of weeks ago with a Threadripper system.

Because this time I limit the disk size to 120GB only, I noticed very quickly that every couple of weeks, my entire LXC will went offline. Only when I check the disk utilization then I realized that the disk was 100% utilized and the LXC froze.

This is the docker-compose.yml I used.

services:
changedetection:
image: ghcr.io/dgtlmoon/changedetection.io
container_name: changedetection
hostname: changedetection
volumes:
- /test/changedetection/changedetection-data:/datastore
environment:
- LOGGER_LEVEL=TRACE
- PLAYWRIGHT_DRIVER_URL=ws://browser-sockpuppet-chrome:3000
- BASE_URL=https://changedetection.server.io/
- HIDE_REFERER=true
- FETCH_WORKERS=10
- MINIMUM_SECONDS_RECHECK_TIME=0
- DISABLE_VERSION_CHECK=true
- SCREENSHOT_MAX_HEIGHT=16000
ports:
- 5050:5000
restart: unless-stopped
depends_on:
browser-sockpuppet-chrome:
condition: service_started
browser-sockpuppet-chrome:
hostname: browser-sockpuppet-chrome
image: dgtlmoon/sockpuppetbrowser:latest
container_name: changedetection-sockpuppetbrowser
restart: unless-stopped
environment:
- SCREEN_WIDTH=1920
- SCREEN_HEIGHT=1024
- SCREEN_DEPTH=16
- MAX_CONCURRENT_CHROME_PROCESSES=10
volumes:
changedetection-data:

[dgtlmoon]

got it :) ok, i moved it here for now, thanks