Skip to content

bug(scan): commands output generates a lot of data in db #195

@psyray

Description

@psyray

Current Behavior

Commands like nuclei, fuff or httpx generate a lot of output.
Actually those output logs are stored in the db, it's a bad idea because it slows all transactions and generates bottleneck
There are used, for example, on the dashboard page.
And it could be linked with other records for displaying a table.
...

Expected Behavior

Huge output logs must be stored on disk or truncated, and we need to monitor this and propose to clean old scan

Steps To Reproduce

Launch a scan on vulnweb.com
Export the startScan db

docker exec -it rengine-celery-1 bash -c 'poetry run -C $HOME python3 manage.py dumpdata startScan --indent 2 > startScan/fixtures/startScan.json'

Some fields have huge data in the output field
image

Environment

- reNgine: 2.1.0
- OS: 
- Python: 
- Docker Engine: 
- Docker Compose: 
- Browser:

Anything else?

No response

Acknowledgements

  • This issue is not a duplicate of an existing bug report.
  • I have chosen an appropriate title.
  • All requested information has been provided properly.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions