database lock issue

[Ali-Razmjoo]

Hi,

in some modules when there are a lots of events submitting to db, i got a lot of failure error with database lock, we need to re-architect the whole thing, it use a lots of IO, unnecessary memory, CPU, etc.

Bests. Ali.

[Ali-Razmjoo]

possible solution: https://github.com/litements/litequeue

[Davda-James]

@Ali-Razmjoo I implemented a solution for this and raised a PR (detailed work), attaching here some work that I did in short:
using queue-based Architecture: Database operations are enqueued and processed by a separate writer thread and falls back to in-memory queues and synchronous writes when litequeue is unavailable. @Ali-Razmjoo and other reviewers pls review it and if any change pls mention will do it PR