Request queue #52
Description
Description
When vCache gets deployed, i.e. as a Docker container, the system should be able to handle multiple async requests.
Impact
- Who: End-unsers
- What: Async processing
- Why: Scalability
Proposed Solution
vCache should implement a new abstraction called the input queue. The user should be able to select between different request queues, i.e. FIFO, and set a max size of this queue.
Acceptance Criteria
- Followed coding conventions
- Implemented or updated tests
- Abstract class
- FIFO implementation
- LIFO implementation
Risks & Dependencies
Fairness between requests.
Additional Context
--