LLM service enters restart loop due to insufficient memory #2944
Description
Bug Report
Tested on: main branch
Environment: Docker compose
(Observed on latest main as of deployment)
Symptom
The LLM service repeatedly restarts when using docker-compose.yaml with a memory limit of 50M. The container enters a restart loop and the service does not become available.
A clear and concise description of what the bug is.
The LLM service should start successfully and remain stable using the default resource configuration defined in docker-compose.yaml.
What is the actual behavior?
When the memory limit in docker-compose.yaml is set to 50M:
The LLM service container restarts continuously
The service never becomes ready
Logs indicate failure during startup
Increasing the memory limit to 100M in docker-compose.yaml allows the container to start and run normally without restarts.
Additional Context
This issue occurs specifically when running the demo using Docker Compose.
Increasing the memory limit from 50M to 100M consistently resolves the restart loop.
Screenshots showing container restarts have been attached for reference.
