Terms

• I have searched all open bug reports
• I agree to follow Wikimedia's Code of Conduct

Behavior

When booting up with the full excellent articles dataset, the application takes ages to start up. After the embeddings have been generated with GPU acceleration (NVIDIA RTX 3090 takes ~10minutes to embed excellent articles full) the application hangs, 1 CPU core on 100%, GPU idle. Is it the storage of the embedding cache as json?

Operating System

runpod host with rtx 3090