Testing Suite

[Kernel-Dirichlet]

The testing suite is passable for a beta version, but at minimum, the current tests need to be refactored. They were created in a much earlier version, and while the control flow has not changed, subtle implementation details as well as the lack of branch coverage have not been addressed. Additionally, the CI scripts need a revisit as well.

Goals:

1. Ensure CoTARAG is fully installable across Ubuntu. Debian, Fedora, RHEL, Arch Linux, and Gentoo linux distros, as well as MacOS and Windows
2. Ensure that all the RAGManager tests include at least two of each core component (indexer, retriever etc.) to ensure that when we swap out custom classes that everything still passes.
3. Whether or not to have a full suite of unit tests and integration tests.

[Kernel-Dirichlet]

The current plan

1. Unit tests will cover all core components of AcceleRAG (embedders, indexers, retrievers, scorers). The query_engine in its current form is going to be deprecated in favor of a native LLMRouter which absorbs and simplifies the logic.

2. Unit tests for CoTAEngine will test prompt strategies, as well as a custom ThoughtAction, LLMThoughtAction and a three step CoTAEngine (i.e. three ThoughtAction units)

3. There will be one integration test for AcceleRAG per modality. Right now that is text and image but will expand to audio and video. This will test the entire pipeline, especially caching, and will use LLama as the default LLM.

4. The repository will add an /agents folder which are ready-to-go agents for a variety of use cases. These also will be given tests as they come up.