"Roo wants to search the codebase for" takes minutes to complete

[tom10271]

App Version

3.25.23

API Provider

VS Code Language Model API

Model Used

Sonnet 4

Roo Code Task Links (Optional)

No response

🔁 Steps to Reproduce

I am running some prompts and Roo Code is trying to get related files.

💥 Outcome Summary

It takes so long everytime. What is the key factor? The Codebase indexing model being used? I found initial indexing is very very slow too with Gemini

📄 Relevant Logs or Errors (Optional)

[roomote]

I'm exploring a potential fix for the slow codebase search performance issue. I'll investigate the indexing and search mechanisms to identify optimization opportunities and will open a PR to share progress.

[roomote]

I've opened PR #7351 with performance optimizations to address the slow codebase indexing issue: #7351

The changes include:

• 3-4x faster initial indexing through increased parallelization (batch sizes and concurrency limits)
• Near-instant re-indexing when files haven't changed (early termination optimization)
• Better user feedback with progress percentage during indexing

All tests are passing and the implementation has been reviewed with 92% confidence. The CI checks are currently running. Feedback welcome!

[daniel-lxs]

Hey @tom10271, indexing speed relies on many factors, like embedding model and hardware resources of your computer. I believe Gemini tends to be a lot slower than other models, especially if you are hitting rate limits constantly.

In my case, it can index a pretty big codebase, but I have a tier 3 API key.

I'll close this since there's not much we can do on our side about this, but feel free to ask any questions.