perf: optimize directory scanning with early termination and O(1) queue operations

- Add limit hint parameter to stop scanning when enough directories are collected
- Replace Array.shift() with index-based traversal for O(1) dequeue operations
- Preserve first-level directory prioritization with limits

Author: daniel-lxs