Description

Fixes #5393

This PR resolves an issue where the list_files tool incorrectly returned directories that should be ignored according to .gitignore patterns. The problem was caused by inconsistent gitignore handling between file and directory listing logic.

Root Cause

The list_files tool had three main issues:

1. Ripgrep handled files correctly - respected .gitignore in recursive mode
2. Directory listing was broken - custom directory scanning logic didn't properly handle .gitignore patterns
3. Non-recursive mode ignored .gitignore entirely - used --no-ignore-vcs flag

Changes Made

🔧 Replaced custom gitignore parsing with proper ignore library

• Removed the limited custom parseGitignoreFile and isIgnoredByGitignore functions
• Added proper createIgnoreInstance using the same ignore library used elsewhere in the codebase
• Now handles complex gitignore patterns correctly (wildcards, negation, etc.)

📁 Fixed parent .gitignore file handling

• Added findGitignoreFiles function that walks up the directory tree
• Now respects .gitignore files from parent directories, not just the target directory

🔄 Made non-recursive mode respect .gitignore

• Removed the --no-ignore-vcs flag from non-recursive ripgrep calls
• Both recursive and non-recursive modes now consistently respect .gitignore

🎯 Improved directory filtering logic

• Updated shouldIncludeDirectory to use the ignore library for proper pattern matching
• Uses relative paths for accurate gitignore pattern matching

Testing

• ✅ All existing tests pass (98/98 tests in glob and tools suites)
• ✅ New gitignore-specific tests (5/5 tests covering various scenarios)
• ✅ Verified both recursive and non-recursive modes respect .gitignore
• ✅ Tested nested .gitignore file handling
• ✅ Confirmed complex gitignore patterns work correctly

Verification of Acceptance Criteria

• ✅ Directories matching .gitignore patterns are now properly excluded from list_files output
• ✅ Both recursive and non-recursive modes consistently respect .gitignore patterns
• ✅ Parent .gitignore files are properly considered when filtering directories
• ✅ Complex gitignore patterns (wildcards, negation, etc.) work correctly
• ✅ No regression in existing file filtering functionality

Files Changed

• src/services/glob/list-files.ts - Main implementation fix
• src/services/glob/__tests__/gitignore-test.spec.ts - Added comprehensive tests
• src/services/glob/__tests__/gitignore-integration.spec.ts - Added integration tests

Checklist

• Code follows project style guidelines
• Self-review completed
• Comments added for complex logic
• No breaking changes
• All tests passing
• Type checking passes
• Linting passes

Impact

This fix ensures that the list_files tool now consistently respects .gitignore patterns for both files and directories in both recursive and non-recursive modes, resolving the reported issue and improving the overall reliability of directory listing functionality.