Skip to content

Conversation

@dmiales
Copy link

@dmiales dmiales commented Jan 2, 2026

perf: implement streaming XML parsing for large folder operations

  • Add StreamingReadFolderRemoteOperation for memory-efficient folder reading using SAX parser
  • Add PropFindSaxHandler for streaming XML parsing of PROPFIND responses
  • Prevent OutOfMemoryError for folders with thousands of files by avoiding full XML loading
  • Integrate streaming parser into RefreshFolderOperation with fallback to legacy method
  • Add batch processing for large folders (500 files per batch) in FileDataStorageManager
  • Improve logging levels and add thread name tracking for better debugging

- Add StreamingReadFolderRemoteOperation for memory-efficient folder reading using SAX parser
- Add PropFindSaxHandler for streaming XML parsing of PROPFIND responses
- Prevent OutOfMemoryError for folders with thousands of files by avoiding full XML loading
- Integrate streaming parser into RefreshFolderOperation with fallback to legacy method
- Add batch processing for large folders (500 files per batch) in FileDataStorageManager
- Improve logging levels and add thread name tracking for better debugging
@dmiales dmiales closed this Jan 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant