Skip to content

Conversation

@prabhath004
Copy link
Contributor

Description

Add optional max_file_size parameter to the AzureBlob source to filter files by size in both list() and get_value() APIs. Files exceeding the specified limit are treated as non-existent and skipped during processing.

Changes

  • Added max_file_size: Option<i64> field to AzureBlob Spec and Executor
  • Implemented file size filtering in list() method using Azure blob metadata
  • Implemented file size filtering in get_value() method using get_properties()
  • Updated Python spec to expose the new parameter
  • Added documentation for the new parameter

Closes #1251

prabhath004 added 2 commits November 5, 2025 14:26
Add optional max_file_size parameter to filter files by size in both
list() and get_value() APIs. Files exceeding the limit are treated as
non-existent. Closes cocoindex-io#1252
@prabhath004 prabhath004 closed this Nov 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Support max_file_size for AzureBlob source

1 participant