Skip to content

Refactor CSV reader to support multiple files with improved concurrency performance#61

Merged
HarrisChu merged 2 commits intomasterfrom
multiple_data
Mar 30, 2026
Merged

Refactor CSV reader to support multiple files with improved concurrency performance#61
HarrisChu merged 2 commits intomasterfrom
multiple_data

Conversation

@HarrisChu
Copy link
Copy Markdown
Contributor

  • Added CsvReaderConfig struct for CSV reader configuration (Delimiter, WithHeader, Limit)
  • Updated ICsvReader interface:
    • GetData(sourceFile string) (Data, error) - read from specified CSV file
    • Close() error - cleanup resources
  • Added GetFileData(sourceFile string) (Data, error) to IGraphClient for backward compatibility

Usage

// Backward compatible - reads from default CSV (csv_path in options)
let d = session.getData()
// New - read from specific CSV files
let personData = session.getFileData("person.csv")
let companyData = session.getFileData("company.csv")

@HarrisChu HarrisChu merged commit d1a1fcf into master Mar 30, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants