Improve Visiting multi files in parallel #5
Description
Currently the DataProvider work with files one by one but we can change this to work in parallel so we can go faster
- Read the DataProvider file and think how we can be faster and work in parallel.
- Bench mark the performance while working on large files