[Iceberg AddFiles] Use thread pool to process incoming datafiles#38018

ahmedabu98 merged 6 commits intoapache:masterapache/beam:masterfrom

ahmedabu98:add-files-perfahmedabu98/beam:add-files-perfCopy head branch name to clipboard