Bulk Copy in Data Transfer Component

Currently, the Data Transfer component only allows transferring one file at a time or in a single iteration. However, we need to copy multiple files (ranging from ~10 to 1000) from an SFTP location to S3 for processing. While we could use a file iterator to loop through the SFTP location and pass each file name to the source URL, this approach would be very time-consuming for large numbers of files. Therefore, the solution needs to be more time-efficient.

Additionally, we require an option to use a pattern to filter and select specific types of files from the source location.