File List to Table

For a more controlled file ingestion pattern. It would be useful to be able to be able to scan a file source e.g. SFTP and store the results of the scan in a CDW table.

This can be achieved by combining File Iterator over individual INSERTs, but that requires manual effort to setup (you need to configure the pass through for all the variables). It would easier if this was native component.

Input: (similar config to file iterator)

Destination: (similar config to a connectors)

Then, once file list output is in a table, a Table Iterator could be used to ingest each file, can be used to do the file ingestion which is easier to control using metadata.