It would be great in a Transformation Pipeline if the Table Input allowed you to select the special metadata fields for external tables, currently it only lets you select the standard columns.
These metadata fields are useful when processing events that are landing as files in the DataLake. In Databricks the SQL to get these fields is _metadata.* e.g. _metadata.filename
