Ability to Extract outputs of a Transformation into Scalar/Grid Variable
I am aware that an Orchestration Pipeline offers the ability to extracts the output of a query into Grid Variables, but in some cases, the queries are complicated and perform several joins and other operations, and the laid down panache of a transformation pipeline is amazing in those cases. It is easier for new Data Engineers to observe the flow as well.
At the moment the following query gets stashed in a Scalar Variable:
And as you can see, this could actually have been nicer to do using a Transformation Pipeline.
We are primarily using Matillion to be able to make explainable codes, and for us the Matillion UI is the best media to do so. If I keep hiding interesting codes inside Queries like these, then the beauty of Matillion would be lost for us.

Subscribe to post
Get notified by email when there are changes.