Delete intermediate tables

Automation
1

Hi all,

I have a production line with 4 workflows and each workflow uses the output data table of the prior one as input.
The only relevant output for my data product is the output table of the last workflow.

Is there a way to automatically delete the intermediate results and only keep the last result?
If yes, how can I do that?

Thanks

2

Perhaps the most simple way if the intermediate tables can’t stay (perhaps with an appropriate name?) would be to just use the same table for all workflows and tick “Take Schema from New”.
Then it would always overwrite the previous data in this table with the latest step. This has the disadvantage that if the final table is used for example in some App the App will be broken while the productionline runs (wrong column format / data etc)

Another solution is to have a final cleanup-workflow in the productionline that uses the API to delete the intermediate data tables. Since you will need to figure out the table id within the workflow I think you need to try fancy JSON parsing processor kung-fu or do it with a Python processor.