How to force evaluation in workflow to use raise_error

[do-hwan.kim]

Hi,

I’m trying to use raise_error() functions in Query processors.

As in the screenshot below, I have a column that stores raise_error(), but because that column should not be save in the and should be excluded before saving, it seems like that ‘check_col’ column is never evaluated and the workflow is not stopped.

Is there a way to force evaluation of a column in a flow of workflow?

[stefan.ganser]

Spark is lazy. It only computes what it must compute in order to produce the result of the workflow. A way to ensure that all rows must be processed and, therefore, also the values in the column in which you are interested, you could append a Count processor to the Query processor.