Hi there,
I'm working on a job which need to load four datasource by order and any one of them failed, the job should still continually go forward to the end.
In order to do that, I use a series of workflows which connected sequentially. Within each of workflow, there is one dataflow to load one data source to the target table. The target table is composed by those four datasource, so, for each of dataflow, I have to use Table_Comparison to make sure the fields are filled based on the primary key. For this approach, it satisfies on those requirements, however, for each of workflow, they are processing for a while. The whole chain takes too much time. Does anyone have idea on how to improve on the performance or any other strategy to handle this case? Thanks a lot!
The screenshot for each of the layer as below
WF chain:
Within each of WF,
Within each of DF
