Hi All,
I created a DS job by adding a SAP HANA column table as the source and using a query transform with a where condition on a single column having 180 million rows. The target is Sybase IQ table. I checked the 'bulk load' option and the mode is 'truncate'.
When the job runs, it is trying to load the whole table 180 million rows and then applying the filter due to which the job is running for 2.5 hours and timing out.When I go to Display Optimized SQL, the query is a select statement without filter condition and directly calling the table name. I tried running it from designer and also from management console and it still the same.
How can I ensure that the filter condition is applied at the database level and only filtered rows are retrieved by DS to the job server.
The same is not happening if the source and target are both HANA. Need urgent help since I need to implement it immediately. Thanks in advance.
Rishi