Quantcast
Channel: SCN : All Content - Data Services and Data Quality
Viewing all articles
Browse latest Browse all 4013

Not able to extract all records from source table

$
0
0

Hi,

 

I got a simple data flow to extract all records from a source table into a CSV file.

DataFlow.png

 

The source table contains 10 millions of records, but when I execute the job it only extract out 190K records which is a big difference.I can confirm that the QUERY does not contains any WHERE condition, it is just a simple mapping.

 

I had enable Audit to COUNT the entry of source table, query and target file:

TraceLog.png

 

From the trace log, I can see the source table only got 190K records, but not able to get the 10 millions records.

 

With the same data flow, I had successfully extract 15 milllions, 19 millions and also 20 millions records. For this case, it is not able to extract 10 millions records which I believe it is not memory related issue.

 

Is anyone experience similar issue before? Please advise.

 

I am using DS 4.2.

 

Thank you.

 

Regards,

Edison


Viewing all articles
Browse latest Browse all 4013

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>