Quantcast
Channel: SCN : All Content - Data Services and Data Quality
Viewing all articles
Browse latest Browse all 4013

Filtering date records out of a large data set?

$
0
0

I'm new to BODS and it looks like a very powerful tool. I have a relatively easy task that I have not found a way to implement with SAP BODS. I have 2 tables.

 

TABLE 1 lists public holidays:  meta data: counter, holiday name, holiday date

 

data example:   1, New Years, 01/01/2013

                         2, National Day, 01/07/2013
3, Christmas, 25/12/2013

 

 

TABLE 2 contains tens of thousands of performance records for 1 month. The records have 3 fields:

Site name, date & time stamp, measurement

 

Site Name,                    DateTimeUtc_ConvertedEST,                 MaxDuration

 

websitename1               2013-07-01 06:43:05.630                  639

websitename1               2013-07-12 06:46:05.630                  511

websitename1               2013-07-12 06:49:05.630                  1200

.

.

.

websitename1               2013-07-25 06:49:05.630                   1200
websitename2               .                                                           .
websitename2               .                                                           .


For each unique websitename, I need to filter out all dates found in the holiday table (in this case July 1st, 2013) and then determine the
total number of records remaining per website name, and the total number of records per website name < 800.


Expected Output

websitename,      #of records < 800,      total # of records

 

Websitename1              1          3 (because July 1st filtered out)

Websitename2              etc.

 

Having trouble filtering out the holiday records.  Inner Join does not seem to work. 

Tried something like:

not (TABLE2."date" = TABLE1."date")

 

This join did not filter out the holiday records correctly.



Any ideas?

 


Viewing all articles
Browse latest Browse all 4013

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>