Quantcast
Channel: SCN : All Content - Data Services and Data Quality
Viewing all 4013 articles
Browse latest View live

Upgrading BODS 3.2 (Windows) job server to BODS 4.X (Unix)

$
0
0

Hi All,

 

We are planning a BODS upgrade - current version is 3.2 (Oracle repository database, Job server on Windows server 2003) to BODS 4.X hosted on a Unix server. Will the upgrade be supported by SAP , because I cannot find such an upgrade path when I checked the documentation.


SAP Dataservices - How-to write data to ABAP tables.

$
0
0

Dear colleagues. DS Gurus.

 

Which variants we have for writing data to ABAP tables?

How to import and execute a Stored Procedure in BODS

$
0
0

Hi Experts,

 

Could anyone share any document or explain how to How to import and execute a Stored Procedure in BODS ?

 

Thanks

Madhu

Sentiment Analysis using BODS

$
0
0

Hello,

 

I'm working right now on project at University, my task is to do Sentiment Analysis on the extracted data from Facebook and saved in Excel.xls files.After loading the data on the SAP HANA, i will have to use TDP(Text Data Processing) which is imbedded part of BODS.

My files contain different languages"comments by people" and two columns of comments in the table, so when i work with Options in the Entity-Base Object, i have only one option to assign the one of the column to be analyzed , this is my problem here.

Second, is it possible to assign many Entity-Base Objects to the source-Table (which contains data), so i could take different languages into consideration...

Where can i find guidance on how to make it possible to achieve it ? do i have to install something extra for the language's recognization?

 

another Problem : after creating target tables, i could import to HANA only 2 times ....but the rest (other new tables) i can't import them :-( , it is strange.

You think is because of no enough memory in datastore (but logically i dont think so ), or any other reasons ? any solutions ??

 

I thank you very much

 

Mirella

Convertion functions in BODS with Examples_Part1

$
0
0

Conversion functions in BODS_Part1

There is different conversion function which used to convert one form of data into another format. The BODS support most of basic conversion functions.

Here, I will explain the syntax and examples for those conversion functions.

 

1. To_char

 

The to_char function used to convert number or date value into string format.

This function will help you to convert a number or date to string.

The syntax for this function is given below with examples.

To_char(number or date, format)

 

Number to string.

 

e.g.      

  • to_char(123,’9999’)= ’123’

  • to_char(123,’09999’)=  ‘0123’
  • to_char(31,’xx’) = ‘1f ‘ ----> string contains hexadecimal integer.
  • to_char(31,’xx’)= ’37’ ----> string contains octal integer

 

Date to string.

 

e.g.

  • to_char(sysdate(),’MM’)= ‘06’ --> month number of the date
  • to_char(sysdate(),’MON’)= ‘JUN’  ---> Month name with 3 letter like ‘JUN’
  • to_char(sysdate(),’MONTH’)= = ‘JUNE ‘ ----> Month name  like 'JUNE'.
  • to_char(sysdate(),’DD’)=’03’ ----> Day part of the date
  • to_char(sysdate(),’YY’)=’13’-----> 2 digit YEAR
  • to_char(sysdate(),’YYYY’)=’2013’----> 4 digit YEAR
  • to_char(sysdate(),’HH’)=’12’----> 2 digit Hour
  • to_char(sysdate(),’MI’)=’13’----> 2 digit Minute
  • to_char(sysdate(),’SS’)=’13’----> 2 digit Second
  • to_char(sysdate(),’FF’)=’286959000’----> Sub second

 

2. Intervel_to_char

This function is to convert an interval to string. This will help you find out the date difference between two dates in different format. Find below given examples and syntax for this function.

The syntax for this function is given below.

 

Interval_to_char(interval, interval type)

 

$start_date=2013.01.01 00:00:00

 

sysdate() = 2013.06.05 17:31:54

 

Interval_to_char($start_date- sysdate(),’D’)=’155’

 

This statement will give the number of days between given interval. Similarly,

Interval type:     M for minutes

                          S for Seconds

                          H for hours

 

3. Julian_To_Date

 

This will convert Julian value to date value.

The syntax for this function is given below.

Julian_to_date(Julian) return date

 

Julian_to_date(2,451,545) = 2000.01.01 00:00:00

 

Please refer below link to get more information about Julian day.

https://en.wikipedia.org/wiki/Julian_day

 

4. Num_to_Intervel

 

This function will help you to convert an number into interval value.

The syntax and examples are given below.

 

If sysdate()=2013.06.05 17:52:21

 

E.g. sysdate()+num_to_intervel(12,’D’)=2013.06.17 17:52:21(Adding 12 days to given date)

       sysdate()+num_to_intervel(1,’H’)=2013.06.05 18:52:21(Adding 1 hour to given date)

Similarly, the number can convert into minutes (M) and seconds(S).

 

Regards

Asgar

Convertion functions in BODS with Examples_2

$
0
0

                                            Conversion functions in BODS_Part2

 

In this section I will explain mainly three conversion function in BO data service. They are mainly CAST, To_Date and load_to_XML.

 

1. CAST

 

Cast function used to explicitly convert an expression in one data type to another data type. The syntax for this function is given below.

 

CAST(Expression, data type) return data type.

 

The expression is the input which will be convert to target data type and the data type should be in build data type .

 

Syntax for different data type is given below .Please see below given table.

 

 

 

Data Type

Syntax

Varchar

Cast(expression,’ varchar(length)’)

decimal

Cast(expression,’decimal(Precision,scale)’)

Integer

Cast(expression,’int’)

Real

Cast(expression,’real’)

Double

Cast(expression,’double’)

Timestamp

Cast(expression,’timestamp’)

Datetime

Cast(expression,’datetime’)

Date

Cast(expression,’date’)

Time

Cast(expression,’time’)

Intervel

Cast(expression,’intervel’)

 

Examples for those functions are given below.

 

 

Input Expression

Source and target Datatype

Ouput

CAST(‘12.20’,’INT’)

Varchar to int

12

CAST(‘12.20’,’DECIMAL(3,1)’)

Varchar to decimal

12.12

CAST(12.20,’REAL’)

Decimal to real

12.200000

CAST(12.20,’DOUBLE’)

Decimel to double

12.200000

CAST(12.20,’VARCHAR(4)’)

Decimel to varchar

12.20

Cast(‘2012.01.01’,’date’)

Varchar to date

2012.01.01

Cast(‘2012.01.01’,’datetime’)

Varchar to datetime

2012.01.01 00:00:00

Cast(‘2012.01.01 12:01:12’,’timestamp’)

Datetime to timestamp

2012.01.01 12.01.12.000000000

Cast(‘sysdate(),’time’)

Datetime to time

12:21:00

Cast(12.121239,’intervel’)

Integer  to interval

12.121239

 

 

This table shows all the data type conversion valid for the cast functions.

 

 

From-To

Varchar

Date

DateTime

Integer

Real

Double

Interval

Timestamp

Time

Decimal

Varchar

x

x

x

x

x

x

x

x

x

x

Date

x

x

x

 

 

 

 

x

 

 

DateTime

x

x

x

 

 

 

 

x

x

 

Integer

x

 

 

x

x

x

x

 

 

x

Real

x

 

 

x

x

x

x

 

 

x

Double

x

 

 

x

x

x

x

 

 

x

Decimal

x

 

 

x

x

x

x

 

 

x

Interval

x

 

 

x

x

x

x

 

 

x

Timestamp

x

x

x

 

 

 

 

x

x

 

Time

x

 

 

x

x

x

x

 

 

x

 

From above table you will get which one data type can be convert to another one and which all are can’t convert to other data type.

 

 

 

2. TO_DATE

 

 

The to_date function used to convert a string to date value. This function converts a string into date format.

 

The string can also convert into datetime and time value format.

 

If the input string has more characters than the format string, the extra characters in the input string will be ignored and will be initialized to the default value.

For example, to_date('10.02.2007 10:12:12, 'DD.MM.YYYY') will convert the date to 10.02.2007 00.00.00. The time part in the input string will be ignored and initialized to 0.

 

The syntax of the function is given below.

 

To_date(string,format) returns date ,datetime or time

 

 

FORMATS

DD

Day of the Month(2 Digit)

MM

Month Number(2 Digit)

MONTH

Full Month Name

MON

Month name(3 char)

YY

Year(2 Digit)

YYYY

Year(4 Digit)

HH24

Hour(2 Digit)

MI

Minutes(2 Digit)

SS

Seconds(2 Digit)

FF

Sub Seconds(Upto 9 Digit)

 

The examples for this function are given below. A string can be converted into date value based on the above given format.

 

Please refer below examples.

 

Function

Result

To_date(‘jun 18,2012’,’MON DD,YYYY’)

2012.06.18 00:00:00

To_date(‘1March1900’,’DDMONTHYYYY’)

1900.03.01 00:00:00

To_date(’12-12-01 13:12’,’MM-YY-DD HH24:MM’)

2012.12.01 12:00

To_date(‘2012Jan01’,’YYYYMONDD’)

2012.01.01 00:00:00

 

 

These are examples for the string to date conversion .you can do any conversion from string to date based on the format given.

 

3. LOAD_TO_XML

 

This function convert an NRDT(Nested Relational Data Model) into XML and place it as a single column during the data load.

 

If the function fails during XML conversion then data services will return NULL value.

 

The Syntax for this is:

 

Load_to_XML(nested_table name,Schema_dtd_name,enable_validation,xml_header,replace_string_nulls,is_top_level_element,max size)

 

 

nested_table_name

Name of NRDM table.

Schema_dtd_name

Name of DTD or XML Schema

enable_validation

Enter 1 to validate and 0 disable validation

xml_header

default is UTF-8

replace_string_nulls

Replace null with this value

is_top_level_element

1 or 0

max size

Expected size of the XML.

 

 

Regards

Asgar

How to extract info from Oracle using DataServices 4

$
0
0

Our environment

     Suse linux 11

     Data Services 4 SP 3

 

 

Oracle  11.2.0.3

 

 

our env

 

 

LINK_DIR <instal>/dataservices

 

 

LD_LIBRARY_PATH ${LINK_DIR}/bin:${LINK_DIR}/DataDirect/odbc/lib:<instal>/sap_bobj/enterprise_xi40/linux_x64/odbc/lib

 

 

ODBCINI <instal>/dataservices/DataDirect/odbc/odbc.ini

 

 

   

questions:

 

 

whats the correct driver?

how to install driver?

how to create the connection?

how to test it?

 

 

regards

DS and FIM: Cannot write pipe, due to error

$
0
0

Hello!

Help me please.

I have a some job, it's job need to load data from model to model (BPC10 BW) .

We a running this job via FIM10, but job don't work,  Error log:

(14.0) 05-17-13 11:05:14 (E) (9420:16104) SYS-050604: |Session PR_MMR_1|Data flow DF_EXPORT_PR_MMR_1

                                                      Cannot write pipe, due to error <The pipe has been ended.  >.

 

I find the note with same problem and solution but this note for DS. But I never used DS, I only used FIM, and I don't know how to use DS. And I know that FIM use DS, and I open DS Desighner and find our several DataFlows of our job, but I can't find/make this action of note "Include the Input primary key column in the Table Comparison transform" (it's from note 1631163).

If it is not difficult for you can you help? Where is it option?

 

Thanks...


Data Load using BODS

$
0
0

Hi All,

 

I am trying to load data into VBAK from system 1 to VBAK in system 2. The number of fields in the source table is more than the number of fields in the target table, but looks like BODS is not able to take care of this situation - it throws an error. Even if the additional fields from the source are not mapped, the system still prompts the error. Pl advise, how to mitigate the error. Thanks.

Convertion functions in BODS with Examples_Part3

$
0
0

Conversion functions in BODS_Part3

In this section I will explain remaining conversion functions available in BO data services. These functions are mainly.

 

  1.    To_decimal
  2.    To_decimal_ext
  3.    Varchar_to_long
  4.    Long_to_varchar.

 

 

TO_DECIMAL

 

This function will convert a string value into decimal value based on the value given.

 

The syntax for this function is given below.

 

To_decimal(Input string,decimal_sep,thousand_sep,scale)

 

Input string

Input number string

Decimal_sep

Separate decimal component from whole number component

Thousand_sep

Separates thousands from hundreds.

Scale

Number of digit right to the decimal value to be return.

 

 

 

If the input string is invalid then the output this function will be zero.

 

E.g. To_decimal(’19,130.234’,’.’,’,’,3)=19130.234

 

TO_DECIMAL_EXT

 

This function will convert a string value into decimal and include precision as a parameter. It will support decimal data type up to 96 precision.

 

The syntax for this function is given below.

 

To_decimal_ext(Input string,decimal_sep,thousand_sep,precision,scale)

 

Input string

Input number string

Decimal_sep

Separate decimal component from whole number component

Thousand_sep

Separates thousands from hundreds.

Precision

Total number of digit in return value.

Scale

Number of digit right to the decimal value to be return.

 

 

If the input string is invalid then the output this function will be zero.

 

E.g. To_decimal(’19,130.234’,’.’,’,’,38,3)=19130.234

 

 

VARCHAR_TO_LONG

 

This function will convert a string into long data type column.

 

This function help full when the string size is too high, consider an example if the string having size 25000 and this column mapped to target column having data type varchar(max). In bods the varchar(max) is  read as long data type. So for loading this data this function is very helpful.

 

Varchar_to_long(column name).

 

LONG_TO_VARCHAR

 

This function will convert a data type column value from long to varchar.

 

The syntax for this function will be.

 

Long_to_varchar(column_name,max_size,Start_pos)

 

column_name

Long Column to be converted into varchar

max_size

Max size of the string after conversion

Start_pos

Start position from that position the conversion start. Default value is 1 and if it is negative that means starting position counted backward

 

 

Consider the data type of the column in database is varchar(max) ,when importing this column in to data service ,the dataservice will read this column as long data type.So to apply some string  function to this column convert it to varchar by using long_varchar function.

 

Regards

Asgar

 

 

BO Data services 4.1 upgrade

$
0
0

Hello,

 

We have SAP BODS v 4.0(14.0.3) and IPS 4.0 SP4 in our landscape and the requirement is to upgrade to BODS v4.1 from v4.0.

As per the upgrade guide, we have installed BODS v4.1 SP01 on top of BODS v4.0.

That is, we have chosen the same installation directory of BODS v4.0 while installing v4.1.

After installation, when we check the version in settings of CMC it is still showing 14.0.3.

Could any of you please advise if we miss any thing.

 

IPS 4.0 SP4 is compatible with BODS v4.1.

 

Regards,

Aparna J.

Data Quality- USA Regulatory Address Cleanse

$
0
0

Hi experts,

 

I am using USA Regulatory Address Cleanse, how to know the package is installed, i am using 4.1 version, i have this question because

i am getting error as

 

14.1) 06-11-13 21:13:18 (E) (25160:28332) VAL-030910: |Session DqmBlueprintUSA_AddressCleanse

                                                       Transform <USARegulatory_AddressCleanse>:Option Error(Option: [USPS License Information/Customer Company Name]): <URC1003>:

                                                       [Customer Company Name] option must be filled in [USPS License Information] block when either [Enable DPV] or [Enable LACSLink]

                                                       options are set to YES.

 

Thanks

Madhu

History_Preserving Error with Data Types

$
0
0

I am creating a History_Preserving transformation.  When I try to run my job I am getting an error messge that states "Data Type of column <START_DATE> specified in option <valid_from_column> for the History_Preserving transform must exactly match the data type of column <END_DATE> specified in option <valid_to_column>."

 

Both my START_DATE and END_DATE are defined with date type DATE.  My start date is populated with sysdate and my end date is populated with null.  Within the History_Preserving transform I am setting the new record to a valid To date of 9999.12.31 and the old record to "one day before valid from_date of new record".

 

My dataflow is Source --> QUERY TRANSFORM --> TABLE COMPARISON --> HISTORY PRESERVING --> KEY GENERATION --> TARGET.

 

I have a feeling I am missing something simple but have not had luck finding much reference to this issue online.  Any help would be appreciated.   

How to identify long running dataflows in a job in BODS?

$
0
0

Hi,

 

Could any one please let me know How to identify long running dataflows in a job?

 

Thanks

Madhu

Implementing Custom Cleansing Package on BODS

$
0
0

Hi All,

 

I am able to execute my Custom Cleansing package ,after creating it in Information Steward 4.1 and imporiting the ATL  in BODS 4.1.

But there is an issue.

 

I want to  replace RD word with Road. So I have

used the parsing strattegy as Parse data on  whitespace and transitions between letters, numbers, or special characters.

 

for eg if the data is

2684 ABC  RD

  it should return

2684 ABC  ROAD,

 

But instead it is returning only

 

ROAD

  as the output field.

 

Can anybody guide me  how to replace a particular variation by its standard form,keeping the ither words intact.

 

Thanks,

Mayank Mehta


Flat File with string with error is causing to skipp valid rows also

$
0
0

I have defined my source as flat file with column delimiter as coma, Row delimiter as new line and text delimiter as single code.  Error threshold (Maximum errors to stop the job as: unlimited). 

 

When I am receiving source file in which 3nd row, one of the column has a string, in which single code is missing...generally that particular row only has to be skipped as it is error.

 

But in this situation, it is skipping all rows afterthis error row. 

 

I have attached flat file screen shot ,

 

3rd Row with Empno :3  has Ename  as 'Samual   which not ended with single code  ,  this row needs to be skipped

But  this row is being skipped and  same time next rows ( Row 4, 5 with EmpNo 4,5 which has strings with proper single codes ) also skipped.

 

Why next rows ( Row 4,5 ) are skipped, they should not be skipped row

 

How could I resolve this?

How to load data to a dat file from oracle as source table

$
0
0

I am planning to extract data from an oracle table, but this data needs to be loaded to a dat file.

 

I have loaded data to flat files(.txt) with pipe or tab delimiter.

 

Haven't worked on dat files loading, please kindly provide steps to produce a dat file.

 

Thank you very much for the helpful details.

 

Regards,

Roger

Pre-delivered Migration content missing with DS 4.1 installation

$
0
0

Hi All,

 

We have installed Data services 4.1 with SP 1.0. After the Installation we found that we are missing the Migration content (Pre-delivered jobs).

 

I feel there is something wrong in the Data services installation file or we have missed the pre-delivered migration content (AIO_BPFDM_IDOC) with the installation. I wanted to know from where we can extract the standard pre-delivered content.

 

Attached is the file which we are looking into.

 

Many thanks for your replies.

 

MPS

SAP Data Services 4.1 - SQL Server Native Client issue

$
0
0

I ran into this problem today after creating a dataflow which wrote data to a temporary table.

 

45804460DBS-07040114/06/2013 17:19|Data flow DF_XXXX|Loader Query_XXXX
45804460DBS-07040114/06/2013 17:19ODBC data source <SQLSERVER\INSTANCE> error message for operation <SQLBindParameter>: <[Microsoft][ODBC SQL Server Driver]Optional feature not implemented>.

 

 

The issue:

The temporary table had a date datatype on it and kept returning the following error when trying to create the table in the SQL Server 2008 R2 SP2 database.

 

Why this issue:

I did not have the latest version of SQL Server Native client installed. In my case above on my Win 2008 R2 server I only had the default one installed (SQL Server 6.01.7601.17514 SQLSRV32.DLL) which I think is pre-2008 and pre-2008 SQL Servers did not have a date data type.

 

So I did this:

Downloaded the x64 version of Microsoft® SQL Server® 2012 Native Client [sqlncli] which can be found here. Installed this and then problem solved even though I use SQL Server 2008 R2.

Loading into tables in two different datastores

$
0
0

Hi Experts,

 

We have many existing jobs which are loading data into target HA1. We have a new requirement, where these existing jobs should load data into HA1 as well as HB1.

 

Capture.JPG

 

Is there a simple way we can do that? Or we have to create new mappings for all existing one's (Replication of existing)?

 

Thanks,

Naresh

Viewing all 4013 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>