Quantcast
Channel: SCN : All Content - Data Services and Data Quality
Viewing all 4013 articles
Browse latest View live
↧

Source Connection checking & Job automation

November 13, 2015, 8:01 am
$
0
0

Hi,

 

I have a batch jobs which fetches data from source DB (oracle 10g) and to be executed after connection is released on daily basis.

 

Because of this dependency of connection release by source team DB team and manually checking connection and release then executing job manually is tedious task and because of this I have to work on weekends and on holidays too.

 

Now I want to automate the Job based on Below conditions so that I don't have to work on weekends and on holidays.

 

1> Checking IF connection is released or not

a. if Yes then Job should get started.

in the middle of job execution connection fluctuation may happen and job may get killed. In that case it should get started again.

 

b. If job is already running or has been executed successfully it should not get started.

 

c. If Connection is not released  then redo step 1 may be at an interval of 1hours. (pts. a & b should be taken into consideration)

 

 

Regards,

Sachin Gupta

↧
Search

Tell us about your address cleansing usage

November 13, 2015, 12:09 pm
$
0
0

I would love to hear from you how you are using address cleansing at your organization.  This will help us guide our product direction and help bring quality services to our great customers.  I'd would really like to know:

 

  • How many addresses do you cleanse each year through DS/DQM?
  • Are there countries for which you don't have directories because your volume doesn't warrant the cost of purchase?
  • Do you make extensive use of geocoding and reverse geocoding?
  • Do you use POI capabilities?
  • Are there countries for which SAP does not offer address data but you wish that we did?

 

Please let me know about your usage.  You can reply in this thread or, if you prefer, you can email me directly at paul.medaille@sap.com.

 

Thanks!

↧
↧

"Unable to locate BOE platform components" when launching DS designer

November 13, 2015, 6:04 am
$
0
0

Hi Dear Experts,

 

I have some troubles with DataServices Designer:

Clip2net_151113200039.png

 

It's new installation:

SAP BI 4.1 sp6 patch 4   -  server1

SAP DS 4.2 sp5 patch 2  -  server2

 

BI full+APS+DS Management console - on server 1.

Jobserver+access server (ds designer) - on server 2.

 

I checked compatibility of BI+FIM from sapnote 1740516, it's fine.

also I tried to replace BCM-4.0.dll (from sapnote 2029321), doesn't help.

In CMC DataServices repository configured, connection is OK.

Access and Job Servers is configured.

 

I don't know what to do, please help me.

Thanks...

↧

How to setup Email in SAP DS 4.2 with authentication ?

November 15, 2015, 9:01 pm
$
0
0

Hi All,

 

I am trying to set up an email configuration in SAP DS 4.2 but getting error in DS while executing a job error as "SMTP error code <530>".

 

Please find below all the steps I performed for configuring & setting up of an email functionality using DS server manager & DS CMC (Central Management Console).

 

First configured the SMTP & sender information in DS Server Manager.

 

 

Server : XX.XXX.XX.XX (SMTP Exchange server IP)

 

Sender : Email id account created for sending the emails from DS server

 

DS_SM.png

 

 

Secondly setting up an email using DS CMC under Servers -> Core Services -> Job Server -> Right Click -> Destination -> Email -> Add

 

 

CMC_1.png

 

 

After this passing all the values in domain name, host, port, authentication method, user name, password, from field & than save -> close.

 

 

CMC_2.png

 

 

But after performing all these steps getting below error when trying to send an email using smtp_to() function from DS may be i am missing something.

 

 

DS_error.png

 

 

one more thing when i tried to do telnet on command prompt using authentication login i am able to send an email using email id account created for sending mail from DS server.

 

 

cmd.png

 

I think issue is with authentication method. Please suggest.

 

 

Thanks,

Ankita

↧

Transaction Control in BODS Target table options

November 16, 2015, 3:40 am
$
0
0

Hi Experts !

 

I am not much familiar with how transaction control works in DS. so looking for valuable inputs and thoughts on points some thing like below

1) how DS buffers data ?

2)what memory it uses? etc.,


Database : SQL DB

we are facing this issue after migrating to higher version.


one of our job is failing with invalid date/time format issue

though there is no issue with data or time in the DF where we are seeing this failure

we have one source and 7 targets and all of them are in SQL DB

all the 7 targets are in transaction control in same DF. and they have an order.

by removing transaction control the job is running fine for few records 25-30 .

we suspect that for more data DS buffers data. and could be memory issues

we are picking up server date and loading into target tables. in other data flows it works fine , only in this case it shows error.

if we removing transaction control option job completing successfully .


Can any one please help on this ?


Thanks&Regards

Ahalya Inturi



↧
↧

Job Server of dataservices 4.x doesn't run

November 15, 2015, 1:00 pm
$
0
0
  1. Hi.

I am having a rare problem with the job server with data services.

After install the CMS and DataServices the job server runs one time and I can’t run the job server anytime after.

This problem is at windows 7, 2008 R2 and 2012 R2 with dataservices 3.x or 4.x, with windows xp dataservice 3.x runs correctly.

I have try to put between “ the path of the .exe of the job server, like a note than I have read, but the issue is not solve.

When I reconfigure the job and sync the job with the database no error occurs, but when I try to run a data flow, dataservies show the error:

job server .... is not responding (BODI-1241021)

The job server is not responding .. (BODI-1260016)

I think isn’t an error of configuration of CMS or DataServies because it runs one time.

In the log of the system I have found the follows messages:



(14.2) 11-09-15 23:48:38 (2296:2012) JobServer: -------------------------------------------------- (BODI-850035)

(14.2) 11-09-15 23:48:38 (2296:2012) JobServer: Job Server Started... (BODI-850036)

(14.2) 11-09-15 23:48:40 (2296:2012) JobServer: Job server uses <300+3> threads for processing and can handle requests from only <50> Data Integrator Designer applications.

                                                The number of threads does not include threads necessary for adapter, SNMP and load balance processing. (BODI-850277)

(14.2) 11-09-15 23:48:40 (2296:2012) JobServer: Binding server to address inet:3500. (BODI-850044)

(14.2) 11-09-15 23:48:40 (2296:4612) JobServer: Thread pool size for processing log file requests set to <100>. (BODI-850271)

(14.2) 11-09-15 23:48:40 (2296:2012) JobServer: Listening on ANY:3500. (BODI-850157)

(14.2) 11-09-15 23:48:41 (2296:2012) JobServer: Thread pool size for processing incoming requests set to <100>. (BODI-850276)

(14.2) 11-09-15 23:48:41 (2296:2012) JobServer: Neither Message Broker, Adapter Manager, nor SNMP MB Server started. (BODI-850043)

(14.2) 11-09-15 23:48:46 (2296:4164) JobServer: End Reading ServerGroup Information from Repository <localhost_DS_REPO_dba>. (BODI-850154)

(14.2) 11-09-15 23:48:46 (2296:4164) JobServer: Job Server is not part of Server Group. Server Group functionalities are disabled (BODI-850211)

 

 

I can’t found the solution, can anybody help with this issue?

 

Best regars.

↧

Cannot start thread error

November 16, 2015, 5:30 am
$
0
0

Hi All,

 

We are receiving the error Cannot start thread for all the Production jobs.

 

I did a research and found that it is related to Stack Size on Linux server. We are on DS 4.2 SP5 and OS is Red hat Linux 6.7 with the reporting database and repo database on Oracle 11 G R2.

 

After referring the below link could not find the maximum Stack size for linux

 

Data Services User Resource limits on Unix systems - Enterprise Information Management - SCN Wiki

 

We have set the stack size on the linux server to 10240.

 

Can anyone tell what should be the recommended and maximum stack size

 

Regards

Arun Sasi

↧

Loosing DQM files during Windows maintenance

November 16, 2015, 8:54 am
$
0
0

Hi,

 

We have installed DQM where our DataServices also running, for some reason whenever our Windows team do maintenance on it, we are loosing some of the files of DQM and the service not starting due to that.

Does anybody face similar issue? If so please share what can be do to avoid it.

 

bR,

Raghu

↧
Search

Getting data as for alphanumeric values

November 16, 2015, 10:02 am
$
0
0

Hi team,

 

I have created one flllat file Datastore objects, i have many fields one of them is SITE, the data type is varchar(4) and in the flat file i have data like 4002,4A02 etc..

 

For Alphanumeric site values , i am getting the values as <Null>  in the DS but for the number values i am getting the correct. Why it is behaving so ?

 

Please help me...

 

Regards,

Praveen.

↧
↧

reverse pivot transformation help

November 16, 2015, 7:42 am
$
0
0

hi guys

 

I am trying to create multiple rows data in single row using reverse pivot transformation but somehow it is not working..

 

Sample data scripts:-

 

 

CREATETABLE TEST(id INT,dt1 datetime, total int, new int, old int, status_1 varchar(50), no_ int)

 

 

INSERTINTO TEST VALUES (101,'2013-04-24 00:00:00.000',10, 7, 3,'new with tags', 2)

 

INSERTINTO TEST VALUES (101,'2013-04-24 00:00:00.000',10, 7, 3,'new without tags',4)

 

 

INSERTINTO TEST VALUES (102,'2013-11-07 00:00:00.000',15, 9, 6,'new with tags', 5)

 

INSERTINTO TEST VALUES (102,'2013-11-27 00:00:00.000',15, 9, 6,'new without tags', 2)

 

INSERTINTO TEST VALUES (102,'2013-11-27 00:00:00.000',15, 9, 6,'return', 1)

 

INSERTINTO TEST VALUES (103,'2013-12-04 00:00:00.000',25, 15, 10,'cancelled', 5)

 

 

select*from TEST

 

CREATETABLE TEST_RESULT(id INT,dt1 datetime, total int, new int, old int, [new with tags] varchar(50), [new without tags] varchar(50), [return] varchar(50), [cancelled] varchar(50))

 

 

INSERTINTO TEST_RESULT VALUES (101,'2013-04-24 00:00:00.000',10, 7, 3, 2,4,0,0)

 

INSERTINTO TEST_RESULT VALUES (102,'2013-11-07 00:00:00.000',15, 9, 6, 5,2,1,0)

 

INSERTINTO TEST_RESULT VALUES (101,'2013-12-04 00:00:00.000',25, 15, 10, 0,0,0,5)

 

 

select*from TEST_RESULT.

 

Please find attached scrrenshot of dataflow using reverse pivot transformation... Please let me know what i am doing wrong..

 

Regards

↧

Can't Import SAP IQ Stored Procedures - (BODI-1112335)

March 17, 2015, 10:43 am
$
0
0

Has anyone working with SAP IQ ever tried importing a stored procedure into data services designer?


SQL Server SPs seem to import fine. But I'm having no luck with SAP IQ.


I'm getting BODI-1112335. Stored Procedure or function <Stored procedure name > was not found in the source DataStore.

 

The SP works fine when called from Interactive SQL.


Sap Data Services Designer - 14.2.4.668

Sap Data Services Repository- 14.2.4.0000

Sap IQ 16.0.0.807-sp08.01



↧

SAP BODS 4.1 Designer port issue

November 20, 2013, 7:57 am
$
0
0

Dear experts,


While trying to connect from Designer getting Logon failed issue. Job server has been running on Linux and there is some firewall between client and server.


After installation, Designer connected success fully(First time) and executed some jobs; then re-started the job server and try to connecting from Designer but it got failed. Then we identified designer port has blocked by firewall; we opened the port with the help of network team and added same port in designer ( tools --> options as attached), initially it was working fine; today again re-started the job server but getting same issue.


Version : BODS 4.1 SP2

 

 

Any ideas what I can do to get this to work?

Thanks in advance

↧

How could i access different view controls by sap.ui.getCore().byId() ? it doesn't work it shows an error

November 17, 2015, 1:56 am
$
0
0

I cannot access elements via byId() from different view/controller.

 

I am trying to access another view elements by using below  syntax.

 

sap.ui.getCore().byId("xxx").setModel(oModel2);


But it shows error like (Cannot read property 'setModel' of undefined).

 

I found some answ in SCN blog they said that

 

When you do createID('XY'), the element is created with an ID havinbg format <prefix>XY . The prefix is that of the view. So when you do sap.ui.getCore().byId('XY'), you will not find any element with ID 'XY'.


Please help me. How could i achieve.


↧
↧

Automatic correction in Sap power designer

November 17, 2015, 6:19 am
$
0
0

Hi ,

          I took a Quick books database and generate Automatic mapping in Mapping editor.some columns are mapped with the '|' symbol.i want to replace with '+'.But,Some there are lot of columns to modify manually.

          So is there any option to change it automatically!please help me.

↧

Updating a dimension table

November 17, 2015, 5:19 am
$
0
0

How would I be able to achieve the following (I tried using a classic chain of a table compare, history preserve and row generation, but to no avail, as only the most recent record gets updated):

 

Suppose I have an employee dimension with just five columns: surrogate key, business key, employee name, position, date of birth. I only want inserts of new records and changed records based on a change of function, i.e. the other columns I'm not really interested in in terms of history, so they should really just be overwritten.

 

So if an employee has changed position a number of times, but HR finds out that the year of her DOB was initially entered incorrectly I want all of the records pertaining to that person to be corrected. How would I be able to achieve this (ideally the whole logic in one single data flow)? Thanks in advance.

↧
Search

SQL Server 2012 connectivity.

November 17, 2015, 1:57 am
$
0
0

Hi All,

 

We need to create connectivity with MS SQL server 2012 as Source and HANA as target in BODS.

There is a confusion about which driver(Native or any other) needs to be present at designer and BODS server end to enable the communication.

Data Direct drivers are present at Server end already.

Also please help me with any prerequisite configurations that needs to be done to be able to connect to SQL server for both BODS and Designer Boxes.

Data service is setup in a Linux box.

 

Warm Regards,

Abhishek

↧

Why do I get parsing errors with my WSDL URL for Web Services usage

November 8, 2010, 1:19 am
$
0
0

Hi,

 

I am puzzled with the errors I get when I want to create a Web Service datastore.

 

Scenario: I have created a SAP Web Service from CRM using SOAMANAGER. The WSDL URL produced by SOAMANAGER is accessibile when pasting the URL directly in Internet Explorer. WSDL URL [http://UXCIQ0M.WDF.SAP.CORP:50076/sap/bc/srt/wsdl/srvc_CBDCB34C89C29304E10000000A4282C0/wsdl11/allinone/ws_policy/document?sap-client=504]

 

When using the WSDL URL in the Web Service datastore URL field, I get the error An error occurred while importing metadata: WSDLException; faultcode=PARSER_ERROR: Problem parsing: The element type "br" must be terminated by matching tag "/br". (BODI-1111469) (BODI-1112446)

 

When I save the WSDL defintion in a local file and use a local file path, I get the errors An error occurred while importing metadata: WSDLException (at /wsdl:definitions/wsdl:portype/wsp:Policy): faultcode=INVALID_WSDL: Encountered unexpected element 'Policy. (BODI-1111469) (BODI-1112446)

 

 

My questions:

 

- Why do I get different parsing errors despite the fact that the XML is the same?

- The WSDL is generated by SOAMANAGER. Shouldn't it work directly when integrating with Web Services generated from an SAP environment?

- Is this related to confiurgation issue? I have set the Job Manager to Support adapter, message broker and SNMP communication

- What is the difference between the datastore of type Adapter and the datastore Web Service? In the white paper [http://www.sdn.sap.com/irj/boc/go/portal/prtroot/docs/library/uuid/20bd5e60-11f9-2b10-2bbb-b5109cceff08?quicklink=index&overridelayout=true] it is mentioned to use the Adapter type to consume a Web Service. It is not clear to me why we have those 2 types.

 

Thanks & Best Regards

Isabelle

↧
↧

Source Connection checking & Job automation

November 13, 2015, 8:01 am
$
0
0

Hi,

 

I have a batch jobs which fetches data from source DB (oracle 10g) and to be executed after connection is released on daily basis.

 

Because of this dependency of connection release by source team DB team and manually checking connection and release then executing job manually is tedious task and because of this I have to work on weekends and on holidays too.

 

Now I want to automate the Job based on Below conditions so that I don't have to work on weekends and on holidays.

 

1> Checking IF connection is released or not

a. if Yes then Job should get started.

in the middle of job execution connection fluctuation may happen and job may get killed. In that case it should get started again.

 

b. If job is already running or has been executed successfully it should not get started.

 

c. If Connection is not released  then redo step 1 may be at an interval of 1hours. (pts. a & b should be taken into consideration)

 

 

Regards,

Sachin Gupta

↧

Sample BODS projects from extraction to reporting

November 17, 2015, 8:44 am
$
0
0

Hi All,

 

Is their any documents / website to go through explaining sample BODS projects from data extraction (using BODS) to final reporting

using SAP BO (Universe and then WEBI / dashboard design)?

 

Regards,

Sachin Gupta

↧

Data Services - Rebuild Central Repository (Dependency Corruption)

November 9, 2015, 1:10 pm
$
0
0

Hello,

 

Over the course of making several changes at once across almost every workflow in a project (lesson learned), I am now unable to check in my project to the central repository. Here is the error I get - note the missing function name before the first dot:

 

(added error text 02-NOV-2015)

"Internal error in 'local repository'. Objects in central and local repositories don't match. Some objects may have been deleted from central repository. Please refresh central object library and try the operation again. (BODI-1112275)

 

The following objects in dependency list constructed from the repository cannot be found in the corresponding dependency list in the cache. Imported function - .TEST.ODBC.HANA"

bods_error.png

 

I've been able to solve a similar issue by fixing an upper/lower case issue in a script. I can't seem to narrow this down and am to the point of trying to recreate a central repository.

 

What is the "best" approach to rebuilding a central repository based on a local repository with checkouts?

 

Thanks.

↧
Viewing all 4013 articles
Browse latest View live
Search