Ascential'S Datastage BW Load Pack 3.0: Bryan Katis Platinum Consultant

Ascentials
DataStage BW Load
PACK 3.0
Bryan Katis
Platinum Consultant
Integration Platform RIG, SAP Labs
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 2
2
Agenda
BW Load PACK 3.0
BW MetaBroker
SAP BW Business Content for Oracle Financials
SAP / Ascential Partnership
3
Agenda
BW Load PACK 3.0
BW MetaBroker
4

BW Load Pack

XML
Pack
Appl. Spec.
Extr.Pack
Application
PACKs
E-Business Applications
^
Legacy Systems
VSAM
RDBMS
(DB2)
ADABAS
R/2
File
Non SAP
Business
API
SAP
BW
Service
API
BW Service API for SAP
S I E B E L
SAPs Data Aquisition Strategy
PeopleSoft
Oracle
BW Load Pack

Native
PlugIns
XML Pack
Application
PACKs
5
SAPs Package One Offering
Package One offers users a low cost solution for integrating
unlimited non-SAP data into SAP BW environments.
DataStage on Intel NT (single copy)
Access to unlimited number of non-SAP R/3 sources, including any of
the data sources supported by the base DataStage license.
DataStage Load PACK for SAP BW (single copy)
Allows DataStage to load unlimited number of SAP BW environments.
Additional Ascential Application PACK (single copy)
Options include Siebel and PeopleSoft; XML PACK ships with
DataStage; Oracle Applications (coming soon).
DataStage Essentials and PACKs education at an Ascential training
facility in Europe or the US.
6
SAPs Package Two Offering
Package Two allows users to set up a separate production version of
DataStage with broader access to data originating in application
environments. This package includes:
DataStage on Intel NT or Unix (two copies)
Access to unlimited number of non-SAP sources, including any of the
data sources supported by the base DataStage license.
DataStage Load PACK for SAP BW (two copies)
Additional Ascential Application PACKs (three copies)
Licenses for application PACKs can be for same or different application
PACKs. Options include Siebel and PeopleSoft; XML PACK ships with
DataStage; Oracle Applications (coming soon).
DataStage Essentials and PACKs education at an Ascential training
facility in Europe or the US.

7
mySAP BI for full Open Enterprise Data Warehouse
When will Package One Not Be Enough?
Performance and Data Security Issues
UNIX environment
High data volumes, with complex transformations and minimal latency
tolerance levels
Back-up or additional production server for load balancing
Separate development from production server
Integration of global data sources in complex system landscape

8
Why choose Ascential DataStage?
SAP certifies CSP Partners for its Staging BAPI interface. Why is
DataStage a better choice?
Ascential DataStage is SAPs preferred data integration technology
Ascential and SAP have co-engineered a joint release of their
products resulting in optimum graphical integration and
performance benefit.
Examples:
Custom Ascential business content ships with SAP BW to be
used for test and demo purposes
SAP BW InfoPackage 3
rd
Party Selections contains Ascential
specific customizations allowing for full exploitation of
DataStage job parameters
The DataStage job log is available for examination in the
InfoPackage monitor
9
Development Partner
SAP BW Certification Levels for CSP Partners
BW 1.2 BW 3.0 BW 2.0 BW 4.0
BAPIs BAPIs BAPIs BAPIs
Certification Level
1.2 2.0 4.0
Staging
BAPIs
Staging&
Metadata
BAPIs
Staging&
Metadata&
.....
BAPIs
No
Significant
BAPI
Development
10
Agenda
BW Load PACK 3.0
BW MetaBroker
11
Generating BW Meta Data from non-SAP Data
Scenario: Importing non-SAP data requires additional manual data
modeling in the Administrator Workbench.

Solution: BW Load PACK 3.0 supports import of non-SAP meta data:
including the creation of InfoObjects, InfoSources, InfoPackages
and Source Systems. Users can now generate SAP BW Business
Content from legacy meta data. Simply point at DataStage Table
Definitions or Stage Column Lists and let the Load PACK create
SAP BW objects ready for data loading.

12
Integrated Process Messaging
Scenario: SAP BW 3.0 supports multiple data sources. It can be
difficult to understand and diagnose data loading problems from
non-SAP sources.

Solution: BW Load PACK delivers process information on-demand to
SAP BW InfoPackages. Users can now see the DataStage job log
and load statistics in the SAP BW InfoPackage monitor.

13
Load PACK Pushes Data into SAP BW
Scenario: Companies have change data triggers and schedulers in
their non-SAP systems that invoke DataStage, but SAP BW will only
accept data loads as pulls, invoked by the SAP BW scheduler. The
data must be landed on the DataStage server.

Solution: New BAPIs in SAP BW allow the InfoPackage scheduling to
be controlled externally by DataStage. The Load PACK can now
manage all scheduling operations and invoke load requests from the
DataStage server.

14
Performance Improvements
Scenario: Data volumes are increasing. Load performance is mission
critical.

Solution: The New Load PACK takes full advantage of data streaming
and multi-threading processing techniques. Users can even tune
their data package transmission sizes for each DataStage job.

15
Improved Architecture
SAP BW
RFC
Server
Load PACK
Client
Load PACK Server
Repository
Flat File
Data
Streaming
Multithreaded
Load Requests
DS Job
16
Meta Data Import Design Assumptions
BW Load PACK jobs produce column lists which mirror BW
transfer structures.
The new Load PACK allows users to generate SAP BW InfoObjects
and InfoSources directly from these column lists. Consolidation of
these operations (ETL and BW modeling) greatly simplifies the
loading of non-SAP data. Job designers can now simultaneously
create and select BW content in the Load PACK GUI.

DataStage repository Table Definitions represent meta data
descriptions that can be used to generate SAP BW business
content.
The Load PACK GUI will permit access to the DataStage repository.
Table Definitions can be used to drive the creation of InfoObjects
in SAP BW.
17
Source System
Source System management has been moved to a new independent
utility. The General tab is primarily used to display and/or select
from existing connections.
18
Transfer Structure
Meta Data BAPI support is accessed in the Transfer Structure tab.
The creation and selection of BW content is now functionally
interdependent.
19
Table Columns
There has been little change to the functionality accessed from the
Columns tab. Column Synchronization occurs automatically.
20
InfoPackages
The Push/Pull Data Load Methods are new with this release of the
Load PACK. It is now possible to create, schedule and invoke SAP
BW InfoPackages from DataStage.
21
Design Objectives
Whenever a DS repository Table Definition or job link Column List
relates directly to a desired SAP BW InfoObject or InfoSource
definition, allow that table definition or list to drive the creation of the
SAP BW Object(s)
Allow users to create InfoObjects while in the process of creating an
InfoSource that might contain that InfoObject
Supply user controllable default values to reduce repetitive data
entry when creating an InfoObject or InfoSource
Make use of DataStage data elements (that will ship with the Load
PACK) to facilitate conversions from a SQL data type to its
equivalent SAP type.
Example: NUMC becomes CHAR and a custom data element
BW_NUMC performs strong data type checking and/or conversion logic
to all runtime data for that column
22
Design Objectives (cont.)
Maintain an InfoObject catalog for all Objects created by the 3
rd
Party
Source System
Provide visibility of the InfoObject catalog - distinguishing between
those objects created by the 3
rd
Party Source System as compared
with the entire list of InfoObjects in SAP BW
Support for Object modeling based on templates derived from the
InfoObject catalog
Provide support for InfoPackage creation, scheduling and external
invocation

23
Full Visibility of Transfer Structure Details
Meta data for selected transfer structure is always visible. Source
System and InfoSource selection/management is available on the
same screen.
24
Entry Point to Meta Data Import Utilities
Transfer Structure tab provides access to all of the InfoObject and
InfoSource capabilities. The GUIs functional hierarchy is extremely
intuitive.
25
Create BW Meta Data from DataStage Meta Data
Press Add InfoObjects and DataStage feeds the columns into
InfoObjects. Simply highlight fields in a DataStage Table Definition.
Selected meta data drives the creation of InfoObjects in SAP BW.
26
InfoObject Defaults
All InfoObject values contain defaults. Columns can be added
sequentially just click the Add All button.
27
All InfoObject Properties can be Edited
All Properties are accessible
28
Intuitive Dependent Property Management
Select columns from the pop-up DataStage Column list. The Load
PACK will know whether the selected rows can simply be selected as
Attributes or need to be created and added to the InfoCatalog before
the corresponding InfoObjects can be selected. Dependent
InfoObjects (Attributes) can be selected from BW InfoCatalogs or
generated directly from DataStage Columns. Example: Select or
Create InfoObjects to be used as Attributes for the current Object.

29
The Load PACK Maintains its own InfoCatalog
To support data integrity, the Load PACK maintains its own
InfoCatalog in SAP BW. InfoObjects generated by the Load PACK
are cataloged. When generating new InfoObjects, this catalog is
queried for possible matches, thereby avoiding unintended meta
data redundancy.
All SAP BW InfoCatalogs can be searched from the Load PACK.
All InfoObjects from all Data Sources are available for use in the
Load PACK.
30
Create BW InfoSources
The Load PACK can create and edit SAP BW InfoSources including
Communication Structures, Transfer Rules and Transfer Structures.
Use DataStage meta data to create and populate
Master/Text/Hierarchy and Transaction InfoSources.
The Load PACKs intuitive GUI allows DataStage job designers
access to the DS Repository.
InfoSources can draw content (InfoObjects) from the DS Repository,
the InfoObject catalog or from InfoObjects generated as part of the
InfoSource creation process.
31
Design InfoSources to Match non-SAP DataSources
Streamline the ETL SAP BW Load process Create the InfoSource
while designing a BW Load job. Allow the non-SAP operational data
to define SAP BW business content.
32
DataStage Data Elements and Transforms
DataStage Data Elements support data typing across disparate meta
data. The new Load PACK exploits this capability. SAP proprietary
data types (DATS, NUMC, etc) are automatically mapped to
DataStage Data Elements.
Powerful Transforms can now be mapped effortlessly to incoming
non-SAP data. Data transformations are handled consistently.

Supplied Custom
Transforms convert
SQL dates to SAP
format
BW Load PACK
automatically supplies
correct Data Element
based on SAP BW
Transfer Structure
33
DataStage Job Log in BW Monitor
34
Agenda
BW Load PACK 3.0
BW MetaBroker
35
SAP BW MetaBroker Capabilities
SAP BW MetaBroker imports SAP BW meta data into
MetaStage
InfoSource transfer & communication structures
BW ODS structures
BW InfoCube structures
InfoSource to ODS & InfoCube relationships (end-to-end data
lineage)

36
SAP BW MetaBroker
37
Whats New in DataStage 6.0?
Significant Performance Enhancements
DataStage Server Link Partitioner and Collector Stages
Point-and-Click graphical distribution of single job workload across multiple
SMP processors.
IPC Stage
New Row buffering option increases performance, particularly on multiple-
CPU systems, by enabling two simultaneously executing work processes in
the same DataStage job to pass data more efficiently.
In-memory Hashed Files
Eliminates memory overhead and initial setup time of multiple server-side
copies of reference data when used by multiple DataStage jobs.
38
Platforms and Software Compatibility
DataStage PACKs for SAP BW
Platforms
Windows NT / 2000 / XP
IBM AIX
SUN Solaris
HP HP-UX
Compaq Tru64 (upon request)
Software Compatibility
DataStage 5.1+
SAP BW 2.0B, 2.1C, 3.0B, 3.1
Content

MetaStage & SAP BW MetaBroker
Platforms
Windows NT / 2000 / XP
Software Compatibility
DataStage XE 6.0
SAP BW 3.0B, 3.1 Content
39
Agenda
BW Load PACK 3.0
BW MetaBroker
40
B
W

L
o
a
d

P
a
c
k

^
RDBMS
SAP BW Business Content for Oracle FI
SAP BW
BAPI
O
r
a
c
l
e

A
p
p
l
.

P
A
C
K

RDBMS
Oracle FI
Access via
Application
Business
Content
Predifined
DataStage Jobs
+
41
Example for Application Packs
Oracle Application PACK (Oracle Release 11i)

Direct Access Stage:
Add Business View functionality accesses the underlying datamodel via
the Business Object level (using Panels and Panel Groups)

Add Table View functionality accesses the underlying datamodel directly
via DDIC information from Oracle (list of tablenames)

Using the metadata description for tables, views and fields as defined in the
Oracle Application
Delta capabilities are given
Automatic search for effective Date fields within Oracle (Type: Timestamp).
Automatic creation of a delta-file with the date of the last job run.

Hierarchy Stage
Supports all in BW needed hierachy data needed in BW.
42
Oracle BW integration
Business Content from
Oracle Financials
Oracle Projects
Oracle Human Resources

Standard BW Content (BW 3.0B +)
DataSources
InfoCubes (e.g. Flexible General Ledger, Profitability Analysis,
Project Accounting)
Web Cockpits (with drill down and navigation, graphical representation,
period comparison)

Extraction Tools
Developed in cooperation with Ascential for BW 3.1 Content, available for
pilots September 2002
43
BW 3.0B Content
Flexible General Ledger, Profitability Analysis
All debits and credits form Oracle GL Balances for
actual, plan and encumbrance data. Amounts and
quantities for statistical postings
Information on the origin of the costs from multiple
account assignments as setup in the accounting
flexfield.
Alternatively, assignment to financial items is
possible for profitability analysis.
Project Accounting
All costs, revenues and consumption quantities for
personnel and non-personnel resources.
DataSources for all transaction data and for all master
data used in theses InfoCubes (32 InfoObjects)
44
BW Web Cockpits based on Oracle Financials
Personalizable (e.g. My Cost Centers)
One-Click Drilldown from Overview to Detail
Switch between table and chart
Automatic selection of predefined time
frames
Web-Cockpits for General Ledger: Costs, Statistical Keyfigures, Profitability
Projects: Status, Employees, Resource Consumption
45
Oracle Integration Overview
Oracle Applications:
Financials
Projects
Human Resources

BW Business Analytics
Content
Web Cockpits/
Business Packages
Info Cubes
Info Sources
Cross ERP data models
...

Extractors for all
relevant Master and
Transaction Data

SAP Business
Warehouse

Direct Access
Native Integration for
Operations

Oracle Self Services
Inquiries and
Transactions

Management Reporting
on operational data

Direct access to
application modules
46

Ascential'S Datastage BW Load Pack 3.0: Bryan Katis Platinum Consultant

Diunggah oleh

Informasi Dokumen

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Ascential'S Datastage BW Load Pack 3.0: Bryan Katis Platinum Consultant

Diunggah oleh

Hak Cipta:

Format Tersedia

Ascentials

Anda mungkin juga menyukai