Informatica

Server
Manager

Last Updated : 01/12/00

Center of Excellence
Data Warehousing

Server Manager Architecture

After this session you should be able to

describe

How to Configure Server Manager

Creating Sessions and Batches
Informaticas session output
Difference in Sequential & Concurrent Batches
Loading Options
Different Ways to Launch a Session
Configure Post- Session Email
Monitor Status of Sessions and Batches
How to load Rejected Data with pmrjldr
How to Recover a Stopped Session

Transformation Process
Source Information
Target Information
Mapping
Scheduling
Error handling
pre/post session scripts
Tuning parameters
Output log information
Transformation overrides

Source Def
Mapping
Target Def.
Session

Server

Repository

Server Manager

Process Involved

Configure Server

Create Session

Run Session

Monitor Session

View Logs

Tune Session

Server Configuration

Native database Connection

Used to connect to source and target databases
Connection name, user ID, password, connection string,
database type

Register Server
TCP/IP host name / IP address, port # or dotted IPX/SPX
address

Log files path

Server path to write session log
Server path to write session errors

You may also need to :

FTP Properties if Source/target files will be sent to server by
FTP
Create External Loader Connections like Sybase IQ

Server Output
.perf
.control
.dat
.idx
Target
Database

Server

.Email
.Error Log
.Event Log
.log
.bad

Session Configuration Wizard

The Session Manager provides a Session Wizard for
easy
Session Configuration.It has four primary pages :

General

Source Setting
Target Setting
Pre and Post Session Command
Performance and Advance Options

Time
Log Files
Transformation

Session Configuration Wizard Contd.

Source Setting

Session Configuration Wizard Contd.

Target Setting

Session Configuration Wizard Contd.

Working With Files

Source and Target Files
Using Multiple Source Files
FTP Source and Target Files
External Loader

Session Configuration Wizard Contd.

File Source
Delimited File
Fixed Width

Heterogeneous Source

Two or more tables existing in different Database

Two or more flat files existing in different System
Two or more ODBC Systems
Relational and flat file sources in one mapping

File Targets (Output Files)

Delimited Files
Fixed width

External Loader

Session Configuration Wizard Contd.

External Loading
Increase Session Performance
Informatica Provides two options
Configure through Session Manager
Oracle , Sybase
Creates control file and starts process to call external loader

Create control file with Control File Wizard

Oracle , Sybase, teradata
Creates control file only

Session Configuration Wizard Contd.

External Loader Process

External Loader Process
Control File

.bad file

NT File

Unix Pipe

Informatica Server
DB Reject File

Transformation - Session Wizard

Attributes
Override transformation attributes in mapping

Examples
Change source qualifier filter statement
Tune SQL statements
Enable lookup caching

Aggregate Behavior
Specify Incremental aggregation
Reinitialize Cache

Session Commands - Session Wizard

Pre - Session Commands

Specify operating system commands that need to
be run on the server when the session starts
Pre-session shell commands/.bat file should return
0 for success and non-zero(any positive) for failure
Good for dropping/truncating tables, deleting .bad
files

Session Commands - Session Wizard

Post - Session Commands

Specify any operating system commands that need
to be run on the server when the session ends
Good for rebuilding indexes and dropping
temporary tables
Can specify different scripts for success and failure
of session.

E-mail Configuration

Used to send e-mail message after a session run

Variables

%s : session name
%l : total rows loaded
%r : total rows rejected
%e : session error status
%t : table details
%b : session start time
%g : attaches the session log to the message

format tags
\t : tab
\r : new line

Dependent on success and failure tabs

Always check the session log for more message

E-mail Configuration Contd..

Process for NT

Must use Microsoft Exchange e-mail system

Exchange client software must be installed on the
server
Exchange service must use network security
User starting Power Mart service must be global
user. Determine the power mart startup account by
selecting
Control panel |services
Power mart services

Create mail box for the user starting the power mart
service
Create profile for user starting the power mart
service

E-mail Configuration Contd...

The profile must contain only the following services

MS Exchange Server
Personal address book

Add post-session e-mail recipients to the personal

address book.

In Unix
Unix server uses mail to send post-session e-mail
User who start the pmserver process should have the mail
in their PATH.

Launching Sessions

Manual Start

Manually launch a session from within the Server

Manager

Session Schedule

Schedule a session using business cycle start,stop &

repeat internal

Batching

Use batches to run session concurrently or

Sequentially

Event Based

Configure a session to launch based upon the

appearance of an indicator file

Command Line

Launch a session from the command line prompt

Launching Sessions

Privileges/Permissions needed to run sessions

Create Sessions & Batches privilege with read
and execute sessions
Sessions Operator privilege with read permission
Super user privilege

Time - Session Wizard

Informatica provides business

cycle-based start
date,stop and repeat intervals
for running sessions

Scheduling Batches

Nest sessions and batches to run concurrent and

sequential , or a combination of the two

Batch scheduler has same scheduling options as

session wizard

Types of batches
Concurrent
Sequential

Scheduling Tips

Load order - Load dependent tables first

Run Sessions in Parallel

Run concurrently in batches

Effective with SMP systems or parallel databases
Caution not to overload target or hardware platform

Load one target in parallel

Load multiple targets in parallel

Event - Based Scheduling

Configure event-based scheduling

Create shell script to send indicator file to directory
local to the Informatica Server
Enter path and file name in the advanced properties
Schedule the session

Session Log Impact

The time the file appears
Deletion of the file

Monitor Session
When the watcher is in wait, status = file wait

PMCMD - Command Line Interface

Can be used with 3rd party scheduling software,

scripts or program to give more more versatility in
running sessions
E.g. CA7, Tivoli

Must have proper Informatica permissions and

privileges to take below actions

Actions
Ping Server
Start and Stop Sessions and batches

Server returns success or failure messages

Type DEBUG after the command for more feedback

PMCMD - Syntax

Pinging the Informatica Server

pmcmd ping {user_name | %user_env_var} {password |
%password_env_var} {[TCP/IP:][hostname:]portno |
IPX/SPX:ipx/spx_address}

Starting and Stopping Sessions and Batches

pmcmd {start | stop} {user_name | %user_env_var}{password
| %password_env_var}{[TCP/IP:][hostname:]portno |
IPX/SPX:ipx/spx_address} [folder_name:]{session_name |
batch_name} session_flag [wait_flag]

Recover Sessions
pmcmd startrecovery {user_name | %user_env_var}
{password | %password_env_var} [TCP/IP:][hostname:]portno
| IPX/SPX:ipx/spx_address}[folder_name:]session_name
wait_flag

After the Session Launches...

Poll | Refresh session Status

View Session Detail

View Performance monitor

View Logs

Tune the session

Correct Session problems

Monitor Session

Session Details
Select Server Requests | Session Details
Number of rows loaded/failed
Read/Write thoroughput
Most current Server message
Audit trail repository or session log

Monitor Session

Performance Monitor
Select Server Requests | Session Performance Details or Open
file <sessionname>.perf
Need to configure session properties to save the performance
detail counters
Help determine where session performance can be improved

Log Files - Session Wizard

Log file path and name
Reject file path and name
Session log and archive options

Monitor Session

Session Log
Select Server requests | Session Log or Select view
log file on button bar or Select Open Log File from
Session Details Window
Gives complete details on a specific session run

Session Sequence of Events

Lock the session and read session properties

Create session log file
Initialize the DTM
Allocate session shared memory and creates buffers
Execute Pre-session scripts
Create Reader and Writer process and connect to the
file or database connection.
Execute the Stored procedures
Form SQL insert, delete, update statements
Create Index cache and data cache(s)
Parse Transformations
Move Data

Session Sequence of Events

Execute post Stored Procedures

Write historical incremental aggregation data to

disk

Close the session log

Send post-session e-mail

Return memory to system

Session Errors

Session might fail because

Server cannot allocate enough memory
Session exceeds maximum number of sessions
configured
Server cannot cannot obtain execute lock
Server cannot execute post-session commands
Server encounters database error

Circumstances effecting session

Server encounters transformation row errors.
Server executes post-session command
unsuccessfully
Server is unable to send post-session email

Error Handling - Session Wizard

Error Handling
Perform Recovery
Override tracing
Stop or Continue on Errors

Reject Files

Created by the Server to store the data rejected

by the writer and/or target database
Conditions causing rejected data include

Target database constraint violations,null values not

accepted,out of space
Target table properties Reject truncated/Overflowed
Rows

Rejected rows are saved in a file <tablename>.bad

Rejected rows are prefaced with an indicator
column
e.g. 3,D,1,D, , , , , , , ,

Reject Indicators

Data, Overflow, Null or Truncated

Reject File Loader ( pmrejldr )

Rename the .bad file by appending the suffix .in

to the filename. E.g., <tablename>.bad.in

From the directory where the reject files are

located, issue command
pmrejldr<config_file_name> [folder_name:] <
session_name>
Config_file_name> is for UNIX only
Session and older name are case-sensitive

Recovery

Perform Recovery when session stops before

completion

OPB_SRVR_RECOVERY stores the number of

records written to the target table

Run session with Perform Recovery checked

under Log Files tab

Uncheck Perform Recovery upon completion

Source should remain static

Cannot perform recovery if the target has bulk

inserts enabled

Performance Tuning and Trouble Shooting

You can tune the performance in four general

area :
System
Source and Target Database
Session
Mappings

Optimizing the System

Accessing Data Over a Network

Flat files
Relational Database
Staging Areas

Using Multiple Servers

Eliminating Paging

Optimizing the Source and Target Database

Optimizing the Source Database

Optimizer Hints
SQL Servers and Joining Large tables
Sybase and SQL Server Packet Sizes

Optimizing the Target Database

Indexes and key Constraints
Bulk Loading

Optimizing the Session

Running Parallel Session

Using Incremental Aggregation

Eliminating Transformation Errors

Tuning Session Parameters

Optimizing the Session Contd....

Tuning Session Parameter

Shared Memory allocation
Buffer Block Size
Index Cache Size
Data Cache Size
Commit Interval
Decimal Arithmetic
Error Tracing

Questions