Anda di halaman 1dari 3

Filter transforamtion:

----------------------
Filter is an active/connected;
used to filter the records/remove unwanted records based on criteria.
it allow single condition to execute on each row

SYS1 --------->SYS2------------>SYS3
SRC_DB ETL(IS) TGT_DB
|
SYS4
ETL(DES)

P1(READER THREAD) P2(TRANS_THREAD)


P3(WRITER) READER
WRITER(REL/FILE)
EXTRACT/TRANS R/R TRANS R/R
LOADING
SRC--------->SQ------------------->FILTER TRANSFORMATION-------------------->TGT
ET(SELECT) I/P SAL>30000 O/P I/P
SHR_MEM MEM | MEM
TGT_SHR_MEM
-------------- -------------- | --------------
RTY---------
101 A 40000 10 | INS 101
A 40000 10
102 B 30000 20 |FALSE REC IS REDIRECT|-FIL 102
B 30000 20
103 C 40000 10 ---------------------- INS 103
C 40000 10
104 D 20000 10 DROPPED FROM FLOW FIL 104
D 20000 10

*FILTER ALLOWS TRUE(CONDITION SATISFIED) RECORDS AS O/P

*IF THE CONDITION IS NOT(FALSE RECORD) STATISFIED THE RECORD IS MOVED TO BAD FILE/
FILTER TRANS DROPS THE FALSE RECORDS FROM THE FILTER(FLOW) AND REDIRECTED TO TARGET
AS FILTERED RECORD
L
BAD FILE: TARGET TABLE NAME1.BAD --> THIS FILE PRESERVED IN INF_SERVER_DIR---
>INFA_SHARED_FOL
--------------------- --> BADFILE_FOL

BAD FILE--> REJECTED DATA(REJECETED FILE)

**multiple condition are not allowed on each row

SRC------>SQ----------------->FILTER-------------------->TGT
SAL>30000
DNO=10
|
INVALID CONDITION

**to execute mutiple conditions we need combine as single using logical operators

SRC------>SQ----------------->FILTER-------------------->TGT
SAL>30000 INSERT 101 A 40000 10
AND FILTERED 102 B 40000 20
DNO=10 FILTERED 103 C 30000 10
INSERT 104 D 50000 10

C1 C2
AND T T = T

OR T F = T
F T = T
F F = F

101 A 40000 10 SAL>30000 INSERT 101 A 40000 10


102 B 40000 20 OR INSERT 102 B 40000 20
103 C 30000 10 DNO=10 INSERT 103 C 30000 10
104 D 50000 10 INSERT 104 D 50000 10

SRC------>SQ----------------->FILTER1-------------------->TGT1
| SAL>30000 INSERT 101 A 40000 10
| INSERT 102 B 40000 20

| FILTERED 103 C 30000 10


| INSERT 104 D 50000 10
|
---------------->FILTER2-------------------->TGT2
DNO=10 INSERT 101 A 40000 10
FILTERED 102 B 40000 20
INSERT 103 C 30000 10
INSERT 104 D 50000 10

PORTS: I O
PROPS:
FILTER CONDITION: TRUE (THIS IS BOOLEAN RESULT GIVE TRUE(1) OR FALSE(0))
TRACING LEVEL : NORMAL -
IQ:WHAT IS TRACING LEVEL? HOW MANY TYPES ARE THERE? EXPLAIN

IS IT RECOMMENDED TO USE TRUNCATE TARGET TABLE OPTION IN REAL TIME?


IS TARGET IS STATGING TABLE OR TEMP TABLE WE CAN USE IT.
OR
WE CAN TRUNCATE IF THE TARGET TABLE IS A DIM TABLE OR FACT TABLE WHEN FULL LOAD
GET FAILED
REFRESH LOAD

FIRST WE LOAD DATA(5 YRS) TO A DIM/FACT TABLE IS CALLED AS :FULL LOAD


ID FULL LOAD GET FAILED AND RECOVERY IS NOT GARUANTED THEN :REFRESH LOAD(TRUNC &
RELOAD TGT)

NEENA
LEELA
MANOJ
PRAKASH

FIRST_NAME LIKE '%ee%

Anda mungkin juga menyukai