Workflow Performance

Tuning in Release 12

Karen Brownfield
About the Speaker Karen Brownfield
25 years E-Business Suite support
17 years Oracle Workflow design and support
OAUG Board 1994-2009, 2014-2017, former President
Member ATG Customer Advisory Board
Oracle EBS User Management SIG ATG CAB Liaison
Workflow and GL SIG Board
Over 100 presentations worldwide
Co-Author multiple books on E-Business Suite
The ABCs of Oracle Workflow for E-Business Suite
Release 11i and Release 12
The Release 12 Primer Shining a Light on the Release
12 World

2 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
About the Speaker Susan Behn
Oracle Ace
Over 20 years E-Business Suite development and
support
Member Oracle Proactive Support Customer Advisory
Board
Chair Oracle EBS User Management SIG
Co-Chair Texas-Louisiana Oracle User Group TLOAUG
Over 100 presentations at multiple venues
Co-Author multiple books on E-Business Suite
The ABCs of Oracle Workflow for E-Business Suite
Release 11i and Release 12
The Release 12 Primer Shining a Light on the Release
12 World

3 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
About Infosemantics
Established in 2001
SBA 8(a) Small Business
disadvantaged company
GSA Schedule contract GS-
35F-0680V
Texas State HUB vendor
For more information, go to
our web site at
www.Infosemantics.com
R12.1.3, OBIEE, R12.2.5
public Vision instances
Posted presentations on
functional and technical topics

4 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Agenda
Audience Profile
Proactively Increase Your Knowledge
Patch Current
Clean Up Old and Errored
Purge
Background Processing
Queue Performance
Mailer Performance
Miscellaneous Performance Aides

5 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Audience Profile
Job Role EBS Version
DBA Release 11i10
System or Workflow Release 12.0.6
Administrator Release 12.1.3
Functional Release 12.2.x
Database Level Not EBS
11gR1 or lower
11gR2
12c

6 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Which are You?

The opposite of the ostrich is the rooster who is alert and awake
early to see what is on the horizon.
Rather than fear, he crows loudly a warning to be heeded by all.
Source: http://users.cybertime.net/~ajgood/ostrich.html

7 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Analyzer
1369938.1 EBS Workflow (WF) Analyzer
Better than R12 Workflow Health Check Diagnostic or 11i
Workflow Status and Purgeable Items or Workflow
Performance
SQL Script Updated often (V200.17 released 10/14/16)
Note provides script to register as concurrent request
Also provides link to new Perl script that will install/update ALL
Analyzers to the report group of your choice
FAQ note 1452224.1
Focuses on Administration and Performance
https://blogs.oracle.com/oracleworkflow/entry/e_business
_suite_proactive_support

8 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Analyzer

9 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
My Oracle Support Notes Emailed Updates

10 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Community
Go to the Oracle
Support
Community tab
Click Find Space,
enter Workflow,
then click Core
Workflow EBS
(MOSC) to go to
the workflow sub-
space

11 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Community
Sign up for RSS feeds

12 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Patch Current

13 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Patch Current
Its not just the Rollups, one-offs are important
Workflow is dependant on HR, AME
Diagnostics are important also
Product workflow fixes are provided by product team,
not ATG patches
Best sources of Current Patches
Patch Wizard look for owf and fnd and atg
Workflow now releasing quarterly rollups
12.2.5 atg_pf.6, FND RPC 8/16, (OWF and one-offs included
in atg_pf.6)
12.1.3 RPC5, FND 7/16 RPC, (no OWF or one-offs since then)
Workflow Analyzer

14 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
From Patch Wizard

Above 12.1.3, below 12.2.5 as of March 8, 2016

15 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
From Workflow Analyzer mailer patches
Mailer Patches

Workflow Patches

16 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Clean Up Errors and
Old Workflows

17 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Old Workflows and Errors

Despite low overall

count and low % closed,
status is red due to age
of both closed and open
18 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Errors
Perform following query
SELECT COUNT (*)
,item_type
,activity_name
,MIN (item_begin_date)
,MAX (item_begin_date)
FROM wf_item_activity_statuses_v
WHERE activity_status_code = 'ERROR'
AND item_end_date IS NULL
GROUP BY item_type
,activity_name
ORDER BY 5 DESC, 1 DESC, 2;

Play with Order By try 1, 5, 2 also

19 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Errors

Triage Most Recent, Highest Numbers

Ignore (at first) high numbers that are very old
It isnt enough to clean up the errored workflows

20 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Associated Error Item Types
Perform following query
SELECT item_type
,parent_item_type
,DECODE (end_date, NULL, 'OPEN', 'CLOSED')
error_type_status
,COUNT (*)
FROM wf_items
WHERE parent_item_type is not null
AND item_type in ('CUNNLWF','DOSFLOW','DOSFLOWE',
'ECXERROR','HRSSA','HRSTAND','HXCEMP','IBUHPSUB','OKLAMERR',
'OMERROR','PARMAAP','PARMATRX','POERROR','WFSTD','XDPWFSTD',
'ZPBWFERR', 'WFERROR')
GROUP BY item_type
,parent_item_type
,DECODE (end_date, NULL, 'OPEN', 'CLOSED')
ORDER BY 4 DESC,item_type,parent_item_type;

21 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Associated Error Item Types

Purge now closes WFERROR where calling activity is

closed
WFERROR not the only ERROR Item Type
Cant purge if children or parents open
Notice chains
OEOH OEOLOMERRORWFERROR
HRSSA HRSSA

22 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Event Errors
Perform following query
SELECT COUNT (*)
,v.text_value
,min(i.begin_date)
,max(i.begin_date)
FROM wf_item_attribute_values v
,wf_items i
WHERE v.item_key=i.item_key The text value of the
AND v.item_type = i.item_type attribute EVENT
AND v.item_type = 'WFERROR' NAME is the name
AND v.NAME = 'EVENT_NAME' of the event
AND v.text_value IS NOT NULL
GROUP BY text_value
ORDER BY 4 DESC,1 DESC,text_value;

23 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Event Errors

Find and fix what causes event to error

See the worklist flexfields section in Workflow Troubleshooting
in Release 12 to get details on event errors shown below

24 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Event Errors
Message to SYSADMIN can re-raise event if still needs
processing, else abort WFERROR
Note: after 24 hours, no record of event anywhere else

25 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Clean Up Event Errors (showing portion of script)

Adjust each
update
similarly

Adjust $FND_TOP/sql/wfrmtype.sql script

Always test in non-production instance first

26 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
From Workflow Analyzer Product Specific

Sections for OM, PO, HR

27 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Configure (Setup) Seeded Workflows
Read the documentation
Setup
How the workflow behaves
My Oracle Support white papers, notes
Setup not just Builder
Profile Options
Approvals Management Engine (AME)
Hierarchies
Other Screens
Account Generator Top Process
PO Documents identify workflow to run by document
GL ledgers page are you using approvals

28 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Purge

29 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge!!

11i Purgeable for

PERM always 0

Need schedule for Temporary and for Permanent

If Purgeable=0, ensure child/parent workflows closed

30 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge Obsolete Workflow Runtime Data
Schedule Nightly or at minimum Weekly
Parameters
Leave Item Type/Item Key blank
Age recommended at least 7, no more than 60
Persistence Type
One Schedule Temporary, one Permanent
Core Workflow Only Set to Y
At least monthly, run w/ value set to N
Commit Frequency leave at default 500 (thats 500
workflows, not 500 records)
Signed Notifications Customer Choice
(R12.2) Other Cached Data recommendation later slide

31 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge What Happens
Aborts WFERROR where PARENT_ITEM_TYPE matches
Item Type parameter and where linked activity
(PARENT_CONTEXT) no longer in error status
But not POERROR, OMERROR or other error types
Rememberset Attempt to Close = Y in the Purge
Order Management Workflows concurrent program to try
to close OMERROR/WFERROR
Purges Item Types matching Item Type parameter if
END_DATE is not NULL and not linked to open parent or
child workflow

32 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge What Happens
(R12.2) Other Cached Data = Y
Purges records from WF_ATTRIBUTE_CACHE
When user record is created/updated, stores 16+ records of data
about the user (name, email, mailer preference, description, etc.)
Does not store old/new values
If table purged, does not rebuild when user signs in
If using OID, contains record when OID sync event is raised (MOS
note 380487.1)
Used as intermediate table for LDAP sync (MOS note 150832.1)
MOS note 846989.1 How to Purge the Wf_attribute_cache
table? recommends periodically removing obsoleted data but
doesnt define obsolete
Hint: To purge just WF_ATTRIBUTE_CACHE, use item_type
System: Mailer (as will never be in runtime history)

33 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge What Happens
If Core Workflow Only = N
Purges WF_ACTIVITIES table where END_DATE is not
NULL and ACTIVITY_ID is not referenced in active
workflows
End-dates, then deletes notifications not referenced in
WF_ITEM_ACTIVITY_STATUSES, _H (orphaned)
Example: notifications from finished concurrent programs
Purges ad-hoc roles where ORIG_SYSTEM =
WF_LOCAL_ROLES or WF_LOCAL_USERS and not
referenced in WF_ROLE_HIERARCHIES or
WF_NOTIFICATIONS or WF_ITEMS.OWNER_ROLE

34 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Orphaned Notifications
From Workflow Analyzer

35 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Catch Up Purging Be Careful!
Purge by Item Type or Age to reduce time of each run
Commit keeps rollback from being an issue
Run with Core Workflow Only = Y
After catching up, run one more time with Core
Workflow Only = N to purge old design data and
orphaned notifications
Then only need N once/week (orphan notifications)
While 10g, 11g automatically reset high water marks,
removing empty space may still be recommended

36 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Rebuild or Not To Rebuild
Starting
Point

After Catch-
After Catch-
up Purge
up Purge
Export/Import

More Activity More Activity

Regular Regular
Purges Purges

More Activity More Activity

Regular Regular
Purges Purges

37 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Rebuild or Not Workflow Analyzer

38 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Rebuild or Not Workflow Analyzer

39 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Rebuild or Not Other Sources
White Paper Analyzing Oracle Workflow Data for
Increased System Performance by Rusty Schmidt
Available as attachment from MOS note 1369938.1
For us, Shrink did not work, Alter Table Move did
(followed by rebuilding indexes and Gather Stats)
MOS note 303709.1 Reclaiming unused space in an E-
Business Suite Instance tablespace
Applies to 11i thru 12.1.3
MOS note 242090.1 SEGMENT SHRINK and Details
MOS note 262353.1 How to View High Water Mark
Step-by-Step Instructions
Database 8.1.8.4 thru 11.2.0.3

40 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge Issues
Synchronous Persistence Type
Synchronous is not a choice for Persistence Type
Lookup code, Persistence Type, is Access Level
System (i.e. cant add codes)
Solution
Help | Diagnostics | Examine
Field: CUSTOMIZATION_LEVEL
Value: E
Add Lookup Code for Sync

Restore CUSTOMIZATION_LEVEL to S

41 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge Issues
Completed With Errors
Completed with Errors end date is set in WF_ITEMS
but at least one activity exists in
WF_ACTIVITY_STATUSES with status of ERROR or
ACTIVE
Cant abort, cant purge, and if linked to parent or child,
parent or child cannot be purged
Same workflow
Each Error has at
least 1 Active

42 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge Issues
Completed With Errors
Modified version of $FND_TOP/sql/wfrmtype.sql

43 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge Issues
Completed With Errors

44 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge My Oracle Support Notes
337923.1 A closer examination of the Concurrent
Program Purge Obsolete Workflow Runtime Data
132254.1 Speeding Up and Purging Workflows
298550.1 Troubleshooting Workflow Data Growth
Issues
144806.1 A Detailed Approach to Purging Oracle
Workflow Runtime Data
277124.1 FAQ on Purging Oracle Workflow Data

45 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge MOS Notes for Parent/Child problems
752383.1 Purge Obsolete Workflow Runtime Data
Concurrent Request (FNDWFPR) Is Not Purging Data
SELECT c.item_type child,
DECODE (c.end_date, NULL,'OPEN','CLOSED') child_status,
c.parent_item_type parent,
DECODE (c.parent_item_type, NULL, 'NOPARENT',
DECODE (p.end_date,NULL,'OPEN', 'CLOSED'))parent_status,
COUNT (*)
FROM wf_items p, wf_items c
WHERE p.item_type(+) = c.parent_item_type
AND p.item_key(+) = c.parent_item_key
GROUP BY c.item_type, DECODE(c.end_date,NULL,'OPEN',CLOSED'),
Business
c.parent_item_type, Event
DECODE (c.parent_item_type, NULL, 'NOPARENT', Errors
DECODE (p.end_date, NULL, 'OPEN', 'CLOSED'))
ORDER BY c.item_type, c.parent_item_type;

46 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge MOS Notes for Parent/Child Problems
1378954.1 bde_wf_process_tree.sql For analyzing
the Root, Children, Grandchildren Associations of a
Single Workflow

47

47 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge MOS Notes Specific to Products
Order Management
751026.1 FNDWFPR Purge Obsolete Workflow
Runtime Data OEOH / OEOL Performance Issues
Scripts to help close attached children
398822.1 Order Management Suite Data Fix Script
Patch
405275.1 How to Detect Data Corruption and Purge
More Eligible OEOH/OEOL Workflow Items for Order
Management Workflow
878032.1 How To Purge Order Management Workflow
Purges closed lines even when header still open
Attempt to Close purges OMERROR / WFERROR that are
orphan or attached to no-longer-error nodes and purges OEOH
where all lines are closed
48 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Purge MOS Notes Specific to Products
Purchasing
458886.1 How To Diagnose Issues Related To Purge Of
Purchasing Workflow Data That Remain Even After
Running The Purge Obsolete Workflow Runtime Data
Concurrent Program?
Scripts to help close attached children

49 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Processing

50 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Engines
Run Engine for Stuck separately
Parameters NULL, NULL, NULL, No, No, Yes
Run once/week or once/month
Run Engine for Timed Out activities separately based
on criticality of timeout
If average timeout = 1 day, run once/day
Parameters NULL, NULL, NULL, No, Yes, No

51 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Engines
Run Engine for Deferred activities separately based on
criticality of activity
Except for OEOL, very few workflows need moving more
than every 15 minutes
If Order volume high, run targeted engine for OEOL
every 5 minutes
Parameters: Order Line, NULL, NULL, Yes, No, No
Run generic every 15-60 minutes
Parameters: NULL, NULL, NULL, Yes, No, No

52 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Engines Workflow Analyzer

APPS
not part of
workflow
name

Note counts of Ready, run SQL and see if queue is

steady or growing
Growing decrease wait time for next execution of
Background Engine
Low or Empty increase wait time

53 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Engines
Activities in queue table WF_DEFERRED_TABLE_M
Time to process = DEQ_TIME ENQ_TIME where
STATE=2
By default, data only stays in this table 24 hours after
DEQ_TIME
In 12.2, these fields are datatype TIMESTAMP
369537.1 How to Monitor the FNDWFBG Workflow
Background Program?
Scripts: whats in queue, what will be dequeued next
466535.1 How to Resolve the Most Common Workflow
Background Engine Problems
Verify index WF_DEFERRED_TABLE_M_N1 exists

54 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Engine Runs a Long Time
186361.1 WF 2.x: Workflow Background Process
Performance Troubleshooting Guide
Determine the Item Type Causing the Issue
Usually its the activity being processed, not the
Background Engine
Check for Loops in Workflow see next slide
560144.1 11.5.10.4: Workflow Background Process
Seems to Take Longer After Rup4
Dont use re-submit time < 5 minutes
AQ_TM_PROCESSES must be auto tune or at least 1
Never set > 9
Check MOS using Background Process
Performance for notes for specific item type
issues
55 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Loops in Workflow (from Workflow Analyzer)

56 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
AQ_TM_PROCESSES (Workflow Analyzer)

57 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
JOB_QUEUE_PROCESSES (Workflow Analyzer)

58 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Background Engine Runs a Long Time
JOB_QUEUE_PROCESSES Exceptions
11i Only 560144.1 11.5.10.4: Workflow Background
Process Seems to Take Longer After Rup4
Must be at least 5
Large volumes of emails 1530928.1 Row Lock
Contention Caused By Workflow Mailer

59 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Queue Performance

60 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
469009.1 Troubleshooting Workflow Agent Listeners
failure to Start
741087.1 Huge FNDCPGSC Logging Messages Are
Generated
Verify Profile options (issue is level 2, 3 messages)
FND: Debug Log Level Unexpected (level 6)
Note: 1107970.1 recommends setting
FND: Debug Log Enables Yes
FND: Debug Module = %
Schedule Purge Diagnostic and Log Messages
Set Log Level for each Listener to Error, then stop and
restart Workflow Agent Listener Container

61 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Queue Performance Workflow Analyzer

62 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
Memory insufficient or Containers consuming all
available memory
444939.1 How do you Change the Maximum Memory
Size taken by Workflow Service Container
Retention
Increases performance if = 0, but destroys ability to tune,
troubleshoot
Recommend 1 day 86400 seconds for the following
queues for troubleshooting
WF_ERROR, WF_JAVA_ERROR, WF_DEFFERED,
WF_JAVA_DEFERRED, WF_NOTIFICATION_IN/OUT
Dbms-aqadm.alter_queue(queue_name =
><queue>,retention_time=>86400);

63 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
White paper Application Development with Oracle
Advanced Queuing by Jeff Jacobs
Worked for PayPal -- lots of queue traffic
www.nocoug.org/download/2012-
08/Jeff_Jacobs_Advanced_Queueing.pdf
The basic solution is:
Add the index to CORRID column
Get the CBO to recognize it, which can be by
generating an appropriate set of statistics or the various
forms of SQL plan management
271855.1 Procedure to Manually Coalesce All the
IOTs / Indexes Associated with Advanced Queueing
Tables to Maintain Enqueue / Dequeue Performance;
Reduce QMON CPU Usage and Redo Generation
64 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
WF_CONTROL
Controls all other queues
Run Control Queue Cleanup every 12 hours
In every instance
469045.1 Troubleshooting WF_CONTROL Agent
Issues
Discussion of this queue
Scripts to run to ensure subscribers are valid and dead
subscribers are removed properly

65 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
WF_DEFERRED
Subscriptions to Events Phase > 100
Workflows started by events
334348.1 Low Performance Processing Messages in
WF_DEFERRED Queue; 468650.1 Troubleshooting
WF_DEFERRED Agent Listeners Performance
Use SQL to determine Events in queue
Identify if events not being dequeued in timely fashion
Time in queue>2X sleep time for queue
Identify events with long processing time
Trace code and identify issues (bugs, tuning, etc)

66 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
WF_DEFERRED
334348.1 Low Performance Processing Message in
WF_DEFERRED Queue; 467650.1 Troubleshooting
WF_DEFERRED Agent Listeners Performance (cont)
Identify Events with high volume
Create additional generic agent listeners
Create specific agent listeners
Increase Inbound Thread Count
(PROCESSOR_IN_THREAD_COUNT) by 1 until
performance acceptable
Temporarily set retention time to 0

67 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Advanced Queue Performance
WF_DEFERRED
Queue may be corrupt
Receiving Errors ORA-24033:No Recipients for
Message
Rebuild using instructions in note 286394.1 How to
rebuild the WF_DEFERRED queue
Other Queue rebuild instructions
WF_NOTIFICATION_OUT MOS note 736898.1
WF_JAVA_DEFERRED MOS note 1635639.1
WF_DEFERRED_TABLE_M MOS note 789716.1
WF_CONTROL MOS note 469045.1 followed by 1955925.1
WF_WS_JMS_IN / WF_WS_JMS_OUT MOS note 1956202.1

68 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Mailer Performance

69 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
Click icon, change
Status to Disabled

If global preference is Do not send me mail (QUERY)

Use Framework Personalization prohibit override from Preferences
link
Ensure records in FND_USER_PREFERENCES updated to
QUERY
For event oracle.apps.wf.notification.send.group, disable local
subscription w/Out Agent WF_NOTIFICATION_OUT@
Do this in test/dev or if you are not using the mailer at all
453137.1 Oracle Workflow Best Practices Release 12 and Release
11i
Remember!! Alert now uses the Mailer
70 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
If global preference is Do Not Send Me Mail and not
running Alert
Dont start Mailer
Set Startup mode for following listeners to Manual or On
Demand
Workflow Deferred Notification Agent Listener
Workflow Inbound Notifications Agent Listener
Monitor WF_NOTIFICATION_IN, _OUT
Monitor WF_DEFERRED for oracle.apps.wf.notification.%
events

71 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
If Inbound Processing is not checked and not running
Alert inbound processing
Set Startup mode for following listeners to Manual or On
Demand
Workflow Inbound Notifications Agent Listener
Monitor WF_NOTIFICATION_IN
Mailer only for Alert
463777.1 How to Disable all Workflow related Email
Notifications Except for the Ones Sent from Oracle
Alerts?
Create new Mailer
Set Correlation id = ALR:%

72 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer

Increase Inbound Polling Interval Processor Min Loop

Sleep (seconds) ensure processor Max Loop Sleep at
least 5*Processor Min Loop Sleep
Note 315748.1 How to Change The Java Workflow
Mailer Inbound Polling Interval
73 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
Click it,
issues
outweigh
benefits
Processor Close on Read Timeout
315748.1 unclick for performance
We dont agree with this note
422870.1 unless clicked, not removed from Process
folder
332152.1 must be clicked if running multiple mailers
using same SMTP Server (Outbound Name) or will get
contention and locking
437986.1 must be clicked or messages get stuck in
Inbox

74 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
Mailer Log shows java.lang.OutOfMemoryError
467516.1 Users suddently (sic) Stop Receiving Email
Notifications
Insufficient Heap Size (Xmx and Xms)
Edit $APPL_TOP/admin/adovars.env
Add/change following
APPSJREOPT=-Xms 128m-Xmx3072m
Export APPSJREOPT
Bounce Concurrent Managers

75 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
You Have Insufficient Privileges
414376.1 You Have Insufficient Privileges For The
Current Operation On Reqapprv Notif
Create dedicated user for the mailer
Framework URL
timeout = 120

0 is SYSADMIN

76 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
Setup separate user to run the Mailer
Must be a workflow administrator
This forces Administrator to be a responsibility as
SYSADMIN must ALWAYS be an administrator
Should only have following responsibilities
System Administrator
Responsibility used as workflow administrator
Should not be a user with other duties
Why not SYSADMIN
Performance: SYSADMIN usually has too many of own emails
due to WFERROR emails
Manageability: Enabling log for SYSADMIN includes many
other functions than mailer thus hampering troubleshooting

77 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Notification Mailer
Tag Files
Out of Office, Undeliverable set to Ignore
388709.1 Email Notification Failures Are Causing The
Email Servers To Crash
Uncheck Mailer parameter Send warning for
unsolicited e-mail
431359.1 Setting up a Tag in the Mailer configuration files
to handle unsolicited mail
Uncheck Mailer parameter Send e-mails for canceled
notifications

78 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Miscellaneous
Performance Aides

79 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Item Attributes As Needed
By default, when workflow initiated, runtime copy of each
item attribute created
66% if item attributes have no value (and that excludes
Event attributes)
SELECT COUNT (*)
,v.item_type
FROM wf_item_attribute_values v
,wf_item_attributes a
WHERE a.item_type = v.item_type
AND a.NAME = v.NAME
AND a.TYPE <> 'EVENT'
AND v.text_value IS NULL
AND v.number_value IS NULL
AND v.date_value IS NULL
GROUP BY v.item_type
ORDER BY 1 DESC;

80 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Item Attributes As Needed
#ONDEMANDATTR
Process Activity Attribute
For top-level runnable process
Type must be Text or Lookup
Use Yes/No Lookup Type
For Text, Value must be Y
Do not assign an item attribute as the value
Runtime copy only created when SetItemAttr<> used
If referenced prior to this call, default value used
Experiment with a particular workflow
HRSSA, REQAPPRV, POAPPRV, etc.

81 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Profile Options
Account Generator:Run in Debug Mode
Except when experiencing an issue with Account
Generator, set it to No
Make sure when problem fixed to purge workflows and
reset (TEMP and PERM)
PO:Workflow Processing Mode
If set to Online, screen does not return control to Buyer
until workflow ends or notifications requiring response is
encountered
Still requires background engine to complete
If Buyers cannot self-approve POs, set to Background

82 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Profile Options R12.2
WF: Defer Processing of Notification Response
Behavior when responding to notifications through
worklist
No control not returned to screen until workflow ended
or reached next deferred activity
Yes control returned immediately, workflow continues
when background engine runs again
Specific behaves as Yes for item types specified in
Lookup Type Workflow Notification Response Deferred Item
Types
Can also be set from
Workflow Administration
page

83 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Statistics Programs
Dont set these to run every 5 minutes
Workflow Mailer Statistics Concurrent Program
Workflow Work Items Statistics Concurrent Program
Workflow Agent Activity Statistics Concurrent Program
Run Once/Day
Just in case you forget to click icon to refresh queries
Run before running workflow analyzer analyzer uses
data from these programs
787228.1 Cannot Abort Old Open Items in Workflow
Manager Because Errored Items are not Returned
12.0.4 wf_item_types.num_error=0, wont show if field is
actually null so run stats programs
12.0.6 click refresh button and is re-calculated

84 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Concurrent Managers
Workflow Agent Listener Service (WFALSNRSVC) must
be enabled and active ALWAYS!!
Workflow Mailer Service (WFMLRSVC) must be
enabled if emailing notifications or running Alert
Workflow Document Web Services Service
(WFWSSVC) must be enabled to use Web Services

85 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Pinning
Objects pinned into memory so they do not need to be
constantly reloaded from disk, flushed out of memory
and reloaded
PIND
69925.1 Pinning Oracle E-Business Suite Objects Into
The Shared Pool
311689.1 ORA-4031 and DBMS_SHARED_POOL.KEEP
remarks and PIND toolkit overview
Requires large SGA and memory
Consider pinning WF_ packages
There are approximately 120 packages, not all used by
every organization
Start with WF_ENGINE
86 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Run 64-bit Database
Memory is critical, 32-bit cant address enough
If not on 11gR2 or 12c, Upgrade
12c is 64-bit only
Always monitor database desupport policies
Different from EBS desupport policies

87 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Wffngen.sql
Translates activity function calls into static calls
According to Oracle, 25% increase in performance
Look for variable itemtypeList_t
Seeded := itemtypeList_t (WFSTD,FNDFFWF)
Add following item types (after configuration complete)
WFERROR, POERROR, OMERROR
Other workflows with high (current) count in WF_ITEMS
Reference
How to Improve Performance in Workflow? (Doc ID
1524731.1

88 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Order Management
130511.1 PERFORMANCE Issues in OM, SE, QP
Remove unnecessary activities
No sub-processes
Make Scheduling a deferred activity
Consider seeded Line process: Line Flow Generic:
Performance
Removes unnecessary activities and sub-processes,
reducing WF data significantly

89 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Partition Tables
Perform after Purge cleanup
Doing this replaces need to export/import
Backup following tables
WF_ITEM_ACTIVITY_STATUSES
WF_ITEM_ACTIVITY_STATUSES_H
WF_ITEM_ATTRIBUTE_VALUES
WF_ITEMS
Ensure have free space in same tablespace slightly
more than currently used (incl. indices)
Move to OATM first 402720.1 OATM Migration fails
with ORA-14257 when moving list partitioned tables

90 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Partition Tables
If using RAC, set up RAC Affinity
After partitioning
Create VPD policy
Configure workflow processes
Schedule Workflow Background Process for RAC
If not using RAC, partition using WFPART.sql
Apply patch 7252442 (11i note 749105.1) or patch
8241676 (R12.1 note 789528.1) afterwards to create
missing indices
See R12.2 Workflow Administrators Guide, Chapter 2
for detailed steps for either method
This guide can be used in 11i and R12.1 for non-RAC
partitioning instructions
91 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
Workflow Book

Available from
Amazon.com,
Barnes & Noble
(bn.com)
Lulu.com
(pdf version)

92 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.
 Thank you!!
Karen.Brownfield@Infosemantics.com

93 Gold
Partner
Copyright 2016 Infosemantics, Inc. All Rights Reserved . Any other commercial product names herein are trademark, registered trademarks or service marks of their respective owners.