AR31

View AR | AR without Proprietary
New AR:
History | States | Assignment | Timetracking
Add Attachment
AR Text Search | More | CARES Home
Assistance Request 1-5755928
Customer Ticket N/A
Short Sudden PS CDR on RNC235
Description
Current 13th Aug : RCA package & Hot fix delivered.Feedback

awaited,
Summary closure requested if no near future plan to implement the

fix.
State Closed : Solution/Service Provided
Outage No
Severity 1
Priority 1
Service Request Remote Technical Support
Request Type Defect
Sub-Type Software
Category Software
Sub-Category Software Defect
Internal Yes
Assignment Events
Ask Alcatel-Lucent
Product
Product 9353 WMS
Version LR14.2.W
No Change Request is linked to this AR
Solution Source DCTPD01545832
Product Location
Site Abu Dhabi AE - Alcatel-Lucent MENA JLT-
Instance 9353WMS-AUH : In Service
Site Company Emirates Telecommunications Corporation
City Abu Dhabi
Country United Arab Emirates
Contact
Name Karim IBRAHIM ABD EL NABY
Company Alcatel-Lucent : Open on behalf of Customer
Phone 971 56 354 4568 Email

Karim.Ibrahim@alcatel-lucent.com
Request Method Email-Eng
Dates
Occurred 02-Jun-2015 14:38 Time now 29-Aug-2015 10:48
(GMT+4)
Reported 02-Jun-2015 14:38 AR Created 02-Jun-2015 14:43
Service Start 02-Jun-2015 14:38
Responded 02-Jun-2015 15:02 Respond Target 02-Jun-2015 15:08

SA - Calculated
Restored 02-Jun-2015 15:08 Restore Target 11-Jun-2015 15:22

SA - Calculated
Resolved 29-Jun-2015 11:37 Resolve Target 08-Aug-2015 15:22

SA - Calculated
Targets for Restore & Resolve were extended by 7 days 1 hour
to account for Pending time

Closed 13-Aug-2015 11:33
Last Modified 13-Aug-2015 11:33 Modified By achowdar
Entitlement
Agreement 242895 (OXIA 627085)
Covered Service TS 24x7 (Gold, Wireless Mobile Access)
Script This request is entitled to service.
People
Owner TSCd-WLS-WCDMA-IN : achowdar
Assignee CloQ-WLS-WCDMA-vGlobal : achowdar
Referred 1 NorP-WLS-WCDMA-vGlobal : achowdar
Referred 2 TEC-WLS-WCDMA-RNC : ayounan
Referred 3 EtPP-WLS-WCDMA-vGlobal : achowdar
Referred 4 TEC-WLS-OAM-EMEA : dchaintr
Resolve Group NorP-WLS-WCDMA-vGlobal
Submitter arutkows
Description
Attachments
[empty]
Showing Investigation and Proprietary logs together in time order Show

separately
Investigation Log and Proprietary Log

1. 02-Jun-2015 15:03
mohmadi
Update to Current Summary: June 2: Under Investigation
2. 02-Jun-2015 15:04
mohmadi
Update to Current Summary: June 2: Awaiting Receive Log Files / Technical
Info
3. 02-Jun-2015 15:04 ALCATEL-LUCENT PROPRIETARY

mohmadi
From: owner-india-wcdma-utran-be@LIST.ALCATEL-LUCENT.COM
[mailto:owner-india-wcdma-utran-be@LIST.ALCATEL-LUCENT.COM] On Behalf Of
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **
Sent: Tuesday, June 02, 2015 4:32 PM
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **
Cc: INDIA-WCDMA-UTRAN-BE
Subject: AR 1-5755928/Priority/RNC 9370/Emirates Telecommunications
Corporation/Sudden PS CDR on RNC235
Hi Karim,
Wanted to know what is the impact on PS KPI at present and when it started,
how
much Is the degradation? I tried calling you but was not able to reach you.
Can you please share KPI reports and RNC logcollection and RNC health
check.
You can upload it on ftp server 135.240.25.160 , path:
/home/wcdma/Etisalat_UAE/1-5755928
Can you please share more details on it. And if we can reduce the severity
to
Major?
As from the description :
You observed the below alarms @ the same time of degradation on both
RNC231,
RNC235 but RNC231 dont have any impact, we had an activity yesterday on
the
WMS for installation of hot fix patch related to WCE at the same time and
we need
know if any relation between them and why only one RNC impacted not both?
Thanks,
Mohmadi Cutlerywala,
Mobile:+91 9870327804.
Email ID: mohmadi.cutlerywala@alcatel-lucent.com

mohmadi
Time Tracking Entry Added - IR01-TSA3
5. 03-Jun-2015 13:10
mohmadi
Update to Current Summary: June 2: No related info found from Logs.

mohmadi
From: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **
To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

Cc: INDIA-WCDMA-UTRAN-BE; 3G_ALU_Integ_UAE; BERIDY, AHMED (AHMED); REDA,
RAMY
(RAMY); EL-MIDANY, AHMED (AHMED); KHEDR, MAHMOUD (MAHMOUD)
Subject: RE: AR 1-5755928/Priority/RNC 9370/Emirates Telecommunications
Hello Mohamdi,
Im uploading All required logs on the server,
@/home/wcdma/Etisalat_UAE/AR1-5755928
Please as I described that the PS CDR increased suddenly @ 3am yesterday ,

Please
find below description,
PROBLEM DESCRIPTION: Sudden PS CDR on RNC235
PROBLEM IMPACT:
High KPIs degradation on RNC235 today 3AM due sudden PS CDR
EXPECTED RESULTS:
- RC of this issue
Action taken and progress:
We observed the below alarms @ the same time of degradation on both RNC231,
RNC235
but RNC231 dont have any impact, we had an activity yesterday on the WMS
for
installation of hot fix patch related to WCE at the same time and we need
know if
any relation between them and why only one RNC impacted not both?
Thanks,
--
BR,
Karim Ibrahim
LTE/3G Integration Professional
Alcatel-Lucent, Dubai, Etisalat Program
M: +971 (0)56-354-4568 || ONNET:2205 5534
Sent: Wednesday, June 03, 2015 12:04 PM

RAMY
Hello Mohamdi
Any update?
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534
From: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **
Sent: Wednesday, June 3, 2015 11:39 AM

RAMY
Hi Karim,
I checked the PPC log during that time but could not see any alarm in RNC
related
to Hardware issue or any process issue.
Also Healthcheck found ok.
Nmis Ftp Session/2 ; 2015-06-02 02:28:13.58
MSG major communications 70060003
ADMIN: unlocked OPER: enabled USAGE: active
AVAIL: PROC: CNTRL:
ALARM: STBY: notSet UNKNW: false

Id: 100C112
Com: TCP connection from 10.238.122.236 failed.
userid = mdmadmin
role =
remoteTcpPort = 34619
Int: 1/1/2/20245; nmiSession.cc; 567; RID3730
Nmis Ftp Session/1 ; 2015-06-02 06:43:07.08
AVAIL: PROC: CNTRL:
Id: 100C113
userid = mdmadmin
role =
Did you had a check from WMS side as both RNC were impacted during that
time.
Thanks,
Mobile:+91 9870327804.
IBRAHIM
ABD EL NABY, Karim (Karim)** CTR **

RAMY
Importance: High
Hello Mohamdi,
From the logs you can see the below, the Porv file changed , which means
that the
CP/OMU did auto reset or something which the same indication of the alarms
which
appeared @ 3:09am,,
If you check the description of the alarms you will see that it related to
RNC
supervision, and if the supervision not come , OMU reset will be done auto
or
manually and we dont take any action on the RNC at this time
Please check deeply on the logs to correlate these alarms.. and find a
clear RC
and escalate the AR if needed,
Prov ; 2015-06-02 06:44:30.03

SET warning operator 70000007
ADMIN: unlocked OPER: enabled USAGE: busy
AVAIL: PROC: initializing CNTRL:
Id: 100C117
Com: Activation complete. Enter 'confirm prov' to confirm the activation or
rollback will occur in 20 minutes.
Int: 1/1/2/21219; casAlarm.cc; 764; RID3730
Prov ; 2015-06-02 06:44:30.45
CLR cleared operator 70000007
ADMIN: unlocked OPER: enabled USAGE: busy
AVAIL: PROC: initializing CNTRL:
Id: 100C118
Com: Activation confirmed. Rollback will not occur.
Prov ; 2015-06-02 06:44:32.77
MSG warning operator 70000039
AVAIL: PROC: CNTRL:
Id: 100C119
Com: The committed file is RID3730_PROV_020620150643.full.002.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

RAMY
Hi Karim,
I understand your point.
But why both RNC impacted at same time, so do you have idea from WMS side
any
reason behind it.
Also please upload RNC logcollection and Healthcheck for other RNC, let me
check
in it.
Thanks,
Mobile:+91 9870327804.
IBRAHIM

RAMY
Hello Mohamdi
From the KPIS, only RNC235 is impacted.. check below the graphs , however
both of
them have loss of supervision at the same time due to our action on the WMS
for
hot fix implementation, Please not we have also 2 WCE RNCs on the same WMS
and
not affected.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

RAMY
Hi Karim,
As informed earlier, But from present Logs no clue could be found during
that time
or any OMU reset alarm also not seen.
Thanks,
Mobile:+91 9870327804.

mohmadi

8. 04-Jun-2015 13:19
mohmadi
Update to Current Summary: June 4: No related info found from Logs. Shared
info
with site team.

mohmadi

RAMY
Hi Mohamdi
Ok, What the main RC of this issue?.
Thanks,
--
BR,
Karim Ibrahim

M: +971 (0)56-354-4568 || ONNET:2205 5534
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **
Sent: Thursday, June 04, 2015 2:53 PM

RAMY
Hi Karim,
I understand your concern.
RC could not be determined as no info was found in logs during that time.
You can observe the RNC and let us know if similar issue is observed again.
Also let us know what is latest PS KPI and CDR status.
Thanks,
Mobile:+91 9870327804.
10. 08-Jun-2015 09:35

mohmadi
info
with site team.

mohmadi

RAMY
(RAMY); EL-MIDANY, AHMED (AHMED); KHEDR, MAHMOUD (MAHMOUD); AGRAWAL, Ritesh
(Ritesh)** CTR **
Importance: High
Hello Mohamdi
We still waiting any clear RC for this issue?!
Is it RF condition?, are there any relation with WMS patch?, how can we
secure
the RNC to dont have the same issue?!
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
Sent: Monday, June 08, 2015 10:18 AM

RAMY
(Ritesh)** CTR **
Hello Mohamdi
Should we close this AR as no RC for this issue!?!!.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798


RAMY
(Ritesh)** CTR **
Hi Karim,
Yes, As for RC we need to wait for re-occurrence as present logs did not
gave any
much info.
Thanks,
Mobile:+91 9870327804.

mohmadi
13. 09-Jun-2015 09:03

mohmadi
info
with site team.

mohmadi
Sent: Monday, June 08, 2015 3:20 PM

RAMY
(Ritesh)** CTR **
Importance: High
Dear Mohamdi
Please escalate this AR, we cannot wait till the issue happened again and
we will
have the same reply that the logs not enough,
Thanks,
--
BR,
Karim Ibrahim

M: +971 (0)56-354-4568 || ONNET: 22341798

RAMY
(Ritesh)** CTR **
Hi Karim,
It seems that you require RC even though logs have no info and you want us
to
escalate the AR to L3?
Thanks,
Mobile:+91 9870327804.

RAMY
(Ritesh)** CTR **
Hello Mohamdi,
May the L3 support will required more logs to find the RC,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
15. 09-Jun-2015 15:36

mohmadi
Update to Current Summary: June 9: Information/Action Requested

mohmadi
Hello TEC, Require your support on it.
Product: 9370 RNC

SW Version: LR14.2.W
Customer: Emirates Telecommunications Corporation
Problem Short Description
Sudden PS CDR on RNC235 (1-5755928)
1. Detailed Description
High KPIs degradation on RNC235 on 2 June at 3AM due sudden PS CDR.
It was observed the below alarms at the same time of degradation on both
RNC231,
RNC235. But RNC231 dont have any impact, They had an activity on same
night on
the WMS for installation of hot fix patch related to WCE at the same time
and
need know if
any relation between them and why only one RNC impacted not both?
Or Is there any relation of RF condition?, are there any relation with WMS
patch?,
how can we secure the RNC to dont have the same issue in future?!
Logs are uploaded on FTP server : 135.240.25.160, User : wftp, Password :

wftp
Directory : /home/wcdma/Etisalat_UAE/AR1-5755928
2. All the steps taken before AR escalated to ALU
As above.
3. All the steps taken before the issue observed by the engineer, who
reported the
AR
N/A
4. Activities After AR was escalated to L2 Technical Support
From the PPC log during that time but could not see any alarm in RNC
related to
Hardware issue or any process issue.Also Healthcheck found ok.
Nmis Ftp Session/2 ; 2015-06-02 02:28:13.58
AVAIL: PROC: CNTRL:
Id: 100C112
userid = mdmadmin
role =
Nmis Ftp Session/1 ; 2015-06-02 06:43:07.08
AVAIL: PROC: CNTRL:
Id: 100C113
userid = mdmadmin
role =
5. Current Status
Required RCA for this issue to avoid it in future
6. Severity of this issue and its impact on the customer's organization

Critical.
7. Attachments
Escalation Note
8. Expectations from the TEC:

mohmadi
To: ROY, Paul (Paul)** CTR **
Cc: INDIA-WCDMA-UTRAN-BE
Subject: AR 1-5755928/Priority/RNC 9370/Emirates Telecommunications
Hello Paul,
This is for your information that we have escalated this AR to your

workgroup
(TEC-WLS-WCDMA-RNC). Please assign someone to have support on this.
Escalation note attached for your reference.
Logs are uploaded on FTP server : 135.240.25.160, User : wftp, Password :

wftp
Directory : /home/wcdma/Etisalat_UAE/AR1-5755928
Thanks,
Mobile:+91 9870327804.

ayounan
TEC Update:
==========
I guess the issue here is the bad KPI for Hour3 on june 2nd 2015.
i extracted the raw counters for RNC235 and it seems the 15 min interval
counter
of 3:15 are corrupted on wms
A lot of Cnode counters are "counterUnfound"
and even some counters are = zero and when you do the summation for the 4
quaters
it is less than the value hourly counter
ex: RAB.SuccEstab.PS.Sum
RAB.SuccEstab.PS.Sum 03:00 03:15 03:30 03:45
Events
RNC235 3408 0 3272 3068
while on hourly counters
RAB.SuccEstab.PS.Sum 03:00
Events
RNC235 13243
issue might be related to issue seen before in LR14.2 and issue was related
to
counters corrupted files on WMS
AR 1-5662780 / AR 1-5669684 fix tracked by CR 01545832

Please re-route AR to OAM TEC to confirm
19. 10-Jun-2015 10:51

achowdar
Update to Current Summary: June 10: Confirmation required if it is related

to
issue seen before in LR14.2 and issue was related to counters corrupted
files on
WMS AR 1-5662780 / AR 1-5669684 fix tracked by CR 01545832.

achowdar
From: CHOWDARY, Ajay (Ajay)** CTR **
To: LOUVIER, CHRISTOPHE (CHRISTOPHE)
Cc: INDIA-WCDMA-WMS-NPO-BE
Subject: // AR 1-5755928 /// Critical /// 9353 WMS /// Emirates

Telecommunications
Corporation /// Sudden PS CDR on RNC235
Hello Christophe,
Require your team support on this.
Product: 9353 WMS
SW Version: LR14.2.W
Customer: Emirates Telecommunications Corporation
Problem Short Description : Sudden PS CDR on RNC235 (1-5755928)
1. Detailed Description
High KPIs degradation on RNC235 on 2 June at 3AM due sudden PS CDR.
It was observed the below alarms at the same time of degradation on both
RNC231,
RNC235. But RNC231 don't have any impact, They had an activity on same
night on
the WMS for installation of hot fix patch related to WCE at the same time
and
need know if any relation between them and why only one RNC impacted not
both?
Or Is there any relation of RF condition?, are there any relation with WMS
patch?,
how can we secure the RNC to don't have the same issue in future?!
2. All the steps taken before AR escalated to ALU
As above.
3. All the steps taken before the issue observed by the engineer, who
reported
the AR
N/A
4. Activities After AR was escalated to L2 Technical Support
N/A
5. Current Status

6. Severity of this issue and its impact on the customer's organization
o Critical.
7. Attachments
N/A
8. Expectations from the TEC:
RNC TEC Analysis
I guess the issue here is the bad KPI for Hour3 on june 2nd 2015.
i extracted the raw counters for RNC235 and it seems the 15 min interval
counter
of 3:15 are corrupted on wms
A lot of Cnode counters are "counterUnfound"
and even some counters are = zero and when you do the summation for the 4
quaters
it is less than the value hourly counter
ex: RAB.SuccEstab.PS.Sum
Events
RNC235 3408 0 3272 3068
Events
RNC235 13243
issue might be related to issue seen before in LR14.2 and issue was related
to
counters corrupted files on WMS
AR 1-5662780 / AR 1-5669684 fix tracked by CR 01545832
Please re-route AR to OAM TEC to confirm

achowdar
Pls let us know if you require any logs for investigation

achowdar
-----Original Message-----
From: owner-india-wcdma-wms-npo-be@LIST.ALCATEL-LUCENT.COM
[mailto:owner-india-wcdma-wms-npo-be@LIST.ALCATEL-LUCENT.COM] On Behalf Of
CHOWDARY, Ajay (Ajay)** CTR **
To: MERAD, ABDESSAMAD (ABDESSAMAD); CUTLERYWALA, Mohmadi (Mohmadi)** CTR

**;
IBRAHIM ABD EL NABY, Karim (Karim)** CTR **

RAMY
(RAMY); EL-MIDANY, AHMED (AHMED); KHEDR, MAHMOUD (MAHMOUD); ARORA, Gaurav
(Gaurav)** CTR **; INDIA-WCDMA-WMS-NPO-BE
Subject: // AR 1-5755928 /// Critical /// 9353 WMS /// Emirates

Telecommunications
Corporation /// Sudden PS CDR on RNC235

Hi Abdessamad,
This AR has been escalated to OAM TEC for further investigation, we will
update
you once we here from them.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
OMC-WMS-NPO GSM WCDMA RTSC
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493
Gtalk ID: chowdary.ajay@gmail.com

mohmadi

RAMY
(Gaurav)** CTR **; CHOWDARY, Ajay (Ajay)** CTR **; INDIA-WCDMA-WMS-NPO-BE

Hi Karim,
TEC has checked and analyzed that the issue here is the bad KPI for Hour3
on june
2nd 2015. After extracting the raw counters for RNC235 and it seems the 15
min
interval counter of 3:15 are corrupted on wms. A lot of Cnode counters are
"counterUnfound" and even some counters are = zero and when you do the
summation
for the 4 quarters it is less than the value hourly counter ex:
RAB.SuccEstab.PS.Sum
Events
RNC235 3408 0 3272 3068
Events
RNC235 13243
This Issue might be related to issue seen before in LR14.2 and issue was
related
to counters corrupted files on WMS
AR 1-5662780 / AR 1-5669684 fix tracked by CR 01545832.
So routing AR to OAM Team to get further checks on it, and OAM person Mr.
Ajay
will keep you updated on it.
Thanks,
Mobile:+91 9870327804.

dchaintr
About the the WMS bug traked by AR 1-5662780 / AR 1-5669684 fix tracked by
CR
01545832:
1) Signature:
presence of error messages: "Error occurred: Exception

DataInfo_Exception from
package WISCI_DATAINFO ("Out of bound exception ........."
in file /opt/nortel/logs/utran/FMK_PM_server-20023.tra*
2) Workaround
So far the problem has been seen only after a restart of WMS. Also the
problem
disapeared after a restart. We have successfully tested on Antel server a

restart
of the service in charge of observation. The impact is no more treatment of
observation data for less than a minute and no loss of supervision. The
exact
commands are:
Under UNIX user oamops on the server:
/opt/nortel/shell/sysmgt/wam_stoponeapp.sh pmgt_utran_gpo_server
/opt/nortel/shell/sysmgt/wam_startoneapp.sh pmgt_utran_gpo_server
If I read correctly the description of the issue seen on June the 2th, a
WMS
restart was performed few time before. WMS s/wrestart is both the trigger
and the
workaround for this bug.
- I do not know if there are still some issue. This could be checked
looking for
thesignature in the logs files. If still present, please apply the

workaround ASAP
- concerning the problem seen on June the 2th, it is probably too late to
find
signature in log files that probaby have been overwritten.
In any case you can send me all the files
/opt/nortel/logs/utran/FMK_PM_server-20023.tra*

achowdar
From: MERAD, ABDESSAMAD (ABDESSAMAD)
To: CHOWDARY, Ajay (Ajay)** CTR **; CUTLERYWALA, Mohmadi (Mohmadi)** CTR
**;

RAMY
Subject: RE: // AR 1-5755928 /// Critical /// 9353 WMS /// Emirates
Telecommunications Corporation /// Sudden PS CDR on RNC235
Hi
FYI attached the release note containing the latest hot fix applied o live
WMS for
wce purpose (achieved outage 02/06/2015)
Best Regards

achowdar
Release Notes for WMS LR14 2W EP3 -> attached in cares

achowdar
To: MERAD, ABDESSAMAD (ABDESSAMAD); CUTLERYWALA, Mohmadi (Mohmadi)** CTR

**;

RAMY

Hi Abdessamad,
Can you pls provide the below mentioned files for further investigation
/opt/nortel/logs/utran/FMK_PM_server-20023.tra*
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493
28. 10-Jun-2015 13:19

achowdar
Update to Current Summary: June 10: Logs Awaited from field team
29. 10-Jun-2015 13:31

achowdar
Update to Current Summary: June 10: Logs provided to TEC, Analysis awaited
achowdar
To: CHAINTREUIL, DIDIER (DIDIER)
Cc: INDIA-WCDMA-WMS-NPO-BE; LOUVIER, CHRISTOPHE (CHRISTOPHE); CHOWDARY,

Ajay
(Ajay)** CTR **
Subject: Escalated: // AR 1-5755928 /// Critical /// 9353 WMS /// Emirates
Hi Didier,
Pls find the requested logs.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493

nchatter
CHATTERJEE, Nilanjan (Nilanjan)** CTR **
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; AMAYO, EFOSA (EFOSA);
CHOWDARY,
Ajay (Ajay)** CTR **
Cc: INDIA-WCDMA-UTRAN-BE; 3G_ALU_Integ_UAE; REDA, RAMY (RAMY); EL-MIDANY,

AHMED
(AHMED); KHEDR, MAHMOUD (MAHMOUD); ARORA, Gaurav (Gaurav)** CTR **;
INDIA-WCDMA-WMS-NPO-BE; BERIDY, AHMED (AHMED); MERAD, ABDESSAMAD

(ABDESSAMAD);
WAGDY MANSOUR, AYMAN (AYMAN)** CTR **; CUTLERYWALA, Mohmadi (Mohmadi)** CTR
**
Hello Karim,
Yes, Please proceed with the WA to neutralize the issue.
TEC remote logged in & checked it is the same issue as below.
Full RCA is still not known but as per the latest TEC feedback:
problem was reproduced in Design Lab.
Design is modifying source code to add more traces.
In the same time there are code review .

Here is the below details that we have now:
The WMS bug traked by AR 1-5662780 / AR 1-5669684 fix tracked by CR

01545832:
1) Signature:
presence of error messages: "Error occurred: Exception

DataInfo_Exception from
package WISCI_DATAINFO ("Out of bound exception ........."
in file /opt/nortel/logs/utran/FMK_PM_server-20023.tra*
2) Workaround
So far the problem has been seen only after a restart of WMS. Also the
problem
disapeared after a restart. We have successfully tested on Antel server a

restart
of the service in charge of observation. The impact is no more treatment of
observation data for less than a minute and no loss of supervision. The
exact
commands are:
Under UNIX user oamops on the server:
/opt/nortel/shell/sysmgt/wam_stoponeapp.sh pmgt_utran_gpo_server
/opt/nortel/shell/sysmgt/wam_startoneapp.sh pmgt_utran_gpo_server
BR
NILANJAN CHATTERJEE
OAM L2 Support- 2G & 3G
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
Nilanjan.Chatterjee@alcatel-lucent.com
To: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; AMAYO, EFOSA (EFOSA);

CHOWDARY, Ajay
(Ajay)** CTR **

AHMED

(ABDESSAMAD);
**
Hello Nilanjan
Ok, we will proceed, but first, Please tell us whats the issue?! Which is
known
and seen with other customer?!, do you have the RC? Can you share with us.
Thanks,
--
BR,
Karim Ibrahim

M: +971 (0)56-354-4568 || ONNET: 22341798
From: CHATTERJEE, Nilanjan (Nilanjan)** CTR **
To: AMAYO, EFOSA (EFOSA); IBRAHIM ABD EL NABY, Karim (Karim)** CTR **;
CHOWDARY,
Ajay (Ajay)** CTR **

AHMED

(ABDESSAMAD);
**
Hello Karim,
The impact is no more treatment of observation data for less than a minute
and no
loss of supervision
Please go ahead with the WA. It is a known problem with this know WA to be
applied. It appeared in more than one customers.
If you dont apply problem remains.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
From: AMAYO, EFOSA (EFOSA)
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; CHOWDARY, Ajay (Ajay)**
CTR **;

AHMED

(ABDESSAMAD);
**
Hello Ajay
Your feedback , as we need to be very sure before proceeding
Thanks & Br,
Efosa
+971507533570 - UAE
+2348058097463 - Nigeria
To: CHOWDARY, Ajay (Ajay)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR
**

AHMED
INDIA-WCDMA-WMS-NPO-BE; AMAYO, EFOSA (EFOSA); BERIDY, AHMED (AHMED); MERAD,
ABDESSAMAD (ABDESSAMAD); WAGDY MANSOUR, AYMAN (AYMAN)** CTR **;

CUTLERYWALA,
Mohmadi (Mohmadi)** CTR **
Hello Ajay,
Please elaborate whats the required and excepting result from this
command,
Please note the issue appeared again on the same RNC today 8.15am.
Thanks,
--
BR,
Karim Ibrahim

M: +971 (0)56-354-4568 || ONNET: 22341798

nchatter
hello didier,
question from customer:
Please from my understanding the issue which appear @ Mobily is different,

there
are RNCs are impacted with continues KPIs impact,
Here, we dont habe this case, the KPIs degraded @ only one RNC, for a very
short
period then its stable, happened 2 times today and last 2 June,
How we can confirm its the same issue?!, is it from logs we have the same
errors,
If yes, please share with us,

dchaintr
1) The software bug is reproduced in design lab but it is not explained

yet. What
we know is the following:
- The problem is triggered by a restart of the service

pmgt_utran_gpo_server
(maybe a bad initialization)
- Once the service has the problem it will affect randomly Cnode obs.
There is no
identified pattern no frequence
- The problem may disappear after a restart (again a restart can be the
trigger)
2) When a Cnode obs file is not correctly decoded:
- we can see may errors "Out of bound exception" in FMK_PM_server-20023.tra

file.
In fact there are so many errors that it fills up all the FMK_PM_server-
20023.tra*
files. It means previous occurrences are generally not more visible in this
log
- the XML file generated in
/opt/nortel/data/utran/observation/stats/<date>/RNCCN-<RNCname> is
generally
smaller (a lot of counters are not present).
3) On this server we can see:
- Errors "of bound exception" in FMK_PM_server-20023.tra for the RNC

RNC321 for
the obs 14h00-14:15 and also the XML file is small compared to files before
and
after (971120 bytes instead of usually about 2300000 bytes.
- If we check the size of the XML file size for the 4 RNC since the
beginning of
the year, we can see clearly that the size for RNC 231 and 235 is not
stable since
end of April. There were some restart of the gpo service at this moment.
As XML
files are zipped so the size does not always reflect the real size of the
file,
but sudden change of size is a good marker of the bug. Look at the attached
graphs
which give the size of XML file for each RNC since January.
Conclusion
- We have the signature and sudden change of XML file size. I have no
doubt we are
facing the known issue already tracked by R 1-5662780 / AR 1-5669684 fix

tracked
by CR 01545832
- The workaround must be tried. Anyway it is harmless, without impact on
supervision. Of course due to the nature of the bug, it may be necessary to

rerun
the same workaround several times before GPO service restart in good shape.
I
would recommend to do the stop/start, wait for one or two hours and check
in
FMK_PM_server-20023.tra if new error "Out of bound" are seen. In case new

error
messages the same workaround should be done again until there is no more
error for
few hours/days.

achowdar
To: MERAD, ABDESSAMAD (ABDESSAMAD); IBRAHIM ABD EL NABY, Karim (Karim)**

CTR **;
AMAYO, EFOSA (EFOSA); CHOWDARY, Ajay (Ajay)** CTR **

AHMED
INDIA-WCDMA-WMS-NPO-BE; BERIDY, AHMED (AHMED); WAGDY MANSOUR, AYMAN

(AYMAN)** CTR
**; CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

Hello Karim, Abdessamad,
As I wrote in the previous mail:
On this server we can see:
- Errors "of bound exception" in FMK_PM_server-20023.tra for the

RNC
RNC321 for the obs 14h00-14:15 and also the XML file is small compared to
files
before and after (971120 bytes instead of usually about 2300000 bytes.
- If we check the size of the XML file size for the 4 RNC since
the
beginning of the year, we can see clearly that the size for RNC 231 and 235
is not
stable since end of April. There were some restart of the gpo service at
this
moment. As XML files are zipped so the size does not always reflect the
real size
of the file, but sudden change of size is a good marker of the bug. Look
at the
attached graphs which give the size of XML file for each RNC since January.
Also please recheck again the below points:
- The problem is triggered by a restart of the service

pmgt_utran_gpo_server
(maybe a bad initialization)
- Once the service has the problem it will affect randomly Cnode
obs.
There is no identified pattern no frequence
So yes as per the above investigation done by TEC yes it is for sure same
issue as
Mobily as explained above. as per the explanation above it has affected

more than
one RNCs & it can affect in random nature.
There is no alarm or flag present. Just to check periodically error "of

bound
exception" in FMK_PM_server-20023.tra. In case it is appeared apply the WA

again.
This has to be done until a permanent fix is identified.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
35. 11-Jun-2015 13:50

achowdar
Update to Current Summary: June 11: work around executed, under

observation,
permanent fix delivery awaited from TEC

nchatter

nchatter

achowdar

nchatter

achowdar

nchatter

42. 18-Jun-2015 13:28
achowdar
Update to Current Summary: June 18: work around executed, under

observation,

achowdar

AHMED
(AHMED); KHEDR, MAHMOUD (MAHMOUD); INDIA-WCDMA-WMS-NPO-BE; BERIDY, AHMED

(AHMED);
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; WAGDY MANSOUR, AYMAN (AYMAN)** CTR
**;
MERAD, ABDESSAMAD (ABDESSAMAD); AMAYO, EFOSA (EFOSA); CHATTERJEE, Nilanjan
(Nilanjan)** CTR **
Hi Karim,
We have checked and found no error in these logs. We don't have any
confirmation
on permanent fix part, will update you once we hear from TEC.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493
Sent: Tuesday, June 16, 2015 5:53 AM
**

AHMED

(AHMED);
**;
MERAD, ABDESSAMAD (ABDESSAMAD); AMAYO, EFOSA (EFOSA)
Importance: High
Dears,
Attached update logs, Please check if the issue still exist,

Please let us know the next step and the feedback from TEC.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
Sent: Friday, June 12, 2015 9:15 AM
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; WAGDY MANSOUR, AYMAN
(AYMAN)**
CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **; MERAD, ABDESSAMAD

(ABDESSAMAD);
AMAYO, EFOSA (EFOSA)

AHMED
INDIA-WCDMA-WMS-NPO-BE; BERIDY, AHMED (AHMED); CUTLERYWALA, Mohmadi

(Mohmadi)**
CTR **
Hi Karim,
No error of "out of bound" observed after applying workaround. Pls keep it
under
observation.
Last error observed was as below
2015/06/11-11:35:17,030+04:00 | FMK_PM_instanceHandler.cc:127 | Thr:31 |

ERR |
component-name | class-name | CId:38251603
Error occurred: Exception DataInfo_Exception from package WISCI_DATAINFO

("Out of
bound exception[0,1296]: -1358015381")
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493
44. 22-Jun-2015 11:45

achowdar
Update to Current Summary: June 22nd work around executed, under

observation,

achowdar
To: CHAINTREUIL, DIDIER (DIDIER)
Cc: INDIA-WCDMA-WMS-NPO-BE; CHATTERJEE, Nilanjan (Nilanjan)** CTR **;

LOUVIER,
CHRISTOPHE (CHRISTOPHE)
Subject: RE: Escalated: // AR 1-5755928 /// Critical /// 9353 WMS ///
Emirates
Hi Didier,
After applying the workaround we didn't found this error again, any finding
or any
time line from design to provide the permanent fix?
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493

nchatter

achowdar
From: CHAINTREUIL, DIDIER (DIDIER)
To: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; CHOWDARY, Ajay (Ajay)** CTR
**
Cc: INDIA-WCDMA-WMS-NPO-BE; LOUVIER, CHRISTOPHE (CHRISTOPHE)
Emirates
Hello,
The RCA package will be provided by R&D guys. I expect to have it this
week.
Of course I will transmit to you as soon asI can
48. 25-Jun-2015 13:19

achowdar
Update to Current Summary: June 25th Design has found the root cause, and
is
preparing a RCA package

49. 29-Jun-2015 10:15
achowdar
Update to Current Summary: June 29th Design has found the root cause, and
is
preparing a RCA package

achowdar
**
Emirates
Hello,
week.

dchaintr
Analysis from Design:
The issue occurs with the combination of 9370 and 9771 XDR PM file
processing.
The information required for mediation is required to be separately
maintained for
9370 and WCE because the set of counters are different between them. Let us
call
this as mediation context for further reference.
In order to get the correct applicable mediation context for 9370 and WCE,
thread
specific data is maintained.
A common thread specific key is used between 9370 and WCE threads. The
value which
is bound to the key is the applicable mediation context for the thread.
The issue of out of bound exception occurs while processing XDR files of
9370
because there is a bug due to which the thread processing the 9370 files
retrieves
the mediation context for WCE instead of mediation context for 9370. This
causes
the wrong offset to be retrieved from the context information.
When the above error is encountered, the processing of all counters is

skipped for
the particular localization due to which the size of the processed XML
files is
smaller than usual.
Solution:
The software is modified to use different thread specific keys between

9370 and
WCE threads. Thus, the relevant mediation context is retrieved for the
corresponding 9370 and WCE threads.
The hotfix built from base LR14.2 EP5 has been verified by ISS.
The hotfix will be available for customers W29

52. 30-Jun-2015 09:49
achowdar
Update to Current Summary: June 30th RCA package delivered, Hot fix will be
available in Wk29
53. 01-Jul-2015 10:51 ALCATEL-LUCENT PROPRIETARY

nchatter
54. 02-Jul-2015 14:07

achowdar
Update to Current Summary: 2nd July : RCA package delivered, Hot fix will
be
available in Wk29
55. 06-Jul-2015 14:07

achowdar
Update to Current Summary: 6th July : RCA package delivered, Hot fix will
be
available in Wk29

ritesh
57. 09-Jul-2015 14:19

achowdar
be
available in Wk29

nchatter
59. 16-Jul-2015 14:36

achowdar
be
available in Wk29

nchatter

nchatter

nchatter

Sent: Wednesday, July 22, 2015 3:34 PM
To: CHAINTREUIL, DIDIER (DIDIER); CHOWDARY, Ajay (Ajay)** CTR **;
@DL_FR_PUB_MoAD-GPS-OAM-Fr
Emirates
Hello TEC team,
Since Didier is OoO.
Can any one of you please let me know if the fix is applied anywhere else?
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
Sent: Monday, July 20, 2015 11:38 AM
To: CHAINTREUIL, DIDIER (DIDIER); CHOWDARY, Ajay (Ajay)** CTR **
Emirates
Bonjour Didier,
Indeed there was an issue with my calendar. Now I have corrected it. Thanks
for
pointing. :
Customer has enquired whether this patch is installed somewhere else. Can
you
please let me know? Is it already installed in Antel?
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
Sent: Friday, July 17, 2015 4:13 PM
**
Emirates

Hello,
Seems we do not share the same calendar. On my calendar, week 29 is now

(from Jul
the 12th to Jul the 18th)
I confirm the fix is available as mentioned in attached doc (CR 01545832/
AR-1-5662780- LR14.2W. FMK_PM Out of bound exception for RNC CNode GPO)
Didier
De : CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Envoy : vendredi 17 juillet 2015 12:19
: CHAINTREUIL, DIDIER (DIDIER); CHOWDARY, Ajay (Ajay)** CTR **
Cc : INDIA-WCDMA-WMS-NPO-BE; LOUVIER, CHRISTOPHE (CHRISTOPHE)
Objet : RE: Escalated: // AR 1-5755928 /// Critical /// 9353 WMS ///
Emirates
Hello Didier,
Customer is asking about availability of the fix.
Though the delivery target was Wk29 ie next week. I see it is showing ALED.
Can I
confirm this to customer?
BR
NILANJAN CHATTERJEE

INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
**
Emirates
Hello,
Yes this is the same problem, the same RCA. But the AR mentioned in the
slides is
the one from Mobily. Need to be changed for each customer.
Didier
Envoy : lundi 29 juin 2015 09:03
Emirates

Hello Didier,
The RCA package is same I believe as attached for Mobily?
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
**
Emirates
Hello,
week.

Envoy : lundi 22 juin 2015 10:08
Emirates
Hello Didier,
Can you please send us the RCA package if it is already prepared?
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
To: CHOWDARY, Ajay (Ajay)** CTR **
Cc: INDIA-WCDMA-WMS-NPO-BE; CHATTERJEE, Nilanjan (Nilanjan)** CTR **;

LOUVIER,
CHRISTOPHE (CHRISTOPHE)
Emirates
Hello,
Last news from design are:
- The problem is understood.
- A fix is currently tested in R&D labs.
I do not know yet when an official delivery will available for customers.
I'll let
you know when we have the information.
Didier
63. 22-Jul-2015 14:10

nchatter
Sent: Monday, July 20, 2015 11:47 AM
CTR **

AHMED

(AHMED);
WAGDY MANSOUR, AYMAN (AYMAN)** CTR **; MERAD, ABDESSAMAD (ABDESSAMAD);

AMAYO,
EFOSA (EFOSA)

Hello Karim,
This fix is delivered last week to solve the "out of bound" issues wherever
it is
faced. Except ETC this issue is faced in Mobily & Antel.
As far as I know it is not yet installed in Mobily. I am not sure about

Antel.
However I have asked TEC in case they have information on installation

elsewhere.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
**

AHMED

(AHMED);

AMAYO,
EFOSA (EFOSA)
Hello Nilnjan
Thanks, please provide more details to about it to be implement and If it's
implemented on another NW or still not?
BR,
Karim
+971 563544568
[nilanjan.chatterjee@alcatel-lucent.com]
Received: Friday, 17 Jul 2015, 2:48PM
[karim.ibrahim@alcatel-lucent.com]; CHOWDARY, Ajay (Ajay)** CTR **
[ajay.chowdary@alcatel-lucent.com]
CC: INDIA-WCDMA-UTRAN-BE [india-wcdma-utran-be@alcatel-lucent.com];
3G_ALU_Integ_UAE [3g_Alu_Integ_Uae@alcatel-lucent.com]; REDA, RAMY (RAMY)
[ramy.reda@alcatel-lucent.com]; EL-MIDANY, AHMED (AHMED)
[Ahmed.El-Midany@alcatel-lucent.com]; KHEDR, MAHMOUD (MAHMOUD)
[Mahmoud.Khedr@alcatel-lucent.com]; INDIA-WCDMA-WMS-NPO-BE
[india-wcdma-wms-npo-be@alcatel-lucent.com]; BERIDY, AHMED (AHMED)
[Ahmed.Beridy@alcatel-lucent.com]; WAGDY MANSOUR, AYMAN (AYMAN)** CTR **
[Ayman.Wagdy@alcatel-lucent.com]; MERAD, ABDESSAMAD (ABDESSAMAD)
[abdessamad.merad@alcatel-lucent.com]; AMAYO, EFOSA (EFOSA)

[efosa.amayo@alcatel-lucent.com]
Hello Karim,
I confirm the fix is available as mentioned in attached doc (CR 01545832/
AR-1-5662780- LR14.2W. FMK_PM Out of bound exception for RNC CNode GPO).
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
CTR **

AHMED

(AHMED);

AMAYO,
EFOSA (EFOSA)
Hello Karim,
(Please ignore my earlier mail)
The fix delivery plan is Wk29 ie next week.
I am checking if it is available already.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019

AHMED

(AHMED);

AMAYO,
EFOSA (EFOSA); CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Hello Ajay,Nilanjan,
Is the fix ready and verified?
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798

AHMED

(AHMED);

AMAYO,
EFOSA (EFOSA); CHATTERJEE, Nilanjan (Nilanjan)** CTR **

Hello Ajay,
Thanks, and please keep us updated once the hotfix is ready and verified,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
To: CHOWDARY, Ajay (Ajay)** CTR **; IBRAHIM ABD EL NABY, Karim (Karim)**
CTR **

AHMED

(AHMED);
**;
(Nilanjan)** CTR **
Hi Karim,
Pls find the RCA package and permanent fix delivery plan attached.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493

AHMED

(AHMED);
**;
(Nilanjan)** CTR **

Hi Karim,
We have checked and found no error in these logs. We don't have any
confirmation
on permanent fix part, will update you once we hear from TEC.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493
64. 22-Jul-2015 14:11

nchatter
Update to Current Summary: 22th July : RCA package & Hot fix delivered. As
per
local team's request enquiring if fix is installed anywhere else
65. 22-Jul-2015 14:12

nchatter
per
local team's request enquiring TEC if fix is installed anywhere else

achowdar
Sent: mercredi 29 juillet 2015 09:05
To: WAGDY MANSOUR, AYMAN (AYMAN)** CTR **; CHATTERJEE, Nilanjan

(Nilanjan)** CTR **
Cc: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; INDIA-WCDMA-UTRAN-BE;
3G_ALU_Integ_UAE; REDA, RAMY (RAMY); EL-MIDANY, AHMED (AHMED); KHEDR,

MAHMOUD
(MAHMOUD); INDIA-WCDMA-WMS-NPO-BE; BERIDY, AHMED (AHMED); MERAD, ABDESSAMAD
(ABDESSAMAD); AMAYO, EFOSA (EFOSA)
Hi Ayman,
LR14.2 is already DR5, EP fixing this issue is nowhere installed. If you

install,
this will be the first network.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493

achowdar
From: MERAD, ABDESSAMAD (ABDESSAMAD)
To: CHOWDARY, Ajay (Ajay)** CTR **; WAGDY MANSOUR, AYMAN (AYMAN)** CTR **;

MAHMOUD
(MAHMOUD); INDIA-WCDMA-WMS-NPO-BE; BERIDY, AHMED (AHMED); AMAYO, EFOSA

(EFOSA)
Ajay
Ayman is asking for WMS LR14.2 EP5 not WMS LR14.2
Please confirm the EP status
Note: ETC is already running WMS LR14.2 EP3.3 (EP3 with hit fix for wce)
thanks
Best Regards

achowdar
To: MERAD, ABDESSAMAD (ABDESSAMAD); CHOWDARY, Ajay (Ajay)** CTR **; WAGDY
MANSOUR,
AYMAN (AYMAN)** CTR **

MAHMOUD

(EFOSA)
Hello Merad,
As we have already provided the feedback as attached EP5 is not installed

in the
customer network so far.
R&D did their testing in LAB & released for field installation.
Please let us know if this information is helpful.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
69. 29-Jul-2015 13:55

achowdar
per
70. 30-Jul-2015 14:20

achowdar
per
71. 07-Aug-2015 10:16

achowdar
From: WAGDY MANSOUR, AYMAN (AYMAN)** CTR **
**

MAHMOUD

(EFOSA);
MERAD, ABDESSAMAD (ABDESSAMAD)

Hello Nilanjan,Ajay
I understand from your feedback that EP5 is tested only in R&D lab and not
tested in any live network,so etislat uae will be first off customer for
this load
( LR14.2 EP5),Hence we will need to secure WMS GPS support during the
action for
any unexpected behavior
We will plan for EP5 installation (intra upgrade) shortly and keep you
updated
Best Regards,
Ayman Wagdy
Senior WCDMA NPI-EMEA-RBC
Alcatel-Lucent U.A.E
Cellular: +971 50 672 2947
E-mail: Ayman.Wagdy@alcatel-lucent.com
72. 07-Aug-2015 10:17

achowdar
Sent: Friday, August 07, 2015 11:47 AM
To: WAGDY MANSOUR, AYMAN (AYMAN)** CTR **; CHATTERJEE, Nilanjan

(Nilanjan)** CTR **

MAHMOUD
(EFOSA);
MERAD, ABDESSAMAD (ABDESSAMAD)
Hi Ayman,
Can you pls Update on this?
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
T:+91-40-30894009
M:+91-9000008493
73. 07-Aug-2015 10:17

achowdar
Update to Current Summary: 7th Aug : RCA package & Hot fix
delivered.Feedback
awaited
74. 10-Aug-2015 10:21

achowdar
Sent: Monday, August 10, 2015 11:50 AM
(AYMAN)**
CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **

AHMED

(AHMED);
AMAYO, EFOSA (EFOSA); MERAD, ABDESSAMAD (ABDESSAMAD)
Hi Karim,
This is a long pending AR, If no near future plan to implement the

workaround we
would like to suggest for closure of this AR.
However you can open a new AR if you face any problem while implementing.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
On-NET:2779-4009
delivered.Feedback
awaited, closure requested if no near future plan to implement the fix.
75. 10-Aug-2015 10:21 ALCATEL-LUCENT PROPRIETARY

achowdar
76. 13-Aug-2015 11:12

achowdar
Sent: Thursday, August 13, 2015 12:36 PM

AHMED

(AHMED);
Hello Ajay
I already replied below that we need to wait till we apply the upgrade and
patch,
Thanks,
BR,
Karim Ibrahim
M: +971(0)563544568| ONNET: 22341798
Every Success has its network
delivered.Feedback
awaited, closure requested if no near future plan to implement the fix.
77. 13-Aug-2015 11:12

achowdar
(AYMAN)**
CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **

AHMED

(AHMED);
Hi Karim,
I understand, when is the upgrade planed?
As this is a long pending AR, If no near future plan to implement the

workaround
we would like to suggest for closure of this AR.
However you can open a new AR if you face any problem while implementing.
Regards
N AJAY CHOWDARY
ALCATEL-LUCENT
INDIA
78. 13-Aug-2015 11:32

achowdar
IBRAHIM

AHMED

(AHMED);

Hello Ajay
Thanks for your support , please close this AR,
Thanks,
BR,
Karim Ibrahim
79. 13-Aug-2015 11:32 ALCATEL-LUCENT PROPRIETARY

achowdar
Add to log
Resolution
Analysis from Design:
The issue occurs with the combination of 9370 and 9771 XDR PM file
processing.
The information required for mediation is required to be separately

maintained for
9370 and WCE because the set of counters are different between them. Let us
call
this as mediation context for further reference.
In order to get the correct applicable mediation context for 9370 and WCE,
thread
specific data is maintained.

A common thread specific key is used between 9370 and WCE threads. The
value which
is bound to the key is the applicable mediation context for the thread.
The issue of out of bound exception occurs while processing XDR files of
9370
because there is a bug due to which the thread processing the 9370 files
retrieves
the mediation context for WCE instead of mediation context for 9370. This
causes
the wrong offset to be retrieved from the context information.
When the above error is encountered, the processing of all counters is

skipped for
the particular localization due to which the size of the processed XML
files is
smaller than usual.
Solution:
The software is modified to use different thread specific keys between

9370 and
WCE threads. Thus, the relevant mediation context is retrieved for the
corresponding 9370 and WCE threads.
The hotfix built from base LR14.2 EP5 has been verified by ISS.
The hotfix will be available for customers W29
Latest update:
June 30th RCA package delivered,
July 17th Hot fix is delivered
End of Assistance Request 1-5755928

View AR | AR without Proprietary | OLCS
New AR:
History | States | Assignment | Timetracking
View Attachments | Add Attachment
AR Text Search | More | CARES Home

AR31

Diunggah oleh

Informasi Dokumen

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

AR31

Diunggah oleh

Hak Cipta:

Format Tersedia

View AR | AR without Proprietary

Short Sudden PS CDR on RNC235

Current 13th Aug : RCA package & Hot fix delivered.Feedback

Summary closure requested if no near future plan to implement the

State Closed : Solution/Service Provided

Service Request Remote Technical Support

Request Type Defect

Sub-Category Software Defect

No Change Request is linked to this AR

Solution Source DCTPD01545832

Instance 9353WMS-AUH : In Service

Site Company Emirates Telecommunications Corporation

City Abu Dhabi

Country United Arab Emirates

Company Alcatel-Lucent : Open on behalf of Customer

Phone 971 56 354 4568 Email

Request Method Email-Eng

Reported 02-Jun-2015 14:38 AR Created 02-Jun-2015 14:43

Service Start 02-Jun-2015 14:38

Responded 02-Jun-2015 15:02 Respond Target 02-Jun-2015 15:08

Restored 02-Jun-2015 15:08 Restore Target 11-Jun-2015 15:22

Resolved 29-Jun-2015 11:37 Resolve Target 08-Aug-2015 15:22

Targets for Restore & Resolve were extended by 7 days 1 hour

to account for Pending time

Last Modified 13-Aug-2015 11:33 Modified By achowdar

Covered Service TS 24x7 (Gold, Wireless Mobile Access)

Script This request is entitled to service.

Assignee CloQ-WLS-WCDMA-vGlobal : achowdar

Referred 1 NorP-WLS-WCDMA-vGlobal : achowdar

Referred 2 TEC-WLS-WCDMA-RNC : ayounan

Referred 3 EtPP-WLS-WCDMA-vGlobal : achowdar

Referred 4 TEC-WLS-OAM-EMEA : dchaintr

Resolve Group NorP-WLS-WCDMA-vGlobal

Showing Investigation and Proprietary logs together in time order Show

Investigation Log and Proprietary Log

Update to Current Summary: June 2: Under Investigation

3. 02-Jun-2015 15:04 ALCATEL-LUCENT PROPRIETARY

CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

Sent: Tuesday, June 02, 2015 4:32 PM

To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **

Subject: AR 1-5755928/Priority/RNC 9370/Emirates Telecommunications

Corporation/Sudden PS CDR on RNC235

You can upload it on ftp server 135.240.25.160 , path:

Email ID: mohmadi.cutlerywala@alcatel-lucent.com

4. 02-Jun-2015 17:44 ALCATEL-LUCENT PROPRIETARY

Time Tracking Entry Added - IR01-TSA3

Update to Current Summary: June 2: No related info found from Logs.

6. 03-Jun-2015 13:10 ALCATEL-LUCENT PROPRIETARY

From: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **

Sent: Tuesday, June 2, 2015 8:32 PM

To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

(RAMY); EL-MIDANY, AHMED (AHMED); KHEDR, MAHMOUD (MAHMOUD)

Subject: RE: AR 1-5755928/Priority/RNC 9370/Emirates Telecommunications

Corporation/Sudden PS CDR on RNC235

Im uploading All required logs on the server,

Please as I described that the PS CDR increased suddenly @ 3am yesterday ,

find below description,

PROBLEM DESCRIPTION: Sudden PS CDR on RNC235

High KPIs degradation on RNC235 today 3AM due sudden PS CDR

Action taken and progress:

LTE/3G Integration Professional

Alcatel-Lucent, Dubai, Etisalat Program

M: +971 (0)56-354-4568 || ONNET:2205 5534

From: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **

CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR

From: IBRAHIM ABD EL NABY, Karim (Karim) CTR

To: CUTLERYWALA, Mohmadi (Mohmadi) CTR

From: IBRAHIM ABD EL NABY, Karim (Karim) CTR

To: CUTLERYWALA, Mohmadi (Mohmadi) CTR

From: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR

ABD EL NABY, Karim (Karim) CTR

To: CUTLERYWALA, Mohmadi (Mohmadi) CTR

From: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR