Anda di halaman 1dari 36

Cluster KPI

Table of contents

About CLOT Drive


CLOT KPI
About Exclusion & Non Exclusion Zone
Binning
Exclusion Zone KPI ( Coverage &
Throughput Test)

Non Exclusion Zone KPI(Retainability


Test)

Call Drop Rate

Non Exclusion Zone KPI (Accessibility


Test)

RSRP
SINR >= -2 dB
Overlapping Servers within 5 dB <= 1
Overlapping Servers within 5 dB <= 2
PCI for all Sectors Observed
MAC Throughput DL >= 2 Mbps
MAC Throughput UL >= 256 kbps
Average MAC Throughput DL (kbps)
Average MAC Throughput UL (kbps)
Average BLER DL
Average BLER UL

TAU Success Rate


Handover Success Rate
Handover Interruption Time < 100ms
RACH Success Rate
Attach Success Rate
VoLTE Setup Success Rate
Attach Setup Time < 1.5 s
IMS Registration Setup Time < 1.5 s
VoLTE Setup Time < 1.5 s

Non Exclusion Zone KPI (VoLTE Quality)

VoLTE Jitter < 40 ms

About CLOT Drive


Field Drive Test:
Field engineer will start performing field drive test after completing site survey
successfully. Field engineer will use 5 handsets to perform five tests using Accuver DM
tool installed in mobile handset.
Each handset will perform one of the test given below
1. FTP DL 1
2. FTP DL 2
3. FTP UL
4. VoLTE Long
5. VoLTE Short
All test scenarios are already predefined in Accuver DM tool. Drive test engineer will
select different test scenarios per handset.

014 Samsung Electronics

CLOT KPI
Sr No

KPIs

Call Model

Category

Target
Value

NonExclusion Status
Exclusion
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider

RSRP

LDL1, LUL

KPI

> 95 %

SINR >= -2 dB

LDL1, LUL

Info

LDL1, LUL

KPI

> 60 %

LDL1, LUL

KPI

> 90 %

LDL1, LUL

Info

LDL

KPI

> 95 %

LUL

KPI

> 95 %

LDL

KPI

> 16,500

LUL

KPI

> 2,500

KPI

<1%

Info

KPI

> 98 %

KPI

> 95 %

3
4
5
6
7
8
9

Overlapping Servers within


5 dB <= 1
Overlapping Servers within
5 dB <= 2
PCI for all Sectors Observed
MAC Throughput DL >= 2
Mbps
MAC Throughput UL >= 256
kbps
Average MAC Throughput
DL (kbps)
Average MAC Throughput
UL (kbps)

LDL1, LUL,
VoL
LDL1, LUL,
VoL
LDL1, LUL,
VoL
LDL1, LUL,
VoL

10

Call Drop Rate

11

TAU Success Rate

12

Handover Success Rate

13

Handover Interruption Time


< 100ms

14

RACH Success Rate

VoS

KPI

> 99 %

15

Attach Success Rate

VoS

KPI

> 99 %

16

VoLTE Setup Success Rate

VoS

KPI

> 99 %

17

Attach Setup Time < 1.5 s

VoS

KPI

> 95%

18

IMS Registration Setup


Time < 1.5 s

VoS

Info

> 95%

19

VoLTE Setup Time < 1.5 s

VoS

KPI

> 95%

Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider
Dont
Consider

About Exclusion & Non Exclusion Zone


Cluster A
PCI
capture

during
drive

Cluster
B
3

BSP of
Site

222222222222222222233333333333333333444444444444455555

Drive Route

Zon
e

PCI
belongs
to target
Cluster
Site

Drive within
Best server
Plot of Target
Cluster Site

Drive within Best


server plot of
Active Site

Exclusion /
Non Exclusion
ZONE of
Cluster A

Non Exclusion
Zone

Exclusion Zone

Exclusion Zone

In this case Site 1 of Cluster A is not active

In this case another cluster site is over


shooting
In this case drive has been done out of
Cluster coverage

5
mtr

Non Active Site = If PCI of site not found during drive


Non Exclusion
5
D
O
O
P
mtr Zone

Remark

About Binning

All Drive Samples

5x5 Area Bin samples


( Bin Sample is avg value of all samples in

1.RSRP

About RSRP KPI : To count best server binned samples that meet RSRP threshold within sectors
coverage prediction polygon Consider : best server samples located within matching sector coverage
prediction polygon
Pass : best server samples passing Coverage_Objective_RSRP_Threshold value

RSRP KPI Calculation:

Exclusion Zone

Samples has RSRP values less than


Coverage_Objective_RSRP_Threshold
value

Step 4
Count samples
Step 3
Step 1
has RSRP values
5x5 Bin Samples
all Drive Samples
more than
Coverage
Objective_RSRP_
Threshold
NOTE : Each BSP has different than Coverage_Objective_RSRP_Threshold value depend on its Clutter
type value
Step 2
Consider
Samples in
exclusion zone
only

KPI Formula :
DL log + UL Log -> (Binned Samples RSRP value> Coverage_Objective_RSRP_Threshold / Total Binned samples)
in exclusion zone

KPI Target Value = > 95 %

2. SINR >= -2 dB
KPI Calculation of SINRExclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

samples with SINR values less than -2dB

Step 3
5x5 Bin
Samples

Step 4
Count samples
has SINR values
greater than or
equal to -2dB

KPI Formula :

DL Log + Ul Log -> (Binned Samples SINR value> = -2dB/ Total Binned samples) in exclusion
zone

KPI Target Value = info only

3. Overlapping Servers within 5 dB


<=
1
About Overlapping Servers within 5 dB <= 1 KPI :

Count the average number of overlapping


LTE pilot signals RSRP within 5dB of the Serving Best Server, including the best server pilot signal,
which meet acceptable threshold criteria. based on location bin samples

Samples has RSRP difference betwee


Overlapping Servers within 5 dB <= 1 KPI Calculation:
1 Neighbour & serving cell values le
st

Exclusion Zone

Step 1
all Drive Samples

Step 2
Consider
Samples in
exclusion zone
only

KPI Formula :

Serving Cell
RSRP

1st Neighbour
RSRP

Step 3
5x5 Bin Samples

than 5dB

Step 4
Count samples
has RSRP values
more 5dB than
1st Neighbour

DL log + UL Log -> (Binned Samples RSRP values more 5dB than 1 st Neighbour / Total Binned samples) in
exclusion zone

KPI Target Value = > 60 %

4. Overlapping Servers within 5 dB


<=
2
About Overlapping Servers within 5 dB <= 1 KPI :

Count the average number of overlapping


LTE pilot signals RSRP within 5dB of the Serving Best Server, including the best server pilot signal,
which meet acceptable threshold criteria. based on location bin samples

Overlapping Servers within 5 dB <= 2 KPI Calculation:


Samples has RSRP difference between
Exclusion Zone

Step 1
all Drive Samples

Step 2
Consider
Samples in
exclusion zone
only

Note : If 2nd Neighbor is missing then Sample is pass

Serving Cell
RSRP

2nd Neighbor & serving cell values less


than 5dB
2nd Neighbor
RSRP

Step 3
5x5 Bin
Samples

Step 4
Count samples
has RSRP values
more 5dB than
2nd Neighbor

KPI Formula :
DL log + UL Log -> (Binned Samples RSRP values more 5dB than 2 nd neighbour/ Total Binned samples) in
exclusion zone

KPI Target Value = > 90 %

5.PCI for all Sectors Observed


Cluster A
PCI
capture

during
drive

Cluster
B
3

222222222222222222233333333333333333444444444444455555

Drive Route

PCI

PCI
belongs to
Cluster

PCI
belongs to
target
Cluster A

PCI found
During
Drive

Cluster A
PCI Found
During
Drive

Total

PCI for all Sectors Observed KPI for Cluster A:

2 PCI found out of 3

BSP of
Site

6. MAC Throughput DL >= 2 Mbps


samples with MAC DL TP values less
KPI Calculation of MAC Throughput DL >= 2 Mbps
than 1Mbps

Exclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

Step 3
5x5 Bin
Samples

Step 4
Count samples
has MAC DL
Throughput
values greater
than 1Mbps

KPI Formula :

DL 1 Log + DL2 Log -> (Binned Samples MAC DL Throughput value> 1Mbps/ Total Binned samples)
in exclusion zone.

KPI Target Value > 95%

7. MAC Throughput UL >= 256 kbps


KPI Calculation of MAC Throughput UL >= 256samples
kbpswith MAC UL TP values less
than 256Kbps

Exclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

Step 3
5x5 Bin
Samples

Step 4
Count samples
has MAC DL
Throughput
values greater
than 256 kbps

KPI Formula :

UL Log -> (Binned Samples MAC UL Throughput value> 256 kbps/ Total Binned samples) in
exclusion zone

KPI Target Value > 95%

8. Average MAC Throughput DL


(kbps)
KPI Calculation of Average MAC Throughput DL (Kbps)
Exclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

Step 3
5x5 Bin
Samples

KPI Formula :

DL 1 Log -> (Binned Samples MAC DL average Throughput value in Kbps) in exclusion zone.
+
DL 2 Log -> (Binned Samples MAC DL average Throughput value in Kbps) in exclusion zone.

KPI Target Value > 16,500 Kbps

9. Average MAC Throughput UL


(kbps)
KPI Calculation of Average MAC Throughput UL (Kbps)
Exclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

Step 3
5x5 Bin
Samples

KPI Formula :

UL Log -> (Binned Samples MAC UL average Throughput value in Kbps) in exclusion zone.

KPI Target Value > 2,500 Kbps

10. Drop Call Rate


KPI Formula : No of Drop Call / No of Call Attempt
Drop Call :
VoLTE Long
= Drop Call ( DL BYE SIP Msg)
DL
= RRC Drop ( abnormal release, RRC connection request
without RRC release)
UL
=
RRC Drop ( abnormal release, RRC connection request
without RRC release)

No of Call Attempt :
VoLTE Long
DL
UL

= (VoLTE Call Duration in sec / 90 sec)


= (Total MAC Throughput DL) bytes/52, 428 800 bytes
= (Total MAC Throughput UL) bytes / 10, 485 760 bytes

KPI Target Value : < 1%

11. TAU Success Rate

KPI Formula : TAU Complete / (TAU Complete + TAU Fail )

TAU complete
VoLTE Long =
DL
UL

Start :NAS_EMM Tracking Area UPDATE Request


Stop : NAS_EMM Tracking Area UPDATE ACCEPT
= Start :NAS_EMM Tracking Area UPDATE Request
Stop : NAS_EMM Tracking Area UPDATE ACCEPT
= Start :NAS_EMM Tracking Area UPDATE Request
Stop : NAS_EMM Tracking Area UPDATE ACCEPT

TAU fail
VoLTE Long =
DL
UL

Start :NAS_EMM Tracking Area Request


But no NAS_EMM Tracking Area UPDATE ACCEPT Message
= Start :NAS_EMM Tracking Area Request
But no NAS_EMM Tracking Area UPDATE ACCEPT Message
= Start :NAS_EMM Tracking Area Request
But no NAS_EMM Tracking Area UPDATE ACCEPT Message

KPI Target Value : Info Only

--> Start

--> End

12.Handover Success Rate

KPI Formula : HO successful case/ (HO Successful case+ HO Failure case)

HO Successful
VoLTE Long
= Start : rrc ConnectionReconfiguraion message
: HO RACH success
DL
= Start : rrc ConnectionReconfiguraion message
RACH success
UL
= Start : rrc ConnectionReconfiguraion message
RACH success

Stop
Stop : HO
Stop : HO

HO fail

VoLTE Long
= Start : rrc ConnectionReconfiguraion message
HO RACH fail or rrcConnectionReconfiguration massage missing
DL
= Start : rrc ConnectionReconfiguraion message
RACH fail or rrcConnectionReconfiguration massage missing
UL
= Start : rrc ConnectionReconfiguraion message
RACH fail or rrcConnectionReconfiguration massage missing
KPI Target Value : >98%

But
But HO
But HO

13. Handover Interruption Time <


100
ms

KPI Formula : Count [HO_Duration < 100ms] / Count


[RJIL_HO_Duration]
HO Duration
VoLTE Long = Start : rrc ConnectionReconfiguraion message
Stop : HO RACH success
DL
= Start : rrc ConnectionReconfiguraion message
Stop : HO RACH success
UL
= Start : rrc ConnectionReconfiguraion message
Stop : HO RACH success

KPI Target Value :

>95%

HO interruption
Time

14.RACH Success Rate


KPI Formula : Count [RACH_OK] / Count [RACH_OK + RACH_Fail]

RACH_OK
VoLTE Short =

RACH_Fail
VoLTE Short =

Start : LTE MAC RACH trigger followed by rrcConnection request


Stop : LTE MAC RACH attempt success

KPI Target Value :

Start : LTE MAC RACH trigger followed by rrcConnection request


Stop : LTE MAC RACH attempt success missing

>99%

->
Start

->
Stop

15. Attach Success Rate


1/2[LTE_Attach_Ok] / Count [LTE_Attach_Attempt]
KPI Formula : Count
LTE_Attach_Attempt
VoLTE Short =

RRC Connection Setup Complete Message(Attach Request)

LTE_Attach_OK
VoLTE Short =

KPI Target Value :

Attem
pt

Complet

200OK for REGISTER Message

>98%

15. Attach Success Rate


2/2

Attemp
t

complet
e

16. VoLTE Setup Success Rate


1/2

KPI Formula : Count [Successful Setup] / Count [Set up_ Attempt]


Set Up Attempt

VoLTE Short = UE sends INVITE (with originating SDP) in SIP message

Successful Setup
VoLTE Short =

KPI Target Value : >99%

Attem
pt

Complet
e

UE receives 200OK (after a bearer with QCI 1 is activated) in SIP message

16. VoLTE Setup Success Rate


2/2

Attemp
t

complet
e

17. Attach Setup Time < 1.5 s


1/2

KPI Formula : Count[ Attach Setup time< 1.5 s] / Count [Successful Attach setup]
Successful VoLTE Attach Set Up
VoLTE Short =
Start: UE sends RRC Connection Setup Complete (AttachRequest)

Stop : Attach Complete (NAS) on Uplink Information Transfer (by UE).

KPI Target Value : >95%

Attem
pt

Complet
e

17. Attach Setup Time < 1.5 s


2/2

Attempt

complet
e

18.IMS Registration Setup Time <


1.5 s
1/2

KPI Formula : Count[ Successful IMS Registration Setup Time < 1.5 s ] / Count [Successful
IMS Registration Setup]
Successful IMS Registration Setup
VoLTE Short =
Start: PDN Connectivity Request for IMS (by UE)
Stop : 200OK for REG reception (by UE).

Attem
pt

Complet
e

KPI Target Value :

>95%

18.IMS Registration Setup Time <


1.5 s
2/2

Attempt

complet
e

19. VoLTE Setup Time <1.5 s


KPI Formula :1/2
Count [Successful Setup time< 1.5 s] / Count [Successful setup]
Successful VoLTE Set Up
VoLTE Short =
Start: UE sends INVITE (with originating SDP) in SIP message
Stop : UE receives 200OK (after a bearer with QCI 1 is activated) in SIP message

KPI Target Value :

Attem
pt

VoLTE
Setup
Time

Complet
e

>95%

19. VoLTE Setup Success Rate


2/2

Attemp
t

complet
e

20.VoLTE Jitter < 40 ms

KPI Formula : Count [LTE_UE_VoLTE_Jitter_Threshold_Count < 40ms] / Count


[LTE_UE_VoLTE_Jitter_Count]

About Jitter

Statistical variation of the RTP data packet inter-arrival time (RFC 3550)
In RTP, jitter is measured in timestamp units.
If the variation becomes too high, callers notice the delay and often revert to a walkie-talkie style
of conversation.

Jitter Calculation
Jitter J(i) = J(i-1) + ( |D(i-1,i)| - J(i-1) )/16

J(i)= Jitter Of Current Packet


J(i-1)= Jitter Of previous Packet

|D(i-1,i)|= difference of relative transit times for the two packets= (Ri - Si) - (Ri-1 Si-1)
Ri= Time of arrival for packet i
Ri-1= Time of arrival for packet i-1
Si= timestamp from the packet i
Si-1= timestamp from the packet i-1

22. VoLTE RTP Packet Loss Rate

KPI Formula : sum of packets lost / sum of total packets transmitted

About RTP packet loss

VoIP has no time to wait for the packet to arrive.


In VoIP, packets can be discarded for a number of reasons, including network congestion, line
errors, and late arrival.
RTP Packet Loss is counted based on RTP packet sequence number

Example
Packet
Sequence No

Total Packet
Transmit at
given Time
stamp

Received
Packet Count

Si

S i+1

S i+3

S i+4

S i+2

S i+6

S i+10

11

Total

11

In above example Total lost Packets are = Total Packet Transmit at given Time stamp - Received
Packet Count
=4

KPI Target Value :

<= 1%

23. Average BLER DL


KPI Calculation of Average BLER DL
Exclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

Step 3
5x5 Bin
Samples

KPI Formula :

DL 1 Log + UL log file -> (Binned Samples Average BLER DL) in exclusion zone.
.

KPI Target Value : Info Only

24. Average BLER UL


KPI Calculation of Average BLER DL
Exclusion Zone

Step 1
all Drive
Samples

Step 2
Consider
Samples in
exclusion zone
only

Step 3
5x5 Bin
Samples

KPI Formula :

DL 1 Log + UL log file -> (Binned Samples Average BLER UL) in exclusion zone.
.

KPI Target Value : Info Only

Copyright and Confidentiality


Copyright 2014, SAMSUNG Electronics Co., Ltd. SAMSUNG Electronics reserves the right to make
changes to the specifications of the products detailed in this document at any time without notice and
obligation to notify any person of such changes. Information in this document is proprietary to SAMSUNG
Electronics Co., Ltd. No information contained here may be copied, translated, transcribed or duplicated
by any form without the prior written consent of SAMSUNG Electronics.

21.VoLTE Latency
KPI Formula
[RTCP packets of origination/termination UE to calculate one way delay]
RTT : TS2(Tx Packet Timestamp) TS1(Rx Packet Timestamp) DLSR

*DLSR(ms)=Delay since last SR TIMESTAMP/65536 (From RFC 1889)

One Way Delay = RTT/2


Unit: ms

Description
VoLTE End-to-End(E2E) Delay budget
This KPI is calculated by checking RTCP One way delay from the DM log
The e2e delay < 100ms samples should be 95% of total samples

Current Status
Actixone Implementation Issue

014 Samsung Electronics

35

014 Samsung Electronics

RRE Reject

RRE Successful

36

Anda mungkin juga menyukai