GSM Key Performance

IndicatorKPIGuidebook
Version: V1.1
Security Category: Secret
Serviceable range: adio Planning Section
GSM Network Planning & Optimization Dept. of Engineering Service Division
!"# Cor$oration
%
1&
1%


Secret
Work Guie!ook for GSM P&O Dept.
"ersion #ntrouction
Version Date Writer Assessor Amendment Records
V1.& '&&()&1)'1 C*en C*un !*eng +ao ,one
V1.1 '&&()1')&- .ang /ia0*i
!*eng +ao1
C*en C*un1
2ei 3i$ing
1V4 KPI and #5G# KPI 6ere added.
' 3mendment: mainly directed at V'.7-
and V8.&.
4Some classic KPI cases and comments
6ere added.
9 Princi$les for KPI risk analysis 6ere
added.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%


Secret
CONTENTS
$ Overview.................................................................................................................................................$
% &S 'aio Service Statistical (P#.........................................................................................................)
'.1 3vailability .....................................................................................................................................9
'.1.1 S5CC+ availability;S5CC+ .............................................................................................9
'.1.' "C+ availability;"C+ ........................................................................................................9
'.1.4 Cell utili0ation.....................................................................................................................9
'.' 3ccessibility ...................................................................................................................................%
'.'.1 andom 3ccess Success rate ..............................................................................................%
'.'.' S5CC+ blocking rate ........................................................................................................%
'.'.4 "C+ blocking rate ..............................................................................................................8
'.'.9 adio connection ratio ........................................................................................................8
'.'.% S5CC+ dro$ rate................................................................................................................-
'.'.8 S5CC+ assignment success rate.........................................................................................-
'.'.- "C+ assignment success rate..............................................................................................-
'.'.( Call setu$ success rate ........................................................................................................(
'.4 Mobility ..........................................................................................................................................7
'.4.1 +andover success rate ........................................................................................................7
'.9 eliability........................................................................................................................................7
'.9.1 "C+ Call 5ro$ ate ...........................................................................................................7
'.9.' "raffic Call 5ro$ ..............................................................................................................1&
'.9.4 Call Com$letion rate .........................................................................................................1&
'.9.9 <= :>ual &)9 .................................................................................................................1&
'.9.% 5= :>ual &)9 .................................................................................................................11
'.% Call Setu$ time...............................................................................................................................11
'.%.1 Call setu$ time ?GSM to PS",@ .......................................................................................11
'.%.' Call setu$ time ?GSM to GSM@ .......................................................................................1'
* &S 'aio Service +est (P#.................................................................................................................$*
4.1 Call Setu$ Success ate ...............................................................................................................14
4.' +andover Success ate ................................................................................................................14
4.4 Call 5ro$ ate ..............................................................................................................................14
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%
1&
1%
'&
'%
4&


Secret
4.9 Coverage ?5rive "est@...................................................................................................................14
4.9.1 S>I ...................................................................................................................................19
4.9.' MAS .................................................................................................................................19
4.9.4 MAS B PS#>...................................................................................................................1%
) PS 'aio Service Statistical (P#.......................................................................................................$,
9.1 3ccessibility..................................................................................................................................1(
9.1.1 5= "C2 establis*ment success rate ..................................................................................1(
9.1.' <= "C2 establis*ment success rate ..................................................................................1(
9.1.4 GPS =C .......................................................................................................................17
9.1.9 GPS =C .......................................................................................................................17
9.1.% #GPS =C .....................................................................................................................'&
9.1.8 #GPS =C .....................................................................................................................'&
- PS 'aio Service +est (P#..................................................................................................................%%
%.1 3ccessibility..................................................................................................................................''
%.1.1 3ttac* success rate ...........................................................................................................''
%.1.' 3verage GPS attac* time ...............................................................................................''
%.1.4 P5P conte:t activation success rate .................................................................................''
%.1.9 P5P conte:t activation time .............................................................................................'4
%.1.% PI,G test success rate ......................................................................................................'4
%.1.8 3verage PI,G test time ....................................................................................................'4
%.' Mobility ........................................................................................................................................'9
%.'.1 outing 3rea <$date Successful rate ...............................................................................'9
%.4 5ata "*roug*$ut ...........................................................................................................................'9
%.4.1 3verage 2"P do6nload rate...............................................................................................'9
%.4.' 3verage 2"P u$load rate...................................................................................................'%
%.4.4 "*roug*$ut........................................................................................................................'%
%.9 eliability .....................................................................................................................................'%
%.9.1 P5"C+ 5ro$ ate ...........................................................................................................'%
. #ntrouction to &N Statistical (P#....................................................................................................%/
8.1 Paging success rate .......................................................................................................................'-
8.' =ocation u$date success rate ........................................................................................................'-
8.4 3ttac* success rate ........................................................................................................................'-
8.9 GPS average attac* time ............................................................................................................'(
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%
1&
1%
'&
'%
4&


Secret
8.% P5P conte:t activation success rate .............................................................................................'(
8.8 outing 3rea <$date Success rate ................................................................................................'(
/ &omments on (P# &ases.....................................................................................................................*0
-.1 Pengs*ui ?C*ongDing@ PS "est esult...........................................................................................4&
-.' /is*ou ?+unan@ C*ina Mobile #5G# "est esult.........................................................................41
-.4 3cce$tance reDuirements for #5G# KPI of 5ata Service of a net6ork......................................44
-.9 A$eration B Maintenance KPI of a ,et6ork................................................................................49
-.% A$eration B Maintenance KPI of a net6ork in Sout*east 3sia ...................................................48
-.8 KPI reDuirements for Indonesia "elkomsel net6ork......................................................................9&
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%


Secret
1 Overview
"*is guidebook collected t*e Key Performance Indicators ?KPI@ for CS and PS
services1 6*ic* are no6 commonly ado$ted in $resales bidding $roEectsF and t*e
definitions of different KPIs and counter formulas for V';V4 are e:$lained *ere as
6ell. Mean6*ile1 6it* t*e aim to unify res$onse on KPIs and avoid t*e $ossible
market risks1 after analy0ing t*e $erformance indicators of current net6orks of bot*
domestic and overseas key $roEects1 t*e 6riter $rovides t*e reference values and risk
values of different KPIs in t*is guide. If t*e KPIs listed in t*e bidding documents go
beyond t*e reference values and risk values ?su$$ose risk value of t*e KPI is
$rovidedF ot*er6ise1 suggested values s*all be a$$lied.@1 6e need to conduct risk
analysis and evaluation1 mean6*ile1 try to avoid t*e risk and send out $re)6arning.
"*e KPIs can be Duite different due to t*e differences in net6ork structure and
dimension. "o make sure t*at our KPI can meet reDuirements in bidding documents1
6e need not only su$$ort from t*eories1 but accumulation of 6ork e:$erience as
6ell. "*e suggested values and risk values of KPI mentioned in t*is guide are
reference suggestions concluded from t*e current conditions of GSM net6ork. 3s
GSM tec*niDues and skills are develo$ing and eDui$ment $erformance is im$roving
constantly1 t*e reference standards for KPI 6ill c*ange accordingly.
"*e key reDuirement for engineers engaged in $resales net6ork $lanning is to
t*oroug*ly understand and master t*e related KPIs1 6*ic* is also t*e basic but
*ig*est demand for radio net6ork $lanning engineers.
G*y net6ork o$erators set u$ KPIs and 6*at are t*ey aimed atH
+o6 to define KPI and 6*at can be resulted from deviation of KPIH
+o6 muc* influence can t*e value of KPI im$ose on $resales biddingH
+o6 to clarify KPI and *o6 to ac*ieve favorable negotiation results during KPI
clarificationH
+o6 to avoid and $re)6arn KPI risksH
G*at is t*e develo$ment direction of KPI assessmentH
#ac* $resales radio net6ork $lanning engineer s*all $ossess related tec*niDues of
and u$)to)date ans6ers to t*e si: Duestions above. 2or lack of s$ace1 t*e si:
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 1Total 46 pages
%
1&
1%
'&
'%
4&


Secret
Duestions 6ill not be furt*er discussed in t*is guidebook. "*e engineers 6ill be able
to e:$erience and get to kno6 t*em in $resales $lanning 6ork in future.
Generally1 KPI can be classified into four ty$es: statistical KPI1 testing KPI1
eDui$ment $erformance KPI1 customer $erce$tion KPI. Anly statistical KPI and
testing KPI are elaborated *ere. 3s for eDui$ment $erformance KPI and customer
$erce$tion KPI1 t*ey are focused on in anot*er guidebook. ,o6adays1 net6ork
o$erators are attac*ing more and more im$ortance to KPI during negotiations.
Cesides t*e four ty$es mentioned above1 a lot more as$ects are involved in KPI. KPI
is also closely related to t*e basic net6ork environment. "*erefore1 KPI is affected
by various factors. "*at is 6*y o$erators are no6 regarding KPI as a very im$ortant
leverage to s*ift risk and decrease net6ork investment and maintenance cost.
#Dui$ment manufacturers must commit t*emselves to suitable1 reasonable and
timely KPI1 so as to bring do6n contract risk and ensure $rofits. Iationali0e
commitment1 s*are risksJ is an im$ortant $rinci$le in $resales $lanning 6ork.
"*e follo6ing are t*e factors t*at s*all be taken into consideration 6*en 6e 6ork on
KPI:
1. net6ork dimensionF
'. net6ork ty$eF
4. degree of subscriber?number@ gro6t*F
9. geogra$*ical distribution of net6ork?urban1 countryside1 village@
%. eDui$ment ty$esF t*ere is difference in KPI for V' and V4.
2unctional $rinci$les for t*is guidebook ?mainly directed at KPI@:
1. "*is guide is only available to t*e radio net6ork $lanning engineers engaged in
$resales bidding. ,o one is entitled to s$read it outside or e:tensively s$read it
inside t*e com$any. "*e rig*t to inter$ret t*e serviceable range of t*is guide
remains 6it* GSM "ec*nical esearc* Section B esources Section.
'. It is suggested to release t*e guidebook in encry$ted document. It can not be
$rocured unless logging into document security soft6are.
4. "*e guide is a reference to radio net6ork $lanning staff engaged in $resales
bidding. It can not re$lace t*e $resales KPI $roEect evaluation.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 2Total 46 pages
%
1&
1%
'&
'%
4&


Secret
9. "*e KPI values enclosed in t*is guide are valid 6it*in only *alf a year since t*e
release of it. 3fter *alf a year1 it needs to be u$dated and reassessed.
%. "*e guide is mostly a$$licable to V'.7- of V' and V8.& ?ISMG@ and V8.1
?Minos@ of V4.
,otes: V8.& ?ISMG@1 V8.1 ?Minos@1 sic $assim
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 3Total 46 pages
%


Secret
2 CS Radio Service Statistical KPI
2.1 Availability
2.1.1 SDCCH availabilitySDCCH
KPI S5CC+ availability ?S5CC+ in service rate@
KPI reference
value
77K
Indicator
definition
S5CC+ usable totalL1&&K;?S5CC+ usable total MS5CC+ unusable total
Counter
formula
V' C118&1L1&&K;?C118&1MC118&'@
V4
V8.& C1&&&4&1''L1&&K;? C1&&&4&1''M C1&&&4&1'4@
V8.1 C7&&&8&1''L1&&K;?C7&&&8&1''MC7&&&8&1'4@
,otes
"*e ratio of t*e S5CC+ usable total to t*e total S5CC+ allocated in net6ork is mainly
used to e:amine eDui$ment $erformance1 es$ecially to ins$ect t*e utili0ation of S5CC+ in
t*e cells. It is directly related to t*e stability of eDui$ment transmission and $o6er su$$ly1
etc.. It reflects t*e utili0ation ratio of net6ork eDui$ment and t*e stability of initial net6ork
o$eration.
2.1.2 TCH availabilityTCH
KPI "C+ availability ?"C+ in service rate@
KPI
reference
value
7(K
Indicator
definition
"C+ usable totalL1&&K;?"C+ usable totalM "CC+ unusable total
Counter
formula
V'
C118&-L1&&K;?C118&-MC118&(@
V4
V8.&
?C1&&&4&1'%MC1&&&4&149MC1&&&4&1%%@L1&&K ; ?C1&&&4&1'% M
C1&&&4&149 M C1&&&4&1%% M 1&&&4&1'8M C1&&&4&'1-M C1&&&4&'1(@
V8.1
?C7&&&8&1'%MC7&&&8&149MC7&&&8&1%%@ L1&&K;
?C7&&&8&1'%MC7&&&8&149M
C7&&&8&1%%MC7&&&8&1'8MC7&&&8&'1-MC7&&&8&'1(@
,otes
"*e ratio of t*e S5CC+ usable total to t*e total S5CC+ allocated in net6ork is mainly used
to e:amine eDui$ment $erformance1 es$ecially to ins$ect t*e utili0ation of S5CC+ in t*e cells. It
is directly related to t*e stability of eDui$menttransmission and $o6er su$$ly1 etc..
2.1.! Cell "tili#atio$
KPI Cell utili0ation
KPI reference (&K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 4Total 46 pages
%


Secret
value
Indicator
definition
Cells1 in 6*ic* ratio of actual traffic ; desired trafficN1
Counter
formula
,one
,otes
"*is is mainly to com$are $erformance of $re$lanning net6ork 6it* t*at of actual
net6ork. "*e $rereDuisite is t*at $recise traffic model traffic dis$ersion net6ork
ca$acity and redundancy rate s*all be $rovided in $re$lanning $eriod. "*is KPI is also
related 6it* net6ork configuration and traffic distribution.
2.2 Accessibility
2.2.1 Ra$do% Access S"ccess rate
KPI andom 3ccess Success rate
KPI reference
value
Suggested value 77K
isk value 77.%K
Indicator
definition
andom access success times L1&&K ; andom access call attem$t times
Counter
formula
V'
?C118'8MC11878)C1187-@L1&&K;?C118'%MC11878@
V4
V8.&
?C1&&&4&&&9MC1&&&4&&1&MC1&&&4&&4()?C1&&&4&&11 MC1&&&4&&47@@
L1&&K;?C1&&&4&&&4MC1&&&4&&1&MC1&&&4&&4(@
V8.1
?C7&&&8&&&9MC7&&&8&&1&MC7&&&8&&4()?C7&&&8&&11 MC7&&&8&&47@@
L1&&K;?C7&&&8&&&4MC7&&&8&&1&MC7&&&8&&4(@
,otes S5CC+ congestion rate s*all be taken into consideration1 because of its direct influence on
t*is KPI.
2.2.2 SDCCH bloc&i$' rate
KPI S5CC+ blocking rate
KPI reference
value
1K
Indicator
definition
Signaling c*annel congestion timesL1&&K ; signaling c*annel call attem$t times
Counter
formula
V'
?C118'%)C118'8MC1187-@L1&&K;?C118'%MC11878@
V4
V8.&
?C1&&&4&&&%MC1&&&4&&11MC1&&&4&&47@ L1&&K; ?C1&&&4&&&4M
C1&&&4&&1&MC1&&&4&&4(@
V8.1
?C7&&&8&&&%MC7&&&8&&11MC7&&&8&&47@L1&&K;?C7&&&8&&&4M
C7&&&8&&1&MC7&&&8&&4(@
,otes "*is is mainly to evaluate t*e fitness bet6een $re$lanned net6ork and actual net6ork. It 6ill
be affected by t*e follo6ing factors:
1. t*e fitness bet6een net6ork desired ca$acity and actual ca$acityF fitness bet6een $reset
traffic model and t*e actual oneF '. burst trafficF 4. lack of S5CC+ ca$acityF 9. internal B
e:ternal interferenceF %. $re$lanned redundancy rateF 8. o$eratorsO s$ecial reDuestsF -. 2 and
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 5Total 46 pages


Secret
+ used as signaling c*annel.
2.2.! TCH bloc&i$' rate
KPI "C+ blocking rate
KPI
reference
value
'K
Indicator
definition
"C+ congestion timesL1&&K; "C+ call attem$ts
Counter
formula
V' C1181')C11877L1&&K;C11811)C1187(
V
4
V8.&
?C1&&&4&&'&MC1&&&4&&41MC1&&&4&&94MC1&&&4&&9-MC1&&&4&&'' M
C1&&&4&&44MC1&&&4&&9%MC1&&&4&&97@L1&&K;?C1&&&4&&17MC1&&&4&&4&M
C1&&&4&&9'MC1&&&4&&98MC1&&&4&&'1MC1&&&4&&4' MC1&&&4&&99MC1&&&4&&9(@
V8.1
?C7&&&8&&'&MC7&&&8&&41MC7&&&8&&94MC7&&&8&&9-MC7&&&8&&''MC7&&&8&&44M
C7&&&8&&9%MC7&&&8&&97@L1&&K;?C7&&&8&&17MC7&&&8&&4&MC7&&&8&&9'MC7&&&8&&98M
C7&&&8&&'1MC7&&&8&&4'MC7&&&8&&99MC7&&&8&&9(@
,otes
"*is is mainly to evaluate t*e fitness bet6een $re$lanned net6ork and actual net6ork1 and t*e $recondition is
t*at $recise traffic model traffic dis$ersion net6ork ca$acity and redundancy rate s*all be $rovided in
$re$lanning $eriod. It is related to t*e follo6ing factors:
1. t*e fitness bet6een net6ork desired ca$acity and actual ca$acityF fitness bet6een $reset traffic model and
t*e actual oneF '. burst trafficF 4. lack of "C+ ca$acityF 9. internal B e:ternal interferenceF %. $re$lanned
redundancy rateF 8. *andovers.
2.2.( Radio co$$ectio$ ratio
KPI adio connection ratio
KPI
reference
value
7-K
Indicator
definition
1)signalling c*annel congestion rateL?1)voice c*annel congestion rate@L1&&K
Counter
formula
V'
?1)?C118'%)C118'8MC1187-@L1&&K;?C118'%MC11878@@L?1)?C1181')C11877@;?C11811)C1187(@@
V
4
V8.&
?1)?C1&&&4&&&%MC1&&&4&&&-@L1&&K ; ?C1&&&4&&&4MC1&&&4&&&8@@ L ?1)?C1&&&4&&11
MC1&&&4&&'&M C1&&&4&&41MC1&&&4&&47 MC1&&&4&&94 M C1&&&4&&9- MC1&&&4&&14M
C1&&&4&&'' MC1&&&4&&44MC1&&&4&&91 MC1&&&4&&9%MC1&&&4&&97@ ; ?C1&&&4&&1&M
C1&&&4&&17M C1&&&4&&4& M C1&&&4&&4(M C1&&&4&&9'MC1&&&4&&98M C1&&&4&&1'M
C1&&&4&&'1 MC1&&&4&&4'MC1&&&4&&9& MC1&&&4&&99MC1&&&4&&9(@@
V8.1 ?1)?C7&&&8&&&%MC7&&&8&&11MC7&&&8&&47@L1&&K;
?C7&&&8&&&4MC7&&&8&&1&MC7&&&8&&4(@@L?1)
?C7&&&8&&'&MC7&&&8&&41MC7&&&8&&94MC7&&&8&&9-MC7&&&8&&''MC7&&&8&&44M
C7&&&8&&9%MC7&&&8&&97@;?C7&&&8&&17MC7&&&8&&4&MC7&&&8&&9'MC7&&&8&&98M
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 6Total 46 pages


Secret
C7&&&8&&'1MC7&&&8&&4'MC7&&&8&&99MC7&&&8&&9(@@
,otes
"*is is mainly to com$are $erformance of $re$lanned net6ork 6it* t*at of actual net6ork. "*e $rereDuisite is t*at
$recise traffic model traffic dis$ersion net6ork ca$acity and redundancy rate s*all be $rovided in $re$lanning
$eriod. "*is KPI is in direct tie)in constraint 6it* S5CC+ blocking rate and "C+ blocking rate.
2.2.) SDCCH dro* rate
KPI S5CC+ dro$ rate
KPI reference
value
Suggested value &.1K
isk value &.&%K
Indicator
definition
S5CC+ call dro$ totalL1&&K;?random access call attem$ts M voice c*annel call attem$ts total
?*andover e:cluded@signalling@
Counter
formula
V' C118&%L1&&K;?C118'%MC11878@
V4 V8.& C1&&&4&&%4L1&&K;?C1&&&4&&&4MC1&&&4&&1&MC1&&&4&&4(@
V8.1 C7&&&8&&%4L1&&K;?C7&&&8&&&4MC7&&&8&&1&MC7&&&8&&4(@
,otes
C118&% accumulates S5CC+ call dro$s resulted from all reasons1 including radio link
failure =3P5 link breaks *andover failure1 etc.1 but e:ce$t t*e follo6ing four reasons: lost
connection 6it* SMM1 forced AMC) disconnection1 forced disconnection by ot*er calls1 and ot*er
causes. If 6e com$ute according to t*e formula above1 S5CC+ call dro$ rate 6ill be rat*er lo6. If
counter 11814% is included ?CSS call dro$ times on S5CC+@1 t*e suggested KPI value is &.8K1 and
suggested risk value &.9K.
C1&&&4&&%4;C7&&&8&&%4 is used to find out t*e freDuency of call dro$s resulted from radio link
failure=3P5 link breaks*andover failure. "*is KPI value is relatively lo6er.
2.2.+ SDCCH assi'$%e$t s"ccess rate
KPI S5CC+ assignment success rate
KPI reference
value
Suggested value 78K
isk value 7(K
Indicator
definition
S5CC+ assignment success rateL1&&;?S5CC+ assignment success times MS5CC+ assignment
failure times@
Counter
formula
V' C11899L1&&K;? C11899M C1189%@
V4
V8.
&
C1&&9'&&19L1&&K;C1&&9'&&19MC1&&9'&&1%@
V8.
1
C7&1'%&&19L1&&K;?C7&1'%&&19MC7&1'%&&1%@
,otes
S5CC+ assignment success rate is involved 6it* many factors1 suc* as =3P5 link freDuency
interferenceaccess $arameters1 etc..
2.2., TCH assi'$%e$t s"ccess rate
KPI "C+ assignment success rate
KPI reference
value
Suggested
value
7(K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 7Total 46 pages


Secret
isk value 77K
Indicator
definition
"C+ assignment success timesL1&&;? "C+ assignment success times M"C+ assignment
failure times@
Counter
formula
V'
C118%-L1&&K;?C118%-MC118%(@
V4
V8.&
?C1&&&4&&1-MC1&&&4&&'(MC1&&&4&&48MC1&&&4&'4% M
C1&&&4&177MC1&&&4&'1&@L1&&K;?C1&&&4&&1-MC1&&&4&&'(
MC1&&&4&&48MC1&&&4&&1(MC1&&&4&&'7MC1&&&4&&4-M
C1&&&4&'4%MC1&&&4&177MC1&&&4&'1&MC1&&&4&'&&M
C1&&&4&'11MC1&&&4&14%@
V8.1
?C7&&&8&&1-MC7&&&8&&'(MC7&&&8&&48MC7&&&8&177M
C7&&&8&'1&MC7&&&8&'4%@ L1&&K;?C7&&&8&&1(MC7&&&8&&'7M
C7&&&8&&4-MC7&&&8&'&&MC7&&&8&'11MC7&&&8&14%M
C7&&&8&&1-MC7&&&8&&'(MC7&&&8&&48MC7&&&8&177M
C7&&&8&'1&MC7&&&8&'4%@
,otes "*is KPI is directly related to radio environment freDuency carrier
$roblemsassignment met*odsa$$lication of data service1 etc..
2.2.- Call set"* s"ccess rate
KPI Call setu$ success rate CSS
KPI reference
value I
Suggested value 7'K
isk valueP 79K
Indicator
definition I
?1)S5CC+ blocking rate@L ?1)S5CC+ assignment failure rate@L?1)S5CC+ dro$
rate@L?1)"C+ blocking rate@L?1)"C+ assignment failure rate@
,ote I "*e definition of t*is CSS is relatively strict because too many factors are included
?=3CSMS1 etc.@. "*e definition is not rational from t*e vie6 of voice call1 so t*at t*e
CSS used in MA"A e:cluded SMS factor. +andover is e:cluded.
KPI reference
value II
Suggested value 74K
isk value 7%K
Indicator
definition II
??MAC success M M"C success ; ?MAC attem$t M M"C attem$t@@ L?1)S5CC+ dro$
rate@L?1)"C+ blocking rate@L?1)"C+ assignment failure rate@
,ote II 3ccording to common understanding1 CSS is mostly a$$lied to ins$ect t*e establis*ment
of voice call. It is rat*er reasonable to e:clude =3C and SMS. +andover is e:cluded.
KPI reference
value III
Suggested value 7-K
isk value 7%K
Indicator
definition III
??MAC success M M"C success ; ?MAC attem$t M M"C attem$t@@ L?1)S5CC+ dro$
rate@L?1)"C+ blocking rate@L?1)"C+ assignment failure rate@
,ote III "*e CSS is mainly measured in t*e vie6 of congestion. It is similar to +utc*isonOs
definition of CSS. +andover e:cluded.
Counter
formula
CSS is usually obtained from t*e combination of original KPI.
#:$lanation 5ifferent manufacturers *ave different definitions for CSS. "*e formula above is
regarded too strict. Some may define it to be "C+ assignment success rate or radio access
com$letion rate. Ge need to make clear t*e formula 6it* customers. It is regarded a
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 8Total 46 pages


Secret
favorable 6ay to e:clude location u$date indicators 6*en 6e define t*is KPI.
2.! .obility
2.!.1 Ha$dover s"ccess rate
KPI +andover success rate
KPI reference
value
V'
Suggested value 79K
isk value 78K
V4
Suggested value 7%K
isk value 7-K
Indicator
definition
+andover success times in busy *oursL1&&K ; *andover reDuest times in busy *ours
Counter
formula
V'
?C1181(MC11887)C118-%@L1&&K;?C1181-MC1188()
C118-%@
V4
V8.&
?C1&&&4&&7(MC1&&&4&1&'MC1&&&4&1'&MC1&&&4&&79M
C1&&&4&&78@L1&& K; ?C1&&&4&&7-MC1&&&4&'14M
C1&&&4&'19M C1&&&4&'1%MC1&&&4&&77MC1&&&4&1&&
MC1&&&4&1&1MC1&&&4&'18 MC1&&&4&117 MC1&&&4&&74
MC1&&&4&&7%@
V8.1
?C7&&&8&&7(MC7&&&8&1&'MC7&&&8&1'&MC7&&&8&&79M
C7&&&8&&78@ L1&&K;
?C7&&&8&&7-MC7&&&8&'14MC7&&&8&'19M
C7&&&8&'1%MC7&&&8&&77MC7&&&8&1&&MC7&&&8&1&1M
C7&&&8&'18MC7&&&8&117MC7&&&8&&74MC7&&&8&&7%@
,otes
"*is formula includes bot* incoming and outgoing *andovers1 6*ile some o$erators may take
into consideration only one of t*em. 3s for V4 eDui$ment1 1)'K can be a$$ro$riately increased
according to real situations. "*is KPI can differ a lot from eac* ot*er due to different ty$es of
net6ork. In many $resales bidding1 t*e o$erators reDuire a *andover success rate of around 7(K1
6*ic* involves *ig* risks to be reac*ed1 t*oug* several net6orks *ave reac*ed 7(K.
2.( Reliability
2.(.1 TCH Call Dro* Rate
KPI "C+ dro$ rate ; Call dro$ rate
KPI reference
value
V'
Suggested value 1.&K
isk value &.-K
V4
Suggested value &.-
isk value &.%
Indicator
definition
"C+ call dro$ timesL1&&K;"C+ assignment success times
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 9Total 46 pages


Secret
Counter
formula
V'
C1181%L1&&K;?C11811)C1187()?C1181'MC118%8MC118%(M
C1181-)C1181()C11877)C1181&4)C118144@@
V4
V8.
&
?C1&&&4&&%9MC1&&&4&&%%@L1&&K;?C1&&&4&&'(M C1&&&4&&48M
C1&&&4&177MC1&&&4&'1&M C1&&&4&&7(MC1&&&4&1&'MC1&&&4&1'&@
V8.
1
?C7&&&8&&%9MC7&&&8&&%%@ L1&&K;?C7&&&8&&'(MC7&&&8&&48M
C7&&&8&177MC7&&&8&'1&MC7&&&8&&7(MC7&&&8&1&'M
C7&&&8&1'&@
,otes
Voice c*annel call dro$ rate falls into t6o ty$es: one is 6it* *andover includedF t*e ot*er is 6it*
*andover e:cluded. "*e formula above takes *andover in it. If *andover is not included1 t*e indicator
6ill be about &.'K *ig*er t*an t*e one 6it* *andover included. "*is discre$ancy is not universally
definite yet1 for it can be bigger in dual)band net6ork. Generally1 call dro$ rate of V4 eDui$ment is a
bit lo6er t*an t*e one of V'. "*is KPI differs a lot in varied ty$es of net6ork. "*e discre$ancy can
reac* &.4K.
2.(.2 Tra//ic Call Dro*
KPI Minute $er dro$?MP5@
KPI reference
value
V'
Suggested value 7&
isk value 1'&
V4
Suggested value 1'&
isk value 1(&
Indicator
definition
"raffic ;"C+ call dro$ timesL8&
Counter
formula
V2 ?C11818;48&&@L8&;C1181%
V
3
V8.&
??C1&&&4&1'7MC1&&&4&1'-@;48&&@L8&;
?C1&&&4&&%9MC1&&&4&&%%@
V8.1 ??C7&&&8&1'7MC7&&&8&1'-@;48&&@L8&;?C7&&&8&&%9MC7&&&8&&%%@
,otes "*is KPI of different net6orks varies to a large e:tent. Generally1 itOs difficult for to
reac* t*is KPIOs standards1 if t*e call dro$ ?6it* *andover included@ rate is *ig*er t*an
&.%K.
2.(.! Call Co%*letio$ rate
KPI Call Success ate CS
KPI
reference value
Suggested
value
7'K
isk value 79K
Indicator
definition
CSSL?1) Call dro$ rate@
Counter
formula
,one. efer to Indicator 5efinition II under Item '.'.(
,otes "*is formula is a customer KPI. Ge need to make it clear 6it* customers
6*en referring to t*is KPI. Cut it is close to customersO $erce$tion.
2.(.( 01 R23"al 45(
KPI <= :>ual &)9
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 10Total 46 pages


Secret
KPI reference
value
Suggested
value
7%K
isk value 7-K
Indicator
definition
<= :>ual &)9 L1&& ; <= :>ual &)-
Counter
formula
V'
?C118119MC11811%MC118118MC11811-MC11811(@ L 1&& ; ?C118119
MC11811%MC118118MC11811-MC11811(M C118117
MC1181'&MC1181'1@
V4
V8.&
?C1&&&4&&88M C1&&&4&&8-M C1&&&4&&8(M C1&&&4&&87M
C1&&&4&&-&@L1&&; ?C1&&&4&&88M C1&&&4&&8-M C1&&&4&&8(M
C1&&&4&&87M C1&&&4&&-&M C1&&&4&&-1M C1&&&4&&-'M C1&&&4&&-4@
V8.1
?C7&&&8&&88M C7&&&8&&8-M C7&&&8&&8(M C7&&&8&&87M
C7&&&8&&-&@L1&&; ?C7&&&8&&88M C7&&&8&&8-M C7&&&8&&8(M
C7&&&8&&87M C7&&&8&&-&M C7&&&8&&-1M C7&&&8&&-'M C7&&&8&&-4@
,otes
,one
2.(.) D1 R23"al 45(
KPI 5= :>ual &)9
KPI reference
value
Suggested
value
7%K
isk value 7-K
Indicator
definition
5= :>ual &)9 L1&& ; 5= :>ual &)-
Counter
formula
V'
?C1181''MC1181'4MC1181'9MC1181'%MC1181'8MC1181'-@L 1&& ;
?C1181'' MC1181'4MC1181'9MC1181'%MC1181'8 MC1181'-
MC1181'(MC1181'7@
V4
V8.
&
? C1&&&4&&-9M C1&&&4&&-% M C1&&&4&&-8M C1&&&4&&-- M
C1&&&4&&-(@L1&&; ? C1&&&4&&-9M C1&&&4&&-% M C1&&&4&&-8M C1&&&4&&-- M
C1&&&4&&-(M C1&&&4&&-7M C1&&&4&&(&M C1&&&4&&(1@
V8.
1
? C7&&&8&&-9M C7&&&8&&-% M C7&&&8&&-8M C7&&&8&&-- M
C7&&&8&&-(@L7&&; ? C7&&&8&&-9M C7&&&8&&-% M C7&&&8&&-8M C7&&&8&&-- M
C7&&&8&&-(M C7&&&8&&-7M C7&&&8&&(&M C7&&&8&&(1@
,otes ,one
2.) Call Set"* ti%e
2.).1 Call set"* ti%e 67S. to PSTN8
KPI Call setu$ time ?GSM to PS",@
KPI reference
value
Suggested
value
( seconds
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 11Total 46 pages


Secret
isk value % seconds
Indicator
definition
time duration from starting call to ringing out
,otes Ge can use test soft6are to estimate t*e time duration1 6*ic* is related 6it* net6ork
structurerouting and radio environment. MSC $rovides t*is KPI. It differs in different
net6ork configurations.
2.).2 Call set"* ti%e 67S. to 7S.8
KPI Call setu$ time ?GSM to GSM@
KPI reference
value
Suggested
value
- seconds
isk value % seconds
Indicator
definition
Abtain from test t*e time duration from starting call to ringing out
,otes Ge can use test soft6are to estimate t*e time duration1 6*ic* is related 6it* net6ork
structurerouting and radio environment. MSC $rovides t*is KPI. It differs in different
net6ork configurations.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 12Total 46 pages


Secret
! CS Radio Service Test KPI
!.1 Call Set"* S"ccess Rate
KPI Call Setu$ Success ate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator
definition
Call connection timesL1&&K ; call attem$t times
Indicator value 5"BC>"1 test $re)defined locations and 5rive "est route
,otes ,one
!.2 Ha$dover S"ccess Rate
KPI +andover Success ate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator
definition
+andover success timesL1&&K ; *andover attem$t times
Indicator value 5"BC>"1 Pre 5efined 5rive "est oute or ,MS
,otes ,one
!.! Call Dro* Rate
KPI Call 5ro$ rate
KPI reference
value
Suggested
value
4K
isk value 'K
Indicator
definition
Call dro$ timesL1&&K ; call connection times
Indicator value 5"BC>"1 test Pre 5efined 5rive "est oute or ,MS
,otes ,one
!.( Covera'e 6Drive Test8
1r!an Su!ur!an 'ural 'oa
Illustration of
coverage
reDuirement
(%K of t*e
sam$le values
s*ould *ave a value
(%K of t*e
sam$le values
s*ould *ave a value
(%K of t*e
sam$le values
s*ould *ave a value
(%K of t*e
sam$le values
s*ould *ave a value
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 13Total 46 pages
%


Secret
eDual to or *ig*er
t*an Q-% dCm.
eDual to or *ig*er
t*an Q(& dCm.
eDual to or *ig*er
t*an Q(% dCm.
eDual to or *ig*er
t*an Q7& dCm.
Influencing factors 1. landformF '. inconsistency bet6een $roEect im$lementation and $roEect $lansF
4. test eDui$mentF 9. test routes
,otes
5etailed coverage reDuirements ?as s*o6n above@ are delivered in t*e bid documents.
#stimation of net6ork dimension is also based on t*e reDuirements. ,o6adays1
reDuirements for net6ork coverage are *ig*er1 so t*e accordingly estimated number of
sites 6ill meet t*e needs. If t*e net6ork dimension *as to be reduced due to market
strategies needs1 t*is KPI 6ill cause $roblems in t*e acce$tance ins$ection. 2urt*er more1
6e need to make sure t*at our customers are a6are of regional assignment 5" routes and
test met*ods. Coverage KPI is one of t*e most im$ortant KPIs1 because it directly reflects
not only our radio net6ork $lanning ability and t*e $erformance of our eDui$ment1 but
also our core com$etitive strengt* in net6ork $lanning. 5ue to lack of s$ace1 t*ere is no
more illustration of coverage KPI *ereafter in t*is guide.
!.(.1 S3I
KPI S>I
KPI reference
value
Suggested
value
7%K sam$le RS1(
isk value 7%K sam$le RS'%
Indicator
definition
"#MS test value
,otes
"*is KPI is for ins$ecting t*e sound distortion degree resulted from inca$able link
transmission. "*e formula is #ricssonOs $atent. It takes into consideration many factors1
including C#2#*andover times*andover conditions5"T activated ?or not@and
t*e encoder in use1 etc.1 to finally get t*e S>I. "*ere are different S>I to$ limits for
different ty$es of encoders. 2or *alf)rate encoder1 t*e S>I to$ limit is 17F for full)rate
encoder1 '1F for en*anced full)rate encoder1 4&. S>I ranges from 1( to 4&. S>I value 6ill
increase 6*en #2 is a$$lied.
!.(.2 .OS
KPI Mean A$inion Score ? MAS@
KPI reference
value
efer to t*e form attac*ed bello6.
Indicator
definition
"est value
,otes "*e commonly used MAS assessment met*od consists of subEective and obEective scoring
$arts. In t*e subEective $art1 engineers subEectively com$are t*e original voice material
and t*e deteriorated voice material according to I"<)" Suggestion book P.(&& and P.(4&1
and give t*eir MAS scores res$ectively1 t*en average t*e scores from different engineers.
G*ile in t*e obEective $art1 P#S> met*od from I"<)" Suggestion book P.(8' is
em$loyed1 t*at is s$ecial eDui$ment or soft6are ?e.g. t*e V>" test eDui$ment of 3gilent@
is used to $roceed t*e assessment. In MAS1 & means t*e 6orst Duality1 % stands for t*e
*ig*est. Standard PCM Duality s*all reac* around 9.9.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 14Total 46 pages


Secret
"*e MAS values for commonly used coding formats are as follo6s:
G.-11UUMAS 9.(
G.-'1G.-'4G.-'8UUMAS 9.'
G.-'( UUMAS9.'
G.-'7 UUMAS9.'
G.-'4.1%.4UUMAS4.%
G.-'4.18.4UUMAS4.7(
MAS can be affected greatly by t*e $erformance of test eDui$ment. "*e test results
from different manufacturers are different. Currently1 t*e test eDui$ment from 3ctena
$erforms t*e best.
Voice version combination
Average MOS(Incl!"ng #$ %&$
MOS'
T#O
2reDuency
*o$$ing
,o freDuency
*o$$ing
2reDuency
*o$$ing
,o freDuency
*o$$ing
100( #$ 3)04 3)29
100( *#$ 3)63 3)57
100( AM$ #$ 3)56 3)54
60( &$ (+*#$'
30( &$ (+*#$'
10( &$ (+*#$'
60( AM$ &$ (+AM$ #$'
30( AM$ &$ (+AM$ #$'
10( AM$ &$ (+AM$ #$'
!.(.! .OS 9 PSE3
SubEective scoring met*od *ad been used in assessment on voice Duality until '&&1.
<sers 6ere reDuested to assess t*e voice Duality of incoming calls by scoring 1)% ?%)
best1 1 ) 6orst@. "*is assessment met*od 6as regulated to be a standard by I"< in
3ugust1 1778. MAS assessment met*od 6as defined in its P.(&& standard in details.
Cut later it 6as found t*at t*is met*od not only took too muc* time1 but also cost a
lot. So t*ere 6as an urgent need for a kind of economic test eDui$ment1 6*ic* can be
used to simulate t*e voice Duality received by users1 and t*us can $lay its $art in
designingtesting and debugging ne6 ty$e of voice encoders.
Git* t*e aim to meet t*e need1 in 2ebruary '&&1 I"< issued t*e ne6 test standard on
voice transmission Duality)P.(8' ?P#S>)Perce$tual #valuation of S$eec* >uality@.
It ado$ts t*e ne6 algorit*m develo$ed by Psytec*nics com$any. P#S> can be used
to com$ute voice sam$leOs MAS)=>A value ?Mean A$inion Score)=istening
>uality AbEective@. "*e com$uted result and t*e subEective scoring result are
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 15Total 46 pages
%
1&
1%


Secret
basically t*e same. P#S> com$ares t*e out$ut signal ?collected after t*e signal is
transmitted t*roug* eDui$ment@ and t*e reference signal1 t*en 6orks out t*e
difference. In t*e ordinary course of event1 t*e bigger t*e difference bet6een t*e
out$ut signal and t*e reference signal1 t*e smaller t*e reference value of MAS 6ill
be. P#S> is testified to be a reliableeconomic and fast measuring tool for voice
encoder. Com$are P#S>Os $redicted value and t*e result from subEective scoring
met*od1 6e can see t*e correlation bet6een t*e t6o values is &.74%?refer to
P(8'#.doc for correlation factors@. 2or '' kinds of I"< benc*mark tests1 t*e
absolute error is 6it*in &.% MAS1 87.'K among 6*ic* is 6it*in &.'% MAS. It is
6ort* our attention t*at P#S> value ranges from &.% to 9.%1 6*ile MAS value
ranges from 1 to %.
#"g 1 MOS,P*S- .orrelat"on /"agra0
3t t*e $resent time1 t*ere are t6o ty$es of >AS test met*od)subEective and obEective
met*ods. MAS subEective test met*od is defined in I"<)" P.(&&. "*e obEective test
met*ods includes PS>M PS>MM and P#S> etc.. I"<)" P.(8' P#S> is t*e
met*od currently recommended by I"< to test end)to)end net6ork voice Duality. It
6ould be ideal if MAS and P#S> are simultaneously su$$orted in t*e >AS test.
#or0 1 /e1"n"t"on o1 MOS 2ales
=evel MAS
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 16Total 46 pages
%
1&
1%
'&


Secret
#:cellent %
Good 9
2air 4
Poor '
Cad 1
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 17Total 46 pages


Secret
( PS Radio Service Statistical KPI
(.1 Accessibility
(.1.1 D1 T:; establis<%e$t s"ccess rate
KPI 5= "C2 establis*ment success rate
KPI reference
value
Suggested value 7%K
isk value 78K
Indicator ty$e Statistical value
Indicator
definition
GPS 5= signalling "C2 link setu$ timesM GPS 5= data "C2 link setu$
times M#GPS 5= signalling "C2 link setu$ times M#GPS 5= data "C2 link
setu$ timesL1&&K; 5= $acket c*annel reDuest timesV4
Counter
formula
V'
?C-&&94MC-&&%-MC-&&-1@L1&&;C-&&91
V4
V8.&
?C1&&&1&&&-MC1&&&1&&1%MC1&&&1&&&(MC1&&&1&&18@
L1&&K;?C1&&&1&191MC1&&&1&19'MC1&&&1&194M
C1&&&1&199MC1&&&1&19%MC1&&&1&198MC1&&&1&19-
MC1&&&1&19(@
V8.1
?C7&&&9&&&-MC7&&&9&&1%MC7&&&9&&&(MC7&&&9&&18@
L1&&K;?C7&&&9&191MC7&&&9&19'MC7&&&9&194M
C7&&&9&199MC7&&&9&19%MC7&&&9&198MC7&&&9&19-
MC7&&&9&19(@
,otes
"*is KPI reflects t*e reDuest fulfilled status of PS do6nlink resources. Its "C2
includes 5= signaling "C2GPS 5= data "C2 and #GPS 5= data "C2. 5= "C2
link setu$ success rate can reflect t*e 5= PS Duality of a cell. Its maEor influencing
factors are as follo6s:
1. Interference: internal B e:ternal interferenceF
'. Parameters setting: eg. errors in "imer and functional $arameters
4. Stability of eDui$ment and transmission: eg. instant breakdo6n?flas*@
resulted from *ig* error rate or unstable linkF
9. <sability of data service functions.
(.1.2 01 T:; establis<%e$t s"ccess rate
KPI <= "C2 establis*ment success rate
KPI
reference
value
Suggested
value
7'K
isk value 7%K
Indicator ty$e Statistical value
Indicator
definition
GPS <= signalling "C2 link setu$ times M GPS <= data "C2 link setu$ times
M#GPS <= signalling "C2 link setu$ times M#GPS <= data "C2 link setu$
timesL1&&; <= $acket c*annel reDuest timesV4
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 18Total 46 pages


Secret
Counter
formula
V' ?C-&&9'MC-&&%%MC-&&87@L1&&K;C-&&9&
V4
V8.&
?C1&&&1&&'%MC1&&&1&&44MC1&&&1&&'8MC1&&&1&&49@
L1&&K ;?C1&&&1&1%7 MC1&&&1&18&MC1&&&1&181MC1&&&1&18(
MC1&&&1&184MC1&&&1&189M C1&&&1&18%MC1&&&1&188@
V8.1
?C7&&&9&&'%MC7&&&9&&44 MC7&&&9&&'8 MC7&&&9&&49@
L1&&K; ?C7&&&9&1%7M C7&&&9&18&
MC7&&&9&181MC7&&&9&18(MC7&&&9&184 MC7&&&9&189
MC7&&&9&18%MC7&&&9&188@
,otes
"*is KPI reflects t*e reDuest fulfilled status of PS u$link resources. Its "C2 includes
<= signaling "C2GPS <= data "C2 and #GPS <= data "C2. <= "C2 link setu$
success rate can reflect t*e <= PS Duality of a cell. Its maEor influencing factors are as
follo6s:
1. Interference: internal B e:ternal interferenceF
'. Parameters setting: eg. errors in "imer and functional $arameters
4. Stability of eDui$ment and transmission: eg. instant breakdo6n resulted
from *ig* error rate or unstable linkF
9. <sability of data service functions.
(.1.! 7PRS R1C
KPI <= GPS =C retransmission rate
KPI
reference
value
Suggested
value
1&K
isk value %K
Indicator ty$e Statistical value
Indicator
definition
GPS <= "C2 ,3CK blocks L1&&K ; valid data statistics received by GPS <=
"C2
Counter
formula
V' C-&&88L1&&K; C-&&8%
V4
V8.&
C1&&&1&&84L1&&K;C1&&&1&&8'
V8.1
C7&&&9&&84L1&&K;C7&&&9&&8'
,otes
"*is KPI reveals <= GPS =C retransmission rate1 6*ic* is t*e most im$ortant
indicator to reflect t*e sensibility of GPS <= service and to s*o6 6*et*er
instabilitycongestion and interference e:ist in t*e system. Its maEor influencing factors
are as follo6s:
1. Interference: internal B e:ternal interferenceF
'. Stability of eDui$ment and transmission: eg. instant breakdo6n resulted
from *ig* error rate or unstable linkF
(.1.( 7PRS R1C
KPI 5= GPS =C retransmission rate
KPI Suggested 1&K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 19Total 46 pages


Secret
reference
value
value
isk value %K
Indicatory
ty$e
Statistical value
Indicator
definition
GPS 5= "C2 ,3CK blocks L1&&K ; valid data statistics received by GPS 5=
"C2
Counter
formula
V' C-&&8(L1&&K; C-&&8-
V4
V8.&
C1&&&1&&8%L1&&K;C1&&&1&&89
V8.1
C7&&&9&&8%L1&&K;C7&&&9&&89
,otes
"*is KPI reveals 5= GPS =C retransmission rate1 6*ic* is t*e most im$ortant
indicator to reflect t*e sensibility of GPS 5= service and to s*o6 6*et*er
instabilitycongestion and interference e:ist in t*e system. Its maEor influencing factors
are as follo6s:
1. Interference: internal B e:ternal interferenceF
'. Stability of eDui$ment and transmission: eg. instant breakdo6n resulted
from *ig* error rate or unstable linkF
(.1.) E7PRS R1C
KPI <= #GPS =C retransmission rate
KPI
reference
value
Suggested
value
1&K
isk value %K
Indicatory
ty$e
Statistical value
Indicator
definition
#GPS <= "C2 ,3CK blocks L1&&K ; valid data statistics received by #GPS <=
"C2
Counter
formula
V' C-&&(&L1&&K; C-&&-7
V4
V8.&
C1&&&1&&-1L1&&K;C1&&&1&&-&
V8.1
C7&&&9&&-1L1&&K;C7&&&9&&-&
,otes efer to <= GPS =C retransmission rate
(.1.+ E7PRS R1C
KPI 5= #GPS =C retransmission rate
KPI
reference
value
Suggested
value
1&K
isk value %K
Indicatory
ty$e
Statistical value
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 20Total 46 pages


Secret
Indicator
definition
#GPS 5= "C2 ,3CK blocks L1&&K ; valid data statistics received by #GPS 5= "C2
Counter
formula
V' C-&&('L1&&K; C-&&(1
V4
V8.&
C1&&&1&&-4L1&&K;C1&&&1&&-'
V8.1
C7&&&9&&-4L1&&K;C7&&&9&&-'
,otes efer to 5= GPS =C retransmission rate
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 21Total 46 pages


Secret
) PS Radio Service Test KPI
).1 Accessibility
).1.1 Attac< s"ccess rate
KPI 3ttac* success rate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator
definition
3ttac* success times;3ttac* attem$t timesV1&&
Indicatory
ty$e
test
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e C>" value. 3ttac* success means t*at t*e
mobile $*one receives t*e 3ttac* 3cce$t signaling 6it*in 1% seconds
after it sends t*e 3ttac* eDuest. It is reDuired to $erform t*e 3ttac*
test ten times at eac* test site.
).1.2 Avera'e 7PRS attac< ti%e
KPI 3verage GPS attac* time
KPI reference
value
Suggested value ' sec
isk value 1.% sec
Indicator
definition
Sum of attac* success duration; 3ttac* success times. It is t*e
duration from t*e mobile sends out t*e first 3ttac* eDuest to it
receives t*e 3ttac* 3cce$t signaling.
It is reDuired to $erform t*e test ten times at eac* test site.
Indicatory ty$e "est value
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value. 3ut*entication
included.
).1.! PDP co$te2t activatio$ s"ccess rate
KPI P5P conte:t activation success rate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator P5P activation success times;attem$t times V1&&.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 22Total 46 pages
%


Secret
definition P5P activation success means t*at t*e mobile $*one receives t*e
3ctivate P5P Conte:t 3cce$t signaling 1% seconds after it sends t*e
3ctivate P5P Conte:t eDuest.
Indicatory ty$e "est
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value. It is reDuired to
$erform t*e P5P activation test ten times at eac* test site. "est met*ods
for GPS and #5G# are t*e same.
).1.( PDP co$te2t activatio$ ti%e
KPI P5P conte:t activation time
KPI reference
value
Suggested value 1.% sec
isk value 1.' sec
Indicator
definition
Sum of P5P activation duration; P5P activation success
times.
P5P activation time means t*e duration from t*e mobile
$*one sends out t*e first 3ctivate P5P Conte:t eDuest
to it receives t*e 3ctivate P5P Conte:t 3cce$t.
Indicatory ty$e "est value
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value.
3ut*entication included. GPS and #5G# are not
se$arated in t*is test.
).1.) PIN7 test s"ccess rate
KPI PI,G test success rate
KPI reference
value
Suggested value 7%K
isk value 7(K
Indicator
definition
Ping success times;Ping attem$t timesL1&&K
Counter
formula
,one
,otes It is regarded as failure if t*e time e:ceeds 4& seconds.
).1.+ Avera'e PIN7 test ti%e
KPI PI,G test time
KPI reference
value
GPS
Suggested value 1.% sec
isk value 1.9 sec
#5G#
Suggested value 1 sec
isk value &.8 sec
Indicator Sum of Ping success duration; Ping success times
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 23Total 46 pages


Secret
definition
Indicatory ty$e "est value
Counter
formula
,one
,otes 3ut*entication is included in t*is KPI. "*e Ping $ackage si0e
6ill *ave influence on t*e test result. Generally1 t*e smaller
t*e Ping $ackage is1 t*e better t*e test result 6ill be. It is
sometimes referred as ound "ri$ "ime.
).2 .obility
).2.1 Ro"ti$' Area 0*date S"ccess/"l rate
KPI outing 3rea <$date Success rate
KPI reference
Suggested value 7&K
isk value 7%K
Indicator
definition
outing u$date attem$t timesL1&&K ; outing u$date success times
Indicatory ty$e test
Counter
formula
,one
,otes <sually it can be statistical value. It also can be obtained from 5" too.
).! Data T<ro"'<*"t
).!.1 Avera'e ;TP dow$load rate
KPI 2"P do6nload rate
KPI
reference
value
GPS
Suggested value '&kb$s
isk value 4&kb$s
#5G#
Suggested value (&kb$s
isk value 1'&kb$s
Indicator definition 3ctual do6nload data Duantity ?byte@;actual do6nload duration
Indicatory ty$e "est value
Counter formula ,one
,otes ,ormally1 t*is KPI is t*e C>" value. Class 9 mobile. Si0e of t*e
do6nloaded document 6ill affect t*e test result. <sually1 t*e
smaller t*e document si0e is1 t*e better t*e test result 6ill be. It is
related to t*e number of PS c*annels terminal ty$e encoding
met*od and test soft6are1 etc.. "*e test result can also be affected
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 24Total 46 pages


Secret
by t*e ado$tion of encoding met*od for CS4 and CS9. 4static time
slots are configured.
).!.2 Avera'e ;TP "*load rate
KPI 2"P u$load rate
KPI reference
value
GPS
Suggested value (kb$s
isk value 1&kb$s
#5G#
Suggested value '%kb$s
isk value 4%kb$s
Indicator definition 3ctual u$load data Duantity ?byte@;actual u$load duration
Indicatory ty$e "est value
Counter formula ,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value. Class 9 mobile.
Si0e of t*e u$loaded document 6ill affect t*e test result. <sually1
t*e smaller t*e document si0e is1 t*e better t*e test result 6ill be.
It is related to t*e number of PS c*annelsterminal ty$eencoding
met*od and test soft6are1 etc.. "*e test result can also be affected
by t*e ado$tion of encoding met*od for CS4 and CS9. "*is KPI is
t*e result of single time slot.
).!.! T<ro"'<*"t
Preconditions
Mobile $*one 6it* multi)timeslot =evel (F single
subscriberF 9 5= static signaling c*annels1 1 <= static
signaling c*annel
Indicators ?#,@ Indicators ?C,@ Suggested value
GPS: Ma: data t*roug*$ut)5= GPS 5= ma:imum transmission rate 7.(kbyte;s
GPS: Ma: data t*roug*$ut)<= GPS <= ma:imum transmission rate '.9kbyte;s
GPS: 3verage data t*roug*$ut)5= GPS 5= average transmission rate %kbyte;s
GPS: 3verage data t*roug*$ut)<= GPS <= average transmission rate 1.4kbyte;s
#5G#: Ma: data t*roug*$ut)5= #5G# 5= ma:imum transmission rate '8.%kbyte;s
#5G#: Ma: data t*roug*$ut)<= #5G# <= ma:imum transmission rate -kbyte;s
#5G#: 3verage data t*roug*$ut)5= #5G# 5= average transmission rate 19kbyte;s
#5G#: 3verage data t*roug*$ut)<= #5G# <= average transmission rate 4.%kbyte;s
).( Reliability
).(.1 PDTCH Dro* Rate
KPI P5"C+ 5ro$ ate
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 25Total 46 pages


Secret
KPI reference
value
Suggested value %K
isk value 'K
Indicatory ty$e 5" test value
Indicator
definition
P5"C+ dro$ times; 2"P do6nload attem$t times L1&&K
Counter
formula
,one
,otes
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 26Total 46 pages


Secret
+ I$trod"ctio$ to CN Statistical KPI
+.1 Pa'i$' s"ccess rate
KPI Paging success rate
KPI reference
value
Suggested value 7&K
isk value 74K
Indicator
definition
Paging res$onse timesL1&&K ; Paging reDuest times
Counter
formula
Paging reDuest times refer to t*e sum of P3GI,G information sent out by all
MSCs in t*e area1 e:cluding t*e secondary $aging information. Paging res$onse
times refer to t*e sum of t*e P3GI,G #S received by all MSCs in t*e area1
including t*e second $aging res$onse. Statistical $oint is at MSC side.
,otes CSC can indirectly $rovide t*is KPI1 but its statistical $oint differs from t*at of
MSC. "*e difference lies in call loss at Interface 3.
+.2 1ocatio$ "*date s"ccess rate
KPI =ocation u$date success rate
KPI reference
value
Provided by t*e SMC side
Indicator
definition
=ocation u$date success times L1&&K; location u$date reDuest times
Counter
formula
Provided by t*e SMC side
,otes "*is KPI can be indirectly $rovided by CSC1 but t*e value is different and its statistical
$oint differs from t*at of MSC too.
+.! Attac< s"ccess rate
KPI 3ttac* success rate
KPI reference
value
Suggested value 7&K
isk value 7%K
Indicator
definition
GPS attac* success times L1&&K ; GPS attac* times
Indicatory
ty$e
GPS attac* success timesSGS, delivers3""3C+ 3CC#P"4GPP
"S '9.&&(e:cluding redeliver
Counter
formula
Statistics at SGS, side
,otes e:cluding <nregistered subs
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 27Total 46 pages


Secret
+.( 7PRS avera'e attac< ti%e
KPI GPS average attac* time
KPI reference
value
Suggested value "o be confirmed
isk value "o be confirmed
Indicator
definition
Customer attac* establis*ment duration L1&&K ; customer
number of attac* establis*ment success
Indicatory ty$e Statistics
Counter
formula
3ttac* establis*ment time refers to t*e time duration from t*e
recei$t of GPS 3""3C+ #><#S" by MS to t*e delivery of
3""3C+ 3CC#P" by SGS,. If t*e attac* time e:ceeds t*e
timer1 t*e attac* duration is only com$uted 6it*in t*e attac*
acce$ted $eriod.
,otes
+.) PDP co$te2t activatio$ s"ccess rate
KPI P5P conte:t activation success rate
KPI reference
value
Suggested value (&K
isk value (%K
Indicator
definition
success times of P5P conte:t activation started by MSL1&&K; attem$t
times of P5P conte:t activation started by MS
"*e attem$t times of P5P conte:t activation started by MS is t*e times
GGS, received Create P5P Conte:t eDuest from SGS,.
"*e success times of P5P conte:t activation started by MS is t*e statistic
of Create P5P Conte:t es$onse sent from GGS, to SGS, 6*en Cause
value is eDuest 3cce$ted.
Indicatory ty$e "est or statistics
Counter
formula
Statistics at GGS, side
,otes "*e $erformance evaluation in C*ina Mobile in '&&4 ?success times of
P5P conte:t activation started by GPS terminal; attem$t times of P5P
conte:t activation started by GPS@ results are as follo6s:
#:cellency inde:: 79K
eac*)t*e)mark inde:: 7&K
=o6est "*res*old inde:: (%K
+.+ Ro"ti$' Area 0*date S"ccess rate
KPI outing 3rea <$date Success rate
KPI reference
value
Suggested value 7'K
isk value 7%K
Indicator
definition
outing u$date attem$t timesL1&&K; routing u$date success times
Indicatory ty$e 2rom statistical value or 5".
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 28Total 46 pages


Secret
Counter
formula
Statistics at SGS, side1 $rovided by GPS core net6ork
,otes
<$date success rate at routing area crossing SGS, is lo6er t*an t*at at t*e SGS,
routing area.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 29Total 46 pages


Secret
, Co%%e$ts o$ KPI Cases
,.1 Pe$'s<"i 6C<o$'=i$'8 PS Test Res"lt
1 C>" scenenear cell
' #5G# Commissioned
4 Multi)timeslot ca$ability4M1
9 ,umber of P5C+ static c*annels: 4
"est state
"est
serial
2"P ty$e
2"P
si0eKbyte
5o6nload
s$eed
?Kbyte;s@
5o6nload
s$eed ?kb$s@
3verage timeslot
s$eedkb$s
Pre)o$timi0ation 1 5o6nload 1&'.4(1 (.77 -1.74 '4.7(
Pre)o$timi0ation ' 5o6nload 9(.1( (.1& 89.(& '1.8&
Pre)o$timi0ation 4 5o6nload '&9.( '.7- '4.-( -.74
Pre)o$timi0ation 9 5o6nload '1((.(1- -.'1 %-.-' 17.'9
Pre)o$timi0ation % 5o6nload 1&'.4(1 7.&% -'.9' '9.19
Pre)o$timi0ation 8 5o6nload 1&'.4(1 (.88 87.'7 '4.1&
Pre)o$timi0ation - 5o6nload %1'.4&9 1%.7- 1'-.-4 9'.%(
Pre)o$timi0ation ( 5o6nload %1'.4&9 14.49 1&8.87 4%.%8
Pre)o$timi0ation 7 5o6nload %1'.4&9 1%.(1 1'8.%1 9'.1-
Pre)o$timi0ation 1& 5o6nload %1'.4&9 1%.-9 1'%.(( 91.78
Pre)o$timi0ation 11 5o6nload %1'.4&9 19.44 119.8- 4(.''
Ping
interval
Ping
package
size byt
e
Ping timelagms Averag
e
timelag
ms
Ping
success
rate
1 2 3 9 % 8 - 8 1!
! 32 83 "3# "12
81
'
8&( %(7 %88 $"% %"1 $"1 "%% 1!!&
% 32 81" %! %81
$$

$%$
$3
3
$1" "2 812 "! $! 1!!&
2 1!! %$1 "%! "$
$%
"
$%3
"%
1
$11 $2 $!$ "88 "1 1!!&
2 %!! 83 %%
1!$
%
82
1
$$
$3
$
18 8# 8$% 8#! 8$3 1!!&
% %!! 8"2 $"! 8%$
$%
%
"$2
81
1
"! 811 $! 82% $$% 1!!&
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 30Total 46 pages
%


Secret
2 8!! % 1! 8"
8"

8#%
82
3
$81 883 8"! 8#" 8"% 1!!&
2 1!!!
11%
$
11%
8
88!
!
$
1!2
8
1
8
1!%
#
881
1!8
2
1!3
$
1!1! 1!!&
2 12!!
1!$
8
8#! 8$
%
$
1!1
$
%

11
1
1!2
!
1!1
8
1!#
2
1!!2 1!!&
&omments on case2
1. G*en C;I is in good condition1 t*e #5G# do6nload s$eed of current eDui$ment
can reac* above 9&kb$s.
'. "*e Ping success rate and Ping timelag can vary very muc* due to different Ping
intervals different Ping $ackage si0es and different Ping servers.
,.2 >is<o" 6H"$a$8 C<i$a .obile ED7E Test Res"lt
+est Specification
"est eDui$ment3," Pilot for #)GPS
'est p(one )*+A, -'#!.one set/
'est laptop0 memory 1!2#, (arddisk 8!+ 1P2
13"!+(z Windo4s 5P6)P2 standard 288!!bps modem rate at
11%2!!bpsmodem error control and compression 7orbiddenno
so7t4are irrelevant to t(e test3
'est met(odoutdoor static 8'P do4nload test 'est location 11
sites at 9ao:ing market in 8eng(uang county 'est time1
t(
;3!
t(
<
=une 2!!8
'est aimto test *68PR) net4ork per7ormance under static state
'est aimto do4nload 1!!!>9 document
'imeslot # static timeslots
+est 'esult
Cranc "est sites "est "est 5o6nload "est location =C =C
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 31Total 46 pages
%
1&
1%
'&


Secret
*
office
documen
t si0e
KC
electrical
level dC
m
times
average
rateKb$
s
average
rate Kb$
s
/is*ou
2eng*uang County
$refectural government
office building
Cell 1
1&&& )99 ' Gate of Prefectural government office '&1.17 1(1.4
/is*ou
2eng*uang County
$refectural government
office building
Cell '
1&&& )9& ' =obby of Ming5u +otel 17'.8 17(.7(
/is*ou
2eng*uang County
$refectural government
office building
Cell 4
1&&& )%1 ' A$$osite Ming5u +otel 17-.&7 '&8.'8
/is*ou Ald district Cell 1 1&&& )97 '
Casketball field
of /iandao$ing Primary Sc*ool
17-.-9 '&1.-7
/is*ou Ald district Cell ' 1&&& )4' '
Casketball field
of /iandao$ing Primary Sc*ool
'&-.'7 174.71
/is*ou Ald district Cell 4 1&&& )%8 '
Kindergarten
ne:t to /iandao$ing Primary Sc*ool
17(.(4 178.4(
/is*ou ainbo6 Cridge Cell 1 1&&& )94 ' A$$osite Ganmingta iver 1(%.-' 171.1
/is*ou ainbo6 Cridge Cell ' 1&&& )94 ' A$$osite Ganmingta iver 171.4- 1(1.48
/is*ou "ianTia 2eng +uang Cell 1 1&&& )49 '
SDuare in front of
"ianTia2eng+uang +otel
17-.98 1(8.%%
/is*ou "ianTia 2eng +uang Cell ' 1&&& )%7 '
SDuare in front of
"ianTia2eng+uang +otel
17-.&7 '&8.'8
/is*ou Cao>ing market Cell 1 1&&& )4( ' Gate of =inlinlou 5rug Store '&-.(% 17(.&'
/is*ou Cao>ing market Cell ' 1&&& )48 ' Gate of =inlinlou 5rug Store 18'.18 1(%.49
/is*ou Cao>ing market Cell 4 1&&& )98 ' Gate of =inlinlou 5rug Store 1(&.%1 1(&.&7
/is*ou Tin*ua Cookstore Cell 1 1&&& )%& ' =obby of Tin*ua +otel 17%.(1 171.%
/is*ou Tin*ua Cookstore Cell ' 1&&& )%4 ' =obby of Tin*ua +otel 17(.&' 1((.4(
/is*ou Tin*ua Cookstore Cell 4 1&&& )9% ' Parking lot of Tin*ua +otel 1(4.&( 17&.18
/is*ou
Com$re*ensive Cuilding Cell
1
1&&& )4- ' =ane1 6est to C*inaMobile business *all 1-(.78 1%-.99
/is*ou
Com$re*ensive Cuilding Cell
'
1&&& )9% ' Gate of TingGuang +otel 1(%.98 1(-.7(
/is*ou
Com$re*ensive Cuilding Cell
'
1&&& )8& ' Gate of TingGuang +otel 1(9.&- 1(9.9%
/is*ou
Com$re*ensive Cuilding
Cell 1(&&M1
1&&& )%& ' Gate of TingGuang +otel 174.7( 1(9.%1
/is*ou
Com$re*ensive Cuilding
Cell 1(&&M'
1&&& )8' ' Gate of TingGuang +otel 1-8.'' 1(%.'1
/is*ou "elecom Cureau Cell 1 1&&& )%1 ' Cusiness +all of "elecom Cureau 1(&.-% 17-.((
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 32Total 46 pages


Secret
/is*ou "elecom Cureau Cell ' 1&&& )89 ' Cusiness +all of "elecom Cureau 1-1.(% 177.17
/is*ou "elecom Cureau Cell 4 1&&& )%- '
Cackdoor of Su$ermarket ?ne:t to "elecom
Cureau@
1('.- 1-7.97
/is*ou "elecom Cureau Cell 1(&&M1 1&&& )%7 ' Gate of furniture store ?ne:t to "elecom Cureau@ 1&%.99 1&8.9(
/is*ou "elecom Cureau Cell 1(&&M' 1&&& )-4 ' Cusiness +all of "elecom Cureau 1(1.(% 1(%.(%
/is*ou "elecom Cureau Cell 1(&&M4 1&&& )(9 ' Cusiness +all of "elecom Cureau 1%7.'& 188.7'
&omments on case2
1. G*en C;I is in good condition1 t*e average #5G# do6nload s$eed can reac*
above 1(&kb$s 6it* a $eak value of above '&&kb$sF
'. "*is test is t*e C>". Cell reselection and 3C rene6al can be neglected1 t*at is
t*ey are not necessary to t*e test conditions.
,.! Acce*ta$ce re="ire%e$ts /or ED7E KPI o/ Data Service o/ a
$etwor&
Serial Indicators #:$lanation 2ormula "arget
1 +PR)?*+PR)
attac(
success rate
+PR)?*+PR) 3ttac* success
means t*at t*e mobile $*one
receives t*e 3ttac* 3cce$t
signaling 1% seconds after it sends
t*e 3ttac* eDuest.
+PR)?*+PR) attac(
success rate +PR) Attac(
success times?attac(
attempt times@1!!
R7%K
' Average
attac( time
Attac( time means t(e
duration 7rom t(e mobile
sends out Attac( Re:uest
until it receives +PR) attac(
accept signaling3
Average attac( timesum o7
attac( success duration
?attac( success times
N4s
4 PDP
activation
success rate
P5P activation success means t*at
t*e mobile $*one receives t*e
3ctivate P5P conte:t 3cce$t
signaling 1% seconds after it sends
t*e 3ctivate P5P Conte:t eDuest.
PDP activation success
ratePDP activation success
times?attempt times@1!!
R7%K
9 PDP average
activation
time
PDP average activation time
means t(e duration 7rom
t(e delivery o7 Activate PDP
1onteAt Re:uest to t(e
receipt o7 Activate PDP
1onteAt Accept by t(e
mobile p(one3
PDP average activation time
sum o7 PDP activation
success duration?PDP
activation success times
N4s
% WAP 4ebsite
log6in
success rate
WAP 4ebsite log6in success
means t(at t(e (omepage
7ully and correctly displays
4it(in "!seconds a7ter t(e
WAP 4ebsite log6in
success rate WAP 4ebsite
log6in success times?
4ebsite log6in attempt
R7%K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 33Total 46 pages
%


Secret
mobile p(one started t(e
WAP 4ebsite log6in re:uest3
times@1!!
8 average WAP
(omepage
displaying
time
WAP (omepage displaying
time re7ers to t(e duration
7rom t(e WAP 4ebsite log6in
re:uest is sent out until t(e
(omepage 7ully and
correctly displays3
average WAP (omepage
displaying time sum o7
success7ul (omepage
displaying duration ? WAP
(omepage displaying
success times
N1!s
- WAP
4ebpage
re7res(
success rate
WAP 4ebpage re7res(
success means t(at t(e
selected 4ebpage can be
re7res(ed 4it(in "!seconds3
WAP 4ebpage re7res(
success rateWAP 4ebpage
re7res( success times ?
4ebpage re7res( attempt
times@1!!
R7%K
( Ping success
rate
Ping success rate ping
success times?ping attempt
times@1!!
R7%K
7 Ping average
timelag
Ping average timelag sum
o7 eac( Ping success
duration?ping success times
N2s
1& 8'P
do4nload
speed
8'P do4nload speedactual
do4nload data
:uantity 9yte ?actual
do4nload time.sec/@
R8!kbp
s
11 8'P upload
speed
8'P upload speed actual
upload data
:uantity 9yte ?actual
upload time.sec/ @
R2!kbp
s
&omments on case2
1. eDuirements of o$eration and maintenance KPI are not as strict as t*ose of
acce$tance c*eck KPI.
'. <sually t*ese KPI reDuirements can be satisfied.
,.( O*eratio$ 9 .ai$te$a$ce KPI o/ a Networ&
S, Indicator <nit "arget =evel Permissible
=evel
emark
1 S5CC+ 5ro$
atio
K 1 1.' Case on system $erformance re$ort of
AMC1 Indication 5efinition: S5CC+
5ro$ atioSS5CC+ call dro$s; 3ccess
attem$t ,umber
' "C+ 5ro$
atio
K ' '.' Case on system $erformance re$ort of
AMC1 Indication 5efinition: "C+ 5ro$
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 34Total 46 pages
%


Secret
atio S "C+ call dro$s; Sei0ed "C+s
?include *andover @
4 Call Success
atio
K 7( 7- Case on system $erformance re$ort of
AMC1 Indication 5efinition: Call Success
ate S 1"C+ assignment failure rate
9 S5CC+
Clocking atio
K &.% &.-% Case on system $erformance re$ort of
AMC1 Indication 5efinition: S5CC+
Clocking atioSS5CC+ overflo6s;
S5CC+ call attem$ts
% "C+
Clocking atio
K ' '.% Case on system $erformance re$ort of
AMC1 Indication 5efinition: "C+
Clocking atioS"C+ overflo6s ?include
*andover@; "C+ call attem$ts ?include
*andover@
8 "C+
3ssignment
Success atio
K 7( 7- Case on system $erformance re$ort of
AMC1 Indication 5efinition: "C+
assignment Success atioS,umber of "C+
assignment successful ; ,umber of "C+
call attem$ts ?include *andover@
- GPS average
5= t*roug*out
$er "C2
Kb$
s
'( '% '9)+our measurement
( #5G# average
5= t*roug*out
$er "C2
Kb$
s
9% 9& '9)+our measurement
7 3ttac*
Success ate
?GPS; #5G#@
K 77 7- '9)+our measurement
1& +andover
Success atio
K 79 74
11 Call Clocking
atio
K N ' for
7(K of all
GSM cells
N ' for
7&K of all
GSM cells
Cased on AMC) statistics
1' Call Setu$
Success ate
?5rive "est@
K 7- 7& 5e$end on t*e 5" route and met*od
14 Call 5ro$
ate ?5rive
"est@
K ' 4 5e$end on t*e 5" route and met*od
19 S$eec*
>uality ?5rive
"est@
MAS RS 4 for
7%K of
measurement
sam$les
RS 4 for
7&K of
measurement
sam$les
5e$end on t*e 5" route and met*od
1% Coverage
?5rive "est@
dCm RS )(% for
7%K of
RS )(% for
7&K of
5e$end on t*e 5" route and met*od
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 35Total 46 pages


Secret
measurement
sam$les
measurement
sam$les
18 <=
"*roug*$ut
Kb$s R1& R1& Cased on 5"
1- 5=
"*roug*$ut
Kb$s R4& R4& Cased on 5"
1( CSC;,C
do6n time
?unsc*eduled@
K R77.777
?N 8 sec@
R77.777
?N 8 sec@
$er CSC;,C ; 6eek
17 "T;c*annel
element failure
?unsc*eduled@
K N 1 of all
active "T
N ' of all
active "T
$er CSC;,C ; 6eek
'& S5CC+
Mean +olding
"ime
s N ' N 4 $er CSC;,C ; C+ of a 6eek
'1 adio 3ccess
Success atio
K R77.% R77 $er CSC;,C ; C+ of a 6eek
'' Gorst Cells
GAS
=ess t*an
1.%K cells of
,et6ork 6it*
GAS %K or
above
=ess t*an
1.%K cells of
,et6ork 6it*
GAS %K or
above
$er CSC;,C ; C+ of a 6eek
'4 T><3= & to 4 K R7- R7% $er CSC;,C ; C+ of a 6eek
'9 3M voice
2#
K N 1 N1 $er CSC;,C ; C+ of a 6eek
&omments on case2
1. "*is KPI com$rises statistical KPI testing KPI and eDui$ment $erformance KPI1 6*ic*
features detailed classification and all)round evaluationF
'. eDuirements for KPIs like GPS average 5= t*roug*out $er "C2 and #5G# average
5= t*roug*out $er "C2 are *ig*er.
4. eDuirements for evaluation of CS voice Duality are *ig*er.
,.) O*eratio$ 9 .ai$te$a$ce KPI o/ a $etwor& i$ So"t<east Asia
3o) 4PI
Measre0en
t
5evel 0 5evel 1 5evel 2
Scope an!
"nterval
1
( o1
ot!oor
area 6"t7
28 s"gnal
level 9
:104 !;0
pre:!e1"ne!
/r"ve test
rote
990( 997( 999(
per c"t< ,
0ont7l<
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 36Total 46 pages
%


Secret
2
.all Setp
Sccess
$ate
(e=cl!e
>loc?"ng'
pre:!e1"ne!
locat"ons an!
/r"ve test
rote,3MS
95( 998( 999(
per c"t< , ;& o1
a 6ee? (!r"ve
test 0ont7l<'
3
Paging
Success
ate
,MS R7&K R7%K R7-K
$er city ; C+ of
6eek.
Git* condition
t*at Core
,et6ork is
ac*ived t*e same
value of =evel 1
and =evel '
4
.all
>loc?"ng
rate
pre:!e1"ne!
locat"ons an!
/r"ve test
rote,3MS
@0)5( @0)5( @1(
per c"t< , ;& o1
a 6ee? (!r"ve
test 0ont7l<'
5
/rop .all
$ate
(e=cl!"ng
"nter $AT'
Pre /e1"ne!
/r"ve Test
$ote,3MS
8SMA @3(
8SMA
@2(
8SMA @1(
per c"t< , ;& o1
a 6ee? (!r"ve
test 0ont7l<'
6
+andover
Success
ate
Pre 5efined
5rive "est
oute or ,MS
R7&K R7-K R7-K
$er city ; C+ of a
6eek ?drive test
mont*ly@1$er city
; C+ of 6eek.
Git* condition
t*at Core
,et6ork is
ac*ived t*e same
value of =evel 1
and =evel '
9
S>I
?"#MS@
Pre 5efined
5rive "est
oute
R'&?7%K@ R '%?7%K@ R '%?7%K@
3verage value
$er city ; C+ of a
6eek
10
.all setp
!ela<
(PST3 to
MSB t"0e
1ro0
n0>er
!"ale! to
r"ng'
Pre /e1"ne!
/r"ve Test
$ote
@6s @ 6s @6s
per Me!"a
8ate6a<,
0ont7l<
11
.all setp
!ela< (MS
to PST3B
t"0e 1ro0
sen!
presse! to
r"ng'
Pre /e1"ne!
/r"ve Test
$ote
@5s @ 5s @5s
per Me!"a
8ate6a<,
0ont7l<
12
Call Setu$
Successful
ate
,MS R7%K R7(K R77K
$er CSC;,C ;
C+ of a 6eek
13
S/..&
Access
Sccess
3MS 999( 999( 999)5(
per ;S.,$3. ,
;& o1 a 6ee?
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 37Total 46 pages


Secret
15
S/..&
;loc?"ng
$ate
Pre /e1"ne!
/r"ve Test
$ote,3MS
@0)5( @0)5( @1(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
16
T.&
;loc?"ng
$ate
Pre /e1"ne!
/r"ve Test
$ote,3MS
@0)5( @0)5( @1(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
18
/rop .all
$ate
Pre /e1"ne!
/r"ve Test
$ote,3MS
@5( @2( @1)5(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
19
+andover
Success
ate
Pre 5efined
5rive "est
oute;,MS
Inter CSS: R7'K :
Inter Cell: R7'K
Inter CSS:
R7-K :
Inter Cell:
R7-K
Inter CSS: R7-K :
Inter Cell: R7-K
$er CSC;,C ;
C+ of a 6eek
?drive test
mont*ly@
Git* condition
t*at Core
,et6ork is
ac*ived t*e same
value of =evel 1
and =evel '
20
$C-DA5 0
to 3
Pre /e1"ne!
/r"ve Test
$ote,3MS
980( 985( 990(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
21
AM$ vo"ce
#*$
Pre /e1"ne!
/r"ve Test
$ote,3MS
@1( @1( @ 1(E
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
23
Sccess1l
PS
Attac70en
t
3MS 998( 998( 998(
per c"t< , ;& o1
a 6ee?
24
Sccess1l
P/P
conte=t
act"vat"on
3MS 998( 998( 998(
per c"t< , ;& o1
a 6ee?
25
/ata
sess"on
Setp
Sccess
$ate (P/P
conte=t
alrea!<
e="st'
Pre /e1"ne!
/r"ve Test
$ote,3MS
995( 998( 998(
per c"t< , ;& o1
a 6ee?
26
Mov"ng
MS #TP
!o6nloa!
1M; 1"le
Pre /e1"ne!
/r"ve test
rote
8P$S930?>ps
8P$S
(.lass 4
MS'A
9304>
8P$S (.lass 4
MS'A9 304>ps
per c"t< , ;& o1
a 0ont7
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 38Total 46 pages


Secret
27
Mov"ng
MS #TP
ploa!
1M; 1"le
Pre /e1"ne!
/r"ve test
rote
8P$S98?>ps
8P$S
(.lass 4
MS'A 9
94>psE
8P$S (.lass 4
MS'A 9 94>psE
per c"t< , ;& o1
a 0ont7
28
Stationary
MS near
site1 2"P
do6nload
1MC file
Pre)defined
locations
GPS ?Class 9
MS@: R 9& Kb$s
GPS
?Class 9
MS@: R 9&
Kb$s
GPS ?Class 9 MS@:
R 9& Kb$s
$er city ; C+ of a
mont*
29
Stat"onar<
8P$S MS
"n cell
>or!erB
#TP
!o6nloa!
1M; 1"le
Pre:!e1"ne!
locat"ons
GPS ?Class 9
MS@: R '& Kb$s
8P$S
(.lass 4
MS'A 9 20
4>psE
8P$S (.lass 4
MS'A 9 20 4>psE
per c"t< , ;& o1
a 0ont7
30
Stat"onar<
DMTS MS
"n cell
>or!er
(S&O'B
#TP
!o6nloa!
1M; 1"le
Pre:!e1"ne!
locat"ons
3,A
9 150
4>ps
9 150 4>ps
per c"t< , ;& o1
a 0ont7
31
P/T.&
>loc?"ng
rate
3MS @0)5( @0)5( @1(E
per ;S. , ;&
o1 a 6ee?
32
60 secon!
!ata
trans1er
!rop $ate
(MS
0ov"ng'
Pre /e1"ne!
/r"ve Test
$ote
@3( @2( @1)5(
per c"t< , ;& o1
a 6ee?
33
$ot"ng
Area
Dp!ate
Sccess1l
rate
3MS 9 95( 9 95( 997(
per c"t< , ;& o1
6ee?
34
MS
"n"t"ate!
serv"ce
setp t"0e
Pre /e1"ne!
/r"ve Test
$ote
@5s @5s @5s
per c"t< , ;& o1
a 6ee?
35
MS
ron!tr"p
P"ng t"0e
(20 p"ng
average!'
Pre /e1"ne!
/r"ve Test
$ote
@1 @1 @0)8s
per c"t< , ;& o1
a 6ee?
36
P/P
p!ate
sccess
rate
3MS 998( 998( 999(
per c"t< , ;& o1
a 6ee?
&omments on case2
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 39Total 46 pages


Secret
1. "*is AM KPI Eust got some of t*e indicators1 e:cluding t*e 6eig*ing of all KPIs
and ';4G intero$erate KPI1 etc.. 5ue to market factors1 t*e AM KPI of t*is
net6ork is set unreasonable1 and t*ere is risk in some of t*e KPIs.
'. "*e evaluation of t*is KPI falls into t*ree grades. "*e reDuirements for
*andover success rate and $aging success rate are very *ig*1 6*ic* are difficult
to reac*. Cut t*e attac*ed $rereDuisites can lo6er t*e risk to some e:tent.
Cesides1 t*e definition of *andover success rate varies 6it* different
manufacturers1 6*ic* 6e need to make clear 6it* customers in tec*nical
clarification.
4. "*e reDuirements for data service and voice KPI are *ig*er.
,.+ KPI re="ire%e$ts /or I$do$esia Tel&o%sel $etwor&

>PB re:ui rements
7 or B ndi nesi a 'el komsel 3 Al s
&omments on case
1. "*e evaluation scale of KPI is relatively large1 mainly dealing 6it* statistical
KPI and testing KPIF
'. It ranges from 'G to 4G net6ork. Its service includes voiceGPS and 4G data
service1 etc..
4. "*e division of KPI evaluation scenes and most KPI values are relatively
reasonable.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 40Total 46 pages
%
1&
1%