February 2012
Page 2
Page 3
RF Acceptance Process
TRANSPORT DEPENDENCIES
Frequency Re-Farming New 2G Collocation 100% Cluster Swap 2G Expansion HSPA + Activation 3G Expansion New 3G Collocation
S W A P
1 Week
4 Day
1 Week
4 Day
1 Week
4 Day
Page 4
Description
1.6GHz or better CPU speed. At least 768MB RAM and 30GB HDD. One for each team. A GPS Receiver is used to provide positioning data for the Drive Test tool. At least one per test vehicle. Each GPS receiver shall have an external antenna. Compatible with TEMS /PROBE Used for Data download and Upload (HSPA+/ HSDPA) DC power to the equipment in the RF Kit for each phone. An inverter to supply AC power to the laptop computers. TEMS Investigation V9 & Above for 2G/3G & V.13 with HSPA/LTE) capabilities Saloon or 4wd Description Software or freeware TEMS Investigation V9 & Above for 2G/3G & V.13 with HSPA/LTE) capabilities for coverage plotting purposes HT/Subcon to prepare the cell files before DT activity Software for MOS quality voice Test Description Operator must have deep knowledge of operating TEMS & post processing data Skilled driver with routing knowledge
GPS Receiver GSM/UMTS UE's Data Dongle (2G/3G with HSPA 7.2MB) AC/DC Portable Converter Drive Test Measurement Tools DT Vehicle Software Speed Test Software (DU METER) TEMS Investigation with license Dongle Mapinfo TEMS Cell Files HUAWEI PROBE Manpower TEMS Operator Driver
Others
SIM Cards (CS & PS) FTP Server Test Number GT Plots Legend
Description
Test SIM should be a P1 type TBD Any phone placed inside the Car (same network); Test Number should place Near the DT Engineer Agreed by Both Parties ( GT, NPM, HT)
Page 5
3. GENERAL DT GUIDELINES
General DT guideline to be adhere during all DT activity During Pre/Post Cluster level DT, minimum number of calls sample must be achieved but calls shall continue until DT route completed. The pre and post drive test coverage shall follow the same driven route. The pre and post drive test should be performed outside the maintenance window and on the same time period (morning on morning, afternoon on afternoon, evening on evening). The post drive test samples should be within + or - 5% of the pre drive test samples. Maximum vehicle speed (<50km/h) TEMS UEs to placed on the vehicle dashboard GPS external antenna shall be placed on the vehicle rooftop PROBE for voice quality MOS will used during Cluster Acceptance. Scanner shall be used during cluster acceptance instead of UEs Using Actix Post processing tools, Location binning should be used in the post processing of drive test log files. Naming of logfile: for Cluster ( Subcon_TeamXX_Area_clustername_Date) ; for SSV (Subcon_TeamXX_Area_sitename_Date).
Page 6
Page 7
SSV SSV
Post-Benchmark
Post-Benchmark
Page 8
5. DRIVETEST METHODOLOGY
5.1 PRE DT (CLUSTER LEVEL)
Guideline Guidelines covers both technology Shall cover all sites within swap cluster until 1 layer neighbor at adjacent cluster Test are purely mobility For 3G testing, when 3G handover to 2G, stop the car and terminate the call and data collection. Wait for the test phone perform reselect to camp to 3G again, and then that the time to start recording again. This scenario is case to case basis, particularly in areas ( in particular in rural areas) with no 3G neighbors or signal is very poor compared to 2G neighbor. Also in areas with no 3G site intended to cover the areas with DT routes.
Test Methods
UE SET-UP TECHNOLOGY TEST EQUIPMENT TEST TYPE TEST METHOD CALL DURATION(s) IDLE MODE(s) B NUMBER/ FTP SERVER SAMPLE
MS1
45 999999 NR DL-3MB
15 NR NR 10sec.
2G
MS2 MS3 MS4
UE SET-UP
B: Any phone placed inside the car 50(minimum); must (same network) complete the DT route B: Any phone placed inside the car LONG CALL (same network) NR FTP:
B NUMBER/ FTP SERVER
NR NR
SAMPLE
3G
15 NR 10sec.
B: Any phone placed inside the car (same network) B: Any phone placed inside the car (same network) FTP:
Outputs
Original log files to be surrendered to HT per site basis and Cluster Basis Sub con to provide pre DT reports to HT for approval & analysis
HUAWEI TECHNOLOGIES CO., LTD. HISILICON SEMICONDUCTOR
Page 9
5.2. SSV DT (Site Level) 5.2.1. SSV TEST-OUTDOOR SITE Guidelines Guidelines covers both technology after Swap. Drive test to be conducted immediately after swap (on the same day) to check for possible Swap Sector. When Swap sector detected; immediately informed concerned Team for swap sector rectification ( HT region In charge). Need to check the actual parameters based on as defined in SSV report requirements during and after Drive test. Need to check the Intra cell handover (clockwise & counter clockwise if applicable for road is passable) as defined in SSV report requirements. DT route should be able to have a HO attempt to the next neighboring site. DT route should be able to have a Cluster border sites have a HO attempt to the next neighboring site from the next adjacent Cluster( if applicable only). Shall cover all sector of the tested site. Test include stationary & mobility. Need to test 2G-3G idle/PS cell reselection test in 2G SSV. Applicable if theres 3G neighbor sites. Update as of September 11, 2012 Need to test 3G-2G idle/PS cell reselection test in 3G SSV if applicable. Applicable if theres 2G neighbor sites. Update as of September 11, 2012
Outputs
Original log files to be surrendered to HT per site basis on a CD/DVD disc Sub con to provide 2G & 3G SSV reports to HT for approval & analysis
Page 10
Test Method
MOBILITY TEST
UE SETUP MS1 MS2 TECHNOLOGY 2G SHORTCALL UNLOCK BCCH Purpose(s) TEST CALL EQUIPMEN TEST TYPE DURATION(s IDLE MODE(s) T ) CS CS 45 NR 15 NR B NUMBER SAMPLE
Unlock the BCCH in TEMSs UE test phone/ TEMS software to check dominant cells during In-call both for G900 & DCS1800 Mobility TEMS UEs Coverage checking , Call checking, and Handover checking both for G900 & DCS1800 Lock BCCH in TEMSs UE test phone /TEMS software of cells of the site need to to test 2G-IDLE MODE Lock BCCH TEMS UE's for coverage extend check after swap and for better swap sector checking in Mobility
B: Any phone placed inside the car (same 30(minimum) network) N/A NR
MOBILITY TEST 2G-3G idle/PS cell reselection test. Update September 11, 2012
2G
UE SET-UP MS1
PURPOSE(s) Cell Reselection test 2G-3G idle/PS. Each sector shall perform cell reselection test to its neighboring 3G site after swap.
SAMPLE(s) NR
STATIONARY TEST
TEST NO.
1 2
UE SET-UP
MS1-DL MS1-UL
FUNCTIONALITY TEST
DL FILESIZE: 3MB UL FILESIZE:1MB
TECHNOLOGY
2G 2G
TEST EQUIPMENT
TEMS UE's TEMS UE's
TEST TYPE
PS PS
SAMPLES
2(minimum) 2(minimum)
COMPLETION
Screenshot after 1 minute DL Screenshot after 1 minute UL
For Data Testing DL & UL of data should be test with minimum of 2 samples each cell in 1 minute duration. DUMETER will be used in measuring average throughput each test. Screenshots are needed for each samples when time reaches 1 minute in DU meter stopwatch during Download and Upload.
Page 11
MOBILITY UE SETUP TECHNOLOGY 3G SHORTCALL UNLOCK Scrambling Code 3G-DEDICATED LOCK Scrambling Code Purpose(s) TEST EQUIPMEN TEST TYPE T CS
SAMPLE
MS1
MS2 MS3
3G (HSDPA)
Unlock the Scrambling Code in TEMSs UE test phone/TEMS software to check dominant cells during In-call in 3G Mobility TEMS UEs Coverage checking , Call checking, and Handover checking in 3G in Mobility Lock the Scrambling Code in TEMSs UE test phone/TEMS software of all cells of the site need to test for coverage extend check after swap and for better swap sector TEMS UE's checking HSDPA Download speed checking and measurement of the site after swap in Mobility DONGLE/TE MS UEs
30(minimum)
CS
99999 125MB
NR 10
B: FTP :
NR NR
PS
MOBILITY TEST 3G-2G idle/PS cell reselection test. Update September 11, 2012
3G
UE SET-UP MS1
PURPOSE(s) Cell Reselection test 3G-2G idle/PS. Each sector shall perform cell reselection test to its neighboring 2G site after swap.
SAMPLE(s) NR
STATIONARY TEST
TEST NO.
1 2
UE SET-UP
MS1-DL MS1-UL
FUNCTIONALITY TEST
HSDPA-125MB HSDPA-50MB
TECHNOLOGY
3G 3G
TEST EQUIPMENT
DONGLE DONGLE
TEST TYPE
PS PS
TEST METHOD
STATIONARY STATIONARY
SAMPLES
2(minimum) 2(minimum)
COMPLETION
1 min Download each samples 1 min Download each samples
Page 12
5.2.1. SSV TEST-IBS SITE TEST1. Stationary Test/ Functionality Test SSV needs to be conducted 2 points (wherever accessible) below 2 different antenna points and 1 point (wherever accessible) 10 meters from the antenna point, to verify there is no coverage or performance degradation after swap and execute all other SSV tests. Monitor the Signal Strength from all points of test. In Test no. 1, 2, & 3 Mobile Terminating (MT), any phone can used capable for receiving files or test type from Mobile Originating and located near the testing area. Test no. 4 & 5 are for Data Testing. DL & UL of data should be test with minimum of 2 samples each Test point in 1 minute duration. DUMETER will be used in measuring average throughput each test. Screenshots are needed for each samples when time reaches 1 minute in DU meter stopwatch during Download and Upload.
2G TEST
TEST NO. UE SET-UP FUNCTIONALITY TEST TEST TEST TYPE TEST METHOD EQUIPMENT SAMPLES COMPLETION TEST NO. UE SET-UP FUNCTIONALITY TEST
3G TEST
TEST TEST TYPE EQUIPMENT TEST METHOD SAMPLES COMPLETION
MS1-MO
CS
STATIONARY
Minimum of 2 100% samples Minimum of 2 100% samples Minimum of 2 100% samples Minimum of 2 samples Minimum of 2 samples
MS1-MO
CS
STATIONARY
Minimum of 2 100% samples Minimum of 2 100% samples Minimum of 2 100% samples Minimum of 2 samples Minimum of 2 samples
MS1-MO
MMS MO & MT
TEMS UE's
PS
STATIONARY
MS1-MO
MMS MO & MT
TEMS UE's
PS
STATIONARY
MS1-MO
SMS MO & MT
TEMS UE's
PS
STATIONARY
MS1-MO
SMS MO & MT
TEMS UE's
PS
STATIONARY
MS1-DL
PS
STATIONARY
MS1-DL
HSDPA -125MB
DONGLE
PS
STATIONARY
MS1-UL
TEMS UE's
PS
STATIONARY
MS1-UL
HSDPA 50MB
DONGLE
PS
STATIONARY
Page 13
Test2. WALK Test-Handover Test. For 2G & 3G TEST METHOD. Test will be used for Handover test from Indoor cell coverage to outdoor cell coverage and outdoor cell coverage to Indoor Cell coverage. All Entrance and Exit of building with IBS and Basement Car park/building Car park ( if applicable) should perform Handover Testing.
2G TEST
TEST NO UE SET-UP TECHNOLOGY TEST EQUIPMENT TEST TYPE TEST METHOD CALL IDLE DURATION(s) MODE(s) B NUMBER TEST NO UE SET-UP TECHNOLOGY TEST EQUIPMENT
3G TEST
TEST TYPE TEST METHOD CALL DURATION(s) IDLE MODE(s) B NUMBER
MS1
2G-LONG CALL
TEMS UE's
CS
MOBILITY
999999
NR
B. : Any phone number (same network) located near the Mobile Originating Phone area of test
MS1
3G-LONG CALL
TEMS UE's
CS
MOBILITY
999999
NR
B. : Any phone number (same network) located near the Mobile Originating Phone area of test
Test3. WALK Test-Cell reselection Test. For 2G & 3G TEST METHOD. PS cell reselection Test shall perform for each cells after swap to its neighboring cells/site. For 2G, test 2G-3G cell reselection and for 3G, test 3G-2G PS cell reselection.
FOR 2G. 2G-3G idle/PS cell reselection test. Update September 11, 2012
UE SETUP MS1 TECHNOLOGY Purpose(s) Cell Reselection test 2G-3G idle/PS. Each sector shall perform cell reselection test to its neighboring 3G site after swap. If applicable. TEST TEST TYPE EQUIPMENT TEMS UE's PS Cell reselection CALL DURATION(s) NR IDLE MODE(s) B NUMBER SAMPLE
2G-IDLE MODE
NR
N/A
NR
FOR 3G. 3G-2G idle/PS cell reselection test. Update September 11, 2012
UE SETUP MS1 TECHNOLOGY Purpose(s) Cell Reselection test 3G-2G idle/PS. Each sector shall perform cell reselection test to its neighboring 2G site after swap. If applicable. TEST TEST TYPE EQUIPMENT TEMS UE's PS Cell reselection CALL DURATION(s) NR IDLE MODE(s) B NUMBER SAMPLE
3G-IDLE MODE
NR
N/A
NR
Page 14
TEST METHOD. Test Signal Strength Spillage of IBS 5 meters distance from the fringe of building and/or along the nearest major street around the buildings perimeter. Signal should be limited to < -85 dBm at a 5 meter distance from the fringe of the building and/or along the nearest major street around the buildings perimeter. Note: Lock all available BCCH-2G or Scrambling Code-3G of IBS site need to test before performing the Spillage Test.
TEST NO
TEST TYPE
B NUMBER
SAMPLE
TEST NO
TEST TYPE
B NUMBER
SAMPLE
MS1
2G-LONG CALL
TEMS UE's
CS
MOBILITY
999999
NR
B. : Any phone number (same network) located near the Mobile Originating Phone area of test
NR
MS1
3G-LONG CALL
TEMS UE's
CS
MOBILITY
999999
NR
B. : Any phone number (same network) located near the Mobile Originating Phone area of test
NR
Page 15
Guideline
Guidelines covers both technology To be conducted upon 100% full cluster integration with SWAP configuration Shall cover all sites within swap cluster until 1 layer neighbor at adjacent cluster Test are purely mobility For 3G testing, when 3G handover to 2G, stop the car and terminate the call and data collection. Wait for the test phone perform reselect to camp to 3G again, and then that the time to start recording again. This scenario is case to case basis, particularly in areas ( in particular in rural areas) with no 3G neighbors or signal is very poor compared to 2G neighbor. Also in areas with no 3G site intended to cover the areas with DT routes.
Test Method
UE SET-UP TECHNOLOGY TEST EQUIPMENT TEST TYPE TEST METHOD CALL DURATION(s) IDLE MODE(s) B NUMBER/ FTP SERVER SAMPLE
2G
45 999999 NR DL-3MB
15 NR NR 10sec.
B: Any phone placed inside the car 50(minimum); must (same network) complete the DT route B: Any phone placed inside the car LONG CALL (same network) NR NR FTP: NR
UE SET-UP
TECHNOLOGY
TEST EQUIPMENT
TEST TYPE
TEST METHOD
SAMPLE
MS1
CS CALL CS CALL
MOBILITY MOBILITY
45 999999
15 NR
3G
MS2
B: Any phone placed inside the car (same network) B: Any phone placed inside the car (same network)
MS3
3G HSDPA
PS-DL
MOBILITY
DL-125M FTP
10sec.
FTP:
NR
Outputs Original log files to be surrendered to HT per site basis on a CD/DVD disc Sub con to provide 2G & 3G pre/post benchmarking report to HT for approval & analysis
HUAWEI TECHNOLOGIES CO., LTD. HISILICON SEMICONDUCTOR
Page 16
Guideline
Guidelines covers both technology To be conducted upon 100% full cluster integration + expansion (as forecast) Shall cover all sites within swap cluster until 1 layer neighbor at adjacent cluster Shall perform after the Acceptance of Site in a Cluster Test covers Mobility and Stationary Drive test call samples should be >400 calls for each technology ( case to case basis especially for cluster with small number of sites <10 sites). For Stationary, Testing covers PS download and Upload in per cell level both 2G & 3G technology ( (EDGE, R99, HSDPA, HSPA+). VOICE QUALITY MOS will perform after all DT KPI passed.
2G
MOBILITY TEST 1- LAPTOP 1
UE SETTEST CALL IDLE TECHNOLOGY TEST TYPE UP EQUIPMENT DURATION(s) MODE(s) B NUMBER/ FTP SERVER SAMPLE MOBILITY TEST 1- LAPTOP 1 UE SETTEST TECHNOLOGY TEST TYPE UP EQUIPMENT
3G
CALL DURATION(s) IDLE MODE(s) B NUMBER/ DL/UL Server SAMPLE
MS1
2GSHORTCALL
45
15
B: Any phone placed inside the car (same network) B: Any phone placed inside the car (same network) NR
MS1
3G
TEMS UEs
CS CALL
45
15
400(minimum)
MS2 2G/ 3G (DUAL MODE) TEMS UE's CS 999999 NR
B: Any phone placed inside the car (same network) B: Any phone placed inside the car (same network)
400(minimum)
NR
MS2
999999
NR
NR
MS3 3G SCANNER CS NR NR NR NR
MS3
2G
SCANNER
CS
NR
NR
NR
MS4 3G (HSDPA/HSPA) DL Dongle PS-DL DL 125MB NR FTP: ?
MS4
2G Dongle (GPRS/EDGE)
PS-DL
DL-3MB
NR
FTP:
Page 17
2G
MOBILITY 1 LAPTOP 2
B NUMBER/ DL/UL Server MOBILITY TEST 1 LAPTOP2
3G
UE SETUP
TECHNOLOGY
IDLE MODE(s)
SAMPLE
UE SET-UP TECHNOLOGY
TEST EQUIPMENT
TEST TYPE
SAMPLE
MS1
2G
TEMS UEs
SMS PING
SMS PING
SMS : A TO A
Minimum of 10 samples
MS1
2G
TEMS UEs
SMS PING
SMS PING
SMS : A TO A
Minimum of 10 samples
MS2
2G (GPRS/EDGE)
TEMS UEs
PS-UL
UL-1MB
NR
FTP:
MS2
3G (HSDPA/HSPA) UL
Dongle
PS-UL
UL 50MB
NR
FTP:
2G
MOBILITY 1 TEST3
UE SET-UP TECHNOLOGY TEST EQUIPMENT TEST TYPE SAMPLE
3G
MOBILITY 1 TEST3
UE SET-UP TECHNOLOGY TEST EQUIPMENT TEST TYPE SAMPLE
MS1
2G
PROBE
MS1
3G
PROBE
Page 18
2G
STATIONARY TEST
TEST NO. UE SET-UP TECHNOLOGY TEST EQUIPMENT TEST TYPE TEST METHOD DL/UL SERVER SAMPLE(s) STATIOANRY TEST TEST NO. UE SETUP
3G
TEST DESCRIPTION TECHNOLOGY
TEST EQUIPMENT TEST TYPE TEST METHOD DL/UL SERVER
SAMPLE(s)
MS1-DL
2G
TEMS UE's
PS
STATIONARY
FTP:
CONTINUE DOWNLOADING BIG FTP FILE MS1-DL 3G : 2.0MB HSDPA : 22.0MB HSPA+ : 38.0MB CONTINUE DOWNLOADING BIG FTP FILE MS1-UL 3G : 0.50MB HSDPA : 7.20MB HSPA+ : 11.0MB
PS
STATIONARY
FTP:
MS1-UL
2G
TEMS UE's
PS
STATIONARY
FTP:
PS
STATIONARY
FTP:
Outputs Original log files to be surrendered to HT per site basis on a CD/DVD disc Sub con to provide 2G & 3G cluster acceptance report to HT for approval & analysis
Page 19
DT SUMMARY TOOLS
Page 20
2G DL THROUGHPUT Kbps 2G RxQual <=4 > 4 to < 5 >=5 to < 8 Below 50 >= 50 to < 70 >= 70 to < 80 >= 80 to < 90 >= 90
2G UL THROUGHPUT Kbps Below 10 >= 10 to < 24 >= 24 to < 40 >= 40 to < 45 >= 45
2. 3G LEGENDS
Signal strength Legend Signal quality Legend Download throughput Legend Upload throughput Legend
3G RSCP dbm Below -95 >= -95 to <-85 >= -85 to <-80 >= -80 to <-75 >= -75
3G DL THROUGHPUT Kbps 3G Ec/No >= -10 Below 1000 >= 1000 to < 2000 >= 2000 to < 3300 >= 3300 to < 4000 >= 4000
3G UL THROUGHPUT Kbps Below 500 >= 500 to < 1000 >= 1000 to < 1200 >= 1200 to < 2000 >= 2000
Page 21
FILESIZE TO DL/UL 0.70 MB 0.35 MB 2.0 MB 0.50 MB 22.0 MB 7.20 MB 38.0 MB 11.0 MB
2G DL
3.0 MB
2G UL
3G DL 3G UL
1.0 MB
125.0 MB 50.0 MB
Set Location under Binning mode Set Projection to World Geodetic System 1984 (GPS) Set X: 005 & Y : .005
Set to Arcseconds
Page 22
Thank you
www.huawei.com
Copyright2011 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.