Security Level: Internal

Speech Quality and MOS

Alex
www.huawei.com

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Agenda

Introduction
Measurement
Evaluation
Optimization

MOS- Subjective Evaluation Way

MOS test is normally performed on a group of listeners.

The listeners listen to the speech material in the same
channel environment and give a score. The scores are
then averaged to obtain the MOS score. The scores vary
largely from listener to listener.

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 3

MOS- Objective Evaluation Way

Objective way compares an original signal with a degraded signal and then
outputs a MOS score. The MOS score is like the result of a subjective
listening test.

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 4

PESQ(P.862)

PESQ value is from

-0.5 to 4.5
PESQ algorithm is
powerful enough to
test end-to-end
speech quality.

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 5

MOS-LQO(P.862.1)

MOS-LQO (Listening
Quality Objective)
value is from 1.02 to
4.56

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 6

PESQ-LQ Mapping

This mapping is not

adopted by ITU-T

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 7

Agenda

Introduction
Measurement
Evaluation
Optimization

Measurement Nemo (MS to MS)

Nemo Audio Module:
Sending Reference
Sample

MOS
Score

Nemo Audio
Module : Receiving
Impaired Sample

HUAWEI TECHNOLOGIES Co., Ltd.

HUAWEI Confidential

Page 9

Measurement QVoice (MS to PSTN)

QVM-MOS
Measurement

QVP-Data Analysis

HUAWEI TECHNOLOGIES Co., Ltd.

HUAWEI Confidential

Page 10

MS to PSTN Way
Reference Sample

MS

BTS

Impaired Sample

Impaired Sample

Uplink MOS

BSC

MSC

Reference Sample

Downlink MOS

UL MOS score and DL MOS score is available.

The configuration of Testing System is more complicated
Required less MS when performing Benchmark

HUAWEI TECHNOLOGIES Co., Ltd.

HUAWEI Confidential

PSTN

Page 11

MS to MS Way
Reference
Sample

MS1

Uplink

BTS

BSC
MSC

MS2
Impaired
Sample

BTS

BSC
Downlink

UL MOS score and DL MOS score is not available

MOS test by MS to MS way is more sensitive for Um interface
Using Local switch or TFO can improve MOS (MS to MS way)

HUAWEI TECHNOLOGIES Co., Ltd.

HUAWEI Confidential

Page 12

Agenda

Introduction
Measurement
Evaluation
Optimization

Common Report
MOS
=Average[MOS(all samples)]

service
performance report.rar

Results.log

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 14

QVoice Report
DL MOS = MOS_FR FR% + MOS_HR HR% + MOS_EFR EFR% +
MOS_AFR AFR% + MOS_AHR AHR%
UL MOS = MOS_FR FR% + MOS_HR HR% + MOS_EFR EFR% +
MOS_AFR AFR% + MOS_AHR AHR%
MOS = (DL_MOS + UL_MOS) / 2

Basic
Report:
44
codectypeusage.RAR

Advanced
Report:
43-AMR.RAR

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 15

Agenda

Introduction
Measurement
Evaluation
Optimization

Factors of MOS
Test Method (Equipment, Testing mode,Speech Sample)
RF
RF performance
performance
RxLev,
RxLev, RxQual,
RxQual, C/I,
C/I, HO,)
HO,)
BSS Features (Codec DTX, TFO, PC)
Transmission
Transmission (Speech
(Speech route
route
Tran.
Tran. quality)
quality)

Factors of
MOS

Hardware BTS/FTC version Fault

Others FR/HR percentage

Consider comprehensively when analyzing MOS

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page1717

Test Method
Equipment

Different equipment has different standard (PESQ is preferred)

Do not compare MOS value from different type of equipment.

Testing Mode

MS to MS

MS to PSTN

Speech Sample

Speech Sample should be the same for any compare.

English Speech Sample is preferred

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page1818

Um interface(1)
SQI (Downlink Um)

Note SQI is not equal to MOS. SQI is just a factor that can affect MOS

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page1919

Um Interface(2)
Improve SQI

Uplink Um Quality
Can be evaluated by single user tracing or STS, normally Uplink Um interface should
be a bit better than downlink Um interface. If not, be aware of Uplink interference,
Uplink DTX, link balance.
HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page2020

Features(1)
Feature
Speech Version

Recommend
Active AMR,
EFR

Effect on MOS
The descending speech quality of 5 types of Speech
Version in GSM is as following:
AMR FR >= EFR > AMR HR >= FR > HR
Active AMR and EFR will improve MOS remarkably.
DTX will introduce clipping which is bad for MOS.
However, DTX can decrease interference which is good
for Um interface.

UL or DL DTX

UL and DL PC

Open

Power Control will decrease network interference.

Hopping

Open

Caused by frequency diversity and interference

equalization, FH is helpful for enhancing speech quality.

Open

TFO can cut one encoding and decoding off a

conversation , which is helpful for enhancing MOS in MS
to MS way.

Open

Allowing speech signal to bypass MSC and BSC, which

also can cut one encoding and decoding time.
However, if TFO is activated, local switch can only save
transmission resources.

TFO

Local Switch

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page2121

Feature(2)-Codec

AMR FR >= EFR > AMR HR >= FR > HR

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page 22

Transmission(1)
Speech Signal Route
Evaluate how many times for encoding and decoding. There will be 0.2 MOS loss for one
more encoding and decoding.
MS to PSTN
Speech Signal Route MS- BTS-BSC-MSC-GMSC-PSTN

Be aware of transmission between MSC and GMSC:

If using IP transmission, NSS part will introduce one time encoding and decoding.
If using TDM transmission, no MOS loss

While performing MOS benchmark, if MS to PSTN test way is adopted, you

should consider the transmission differences between MSC and GMSC.
For example If networks all use AMR codec, the maximum MOS value in
network with IP backbone is 3.8 to 3.9, and maximum MOS value in network with
TDM can be 4.0-4.2.
HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page2323

Transmission(2)
Speech Signal Route
MS to MS
Speech route MS-BTS-BSC-MSC-BSC-BTS-MSC
The speech will experience 2 times encoding and decoding.
But if TFO is adopted in the network, only one time encoding and decoding,
which can provide 0.2 MOS increase.
No TFO, 2 times
encoding and
decoding
TFO, 1time encoding
and decoding

Transmission Quality
Speech quality is also strongly related to transmission quality, especially for microwave
or satellite transmission type, which are more easily affected by weather (raining,
snowing) and cause MOS degrading.
HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page2424

Hardware
For BSS part, BTS and TC can affect the speech quality.
Select the recommended software version.

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page2525

Others

FR/HR traffic distribution

Suppose score for AMR FR and AMR HR will not change, if the percentage of AFR
raise from 65% to 80%.....

MOS (3.3) = 3.5(AMR FR)* 65% + 3.0(AMR HR) * 35%

MOS (3.4) = 3.5(AMR FR)* 80% + 3.0(AMR HR) * 20%

Vehicle Speed

HUAWEI TECHNOLOGIES CO., LTD.

Huawei Confidential

Page
Page2626

Thank you
www.huawei.com