Table of Contents
C-RAN............................................................................................................................................... i
The Road Towards Green RAN ..................................................................................................... i
1 Introduction ............................................................................................................................ 3
1.1 Background ......................................................................................................................... 3
1.2 Vision of C-RAN .................................................................................................................. 4
1.3 Objectives of this White Paper ....................................................................................... 4
1.4 Status of this White Paper ............................................................................................... 5
2 Challenges of Todays RAN ............................................................................................... 6
2.1 Large Number of BS and Associated High Power Consumption .............................. 6
2.2 Rapid Increasing CAPEX/OPEX of RAN.......................................................................... 7
2.3 Interference in LTE networks .......................................................................................... 9
2.3 Explosive Network Capacity Need with Falling ARPUs............................................. 13
2.4 Dynamic mobile network load and low BS utilization rate ..................................... 14
2.5 Growing Internet Service Pressure on Operators Core Network.......................... 14
3 Architecture of C-RAN ....................................................................................................... 16
3.1 Advantages of C-RAN ..................................................................................................... 18
3.2 Technical Challenges of C-RAN ..................................................................................... 20
4 C-RAN deployment scenarios ........................................................................................ 23
4.1 TD-SCDMA C-RAN deployment ..................................................................................... 23
4.2 TD-LTE C-RAN deployment ........................................................................................... 26
5 Technology Trends and Feasibility Analysis ...................................................................... 30
5.1 Wireless Signal Transmission on Optical Network.................................................... 30
5.2 Dynamic Radio Resource Allocation and Cooperative Transmission/Reception . 39
5.3 Large Scale Baseband Pool and Its Interconnection ........................................................... 42
5.4 Open Platform Based Base Station Virtualization ................................................................ 43
5.5 Distributed Service Network ................................................................................................. 47
6 Recent Progress .................................................................................................................. 49
6.1 C-RAN Field Trials ............................................................................................................... 49
6.1.1 TD-SCDMA and GSM Field Trial ................................................................................ 49
6.1.2 TD-LTE C-RAN Field Trial ........................................................................................... 55
6.2 Cooperative radio technologies under C-RAN ........................................................... 57
6.3 PoC development on C-RAN BBU pooling .................................................................. 60
6.4 Progress on C-RAN virtualization ................................................................................. 69
6.5 Edge Applications on C-RAN ......................................................................................... 74
i
7 Evolution Path....................................................................................................................... 78
8 Global landscape of C-RAN activities .......................................................................... 81
9 Conclusions ........................................................................................................................... 82
Acknowledgements ............................................................................................................... 84
Terms and Definitions .......................................................................................................... 85
References................................................................................................................................. 88
ii
1 Introduction
1.1 Background
Todays mobile operators are facing a strong competition environment. The cost to build,
operate and upgrade the Radio Access Network (RAN) is becoming more and more expensive
while the revenue is not growing at the same rate. The mobile internet traffic is surging, while
the ARPU is flat or even decreasing slowly, which impacts the ability to build out the networks
and offer services in a timely fashion.. To maintain profitability and growth, mobile operators
must find solutions to reduce cost as well as to provide better services to the customers.
On the other hand, the proliferation of mobile broadband internet also presents a unique
opportunity for developing an evolved network architecture that will enable new applications
and services, and become more energy efficient.
The RAN is the most important asset for mobile operators to provide high data rate, high
quality, and 24x7 services to mobile users. Traditional RAN architecture has the following
characteristics: first, each Base Station (BS) only connects to a fixed number of sector
antennas that cover a small area and only handle transmission/reception signals in its coverage
area; second, the system capacity is limited by interference, making it difficult to improve
spectrum capacity; and last but not least, BSs are built on proprietary platforms as a vertical
solution. These characteristics have resulted in many challenges. For example, the large
number of BSs requires corresponding initial investment, site support, site rental and
management support. Building more BS sites means increasing CAPEX and OPEX. Usually, BSs
utilization rate is low because the average network load is usually far lower than that in peak
load; while the BS processing power cant be shared with other BSs. Isolated BSs prove costly
and difficult to improve spectrum capacity. Lastly, a proprietary platform means mobile
operators must manage multiple none-compatible platforms if service providers want to
purchase systems from multiple vendors. Causing operators to have more complex and costly
plan for network expansion and upgrading. To meet the fast increasing data services, mobile
operators need to upgrade their network frequently and operate multiple-standard network,
including GSM, WCDMA/TD-SCDMA and LTE. However, the proprietary platform means mobile
operators lack the flexibility in network upgrade, or the ability to add services beyond simple
upgrades.
In summary, traditional RAN will become far too expensive for mobile operators to keep
competitive in the future mobile internet world. It lacks the efficiency to support sophisticated
centralized interference management required by future heterogeneous networks, the flexibility
to migrate services to network edge for innovative applications and the ability to generate new
revenue from revenue from new services. Mobile operators are faced with the challenge of
architecting radio network that enable flexibility. In the following sections, we will explore ways
to address these challenges.
Centralized base-band pool processing, Co-operative radio with distributed antenna equipped
by Remote Ratio Head (RRH) and real-time Cloud infrastructures RAN (C-RAN) can address the
challenges the operators are faced with and meet the requirements. Centralized signal
processing greatly reduces the number of sites equipment room needed to cover the same
areas; Co-operative radio with distributed antenna equipped by Remote Radio Head (RRH)
provides higher spectrum efficiency; real-time Cloud infrastructure based on open platform and
BS virtualization enables processing aggregation and dynamic allocation, reducing the power
consumption and increasing the infrastructure utilization rate. These novel technologies provide
an innovative approach to enabling the operators to not only meet the requirements but
advance the network to provide coverage, new services, and lower support costs.
C-RAN is not a replacement for 3G/B3G standards, only an alternative approach to current
delivery. From a long term perspective, C-RAN provides low cost and high performance green
network architecture to operators. In turn operators are able to deliver rich wireless services in
a cost-effective manner for all concerned.
C-RAN is not the only RAN deployment solution that will replace all todays macro cell station,
micro cell station, pico cell station, indoor coverage system, and repeaters. Different
deployment solutions have their respective advantages and disadvantages and are suitable for
particular deployment scenarios. C-RAN is targeting to be applicable to most typical RAN
deployment scenarios, like macro cell, micro cell, pico cell and indoor coverage. In addition,
other RAN deployment solution can serve as complementary deployment of C-RAN for certain
case.
Transmission,
15%
Other Support
Equipment,
3%
Management
office, 7%
Channel, 6%
Air
Conditioners,
46%
Major
Equipment,
51%
The TCO including the CAPEX and the OPEX results from the network construction and
operation. The CAPEX is mainly associated with network infrastructure build, while OPEX is
mainly associated with network operation and management.
In general, up to 80% CAPEX of a mobile operator is spent on the RAN. This means that most
of the CAPEX is related to building up cell sites for the RAN. The historical CAPEX expenditure of
2007-2012 forest are shown in Fig.2-2. Because 3G/B3G signals deployed frequency 2GHz
have higher path loss and penetration loss than 2G signals (deployed frequency 900MHz),
multiple cell sites are needed for the similar level of 2G coverage. Thus, the dramatic increase
was found in the CAPEX when building a 3G network.
The CAPEX is mainly spent at the stage of cell site constructions and consists of purchase and
construction
expenditures.
Purchase
expenditures
include
the
purchases
of
BS
and
supplementary equipments, such as power and air conditioning equipments etc. Construction
expenditures include network planning, site acquisition, civil works and so on. As shown is
Fig.2-3, it is noticeable that the cost of major wireless equipments makes up only 35% of
CAPEX, while the cost of the site acquisition, civil works, and equipment installation is more
than 50% of the total cost. Essentially, this means that more than half of CAPEX is not spent on
productive wireless functionality. Therefore, ways to reduce the cost of the supplementary
equipment and the expenditure on site installation and deployment is important to lower the
CAPEX of mobile operators.
Multi-standard environment
It is understood that the large number of legacy terminals, 2G, 3G, and B3G infrastructure will
coexist for a very long time to meet consumers demand. Most of the major mobile operators
worldwide will thus have to use two or three networks (Table 1) [1]. In the new economic
climate, operators must find ways to control CAPEX and OPEX while growing their businesses.
The base station occupies the largest part of infrastructure investment in a mobile network.
Multi-mode base station is expected as a cost efficient way for operators to alleviate the cost of
network construction and O&M. In addition, sharing of hardware resources in a multi-mode
base station is the key approach to lower cost.
Vodafone
TMobile
WCDMA
One
France
Telecom
Verizon
SK
Telecom
Telstra
China
Unicom
TD-SCDMA
CDMA
EVDO
China
Mobile
&
2000
&
LTE
adjacent cells becomes unavoidable, which leads to low-throughput performance. How to avoid
and eliminate inter-cell interference becomes an important researching subject for LTE.
In the inter-cell interference tests in the trial networks, the comparison tests in terms of SINR
and single-user throughput have been done on the condition of different system loads. The
results are illustrated in Figure 2-5 and Figure 2-6. Comparing to 0% load case, the downlink
average SINR is decreased by 5.33dB and 8.28dB respectively, and the downlink throughput is
decreased by 40% and 55% respectively in case of 50% load and 100% load.
10
In LTE networks, it is very common of coverage overlapping with neighboring cells. In our test,
we defined adjacent cell as the cell which RSRP is at most 10dB less than the serving cell and
made a statistical results on the number of adjacent cells. The result is shown in Figure 2-7. It
can be seen that in high-density urban area with inter-cell distance of from 300 to 500 meters,
11
the probability for a UE to find one or more adjacent cells is as high as 71.8%. In some cases,
the UE can even find 6 adjacent cells.
Cell sectorization technology is usually used for 3 intra-site cells to set them to different
orientation. It is clear that on the cell edge, overlapping is unavoidable for coverage sake.
According to the statistics shown in figure 2-8, the probability is 30.1% for UEs to detect the
signals coming from the intra-site adjacent cells. At the same time, the probability is 1.4% for
UEs to simultaneously detect the signals coming from the intra-site 3 cells.
Fig. 2-7: The statistics of the number of adjacent cells in large-scale network
(RSRP is lower than the main cell within 10dB)
Fig. 2-8: The statistics of the number of adjacent cells loaded an eNB in large-scale network
(RSRP is lower than the main cell within 10dB)
Through the comparison tests, it can be seen that how to reduce the co-channel interference is
the major problem and challenge for large-scale LTE networks. At present, there are many
interference coordination technologies such as ICIC, CoMP etc. However the gain from those
technologies is limited under traditional distributed architecture. On the contrary, a centralized
12
C-RAN architecture can facilitate their implementation and fully exploit their gain on system
performance.
increasing bandwidth of wireless broadband triggers the increase in mobile traffic, because the
mobile users can use a variety of high-bandwidth services, such as video-based applications.
This new trend will become a serious challenge to future RAN.
Based on the forecast data [2], global mobile traffic increases 66-fold with a compound annual
growth rate (CAGR) of 131% between 2008 and 2013. The similar trend is observed in current
CMCC network. On the contrary, the peak data rate from UMTS to LTE-A only increases with a
CAGR of 55%. Clearly, as shown in Fig. 2-9, there is a large gap between the CAGR of new air
interface and the CAGR of customers need. In order to fill this gap, new infrastructure
technologies need to be developed to further improve the performance of LTE/LTE-A.
13
14
to upgrade their back-haul and core network to keep up with the growing pace. This is a huge
common challenge to all the mobile operators in the wireless industry.
The exponential growth of mobile broadband data puts pressure on operators existing packet
core elements such as SGSNs and GGSNs, increasing mobile Internet delivery cost and
challenging the flat-rate data service models. The majority of this traffic is either Internet
bound or sourced from the Internet. Catering to this exponential growth in mobile Internet
traffic by using traditional 3G deployment models, the older 3G platform is resulting in huge
CAPEX and OPEX cost while adding little benefit to the ARPU. Additional issues are the
continuous CAPEX spending on older SGSNs & GGSNs, the higher Internet distribution cost, the
congestion on backhaul and the congestion on limited shared capacity of base stations.
Therefore, offloading the Internet traffic, as close to the base stations as possible, can be an
effective way to reduce the mobile Internet delivery cost.
15
3 Architecture of C-RAN
We believe Centralized processing, Cooperative radio, Cloud, and Clean (Green) infrastructure
Radio Access Network (C-RAN) is the answer to solve the challenges mentioned above. Its a
natural evolution of the distributed BTS, which is composed of the baseband Unit (BBU) and
remote radio head (RRH). According to the different function splitting between BBU and RRH,
there are two kinds of C-RAN solutions: one is called full centralization, where baseband (i.e.
layer 1) and the layer 2, layer 3 BTS functions are located in BBU; the other is called partial
centralization, where the RRH integrates not only the radio function but also the baseband
function, while all other higher layer functions are still located in BBU. For the solution 2,
although the BBU doesnt include the baseband function, it is still called BBU for the simplicity.
The different function partition method is shown in Fig.3-1.
Antenna
Solution 2 Solution 1
GPS
Core
network
Main
Control
& Clock
Baseband
processing
BBU
Digital
IF
Transmitter
/Receiver
PA
&
LNA
RRU
16
Virtual BS Pool
L1/L2/L3/O&M
L1/L2/L3/O&M
L1/L2/L3/O&M
Fiber
RRH
RRH
RRH
RRH
RRH
RRH
RRH
L2/L3/O&M
L2/L3/O&M
L2/L3/O&M
Fiber or
Microwave
RRH/L1
RRH/L1
RRH/L1
RRH/L1
RRH/L1
RRH/L1
RRH/L1
17
The other type of C-RAN is to centralize partial BBU functions which include collaborative
function, L2 and L3 scheduling, and wireless resource allocation. As shown in Figure 3-3, the
feature of this architecture is small centralization with partial BBU functions centralized into
one central point which is connected with the remained remote BBU via dark fiber or PTN
networks. With such architecture, the central point can schedule the wireless resource in each
cell on a global level and even realize the joint transmission or joint reception on PHY layer to
improve cell edge performance. The data bandwidth between the central point and remote sites
is small, which minimizes the change on existing transport networks. The major disadvantage
of this architecture is that it still requires remote equipment rooms. One-body type base station
is not preferred from the perspective of system management and future upgrade. In addition,
the delay on information exchange can have an impact on the system performance
improvement.
With either one of these C-RAN architectures, mobile operators can quickly deploy and make
upgrades to their network. The operator only needs to install new RRHs and connect them to
the BBU pool to expand the network coverage or split the cell to improve capacity. If the
network load grows, the operator only needs to upgrade the BBU pools HW to accommodate
the increased processing capacity. Moreover, the fully centralized solution, in combination with
open platform and general purpose processors, will provide an easy way to develop and deploy
software defined radio (SDR) which enables upgrading of air interface standards by software
only, and makes it easier to upgrade RAN and support multi-standard operation.
Different from traditional distributed BS architecture, C-RAN breaks up the static relationship
between RRHs and BBUs. Each RRH does not belong to any specific physical BBU. The radio
signals from /to a particular RRH can be processed by a virtual BS, which is part of the
processing capacity allocated from the physical BBU pool by the real-time virtualization
technology. The adoption of virtualization technology will maximize the flexibility in the C-RAN
system.
Both solutions described above are under development and evaluation. They could be properly
deployed in different networks depending on the situation of the network. The following
discussion will focus on the Fully Centralized Solution.
18
Smaller cells with lower transmission power can be deployed while the network coverage
quality is not affected. The energy used for signal transmission will be reduced, which is
especially helpful for the reduction of power consumption in the RAN and extend the UE
battery stand-by time. Lastly, because the BBU pool is a shared resource among a large
number of virtual BS, it means a much higher utilization rate of processing resources and
lower power consumption can be achieved. When a virtual BS is idle at night and most of
the processing power is not needed, they can be selectively turned off (or be taken to a
lower power state) without affecting the 7x24 service commitment.
Capacity Improvement
In C-RAN, virtual BSs can work together in a large physical BBU pool and they can easily
share the signaling, traffic data and channel state information (CSI) of active UEs in the
system. It is much easier to implement joint processing & scheduling to mitigate inter-cell
interference (ICI) and improve spectral efficiency. For example, cooperative multi-point
processing technology (CoMP in LTE-Advanced), can easily be implemented under the CRAN infrastructure.
19
20
Service on Edge
Unlike service in a data center, distributing services on the edge of the RAN has its unique
challenges. In the following research framework part, we try to summarize these challenges
into the following three categories: services on the edges integration with the RAN, intelligence
of DSN, and the deployment and management of distributed service.
21
22
23
BBU
Pool
Fig. 4-1: Capacity and coverage improvement using Pico-RRU for weak-spot and hot-spots
With the increased difficulty on site acquisition and pressure on forced removal of existing
equipment rooms by proprietors, many area in high density urban cities are of weak coverage.
To address this issue, installation of BBU pool in the center equipment room and the small
RRUs will take more important roles . It is recommended that the centralization equipment
room should be owned by operators themselves to avoid impact by possible site relocation in
the future. At the same time, the so-called multi-RRU co-cell technology can be used to
improved the network quality. Generally there can be a vertical three-layer network
deployment mode: basic coverage by macro base stations, capacity and coverage supplement
by micro RRUs in the outdoor and traffic asorbion via indoor solution.
The characteristic of this scenario includes two key parts: BBU pool centralized in the existing
macro-site and 2-antennas Pico-RRU with low transmit power on the remote site. The scale of
centralized carriers is decided by area characteristics such as the traffic volumn. In addition,
the fiber from the last-mile pipeline can be utilized or it can be installed hanging over the
building.
24
BTS
BTS
BTS
Residential
area
BTS
BTS
BTS
BTS
BBU
pool
BTS
Industrial
area
BBU pool
RRU
25
26
Installation of RRU and antennas needs reconstruction on the rooftop in original sites, which
instead, makes the civil work more difficult. As the result, in the predictable future, there will
appear large area of blind or weak coverage in the urban cities. To address this, small cells are
needed to provide continuous seamless coverage which imposes new requirements on
wireless equipments, including:
1. Smaller transmission power and miniaturization for RRU as well as smaller size for antennas.
RRU and antennas with smaller size can reduce the public concern on the radio radiation. And
RRUs of low power consumption will match the requirements of the environment-friendly
policies from government and save the time for installation permission. The current
transmission power is 5w per channel for an outdoor RRU. It is estimated through link budget
calculation that in case of typical inter-cell distance of 100 meters, the needed transmission
power can be smaller.
2. Collaborative radio support with BBU pool. Some technologies, such as multi-RRU co-cell and
generalized MIMO can help to reduce the interference and thus to improve system performance.
In this way, the network will consist of at least two layers. One is the macro cell for basic
coverage, and the other is the small cell to absorb the hot-spot traffic. It is estimated that the
ratio of macro to micro RRUs is between 1:3 and 1:6.
27
least 48 fiber cores for C-RAN centralization in the ISAZs with sufficient fiber, taking into
account the potential centralization scale. In the future the usage of fiber can be further
reduced with the introduction of WDM equipments.
After the centralization of BBU, the collaborative radio technologies (e.g. JT/JR) can be further
adopted in the BBU pool to enhance the system performance.
There are three construction methods under this scenario.
A. Scenario a: If the TD-LTE equipements cant be installed in existing 2G/3G sites, then the
new BBUs can be centralized into aggregation office of ISAZ and a new remote site with
outdoor stand-by power supply is necessary for RRU installation.
B. Scenario b: If the TD-LTE equipments can be installed in existing 2G/3Gsites, then the new
BBUs can be centralized into aggregation office of ISAZ and the RRU can be installed in the
existing 2G/3G remote sites. Stand-by power resource for RRU is also required.
C. Scenario c: If the TD-SCDMA BBU can be upgraded to TD-LTE, then it is not necessary to
deploy C-RAN. However, if the network suffers from severe interference from neiboring cells,
then C-RAN centralization can be used for introduction of collaborative radio technologies to
address the issue.
28
in the same BBU pool which enables complex and fast collaborative radio technology to improve
wireless performance. With WDM solution, the typical length of a WDM ring is less than 20km.
29
also
improve
the
baseband
wireless
signal
transmission
delay
jitter
and
requirements indirectly. Not including the transmission medium between the round-trip time
(i.e., regardless of delays caused by the cable length), for the user plane data (IQ data) on the
CPRI/Ir/OBRI links, the overall link round-trip delay may not exceed 5s. The OBRI interface
requires periodic measurement of each link or multi-hop cable length. In terms of calibration,
the accuracy of round trip latency of each link or hop should satisfy 16.276ns [4].
30
System Reliability
For the reliability of the system, because the traditional optical transmission networks
(SDH/PTN) in the access network links provide reliable loop protection, automatic replace and
fiber optic link management function, C-RAN architecture in the access network must also
provide comparative reliability and manageability. In traditional RAN architecture, each BBU on
the access ring usually has access to the corresponding transmission equipment of the center
transmission machine room through SDH/PTN. Through the SDH/PTN ring routing and
protection function, the system can quickly switch to the safe routing mode when any point on
this loop experiences optical fiber failure, ensuring that business is not interrupted. Under the
C-RAN architecture, it also should offer a similar optical fiber ring network protection function.
Centralized BBU should support more than 10~1000 base station sites, and then the optical
fiber connected OBRI link between distributed RRH and centralized BBU is long. If only point-2point optical fiber transmission occurred between each distributed RRH and centralized BBU,
then any fault on the optical fiber link will lead to the corresponding RRH loosing service. In
order to ensure the normal operation of the whole system under the condition of any single
point of failure in the optical fiber, the CPRI/Ir/OBRI link connecting the BBU-RRH should use
fiber ring network protection technology, using the main/minor optical fiber of different
channels to realize CPRI/Ir/OBRI link real-time backup.
Cost Requirements
Finally, in terms of cost, the high speed optical module necessary for the CPRI/Ir/OBRI optical
interface will be amongst the important factors affecting the C-RAN economic structure.
Compared to traditional architecture, the wireless signal transmission data rate on C-RAN is
more than 100-200 times higher than the bearer service data rate after demodulation. Building
the fiber transportation network in developed city is very hard. This is less of an issue for
operators that already deploy optical fiber and particularly for operators own their own optical
network.
Although the cost of the optical fiber employing CPRI/Ir/OBRI for high speed wireless signal
transmission doesn't need to increase, the high speed optic module or optical transmission
equipment costs must compare to traditional SDH/PTN transmission equipment in order to
make C-RAN architecture more attractive on the CAPEX and OPEX fronts .Therefore, how to
achieve a low cost, high bandwidth and low latency wireless signal optical fiber transmission will
become a key challenge for realization of the future LTE and LTE network deployment by C-RAN.
31
For the above problems and corresponding technical progress trend, we will analyze and put
forward ideas for solving these problems.
frequency domain
At the same time, the EVM indicators will worsen on the downlink. With
increased compression ratio, the system performance will deteriorate even more. Currently,
we still need to investigate the impacts caused by different compression schemes.
Table 2 lists the advantages and disadvantages of various compression schemes. As
indicated, there is no ideal OBRI link data compression scheme. More studies in this area
are required.
Table 2. Comparison of Pros and Cons for Various Data Compression Techniques
Bandwidth
Compression
Schemes
Reducing signal
sampling
32
Pros
Low complexity;
Cons
Severe performance loss.
Non-linear
quantization
complexity.
and U law;
High compression efficiency to 53%.
IQ data
Compression
High complexity;
compression modules.
~58%;
Sub-carrier
Compression
33
As mentioned above, BBU-RRH wireless signal connection supporting LTE and LTE-Advance
creates new challenges to optical transmission network rates and cost. The rapid
development of the optical transmission technology provides more economic solutions to
solve the problem. A single fiber capacity of current commercial WDM system can be up to
3.2
T.10
Gpbs
optical
transmission
technology
applies
generally
and
become
until the
10000
3000
2500
2000
1500
66.7%
1000
54.2%
500
0
Aug-07
62.2%
Feb-08
10Km
Aug-08
40Km
Feb-09
Aug-09
80Km
of a C-RAN network.
9000
8000
35.2%
7000
6000
5000
4000
61.5%
3000
60%
2000
1000
0
Aug-07
Feb-08
550m
Aug-08
10Km
Feb-09
Aug-09
40Km
Radio remote
head
Trun
kc
able
Optical
switching box
Transmission ring
Trunk c
a
ble 1
Central apparatus
room
35
transmission layer, each optical route has 144 to 576 fibers; at the convergence
transmission layer, each route has 96-144 fibers; while at the access transmission layer,
each route has 24-48 fibers. If the Baseband pool is located in the transmission
convergence equipment room, the optical fiber resource to and from the equipment room
determines the coverage of the baseband pool.
According to the resourcing of the optical transmission network, especially the fiber
resource in the access transmission network, there are four different solutions to carry
CPRI/Ir/OBRI over it: 1. Dark fiber; 2. WDM/OTN; 3. Unified Fixed and Mobile access like
UniPON; 4. Passive WDM. These solutions have different advantages and disadvantages,
and they are each suitable for different deployment scenarios. From the trials conducted,
for a BBU pool with less than 10 macro BSs, it is preferred to use a dark fiber solution while
other solutions still need more field tests and verification, because they may introduce new
transmission devices and associated O&M issues.
The first solution is Dark fiber. It is suitable when there is plenty of fiber resource. It is easy
to deploy if there are a lot spare fiber resources. The benefits of this solution are: fast
deployment and low cost because no additional optical transport network equipment is
needed. The concerns of this solution are: it consumes significant fiber resource, thus the
network extensibility will be a challenge; new protection mechanisms are required in case
of fiber failure; and it is hard to implement O&M, therefore it will introduce some difficulties
for optical network O&M. However, there are feasible solutions to address such challenges.
For fiber resources, if there is already a channel route available, it is fairly inexpensive to
add new fiber cables or upgrade existing fibers. To address fiber failure protection, there
are CPRI/Ir/OBRI compliant products available now that have the 1+1 backup or ring
topology protection features. If deployed with physical ring topology that provides
alternative fiber route, it will be able to provide similar recoverability capability as SDH/PTN.
For the O&M of the fiber in the access ring, we are considering introducing new O&M
capabilities
in
the
CPRI/Ir/OBRI
standard
to
satisfy
the
fiber
transport
network
management requirement.
The second solution is WDM/OTN solution. It is suitable for Macro cellular base station
systems when there is limited fiber resource, especially where the fiber resource in the
access ring is very limited, or adding new fiber in existing route is too difficult or cost is too
high. By upgrading the optical access transmission network to WDM/OTN, the bandwidth of
transporting CPRI/Ir/OBRI interface on BBU-RRH link is largely improved. Through
transmitting as many as 40 or even 80 wavelength with 10Gpbs in one fiber, it can support
a large number of cascading RRH on one pair of optical fiber. This technology can reduce
the demand of dark fiber, however, upgrading existing access ring into WDM/OTN
transmission network means higher costs. On the other hand, because the access transport
network is usually within a few tens of kilometers, the WDM/OTN equipment can be much
cheaper than those used in long distant backbone networks. OTN (Optical Transport
36
37
In this and the subsequent sections in the White Paper, the transmission between the BBU
and the RRU in C-RAN is defined as fronthaul transmission (compared with traditional
backhaul transmission between the BBU and the core network).
CPRI compression. With the maturity of CPRI compression, several vendors have
commercially realized 2:1 compression with lossless performance. It can help to save
half usage of fiber consumption. In addition, the Single Fiber Bi-direction (SFBD)
technology allows simultaneous UL and DL transmission on a single fiber, which further
halves fiber consumption. Combining CPRI compression and SFBD can save the fiber
consumption by 3 folds. CMCC has successfully verified the two technologies in C-RAN
TD-LTE field trials. More details and information can be found in Chapter 6.
WDM solution. Since WDM technology is sufficiently mature, vendors can develop WDM
equipments tailored to fronthaul transmisstion within a short period of time. Currently
a few operators have adopted this solution to enable the large-scale C-RAN
deployment. Some commercial products can support as many as 60 2.5Gbps CPRI
links in one pair of fiber, which significantly reduce fiber consumption. 1+1 or 1:1 ring
protection is also supported and several low data rate links can be multiplexed into one
link of high data rate. The main issue for the solution lies on the high cost, which
hinders its large-scale deployment by operators.
OTN solution. Compared with WDM solution, OTN provides more powerful O&M
capability, longer reach as well as flexible routing function. In addition, open interface
and standard protocol of OTN, in some sense, help to bring down the cost and drerease
the development difficulty. Some vendors suggested to integrate OTN functions into
optical modules rather than using active line cards, which can simplify network
deployment and maintenance to a large extent.
38
regulation in many countries. The bandwidth in 60Ghz band is wide and thus it is easy
to get channels with 250MHz or wider bandwidth. With simple modulation technique, it
is easy to achieve over 1Gbps transmission rate within 100 ~ 400 meter range. For
LTE RRU with 20MHz bandwidth and 2 antennas, the data rate after 2:1 compression is
less than 1 Gbps and can be transmitted via millimeter microwave. 5GHz millimeter
microwave products just came into the market and can support the fronthaul
transmission of 20MHz LTE with 8 antennas.
CPRI redefinition. The basic idea of CPRI redefinition is to move a partial set of physical
layer functions to the RRU side in order to reduce the required data rate between the
BBU and the RRU. There can be several possibilities on the function partition. By
carefully designing the partition scheme, the data rate between the BBU and the RRU
can become elastic and varying with real user traffic, which is the opposite from
traditional case in which the I/Q stream is constant even when there is no real traffic.
This feature not only helps to reduce the capacity requirement on switching network
within the BBU pool but also reduces the switching latency. In addition, the data can
now be encapsulated in form of packets rather than a constant stream and therefore
can be transmitted by packet switching protocol, such as Ethernet which enjoys the
benefits of improved flexibility and improved switching efficiency. One of the biggest
disadvantages however, is the need to change the existing CPRI specification, which
increases the difficulty in realization.
WDM-PON. There has been some discussion on using WDM-PON as a C-RAN fronthaul
alternative in FSAN and ITU-T Q2 working group recently. The basic idea is to make
use of the rich fiber resource deployed for FTTx and design a new technology based on
the combination of the low-cost PON and WDM for CPRI transmission. WDM solutions
adopt colored optical modules, which raises the bar in SFP installation, maintenance
and storage. In comparison, WDM-PON targets at using colorless SFP, which greatly
helps to simplify the installation, maintenance and storage issues. In addition, WDMPON claims such advantages as cost reduction, saving on fiber consumption and
flexible topology support. Despite being at the initial stage, in the long run WDM-PON
can become one of the most efficient fronthaul solutions for C-RAN.
39
will cause severe degradation of system performance and cannot be mitigated by increasing the
transmit power of desired signals. At the same time, in view of the analysis, single cell wireless
resources usage efficiency is low. To improve system spectrum efficiency, advanced multi-cell
joint RRM and cooperative multi-point transmission schemes should be adopted in the C-RAN
system.
Many uses
various optimization techniques in trying to determine the optimal resource scheduling and the
power control solutions to maximize the total throughput of all cells with some specific
constraints. To reduce the complexity incurred in the C-RAN network architecture and the
scheduling process, the joint processing/scheduling should be limited to a number of cells
within a cluster. The complexity of scheduling among the eNBs clusters is determined by the
velocity of mobile users and the number of UEs and RRHs in the cluster. Thus, choosing an
optimal clustering approach will require balancing among the performance gain, the
requirement of backhaul capacity and the complexity of scheduling.
As shown in Fig. 5-3, UEs will be served by one of the available clusters which are formed in a
static or semi-static way based on the feedback or measurements reports of UEs. In this
scenario, a subset of cells within a cluster will cooperate in transmission to the UEs associated
with the cluster. To further reduce the complexity, it is possible to limit the number of cells
cooperating in joint transmission to a UE at each scheduling instant. The cells in actual
transmission to a UE are called active cells for the UE. The active cells can be defined from the
UE perspective based on the signal strength (normally cells with strong signal strength are
chosen among cells within the supercell). The activation/de-activation of a cell can be done by
a super eNB, which is the control entity in cell clustering and can adjust the sets scope based
on the UE feedback.
Cell cluster 1
Cell cluster 2
Cell cluster 3
40
Technical Challenges
Cooperative transmission / reception (CT/CR) has great potentials in reducing interference and
improving spectrum efficiency of system. However, this technology has many problems that
need to be further studied before it can be applied to the practical networks. There are many
challenges listed as follows:
Coordinated Radio resource allocation and power allocation schemes for multi-cells.
41
capable of supporting dynamic resource allocation across different BBU, thus hard to resolve
the dynamic network load in a larger area. In the current RRH+BBU architecture, the RRH is
usually connected to a particular BBU by a fixed link, and it can only transmits its baseband
signal and O&M signaling to the BBU its connected to. This makes it difficult for another BBU to
obtain any uplink baseband data from that RRH. Similarly, any other BBU has difficulty sending
downlink baseband data to this RRH. Because of this limitation, the processing resources of
different BBUs can hardly be shared: the idle BBUs processing resources are wasted and it
cannot be used to help the BBU with a heavy workload.
The centralized baseband pool should provide a high bandwidth, low latency switch matrix with
an appropriate protocol to support the high speed, low latency and low cost interconnection
among multiple BBUs. In a medium sized dense urban network coverage (approximately 25 sq.
km in area), with an average distance between BS of 500m, a centralized baseband pool that
can cover the whole area needs to support about 100 BS. For a typical TD-SCDMA system with
3 sectors per macro BS and 3 carriers/sectors, it means that the centralized baseband pool
needs to support 900 TD-SCDMA carriers.
is even larger, such as 15 km X 15 km, then the baseband pool would need to support up to
1000 macro BSs carriers. Because of the limitation in the high-speed differential signal
transmission, the traditional BBU architecture cannot scale up to support such capacity by
simply expanding the backplane dimensions.
Infinite Band technology can provide significant switching bandwidth (20Gbps-40Gpbs/port)
and very low switching latency. It is widely used in supercomputers. However, the cost per port
is very high (20,000RMB) and as such does not meet the C-RAN cost requirement. Inspired by
the data center networks distributed inter-connect architecture, the centralized BBU pool in CRAN can also use a distributed optic interconnection to combine multiple BBU into a scalable
baseband pool. Based on that, the RRHs signal can be routed to any one of BBUs in the pool.
Thus load balance according to dynamic network load among BBUs can be achieved, and
system power consumption can be reduced. It also makes the deployment of multi-point MIMO
technology and interference mitigation algorithms easier, which can improve radio system
capacity.
42
The dynamic carrier scheduling of resources within baseband pools enhances redundancy of the
BBU and increases overall operational reliability of the baseband pool. When a baseband card or
a carrier processing unit fails, the work load can be promptly redistributed to other available
resources within the pool, and restore the normal operation. In addition, for areas that have
strong dynamic network load, the operator can deploy fewer baseband resources to meet the
demands of different sites that have opposite peak loads at different times. For example,
operator can use the same BBU pool with multiple RRHs to cover both residential areas and
office areas. Then dynamically allocates baseband resources to ensure basic coverage for both
areas. Remaining baseband resources can be dynamically allocated to cover the business area
during working hours and the residential area during after working hours. This will increase the
overall carrier resource utilization.
Inter-connection between BBUs must satisfy the wireless signals requirements of low
latency, high speed, and high reliability. The requirements are similar to the CPRI/Ir/OBRI
interface, and should support real-time transmission of 2.5/6.144/10Gbps rate.
Dynamic carrier scheduling among BBUs to achieve efficient load balance within the
system and failure protection without service interruption.
Support multipoint collaboration (CoMP). It needs to consider the data flow between
different BBUs to support collaboration radio.
Fault-tolerance. Fiber inter connection should support 1+1 failure protection, BBU frame
and baseband processing board N +1 protection to achieve high system robustness.
High scalability: it can extend the system capability smoothly without services interruption.
43
I/O modules can be shared between BBU processing boards which support different
standards. However, this structure can't share processing resources between different
processing boards and usually need to replace or add new processing board hardware for
upgrades.
Unified BBU system platform and unified processing board hardware platform to support
multi-mode through the software re-configuration. Through software
upgrades or
configuration, the same processing board can support different standards (e.g. LTE or TDSCDMA). In some of the latest products, the RRH can also be SDR-enabled to support
different standards in the same spectrum band. This solution allows the base station to be
upgraded to a new standard without changing the hardware. However, current products
usually require the BBU to restart in order to download new DSP / FPGA software for
standards upgrade. This limits the sharing of hardware between different standards.
In
fact, this prevents the dynamic resources allocation according to real-time traffic load
without interrupt of services.
Current SDR base station products partially meets the requirements of multistandards support,
however, it does not satisfy the operator flexible operation requirement of dynamically shared
resources among multiple standards, load-balancing, etc.
of
DSP
processing
resources.
On
the
other
hand,
DSP
from
different
manufacturers and even a same manufacturer cannot guarantee backwards compatibility. The
real-time operating systems are different from each other, and there is no de fact standard yet.
Generally BBUs based on DSP platform are proprietary platforms. And it is still difficult to
achieve smooth upgrading and resource virtualization.
Meanwhile, General Purpose Processors have progressed rapidly, and they are now capable of
efficiently processing wireless signals. Therefore, the telecom industry now has more choices
for software defined radio. Technology evolution in areas such as multi-core, SIMD (singleinstruction multiple data), large on-chip caches, low latency off-chip system memory are
facilitating the use of GPP in traditional signal processing applications such as baseband
processing in base stations. Traditional general processors usually have lower performance than
DSP in power efficiency; however, in recent years the general processor has made a lot of
improvements in this respect. Fig.5-5 shows the general processor technical progress in
44
processing performance and power consumption in nearly 6-7 years. It is can be seen that the
floating point computing capacity per watt improves very fast. These data points prove that the
evolution in GPP has made it an attractive solution for various data processing tasks in the base
station.
The advantage of GPP is that they have a long history of backward compatibility, ensuring that
software can run on each new generation of processor without any change, and this is
beneficial for smooth upgrade of the BBU. On the operating system side, there are multiple
OSs available on GPP that have real-time capability, and also allow the virtualization of BS
baseband signal processing.
(CPUs in 50-65 watt power envelopes used as basis for comparison in graph)
Technical progress in DSP and GPP has provided more powerful signal processing with less
power consumption. This progress has made the SDR based BS solutions more attractive.
Traditional DSP has become matured solution for product, and will continue to evolve. The
advanced research on wireless signal processing on GPP has provided more choices for the base
station, and has the potential to become part of the future open, unified multi-mode BS
platform.
45
virtualized base stations and different air interface standards. This allows the operator to
efficiently support the variety of air interfaces, and adjust to the tide effects in different areas
and fluctuating demands. At the same time, the common hardware platform will provide cost
effectiveness to manage, maintain, expand and upgrade the base station. Therefore, we believe
real time virtualized baseband pools will be part of the next generation wireless network, as
shown in Fig. 5-6. Within in given centralized baseband pool, all the physical layer processing
resources would be managed and allocated by a real time virtualized operating system. So, a
base station instance can be easily built up through the flexible resource combination. The real
time virtualized OS would adjust, allocate and re-allocate resources based on each virtualized
base station requirements, in order to meet its demands.
Physical Hardware
Processors
Processors
Processors
Processors
PHY Layer
(Signal processing)
resource pool
BS of standard 1
C
C
MAC/Trans. Layer
(Packet processing)
resource pool
A
A
M
M
P
P
BS of standard 2
Accelerator
(CODEC, cryto, etc.)
resource pool
C
C
M
M
P
P
BS of standard 3
C
C
A
A
A
A
M
M
P
P
Technical Challenges
Since wireless base stations have stringent real-time and high performance requirements,
traditional virtualization technique is challenged to solve the latency requirements of wireless
signal processing. In order to implement real time virtualized base station in a centralized base
band pool, the following challenges have to be solved:
46
General purpose processor and advanced processing algorithm for real time signal
processing
The high-bandwidth, low latency, low cost BBU inter-connection topology among physical
processing resources in the baseband pool. It includes the interconnection among the chips
in a BBU, among the BBUs in a physical rack, and among multiple racks.
processing
resources
management,
and
dynamic
allocation
of
physical
processing resources to each virtual base station, in order to ensure processing latency
and jitter control HW level support on virtualization in order to minimize latency.
Distributed Service
Network
DSN element
C-RAN element
BBU pool
BBU pool
47
In a platform layer, DSN and C-RAN both encapsulate their network elements through
virtualization technology on general servers, so, it is possible to run DSN and C-RAN on the
same virtualized platform. But how to implement the resource management including the
dimension of time and the dimension of physical resource is the key issue in the research of
platform unification for DSN and C-RAN.
48
6 Recent Progress
To accelerate the development and commercialization of C-RAN, China Mobile has been working
actively with industry partners. We have made good progress in field trial, large scale BBU pool
implementation, and baseband PoC based on IT platform. This chapter will first introduce the
advantages and disadvantages observed in C-RAN field trial, followed by discussion of large
scale BBU pool solution, up to 1000 carriers, based on current BBU device, and lastly the recent
R&D result of multi-mode PoC based on IT platform.
Overall situation
The first trial in Zhuhai City only took 3 months to complete. The commercial trial has 18 TDSCDMA macro sites covering about 30 square km area. This trial has verified some centralized
deployment technologies feasibility. The construction and operation of a commercial clearly
highlighted the C-RANs advantage over tradition RAN in cost, flexibility and energy savings. At
the same time, it also exposed challenges on fiber resource, as well as transmission
construction.
After that, there have been several trials on centralized deployment solutions of GSM system.
The network layout is mainly consisted of replacing and upgrading existing sites. There are
total15 sites covering 15 square km in the trial, where only 2 of them are new sites. Compared
with TD-SCDMA network, GSM solutions have
daisy-chain of 18 RRHs with only 1 pair of fiber. This could significantly reduce the number of
fiber resources needed in C-RAN centralized deployment with dark fiber solution.
The following sections will describe the network status before and after C-RAN deployment, key
technology introduced, field test results and challenges observed. .
49
The trial area in Zhuhai city is mainly consisted of a national high tech development zone, a
residential community, and a few college campuses. The data traffic in this area is growing
rapidly, as the customers here are well-educated and early adapters of new services. Part of
the trial areas has demonstrated tidal effect of traffic loading, with predictable traffic loading
pattern associated with time, location or event. For example, the national high tech
development zone has most people during working hours. The same group of customers usually
returns to nearby community after work. Students in colleges tend to stay away from using
wireless devices during school hours, while they tend to make a lot of calls in night.
Traditionally, network planning must support the peak traffic load at each individual site, which
is usually 10 times higher than the down time This results in a very low average utilization rate
of the BTS devices. It also introduces difficulties in network planning, construction and
optimization. It is suitable to adopt baseband pool with dynamic carrier allocation. In the trial
field, there will be 9 sites co-located with existing GSM site, while another 9 sites is new. All
these 9 sites have to be connected with new fiber channels and they are spread in 30 square
km. This is a challenge for fiber construction.
The trial area in Changsha city is consisted of a few campuses near Yuelu Mountains. The traffic
load and traffic density is quite high here. In addition, there is a lot of dormitories, and local
residential apartments. The propagation environment is very complex and the coverage KPI still
has room to be improved. This makes it suitable to verify C-RANs capacity in urban city
environment. Finally, since most of the trial sites are reusing or upgrading existing ones, there
is plenty of fiber resources.
Overall Solution
The solution starts with planning of system capacity in centralized deployment. In the Zhuhai
trial, each TD-SCDMA sites configuration is 4/4/4, which means that there are 3 sectors in
each site, and every sector has 4 carriers. Overall, the 18 trial sites need 216 carriers. When
considering the BBU pool capacity, the total BBU pool can be planned to support the maximum
co-current traffic for the same area.
There are two kinds of TD-SCDMA carriers, R4 carrier is mainly used for voice traffic, and
HSDPA carrier is mainly used for data traffic. Based on China Mobiles planning requirements,
every sites traffic load should not exceed 75%. As a result, each R4 carrier supports up to 203
voice users, and each HSDPA carrier can support up to 93 users. There are total 17,000
effective users in the trial area. When BBU pool is deployed, 160 carriers will be able to support
20,000 effective users. This means the C-RAN centralized deployment can save the BBU
capacity by roughly 25%, compared with traditional deployment method.
Similarly, the trial in Changsha also has used the co-current capacity to decide the total
capacity of the BBU pool.
50
The second part of the solution involves dynamic carrier allocation. In TD-SCDMA system, each
RRH/sector can support maximum 6 R4 and HSDPA carriers. In the idle situation, each
RRH/sector has only one R4 carrier and one HSDPA carrier. There are different carrier allocation
decision criteria whether more R4 and HSDPA carriers should be added. Whenever the existing
R4 carriers loading rate is above a threshold, there should be more R4 carriers allocated in this
site. For HSDPA carrier, similar rule applies. Where there is not enough load in multiple R4 or
HSDPA carrier, it is also possible to reduce the number of R4 and HSDPA carriers in one sector.
For GSM system similar rule also applies but the criteria is the utilization rate of each GSM
carrier.
The third portion of the solution involves RRH daisy chain and fiber failure protection
technologies. These technologies are derived from the distributed BBU-RRH deployment
method which usually uses point-to-point dark fiber connections. When BBU-RRHs are
separated by significant distance, it is important to consider the saving of fiber resource and
protection against unpredictable fiber failure caused by external factors. In TD-SCDMA, each
fiber link can handle up to 6.144Gpbs transmission, enough to support 15 TD-SCDMA carriers.
Thus, one pair of fiber is able to support one site with 3 sectors and maximum carrier of 15. In
the Zhuhai trial, each access ring has 9 sites and used 9 pair of fibers to support the 9 sites
connected to the ring.
On the other hand, GSM has far less baseband requirement due to its narrow band nature;
therefore it can support more capacity in daisy-chain configuration. There are commercial
products that can support 18 to 21 RRH daisy chained on one pair of dark fiber. We can
calculate the fiber resource required per access ring as following: usually, each access ring has
8~ 12 physical sites and each site has 3 sectors, and has 900M and 1800M dual bands. This
means, each access ring may has up to 16~24 logical sites, which is 48 to 72 sectors/RRH. To
connect all the RRH in daisy chain, we would need 4~5 pair of fibers in the ring.
Lastly, the field trial has also verified key technology for outdoor deployment, like power supply
for remote sites. In the Zhuhai Trial, there is no BTS equipment room in the 9 new sites. Thus
the traditional DC power supply is not available. External power booth is used instead. Existing
outdoor power solution met the need of network deployment: with sufficient operation
temperature range, -40+70, C-level anti-flash capacity and theft-proof solution to ensure
the safety of device without on-site attendance. GSM and TD-SCDMA remote site both can
apply this outdoor power solution.
Technical Performance
This section will outline the technical performance data from selected test cases in the trial,
starting with the dynamic carrier allocation procedure. The following figure illustrates the total
number of carriers allocated to one sector in a typical day on one site in Zhuhai trial. The blue
curve represents this sectors total carrier capacity, while the purple curve represents the actual
51
network load for this sector. It is clearly shown that the dynamic carrier allocation has adapted
effectively to dynamic load in network.
when the access fiber ring was cut accidently, the BBU-RRH
traffic will be automatically switched to another unaffected route in the ring. The switching
delay during the failure protection is comparable to normal cross-BTS or cross-MSC. Thus the
failure protection has very limited effects to network KPI.
In summary, C-RAN centralized deployment does not have negative effect on radio
performance. On the contrary, it may provide extra gains on radio performance. Moreover, RRH
daisy chain could reduce the dark fiber resource needs, while out-door units meet the power
requirement of out-door remote sites. Now dark fiber transportation solution has been well
verified, and other transmission technologies are in testing.
Economic analysis
The trial in Zhuhai city shows that, compared with traditional RAN deployment method, C-RAN
centralized deployment can reduce the TD-SCDMA networks CAPEX and OPEX significantly,
especially for new TD-SCDMA site which is not reusing existing GSM site. In the following figure,
it is shown that OPEX and CAPEX can be reduced by 53%, and 30% respectively for new cell
sites.
52
Construction Impact
The centralized deployment of C-RAN greatly simplifies the remote site selection and
construction requirements, construction time required for new base stations, which lead to
faster network deployment. Table 3 shows the comparison of the construction process between
traditional base station and C-RAN centralized approach in the China Mobiles TD-SCDMA
network deployment in Zhuhai City, Guangdong Province.
From figure 6-3, C-RAN showcases the advantage of deployment time. The savings are mainly
from site selection/purchasing, base station equipment room construction and transmission
system debug, etc.
53
site selection
Stringent,
flexible
Equipment room
Power supply
equal
Site Equipment
Installation needed
No requirement
transmission
Equipment install
Verification
Base
Station
equipment
Air
conditioning
Switching
Supply
Traditional
0.65 KW
2.0 KW
0.2 KW
0.2 KW
0.2 KW
3.45KW
C-RAN
0.55KW
0.2KW
0.10KW
0.85KW
Storage
Battery
Transmission
System
Total
Summary
C-RAN centralized commercial access network demonstrates several benefits including: 1)
simplified site selection and improve the speed of location selection negotiations; 2) reduced
base station construction and maintenance cost, improved network deployment efficiency; 3)
reduced supporting facilities of remote cell sites, led to construction cost reduction by 1/3 per
site.
54
In terms of network operation, C-RAN takes advantage of low cost, energy efficiency RRH.
Centralized BBU facilitates easy maintenance and flexible upgrade. The overall network
utilization can be improved due to virtualization technology and resource sharing which not only
increases
utilization
but
also
lowers
overall
power
consumption
thru
various
power
management schemes.
CMCC has been conducting TD-LTE C-RAN field trial in the city of Chengdu, Fuzhou and
Guangzhou since the 2nd half year of 2012 with the target to demonstrate efficient fronthaul
solutions which can help reduce fiber consumption. More concretely, two technologies, i.e. CPRI
compression and Single Fiber Bi-direction (SFBD) are tested in the trials
Lab tests have already shown that lossless CPRI compression can be achieved with 2:1
compression ratio. In other words, the number of fiber needed for the centralization could
be saved by half with compression implemented.
When combining CPRI compression and SFB together, fiber resource could be saved by 4-folds
with lossless performance.
55
These field trails in Chengdu, Fuzhou and Guangzhou have centralization scale of 6~12 sites
centralized, i.e. 18 ~ 36 8-antenna TD-LTE carriers. Similar configuration is adopted as shown
in the table below while commercial eNBs and EPCs are used together with test UEs.
2.85GHz
Bandwidth
20MHz
Normal CP
Frame
structure
CPRI
2:1 compression
Optic module
UL
SIMO
DL
Adaptive MIMO
QCI
Scheduler
PF
Extensive test cases have been carried out including total system throughput, end to end delay,
protection switching etc. to demonstrate comprehensively the performance with compression
and SFBD. We also compared system performance with and without the usage of those two
technologies. Test results verified that compression (with 2:1 compression ratio) and SFB are
mature enough and the system performance is almost the same as without the adoption of the
technologies.
Despite the fact that combination of compression and SFBD can save fiber resource to 1/4, it is
still far from enough for future C-RAN large-scale deployment. Therefore now CMCC is actively
exploiting other more efficient and cost-optimized fronthaul technologies. So far WDM-based
schemes, which carry dozens of carriers on a single (pair of) fiber seem to be the most
promising fronthaul solutions to C-RAN large-scale deployment. Several tests on WDM solutions
are now undergoing. Initial results are quite promising. Being transparent to CPRI transmission,
the WDM solution can be easily implemented in 2G, 3G and LTE networks. Moreover, using
DWDM, it can transport more than 15 8-antenna TD-LTE carriers with just a pair of fiber, which
greatly saves the fiber consumption. It also has various topology support including ring, tree,
star etc., which makes it flexible for network deployment. In addition, it supports either 1+1 or
1:1 protection with low-latency link reversal. The whole results would be presented in the
upcoming version of this WP.
56
In addition to pure WDM solution, there is another WDM-based solution called WDM-PON, which,
targeting at low-cost implementation by the nature of PON technology, is now under discussion
and development stage within ITU-T.
TDD DL:UL=2:2
BS 8TxUE 2Rx.
CoMP Mode
2-cell dynamic JT
Channel
Non-ideal channel
Estimation
Channel Mode
57
58
Interference
Interference Area
Area
Coorperative
Coorperative Area
Area of
of one
one eNB
eNB
Coorperative
Coorperative Area
Area among
among different
different eNBs
eNBs
21 Cells on 7 eNBs
59
developed large scale Baseband Pool supporting more than thousands of carriers. The
innovation includes the IQ data routing switch method designed by CMRI, using existing
equipment. Several C-RAN partners have made breakthrough progress to expand the scale of
Baseband Pool beyond thousands of carriers.
distributed multilayer switch architecture, with high serviceability, low maintenance and flexible
capacity expansion. This section describes the key technology for large scale baseband pool
development -- IQ data routing switch, and its adaptive improvement for telecommunication
equipment. Finally, it briefly highlights the key technical characteristics of the equipment.
IQ Data Routing Switch Architecture
IQ data routing switch is the core unit of the large scale baseband pool. It is capable of
switching any RRH data to any baseband processing unit for data processing. This data switch
architecture is based on the Fat-Tree architecture of DCN technology. The advantages of this
architecture include:
-
switch node has the same number of switch ports, and maintains the same required
transmission bandwidth. Therefore reduces switch capability requirement for each node. There
is at least one connection between any lower processing node and other processing node. If
one connection is out of service, redundant connections can play a backup role, which results in
a highly fault tolerant networks. As shown in the following figure:
60
The limitation of this approach is the amount of data flow from the interconnection
between any two equipments is limited by the capability of the backplane of single equipment.
So todays design can only support connection between 2 sets of equipment. Consequently
upgrading a single equipment capacity by adding more baseband process units will demand
higher switch capability of the backplanes. To combat this limitation, China Mobile Research
Institute proposed to apply the Fat-Tree structure into existing wireless BBU equipment.
Without significant changes to the existing equipment, the proposal adds a set of high layer
switch unit to form Fat-Tree Topology to gain higher switch and baseband pool processing
capacities. Similar to how the Computer network works, at this network structure, each
baseband processing Board, through the high layer network, can transfer its data to other
baseband board that is in lower utilization state.
boards in the baseband pool will increase redundancy, and achieve real-time protection, thus
improving the reliability of the equipment.
However, contrasting to the computer network, IQ data routing switch has additional
characteristics.
First of all, Baseband signals require real time processing, and bound by its frame structure of
GSM/TD-SCDMA/TD-LTE protocols. Each frame has strict timing requirements. IQ data routing
switch cannot send a data packet belonging to a single carrier, over different connections to the
receiver. Otherwise it will require the receiver to rearrange the received data packet, which will
generate additional delay. The End-to-end transmission cannot be routed multiple times,
which .causes delay and jitter at the received end. China Mobile Research Institute has
proposed a Pre-distribution Routing technology to solve this problem. Its principle is to pre-
61
allocate resource before connection is established, making each switching node setting aside
adequate resources and identifying of the next routing port.
Secondly, IQ data transmission requires relatively large bandwidth, it is important to consider
transmission path load balancing, otherwise it could easily cause the route blockage during
overload. Therefore China Mobile Research institute has proposed the Load Balanced
technology. The principle is that: for a routing node receiving a data flow, the data flow with
the source address of Src, the object address of Dst, the flow (each data spread sent of is 1 or
multiple carriers) data numbered the Num, routing node finds the routing table based on Dst. If
the routing table includes multiple suitable next jumps, the routing node will generate a
random number according to (Src, Dst, Num), then determining the address of next Jump
based on the random number. This has resulted in path selection of randomization. With the
Path selection of randomization, even if the Src and Dst are same, the difference of the carrier
number (Num) will generate different path/route, so as to achieve the load balancing.
Distributed Architecture
In addition to IQ data routing, we need to consider implementation of resource management,
signal processing functions and so on, for a large scale baseband pool. China Mobile Research
Institute has introduced the Distribute Architecture. Use ZTE equipment as an example, a single
baseband processor BBU module can handle the Iub interface signaling and servicing
processing, based on the largest capacity in a network with 108 carriers. A distributed
framework can solve the problem of large scale processing, retain service processing unit for
each box. At the same time, a separate Ethernet switch handles dynamic resource management.
Each box has separate and independent Iub ports; it logically becomes independent network
elements of NodeB. In addition, one extra master network element manages entire resource of
the rack, and controls redistribution of individual physical resources. This approach is simple to
implement, adding a box means gaining one more independent NoteB network element,
without any impact to other network elements. Also, when a baseband processing unit fails, the
failed unit, under the master redistribution mechanism, can redistribute its original signaling
information to other box over the Ethernet.
62
The following sections will describe hardware and software architecture of the prototype.
As shown below, the PCI Express interface is connected to CPRI/ir interface converter, which
then carries GSM/TD-SCDMA/TD-LTE signals to commercial RRHs. IQ samples of all three
standards are processed by the commercial server in real time.
63
hard real time and synchronization on the CPRI/Ir interface card, we can separate the RRH
hard real time CPRI/Ir functions from the IT signal processing tasks which only require soft
real time.
Finally, significant effort had been spent to optimize LTE algorithm on general purpose processor,
fully utilizing every available instruction set and memory to the maximum advantages,
therefore significantly increases the CPU processing efficiency. We were able to implement 3GPP
release 8 TD-LTE physical layer entirely on software running on general purpose processor and
meeting all the timing and delay benchmarks. The TD-LTE implementation parameters are:
20Mhz bandwidth, 2x2 MIMO downlink, 1x2 SIMO uplink, 64QAM/15QAM/QPSK modulation,
Turbo decoder with adaptive early termination. Under peak throughput, every subframe was
being processed under 1ms TTI, meeting the most stringent HARQ processing latency
requirements in TD-LTE. As expected, GSM and TD-SCDMA processing met the timing
requirements with flying colors.
Based on trial results to date, we can conclude that CPU is capable to process baseband signal
processing work load and associated real time requirements. Cycle counts of certain modules
take up higher proportion of the overall processing time, such as turbo decoder, convolution
decoding, FFT processing etc. By introducing co-processing of such tasks, we can expect to
increase overall efficiency by 5 times or higher. In the not too distant future, general purpose
CPU implementing BBU functions, combining with DSN, will be the foundation of an open
platform that serves a large scale dynamic baseband pool, evolving into a virtualized, cloud
computing C-RAN solution.
64
downlink, processing modules of high computation load include FFT, 8-antenna precoding and
turbo encoding. The other modules, including scramble, modulation, layer mapping and so on,
do not require high computation capability. They can be performed by CPU from the point of
view of computing power and processing delay. However, it is more reasonable to put these
parts on the hardware accelerators from interface data traffic point of view.
The figure below shows the function block architecture of the Downlink Accelerated Processing
Modules. The yellow box indicates the input data required by the physical-layer downlink
processing function modules, including both physical-layer parameters and data carried by the
channel. For example, for each user, PDSCH processing not only requires pending data block
from the MAC layer of the user, but also needs the corresponding physical-layer configuration
parameters of the user. The physical-layer downlink processing modules on the hardware
platform will process the MAC data on PDSCH according to the configured physical-layer
parameters. On the other hand, the algorithms for bit-level processing and symbol-level signal
processing of PDCCH are of low complexity and can be completed by CPU. In order to call for
the
physical-layer
downlink
processing
function
modules,
subcarrier
mapping
location
information is required. The green box indicates that corresponding physical-layer processing
module only requires input of configuration parameters, such as PSS/SSS and a variety of
reference signals. The generation of these reference signals follows the same algorithm
principle and these sequences can be uniquely generated by determinate generating algorithms
through a limited number of physical-layer parameters. Therefore, it is more appropriate to
transmit a few physical-layer parameters than to transmit generated desired frequency-domain
sequences on the interface, which can reduce the data transmission bandwidth on the interface.
65
PDCCH/PCFICH/PHIC
H Data after Precoding
+ Mapping Information
RS Control
Information
PSS/SSS
Control
Information
RB Mapping +
Precoding Matrix
Information
PDSCH/PMCH
Data + Control
Information
CRC(TB)
Effective data
maximum
throughput is
about 300Kb per
DL subframe
CB Seg/CRC
Channel Coding
Rate Matching
CB Concate.
Scrambling
Bit-level
RS generation
Modulation
PSS/SSS generation
Layer Mapping & Precoding
Resource Element (RE) Mapping
Effective data
maximum
throughput is
about
4.3008Mb per
DL subframe
Symbol-level
IFFT
Add CP
Sample-level
Fig. 6-9 Function Block Diagram of the Downlink Accelerated Processing Modules
Similarly, in uplink high processing modules of high computation are IFFT, channel estimation,
equalization and turbo decoding of PDSCH. However, channel estimation is one of the most
flexible parts in uplink processing, which is difficult to achieve the compatibility among different
vendors if it is realized in accelerators. The processing modules between equalization and turbo
decoding are of low complexity, which can be performed by CPU from the point of view of
computing power and processing delay. However, it is more reasonable to process these parts
on the hardware accelerators from interface data traffic point of view.
The function block architecture of the Uplink Accelerated Processing Modules is shown in the
figure below. The green box indicates that the processing is completed by CPU and the shaded
box indicates that the processing is completed by the hardware accelerator. It is more
appropriate to send effective frequency data than to send raw IQ data back to CPU after CPRI
termination, which can significantly reduce the interface data traffic. However, PRACH needs to
be considered before FFT is performed since PRACH, PUCCH and PUSCH exist in the same
subframe or multiple subframes in the form of time division. With respect to PRACH, it is in the
oversampled state (especially the format 0 - format 3) when the sampling rate is 30.72Mhz.
Digital down-sampling is usually adopted in the receiver to reduce the sampling points of RACH
time-domain signal. Down-sampling of the oversampled PRACH time-domain signal inputted by
the antenna interface is conducted to obtain the digital signal with a low sampling rate. After
66
filtering and FFT, signal detection and peak position estimation can be done. Then the hardware
accelerator separates UE data, PUCCH data and SRS data from frequency-domain data. Finally,
DMRS data of PUSCH, PUCCH data and SRS data are sent to CPU which finishes the remaining
processing including PUCCH receiving processing, SRS signal receiving processing, as well as
channel estimation, time/frequency offset estimation and noise power estimation etc. of PUSCH.
Eventually, the aforesaid PUSCH channel estimation results are output to the hardware
accelerator to complete PUSCH subsequent equalization, demodulation and bit-level processing.
It is worth pointing out that the equalization processing modules should be programmable,
meeting the equalization implementation requirements from different vendors. Meanwhile, it
supports the matrix operation with a maximum size of 8*8 and needs to support simultaneous
processing of multiple smaller matrix operations (such as 2*2).
I/Q
Sample-level
CP Removal
subcarrier shift
FFT
Data Selection
PRACH
Data
Equalization
DMRS
Channel Estimation
IDFT
Data/Ctrl De-multiplexing
Noise Estimation
Downsampling
DMRS maximum
throughput is
1.3Mb per UL
subframe
Effective data
maximum
throughtput is
4.3008Mb per
UL subframe
CE maximum
throughput is
3.7Mb per UL
subframe
De-modulation
CP Removal
De-scramble+interleaver
FFT
Turbo Decoding + CRC
PRACH
Freq Data
PUCCH + SRS
Freq Data
PUSCH CB
Data
PUSCH
CQI/PMI/RI
ACK/NACK
Fig 6-10 Function Block Diagram of the Uplink Accelerated Processing Module
Up to September 2013, together with our partners we have developed a scalable BBU pool
prototype based on simple accelerator. The complete commercial LTE/GSM protocols have been
implemented in the prototype, which has shown the ability of communicating with commercial
terminals. The prototype system architecture is shown in the figure below, only Turbo
encoder/decoder and FFT/iFFT are processed on the accelerator. 18 GSM cells (supporting 108
TRXs), 9 2-antenna 10MHz FDD-LTE cells and 93 2-antenna 20MHz TDD-LTE cells are
configured in the BBU pool.
67
Fig. 6-11 System Architecture of BBU Pool Prototype based on Simple Accelerator
It is calculated that 4 CPU cores are needed to process one 8-antenna 20MHz TD-LTE carrier.
Compared to pure-software based prototype, the performance-power ratio has been improved
significantly. If accelerator is enhanced based on above hardware platform, the processing
resource for each 8-antenna 20MHz TD-LTE carrier can be reduced to 1~2 CPU cores and the
power consumption per carrier can be 15~20w, taking into account future CPU evolution.
In order to acquire more pooling benefits, especially dynamic carrier migration, we are working
with several vendors to discuss the definition for functions and interfaces of hardware platform.
The hardware platform can be logically divided into two parts based on preliminary ideas:
digital front-end and accelerator.
Digital front-end
CPRI/Ir/OBRI interface conversion and sample-level processing are completed by digital frontend. Then the processed data is sent to its inserted server by PCI Express, or switched to any
other servers by a 10Ge/Infiniband switch network in BBU pool. Effective IQ data of several
different networks (such as GSM, TD-SCDMA and TD-LTE) can be sent to general purpose
processor by this digital front-end. As for LTE, the functions achieved by the digital front-end
include CPRI processing, resource mapping, IFFT and CP addition with respect to downlink
processing, as well as CP removal , FFT, UE data separation and PRACH processing with respect
to uplink processing. IQ data encapsulation and extraction are implemented in CPRI processing,
which is helpful to adapt RRHs from different vendors. The exchange data is proportional to
user data rate with the help of resource mapping and UE data separation, i.e. RB insertion and
68
selection. The data bandwidth can be reduced by PRACH pre-processing. Furthermore if the
digital front end is placed in RRU, then a new interface definition between RRU and BBU is
formed.
Accelerator
Partial physical layer processing and L2 encryption and decryption algorithms processing are
integrated in accelerators, improving protocol processing efficiency of general purpose
processor. As for LTE, the functions achieved by the accelerator include encryption and
decryption processing, PDSCH/PMCH bit-level and symbol-level processing, PBCH symbol-level
processing, RS/PSS/SSS generation and RE mapping of all channels with respect to downlink
processing, as well as PUSCH equalization, symbol-level and bit-level processing with respect to
uplink processing. The accelerator can not only effectively improve the performance per watt of
the system, but also can reduce the interface traffic requirement between hardware platform
and the general purpose processor.
integration,
in
the
hardware resources
virtual machine (VM)
saving
can
and
adjust
cost
reduction. In
processing
resources
dynamically according to traffic variation between busy andspare time. Moreover, BBUs with low
traffic can be centralized onto fewer physical servers through VM live migration. By shutting
down the idle servers, the overall system power consumption can be reduced. Teaming up with
industry partners, China Mobile Research Institute associated has been extensively researching
on the implementation solutions of cloud and virtualization based C-RAN and has achieved lots
of achievements so far.
69
C-RAN aims to migrate the traditional base station to general-purpose servers and implement
virtualization. Toward this end, the correspondence between traditional BBU and VMs, i.e. the
granularity of virtualization is worthy of study and analysis. The figure above is just an example
in which one VM is assigned to process an original BBU. In practical deployment, it is possible
that a virtual machine can handle only one carrier within the BBU or even smaller units. On the
other hand, there is another layered approach in which a virtual machine handles
just one
Due to the difference of the communication protocols, the requirements of processing resources
for GSM, TD-SCDMA and TD-LTE are quite different in terms of compute capability and realtime performance. In practice, different virtualization granularity should be considered
accordingly. In the case of TD-LTE which has the highest demand for the processing resources,
a virtualization granularity as figure 6-13 showed could be adopted.
70
BBU1
VM
BBU2
BBU1 L3
VM
BBU2 L3
VM
VM
VM
VM
VM
VM
Cell 1
L2/part L1
Cell 2
L2/part L1
Cell 3
L2/part L1
Cell 4
L2/part L1
Cell 5
L2/part L1
Cell 6
L2/part L1
Hypervisor/VMM
Hardware
Acceloratorpart L1
Physical Server
Compared with L1, the real-time requirement of L2/L3 is relatively low, which makes it possible
to be placed in the virtual machine and processed by the CPU. However, certain technical
solutions for the hypervisor and the guest-OS of VM are still needed to ensure the real-time
signal processing, i.e., the so-called real-time cloud and real-time virtualization. A real-time
operating system is the basis of real-time virtualization. Taking into account openness,
versatility and overall system cost, we are now mainly using Linux as the operating system for
C-RAN. The research so far has shown that Linux kernel integrated with real-time patch is
suitable and effective for C-RAN virtualization. By introducing Linux real-time preemption patch
(PREEMPT_RT), conducting a series of parameter configuration and optimization, supporting
preemption and hard interruption, improving locking mechanism, the kernel can immediately
response and process correspondingly when receiving an interrupt request for signal processing,
so as to ensure the real-time performance.
Hypervisor also needs to leverage a similar real-time solution. By integrating the real-time
patch into the hypervisor or its host-OS and making parameter adjustment, the real-time
problem could be solved. In addition, the hypervisor needs to be further optimized to minimize
71
the overhead introduced by virtualization and the impact to the VMs real-time performance.
As for the selection of the type of hypervisor technology, in addition to the requirements of CRANs openness and versatility, whether it can provide solutions to meet the real-time demands
is the basic requirement. Currently, China Mobile Research Institute, together with partners,
has proposed a series of real-time solutions based on KVM and ESXi, and kept continuous
research on the performance optimization. The interrupt latency of an optimized RT-KVM
system is shown as figure 6-14, in which the maximum interrupt latency is less than 14s [12].
Fig. 6-14:
Virtualization management functions should also fulfill the real-time constraints. Taking VM live
migration as an example, the service interruption time of traditional live migration cannot fulfill
the real-time constraints of mobile networks. If utilized in C-RAN directly, it might happen that
the VM could not accomplish the migration process normally. So certain technical solutions
must be taken into account. China Mobile Research Institute is now working with partners to
research the appropriate technology solutions.
I/O virtualization
As mentioned above, C-RAN requires the use of L1 accelerator to solve part of the real-time
problems. The data exchange between L1 and L2/L3 raises very high requirements for the I/O
performance between the accelerator and the VM. In a traditional virtualization environment,
due to the introduction of the hypervisor, the data communication between VM and the
underlying hardware needs the hypervisors intervention, which brings additional overhead,
thus resulting in degradation of I/O performance. Therefore, I/O virtualization technique should
be introduced to improve the system I/O performance.
72
In the case of an accelerator serving only one VM, PCI passthrough technique is competent. But
in the case of one accelerator serveing multiple VMs, SR-IOV technique should be adopted.
Single Root I/O Virtualization (SR-IOV) is an I/O virtualization technique for single physical
server, which is based on PCI-E specification and relatively mature. By dividing the physical I/O
channel of PCI-e interface into multiple virtual I/O channels, the system can assign one or more
virtual channels to a VM when creating it. Each virtual machine's virtual channel is independent
and the data exchange between accelerator and its connected VMs is done through their
separate virtual channels. Without the intervention of hypervisor, the system I/O performance
is greatly improved. A server virtualization architecture applied with SR-IOV is shown in figure
6-15.
VM
Cell 1
L2/L3
VM
Cell 2
L2/L3
VM
Cell 3
L2/L3
Hypervisor/VMM
Hardware
Accelorator
Server
Developing on the basis of SR-IOV, Multi Root I/O Virtualization (MR-IOV) supports I/O resource
sharing and virtualization among multiple physical servers. By separating the PCI-e devices
from the physical server and forming a resource pool, I/O virtualization could be done in a
resource pool range. Taking advantage of MR-IOV, the binding relationship between accelerators
and physical servers can be removed, so that the system could allocate and orchestrate the
resources uniformly and more flexibly. So far MR-IOV is still on the development stage. China
Mobile Research Institute hopes to promote the MR-IOV technology and push forward maturity
73
of ecosystem together with industry partners. By then its application in C-RAN would be
expected.
As shown in Fig. 6-16, edge applications and BBU pool software are deployed over the same
hardware platform and isolated from each other via virtual machines. It is expected not only to
reduce backbone traffic and latency, but also to provide rapid time-to-market deployment via
GPP platform and virtualization technologies. The architecture has the following characteristics.
1.
processed. If we deploy applications over C-RAN BBU pool serving 5000~1000 users, the
hit rate of content retrieval can be guaranteed and deployment cost can be reduced as
well.
2.
Radio API: by providing real-time and refined radio network information, e.g. real-time
loading and radio link status, applications on edge can be improved further.
3.
GPP platform and IT technologies: low-cost and faster development, release, maintenance
can be achieved with mature development toolkits when using GPP platform.
74
4.
Collaboration with cloud data centers: Applications in the cloud data centers and over the
edge can collaborate and complement each other to build a smarter pipe.
Data Center
Network
optimization
Other
servers
Content
source
Core Network
IP
API
BBU Pool
S1
Data
Content Online
collection Cache gaming
Location
based
VM
VM
GPP HW
Base Staitons
Edge App
Platform
Fig. 6-16 Edge applications architecture over C-RAN GPP BBU pool
We have made rough estimation of the number of LTE users and the traffic models in the next
5 years. Based on those assumptions, CDN/Cache deployment locations and hit rate of content
retrieval have also been analyzed. The results show that C-RAN architecture is a perfect match
for edge CDN/Cache deployment. For example, we assume that the penetration rate of LTE
users is 30% and the total number of LTE users is expected to reach 200 million with some
provinces having 10 million users. We also assume that approximately10% of LTE users watch
video for 5 minutes per day and the average bit rate is 1Mbps. Then the total traffic reaches up
to 200Gbps and 8Gbps per province could be attained. It is clear that the expected traffic is
going to bring considerable pressure over the access and backbone transmission network. In
order to overcome those challenges, it would be beneficial to distribute CDN/Cache over the
edge for better traffic offloading. Further analysis shows that if C-RAN consolidates more than
50 base stations and serves more than 10 thousand users, the hit rate of content retrieval
could reach as high as 30% or so.
75
In addition, we have specified radio APIs including dozens of radio parameters on user, cell and
eNB levels. The APIs include real-time loading, ongoing and potential QoS, mobility, signal
strength, transmission power etc. These open APIs enable the edge applications to adjust
parameters such as UL/DL audio/video bit rates, picture and text compression rates etc. Edge
applications can also customize the reporting periodicity and subscribe/notify the specific
parameters. Currently our C-RAN vendors are developing the related API interface based on the
specifications.
Lastly, we are working on Proof of Concept and verification. Figure 6-17 is the architecture of
the prototype under development.
implementing data routing module over LTE BBU pool. Upon applications request, radio API
platform is able to provide real-time user/cell/eNB/Pool level radio link information. We are
focusing on two types of edge applications. One is content caching with video acceleration. The
popular and top viewed video is cached over C-RAN and the bit rates are adjusted. Alternatively
the content can be pre-cached based on real-time radio network status. The other is LTE
network optimization. By deploying the software module of radio data collection, processing
and distribution over C-RAN BBU pool, most of radio data can be processed locally. Unlike
traditional ways of collecting all traffic with higher bandwidth and processing requirements, in
this way only small amount of necessary radio data is required to be collected and backhauled
to the centralized OAM center.
Core
Netowork
C-RAN GPP
platform
LTE
BBU
Pool
User
plane data
routing
Radio
API
platform
Edge
applications
We have finished the first TD-LTE PoC with edge services recently. We adopted open source
OAI for RAN protocol stack and implemented end-to-end communications with commercial
terminals.
In addition, we have integrated three different services to demonstrate the strengths of edge
computing.
1. Voice recognition: the software client installed in terminals uploads collected voice clips to
the analyzing server deployed close to RAN. And the server can convert speech to text quickly
76
and send response in a rather real-time manner. In the future, we are going to explore the
possibility of introducing image and video recognition.
2. Radio signal quality analysis: when the drop rate or interference is high in current serving
cell, BBU software can start analyzing signal quality by importing IQ data. In this way the
interference issues and other abnormal cases can be quickly identified and resolved.
3. Radio signal map: real-time radio signal statistics per users can be collected via an open API
of BBU to form a real-time radio signal map so that operator can monitor each base station
globally and visually.
We would like to work together with industrial community to accelerate the research,
standardization, development and commercialization of edge applications. On one hand, we
focus on interface standardization and functional extension of RAN equipments, in which the
standardization of radio API is indispensible for inter-operability in a multi-vendor environment.
Currently user plane traffic routing is based on relatively static configurations (e.g. APN, GW
location), which tends to place restrictions on the flexibility of edge services. More flexible data
traffic routing is essential, e.g. based on application types.
make full advantage of distributed computation and storage capabilities, we also hope to work
with application providers to dig more use cases of edge services.
77
7 Evolution Path
C-RAN is not only a new network infrastructure, but also a combination of introducing a serial
of new technologies in this new infrastructure. Thus, the deployment of C-RAN must be a wellplanned, step-by-step process. Due to the fact that there are many different areas with
different deployment scenarios, and there are many different existing radio access technologies
deployed, it is natural that C-RAN would have different scheme to best suite the above
situations. For China Mobile, 2G and 3G is not longer the focus of future network build-out, but
here are still very large assets of 2G and 3G system throughout the county. Thus for existing
system, the focus is to maintain the network and increase network capacity where needed. The
focus is TD-LTE network construction, which is also the focus of C-RAN deployment.
Considering the TD-LTE construction progress and future timeline, C-RANs overall deployment
strategy can be divided into three stages, where different area may have different timeline on
these stages.
To address this deployment challenges, C-RANs major deployment scenario is to combine with
all-service access network deployment, which centralized BTS within 3~5 squire km into
aggregation transport equipment room. In the same time, remote micro-RRU can be used for
hotspot and coverage hole deployment to improve the network coverage and performance for
area where it is hard to find new sites.
On the BTS main equipment side, the centralized BBU can build Baseband Pool, and introduce
co-operative algorithm like CS/CB or JT/JR etc. Because TD-LTE with same frequency network
deployment is more sensitive to inter-cell interference, it requires higher accuracy in network
planning and optimization. BTS main equipment needs to gradually migrate to GPP based open
platform to better support third party network application software that can monitor and
analysis the network performance and interference situation in real-time. This will enable much
faster network optimization and tuning based on effective in-field measurement data, and will
be helpful to improve the overall network quality. Considering the time needed in BTS main
78
For the fronthaul transport, introduction of WDM solution is needed. This will resolve many
deployment scenarios difficulty in finding extra fiber sources by using existing dark fiber to
transmit multiple route of CPRI/Ir/ORI in WDM. In places where there is no fiber resource at all
or too expensive to deploy fiber, mmWave solution can be considered to address the last
hundred meter fronthaul transmission.
To deal with the capacity need, macro base station will introduce more carriers and carrier
aggregation technology. In addition, more remote micro-RRUs will be introduced into network
to improve the network capacity for the surging mobile broadband traffic. The TD-LTE HetNet
will be composed by the overlay of existing macro base station and the additional micro-RRUs
will be an important deployment scenario. There are many different technical solutions for
HetNet, including same frequency of macro and micro cell deployment, carrier aggregation,
separate of user plan and control plan between macro and micro cell.
Due to the tight connection between macro and micro cell in the HetNet deployment scenario, it
is necessary for centralized BBU pool for HetNet. This will in turn named many advanced
features in HetNet, including but not limited to: co-operative radio transmission/receiving
between macro and micro cell, separation of user plan and control plan based on carrier
aggregation between macro and micro cell etc. The BTS main equipment should be based on
GPP open platform plus physical layer accelerator card. Meanwhile, network side applications
like CDN/Cache can be deployed on GPP based BBU pool to cache certain data. This will greatly
reduce the backhaul transmission traffic. Shared open platform will largely reduce the overall
TCO operating Radio Access Network and the CDN devices, which is one key benefits of C-RAN.
79
more and more micro-RRU will be deployed in the network, and these micro-RRU will have
overlapping coverage with neighbor micro-RRU. And due to the increasing number of microRRU and baseband pool size, the advantage of baseband pooling will be significant.
At this stage, more and more BBU pool will be using GPP-based open platform. The legacy
2G/3G network can be gradually replaced by soft BTS deployed on the same TD-LTE BBU pool
and multi-band multi-mode RRU. In addition, more and more high layer network application
can be deployed in the same BBU pool, which will enable better operation and optimization of
the Radio Access Network, and enable faster innovation and deployment of services. This will
enable the mobile operators to avoid the dumb pipe position in mobile internet ecosystem, and
to become smart pipe to better compete with internet service providers in the future.
80
C-RAN deployment
SK telecom and Korea Telecom, the two biggest carriers in south Korea which is famous for rich
fiber availability, adopts C-RAN centralization method to deploy the commercial LTE networks.
Their C-RAN deployment has a high centralization scale. It is said that the LTE network in Seoul
is centralized into around 10 central offices with each supporting on average several hundred
LTE carriers. In Japan with similarly rich fiber resource, DoCoMo just released a public release
claiming their plan of using C-RAN for future LTE-A deployment.
C-RAN in SDOs
In 2009 a dedicated C-RAN project P-CRAN was founded in the alliance of Next Generation
Mobile Networks (NGMN) [15]. Led by China Mobile and received extensive supports from both
operators and vendors including KT, SKT, Orange, Intel, ZTE, Huawei and Alcatel-Lucent, this
project aimed at promoting the concept of C-RAN, collecting requirements from operators and
helping build the ecosystem. The project was closed at the end of 2012, releasing four
deliverables to the industry. Through the deliverables, the advantages of C-RAN in saving TCO
cost and speeding up site construction are well understood. These deliverables also include the
C-RAN requirements and initial study on key technologies as well as the potential SDO impact.
In 2013 NGMN extended the study on C-RAN in a C-RAN work stream under the project of RAN
Evolution. On the basis of previous C-RAN project, this work stream aims at further detailed
study on key technologies critical to C-RAN implementation, including BBU pooling, RAN sharing,
function split between the BBU and the RRU, and C-RAN virtualization. In addition, the
requirements on C-RAN fronthaul are specified, which is of significance to C-RAN deployment.
Another organization worth mentioning is Network Functions Virtualisation (NFV) Industry
Specification Group (ISG) under the auspicious of European Telecommunications Standards
Institute (ETSI). Founded in 2012, this ISG is devoted to the development on the virtualization
requirements and the system architecture. The idea behind NFV is to consolidate many
network equipment types onto industry standard high volume servers, switches and storage,
which could be located in Data centers, network nodes and in the end user premises [12]. So
far this ISG has attracted more than 150 members from not only telecom but also IT industry.
In addition, there are several C-RAN related projects under European Commissions Seventh
Framework Programme (FP7). For example, the iJOIN project deals with the interworking and
joint design of an open access and backhaul network architecture for small cells on cloud
networks [13]. Another project, Mobile Cloud Networking (MCN) aims at exploiting Cloud
Computing as infrastructure for future mobile network deployment, operation and innovative
value-added services [14].
81
9 Conclusions
With the arrival of the mobile Internet era, todays RAN architecture is facing more and more
challenges that the mobile operators need to solve: mobile data flow increases drastically
caused by the popularity of smart terminals, spectrum efficiency bottleneck, lack of multistandard flexibility on the same platform, dynamic network load because of the tidal effect,
and expensive to provide ever increasing internet service to end users. Mobile operators must
aggressively consider the evolution of the RAN to a high efficiency and low cost architecture.
C-RAN is a promising solution to the challenges mentioned above. By using new technologies at
various stages of C-RAN, we can improve and simplify the network construction and
deployment, fundamentally change the cost structure of mobile operators, and provide more
flexible and efficient services to end users. With the distributed RRH and centralized BBU
architecture, advanced multipoint transmission/reception technology, SDR with multi-standard
support, virtualization technology on general purpose processor, more efficient way of dealing
with the tidal effect and service on the edge of the RAN, C-RAN will provide todays mobile
operator with a much more efficient, competitive, and profitable infrastructure in the dynamic
market environment.
China Mobile has been developing and deploying C-RAN systems since 2009. In particular,
CMCC has conducted extensive field trials in more than 10 cities across China. Our field trials in
GSM and TD-SCDMA have vigorously demonstrated the benefits that C-RAN centralization can
bring to operators. For example, compared to distributed TD-SCDMA networks, up to 15%
CAPEX and 50% OPEX could be saved using C-RAN centralization. Moreover, system roll out
time is saved by 1/3 and in view of green deployment, the saving on power consumption can
be as high as 70%.
In the meantime, the TD-LTE C-RAN trials in the cities of Fuzhou, Chengdu and Guangzhou
have verified the maturity and effectiveness of CPRI compression and single fiber bi-direction
(SFBD) technologies in the fronthaul implementation. Using SFBD and CPRI compression with
2:1 compression ratio, the fiber consumption can be saved by 3 folds while keeping system
performance lossless. Moreover, WDM-based solutions are being tested currently, which
promises even greater potential save on fiber resource and facilitate large-scale C-RAN
deployment.
On the road toward virtualization, CMCC has developed an x86-based 3-mode base station
prototype in which GSM, TS-SCDMA and TD-LTE were realized in a pure software manner.
Although CMCC has demo-ed an end-to-end call using commercial UE and core network. the
pure software implementation is not achieved cost effectively. The power-performance ratio is
low. It is therefore concluded that a dedicated hardware accelerator is needed for processing
partial L1 functions that are computation-intensive, e.g. iFFT/FFT and channel coding/decoding.
Under the guidance of this idea, two sets of PoCs were further developed. One PoC was
developed by commercial LTE protocol stack. It was proved that with the adoption of dedicated
accelerator, the performance-power ratio of the general-purpose processor platform is
comparable to that of traditional proprietary platform. The other PoC demonstrated the power
of edge computing for new service introduction and innovative network operation and
management.
The ultimate goal of C-RAN is to realize resource cloudization and one of the possible solutions
to achieve that is virtualization technology. In this White Paer a system reference architecture
82
is proposed and further analysis showed that the major challenges for virtualization
implementation lie on granularity of virtual machine, hypervisor and operating system
optimization and I/O virtualization.
C-RAN is a multi-stage RAN evolution which requires joint efforts from every partner in the
ecosystem including both IT and telecom industry. CMCC would like to take this WP as an
opportunity to call for more action, contribution and commitment on C-RAN research and
development, which is the sure trend to the future.
83
Acknowledgements
We would like to thank Alcatel-Lucent, IBM China Research Lab, Intel Cooperation and Institute
of Computing Technology, Chinese Academy of Sciences for their valuable contribution to this
white paper. We would also like to express our gratitude to all C-RAN team members in China
Mobile for their hard work.
84
AIS
ASIC
ARPU
BBU
BS
Base Station
CAGR
CAPEX
Capital Expenditure
CBF
Coordinated Beam-Forming
CDN
CoMP
C-RAN
CSI
CT/CR
Cooperative Transmission/Reception
DPI
DSP
DSN
eNB
Evolved Node B
FEC
FTTX
Fiber To The X
FPGA
GGSN
GPP
GSM
HW/SW
Hardware/Software
ICI
Inter-cell Interference
IQ
In-phase/Quadrature-phase)
I/O
Input/Output
JP
Joint Processing
LTE
LTE-A
MAC
85
MIMO
MNC
OBRI
NFV
OFDM
OPEX
Operating Expenditure
OTN
O&M
P2P
Peer to Peer
PA
Power Amplifier
PHY
Physical Layer
Pon
QoS
Quality of Service
RAN
RF
Radio Frequency
RNC
RRH
RRM
SDR
SFP
SGSN
TCO
TDD
TD-SCDMA
TEM
TP
Transmission Point
UE
User Equipment
UL/DL
Uplink/Downlink
UMTS
UniPon
VNI
VM
Virtual Machine
VoIP
Voice over IP
WCDMA
WDM
86
XENPAK
XFP
87
References
[1] Co-Platform Multi-Mode BTS (C-P MMBTS): Leading the Trend of Multi-Mode Network
Convergence, white paper from In-Stat, 2009.Multi standard
[2] Cisco Visual Networking Index, URL: www.cisco.com/web/go/vni
[3] Geza Szabo,Daniel Orincsay,Balazs, Peter Gero,Sandor Gyori,Tamas Borsos, Traffic
Analysis of Mobile Broadband Networks, Third Annual International Wireless Internet
Conference October 22-24, 2007, Austin, Texas, USA
[4] CPRI
Specification
V4.1,
Common
Public
Radio
Interface
(CPRI);
Interface
Specification. 2009-02-18
[5] F.-Joachim Westphal. Trends and evolution of transport networks. SL SI, IBU Telco, SSC
ENPS
[6] 3GPP, R1-093273, SRS feedback mechanism based CoMP schemes in TD-LTE-Advanced
[7] Q. H. Spencer, A. L. Swindlehurst and M.Haardt, Zero-forcing methods for downlink
spatial multiplexing in multiuser MIMO channels, IEEE Transactions on Signal Processing,
vol. 52, pp. 461 471, Feb. 2004.
[8] L. U. Choi and R. D. Murch, A transmit preprocessing technique for multiuser mimo
systems using a decomposition approach, IEEE Trans. Wireless Commun., vol. 3, no. 1,
pp. 2024, Jan. 2004.
[9] Jun Zhang, Runhua Chen, J. G. Andrews and R. W. Heath, Coordinated multi-cell MIMO
systems with cellular block diagonalization, Proc.41st Asilomar Conference on Signals,
Systems and Computers (ACSSC 07), pp. 1669 1673, Nov. 2007.
[10] Rajesh Gadiyar, John Mangan, Using Intel Architecture for implementing SDR in Wireless
Basesations, SDRForum, SDR09.
[11] White Paper of Distributed Service Network. China Mobile Research Institute.
[12] ETSI
NFV
ISG
(2012)
Network
Functions
Virtualisation.
[Online].
Available:
http://portal.etsi.org/portal/server.pt/community/NFV/367
[13] www.ict-ijoin.eu
[14] https://www.mobile-cloud-networking.eu
[15] www.ngmn.org
88
Contact:
HUANG Jinri
DUAN Ran
Email:
huangjinri@chinamobile.com
duanran@chinamobile.com
89