fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
1
AbstractA Smart Grid is a highly complex cyber-physical electrical power system that uses two-way digital communication and
intelligent embedded devices to achieve sensing, control, computation and communication within power network. To validate the
functionality, security and reliability of such an system requires the modeling and emulation of both communication network and power
network, as well as the interactions between them. In this paper, we present Smart-Grid Common Open Research Emulator (SCORE),
a distributed software emulator for cyber-physical analysis in Smart Grid. SCORE integrates the emulations of both power network
and communication network, and it is highlighted by the following features: firstly, SCORE is the first software emulation platform for
Smart Grid, which means that the same application program running in SCORE can be directly ported to embedded devices with little
or no migration issues. Secondly, for one Smart Grid instance, SCORE supports distributed emulation when the instance is in very
large scale. Thirdly, for multiple Smart Grid emulation instances running on different networked computers, SCORE allows them to
dynamically connect or disconnect with each other in run time, such that each instance can capture its own interior system dynamics
even without a prior knowledge of the entire Smart Grid topology.
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
2
with each other in run time when the interfaces management strategy is simulated and analyzed within
between each other are specified. Each instance this platform. In 2009, Molderink et al. built a sim-
can capture its own interior system dynamics even ulation environment from scratch to analyze control
without a prior knowledge of the entire Smart Grid algorithms for energy efficiency [8]. Micro-generators,
topology. energy buffers and appliances are modeled and different
2 R ELATED WORK energy streams like heat and gas are considered. In
2010, Faria et al. presents Demsi, a simulator for demand
Creating test platform for cyber-physical analysis in response in the context of competitive electricity markets
Smart Grid is challenging and it has been studied for and intensive use of distributed generation [9]. Demis
years. From our literature reviews, the approaches to is extended from power system analysis tool PSCAD
solve this issue generally fall into two categories: real [10]. Energy service provider and demand side player
hardware testbed and software simulation. are modeled and strategic decisions are supported. In
2.1 Real hardware testbed approach 2011, Narayan et al. presents GridSpice [11], a cloud-
based simulation package for Smart Grid. Leveraging the
Real hardware testbeds are further classified into two powerful component of Gridlab-D [12] and Matpower
categories: flat-out hardware platforms and hardware- [13], GridSpice is being developed iteratively with an
in-the-loop platforms. ultimate goal of modeling the interactions between all
2.1.1 Flat-out hardware platform parts of the electrical network, including generation,
transmission, distribution, storage and loads. Currently,
Flat-out hardware platforms are the ones consisting of
GridSpice includes the ability to perform distribution
pure hardware devices. The Korean government selected
simulations along with one-shot optimal power flow
the whole Jeju Island to build the Smart Grid testbed
simulations and demand response features. All the in-
to allow the testing of Smart Grid technologies and
dividual software platforms can complete their own
business models [2]. Renewable Energy Laboratory in
tasks in the specific application domain, but they all
Greece set up a central-controlled microgrid testbed
just concentrate on the power network simulation. The
consisting of PV-panels, battery banks and inverter-
Communication network, as another critical component
s to investigate the proposed Smart Grid topologies
of Smart Grid is not considered in these platforms. This
[3]. Sensorweb Reserach Laboratory from Georgia State
is why the co-simulation platform comes to the picture.
University designed SmartGridLab testbed to test the
distributed demand response algorithm. It consists of 2.2.2 Co-simulation platforms
intelligent power switch, power generator, renewable
Co-simulation (co-operative simulation) is a simulation
energy sources, smart appliances, and power meter [4].
methodology that allows individual components to be
2.1.2 Hardware-in-the-loop platform simulated by different simulation tools running simul-
Hardware-in-the-loop platform mixed hardware devices taneously and exchanging information in a collabora-
with software simulators to achieve the cyber physical tive manner [14]. In [15], Hopkinson et al. introduce a
analysis of Smart Grid. Stanovich et al. in [5] integrates federated simulation combing NS2 [16], a discrete event
hardware from energy field, such as Remote Terminal network simulator with PSCAD [10], a continuous time
Unit (RTU), fiber optical cables within the testbed. Hahn power network simulator. In [17], Godfrey et al. simulate
et al. in [6] employs devices like Programmable Logic the Smart Grid using NS2 and OpenDSS [18], a power
Units (PLUs) and Intelligent Electronic Devices (IEDs) network simulator. In [19], Mallouhi et al. set up a co-
for communication networks and Real-Time Digtial Sim- simulation testbed specifically for security analysis of
ulators for power network simulation. SCADA system by employing PowerWorld simulator
and OPNET. In [20] and [21], Lin et al. introduces a global
2.2 Software simulation approach event queue to synchronize NS2 and PSLF [22]. The co-
The software simulation tools for Smart Grid analysis simulation approach typically needs iteratively running
can be further classified into two categories: individual separate electrical and communication network simula-
simulation platforms and co-simulation platforms. tion. The performance is affected by putting extra over-
head of an intermediary of synchronization. Meanwhile,
2.2.1 Individual simulation platforms the interaction between communications and power sys-
Individual simulation platforms are those which en- tem models is usually restricted to fixed synchronization
capsulate the simulation features for Smart Grid into interval. Mismatches can occur between the real dy-
one entity. In other words, it is one single simulator to namics and the simulated one, which exposes reliability
complete the job. These platforms usually focus on one issues of such systems. An improvement about this issue
particular aspect of interests for Smart Grid. In 2008, is to integrate one simulation component into the other.
Guo et al. designed and developed an energy demand In [23], electric network is made into a component within
management simulator (EDMS) to predict the response OMNET++ [24], a network simulator. In [25], the adevs
from different deployment strategies of distributed do- simulation tools are integrated into NS2 to provide a
mestic energy management [7]. A self-adaptive demand hybrid modeling of the continuous time power system
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
3
and discrete event communication system through the connect and disconnect with the testbed at any time.
discretization of the continuous power dynamics. SCORE also has its own limits: the power network model
2.3 Remarks about related work is static DC power flow model such that we cannot use
SCORE to capture transient power dynamics or renew-
From the above discussion, we can see the characteristics able grid integrations, etc. The strengths and limitations
of the real hardware testbed approach and the software of our approach compared with related works are listed
simulation approach for cyber-physical analysis in Smart in Table 1.
Grid.
The real hardware testbed approach achieves high
fidelity by employing dedicated devices as part of the TABLE 1
testbeds. The critical control programs, such as demand Summary of features for Real hardware testbed,
response algorithms, routing protocols, and security s- Software Simulation and SCORE
Real hardware testbed Software Simulation SCORE
trategies, can be tested in real hardware testbeds and Accessibility Difficult Easy Easy
Scalability Low High High
they could be directly migrated to the actual Smart Grid Code migration Yes No Yes
Time step Real time Real time/discrete time Real time
embedded devices. However, the problems with the real Transient analysis of power system Yes Yes No
Renewable integration Yes No No
hardware testbed approach is that since the dedicated
and specialized hardware are the integral parts of the
testbeds, they cannot be easily accessed and used by
Our previous conference paper in [26] has draw great
the public research community and difficult to be scaled
attention in research community and our open source
when the test case becomes quite large.
release now has more than one hundred downloads from
The software simulation approach, on the other hand,
http://sourceforge.net/projects/score-sensorweb/.In
achieves better scalability and can be easily accessed
this paper, we make substantial extensions by:
and distributed. The software simulation tools typi-
cally run on a single PC and abstract the operating Presenting implementation details of GUI, services
system, communication protocols and power dynamics layer, lighted weighted virtual nodes, communica-
into mathematical simulation models to produce overall tion module, power module.
statistical analysis. In other words, they just duplicate Adding domain decomposition based algorithms
the behaviours of the Smart Grid system but not the and implementations for dynamic connect and dis-
execution environment. Therefore, the critical control connect feature.
programs of Smart Grid applications either cannot be Developing energy model programming API library.
tested or can be tested but cannot be migrated to physical Conducting extensive survey of related work.
Smart Grid devices directly. 3 S YSTEM DESIGN AND IMPLEMENTATION
2.4 Our approach: software emulation 3.1 Overview
SCORE bridges the gaps between real hardware ap- Our design of SCORE takes advantage of COREs struc-
proach and software simulation approach. The key ad- ture. Figure 1 provides an abstract overview of SCOREs
vantages of SCORE are: architecture and our integration approach. As shown,
First, software emulation achieves high fidelity by SCORE consists of GUI, Service Layer, Communication
duplicating the execution environment, such that Module and Power Module.
the programs running in the emulation platform
3.2 GUI
can be directly ported to the embedded devices as
firmware. The SCORE GUI is built using Tcl/Tk. The Tk toolkit
Second, SCORE enables distributed emulation fea- provides almost sufficient widgets for all the X window
ture such that very large scale test case can also be system interface needs. The Tcl/Tk GUI provides an
supported. easily drag-and-draw canvas with various Smart Grid
Finally, SCORE supports dynamic connection and devices (Appliances, Solar Panel, and Wind Turbine,etc),
disconnection between multiple Smart Grid emula- which can be placed and linked together with commu-
tion instances in real time. The significance of this nication links or power lines. Also, the communication
feature is two folds. First, when users from multiple interfaces, power interfaces and energy model parame-
parties in different locations want to conduct the ters of each node can be configured. During emulation
integration testing together, but want to preserve execution, a bash shell can be popped out when double
the privacy of power and communication networks clicking the selected node. Users can navigate the local
configurations, this feature would make it happen file system or execute bash script through the interactive
without requiring explicit synchronization from all shell window. Distributed emulation can be conducted
parties. Second, our in-progress research is integrat- by assigning a selection of nodes to another emulation
ing SCORE with real hardware testbeds. In this case, server in GUI. The message broker in Service Layer is
the dynamic feature would be necessary since we used to forward messages from the GUI to the appro-
want to give the freedom of SCORE to dynamically priate emulation server.
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
4
Virtual Nodes the perspective of codes running inside the virtual node,
each emulated node is just another piece of hardware
platform controlled by Linux OS, which equips SCORE
Smart Grid
Applications
with the property of portability that the emulated node
Service Layer
can execute unmodified Smart Grid application codes
Communication Power running inside a real physical Linux-running hardware
interface interface Start-UP
daemon
GUI
devices, and vice versa.
Linux 3.5 Communication Module
Power containers
Communication Module support
Module
The communication module in SCORE leverages the
Initializer
Session comprehensive support of various wired and wireless
Wire/
Energy
manager communication network models and protocols from
Wireless
model
models Dynamic CORE. Each emulated node has its own instance of OS
$
connection/
Synchronization
/interaction
Power disconnection implemented TCP/IP stack supported by Linux names-
add-on
network
model
paces, from the perspective of Open Systems Intercon-
Protocol Smart Grid
library Incremental Services nection (OSI) model, thus SCORE allows high fidelity
update emulation of network layer and above. By default, a sim-
handler
plified simulation of link and physical layers is enabled,
which is implemented using netem with Ethernet bridg-
ing in Linux. Statistical network effects such as band-
Fig. 1. SCORE Architecture width, loss rate, bit error rate and noise level can be con-
figured and applied. For higher-fidelity link and physical
layer emulation, other network simulation tools, such as
3.3 Service Layer EMANE [1], can be easily integrated. In addition, the
The Service Layer are python frameworks that is re- virtualized Ethernet interface can be directly mapped
sponsible for creating sessions, instantiating the virtual to a physical Ethernet interface on the emulation host,
nodes, communication and power interfaces, communi- such that all the traffic passing through that physical
cation links and power lines, based on the GUI input port can be transferred to the emulation environment,
or a batch-mode configuration file. Note that start-up allowing real time communication between the virtual
daemon in service layer interacts with GUI using a nodes inside a running emulation and external physical
TCP socket-based API such that the emulation can run networks. By using the virtualized interfaces on each
on a different machine with the GUI or even without emulation host, the communication network emulated
a GUI. Pre-defined energy models and communication on different hosts can directly connect with each other
protocols, which are usually daemonized in the Linux in run time, which enables the dynamic emulation of the
operating system of emulation server, are all wrapped as communication networks. Meanwhile, we employ this
Smart Grid services in this layer. These communication feature to enable the interactions and synchronization
and energy services can all be employed to develop between the communication module and the power
various Smart Grid Applications. Users are also allowed module discussed in the next section. The idea is that
to add their own customized services to SCORE by the power module is running on a host physically in
providing their own implementations. Last but not the the same network with the communication emulation
least, as our newly developed feature, the Dynamic host so that the power module can receive and react to
connection/disconnection add-on in service layer can the queued-up messages sent by all the emulated virtual
process the dynamic emulation request by employing the node in real time.
dynamic features in communication modules and power
3.6 Power Module
modules.
The power module in SCORE emulates the power flows
3.4 Light weighted virtualization
analysis within Smart Grid and also provides implemen-
The emulation feature of SCORE are implemented us- tations of pre-defined energy models. We use current
ing Linux namespace techniques, which is a recent model in circuit theory to emulate the real power flow
light weighted paravirtualization technique supported within power network. Figure 2 shows the data flow
by mainstream Linux kernel. Different from the typical diagram of power module. The power module receives
virtual machines techniques like the ones in VMware initial power network topology, energy model config-
or Virtual Box, each emulated virtual node in SCORE uration information and the dynamic connection/dis-
only has its separated copy of network interface, protocol connection request from service layer to formulate the
stack and process control group. Other resources like power network model, which will be introduced later.
operating system and local file system, are shared by all The model is updated when the corresponding model
the virtual nodes. This light-weighted virtualization ap- updates are received from the interactions with commu-
proach enables the scalability of SCORE. Moreover, from nication module.
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
5
The power network module of SCORE is highlighted 3.6.1 Power network model
by the following features: Now let us introduce the power network model. Assume
First, SCORE adopt incremental model updating in a power grid is composed of n nodes and b branches.
computation to react more efficiently to the system Since the power network dynamics is subject to Kirch-
status changes. hoffs current and voltage laws (KCL and KVL), in order
Second, as the size and order of the power net- to calculate the voltages of all nodes, we apply nodal
work increase, distributed computation for power analysis to the grid and get the linear equations for the
network becomes a necessity for efficient Smart Grid whole system:
emulation. SCORE highlights itself in scalability by AV = I (1)
enabling the user to conduct the emulation in a
distributed way when a single PC cannot provide where coefficient matrix A is the (n 1) (n 1)
enough computation capabilities. We choose to split reduced nodal admittance matrix since we have chosen
the power network model into several subdomains a reference node. Let N br(i) represents the neighbor set
and let each subdomains be computed and updated of node i in the power network, we get:
separately in parallel. With appropriate coordinating P
gis i = j.
among those separate computing and updating pro-
sN br(i)
cesses, the merged result of power flows in Smart aij = gij j N br(i) (2)
Grid is solid without any loss of precision compared
0 otherwise
with centralized computation.
Finally, by only specifying the interfaces between gij is the admittance between node i and node j, V and
each power network, SCORE allow dynamic con- I are the unknown node voltage vector and the known
nections and disconnections of multiple Smart Grid nodal current injection vector, respectively.
instances running on different hosts. The signifi-
3.6.2 Incremental updating
cance of this feature are two-folded: first, in the
situation when each user is reluctant to expose their Based on previous model, lets consider the situation
own Smart Grid topology details to others, they when the power network topology changes. Suppose
can still conduct the combined emulation with each the power grid status changes, such as the admittance
other to see the impact of external networks on their between node i and node j is changed by gij . So the
own network. Privacy is protected while Smart Grid new coefficient matrix A
e can be written as:
analysis is conducted. Second, even though we have
e = A + U gij U T
A (3)
not implemented in our platform, by adding an ap-
propriate hardware interface serving as the gateway, where
this feature enables SCORE to communicate and h iT
exchange energy directly with testbeds or even the U= 0 1 1 0
real power grid. This cyber-physical interaction is i j
very valuable to the scalable and reliable testings of
Smart Grid technologies [27]. Particularly, the changed admittance gij equals to gij
when the branch is removed and gij = gij when a new
Power network branch is added. Notice that [28]
topology and Energy
model information
e1 = A1 A1 U gij 1 + U T A1 U 1 U T A1 (4)
Initailized
A
power network
Parsing model e1 with a much lower computation
Dynamic Connection/ then we can get the A
disconnection request
cost when we store previously computed A1 .
Power network
Partitioning
model updates
3.6.3 Power network model: domain decomposition
Power flows in
Smart Grid Parallel power
Coordinating
network model Power network is naturally suitable for emulation in
distributed paradigms, since due to the economy and
Power network models in
each subdomain geographical reasons, power network is generally a net-
Multiple instances work of loosely coupled sub power networks. Each sub
Topology
updates network is a relatively independent partition of the w-
Computation result
Computing
Incremental hole energy system and only few in-between connection
in each subdomain updating
lines join them together. Inside each sub network, we
divide the nodes into two sets:
Updates result
Internal nodes: nodes that only have connections
with the nodes inside the same sub network.
Fig. 2. Data flow diagram of Power Module Boundary nodes: nodes that have connections with
the nodes in other sub networks.
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
6
each sub network and putting all the boundary nodes of Vb1 Vb2
the network in the back, we formulate the nodal analysis Sub network1 Sub network2
b1 b2
model for the whole power network as the following:
Vb1 Vb2
YA1 A1 0 0 YA1 B VA1 IA1
0 YA2 A2 0 YA2 B VA2 IA2
.. .. .. .. .. .. ..
(5)
= .
. . . . . .
Fig. 4. The decomposition of one power network emula-
0 0 YAk Ak YAk B VAk IAk
YBA1 YBA2 YBAk YBB VB IB tion instance into two.
Notice that B is the set of all boundary nodes in the the power network is decomposed into k sub power
whole network, consisting of B1 , B2 , ..., Bk . Therefore, networks and each sub power network is assigned to
YAi B only has non zero entries in its submatrix YAi Bi , one computation host. We choose one of them as the
for all i = 1, 2, ...k. Coordinator and it also caches YBB and IB for the
From (5), if the voltages for boundary nodes set VB boundary node set. Based on equations (6) (11), the
is known, then the voltages for the nodes in each sub decomposition process for each computation host i, i =
network can be calculated as the following: 1, 2, ..., k, is executed as the following:
YAi Ai VAi = IAi YAi B VB , i {1, 2, ..., k}. (6) Compute xi and yi based on equations (10) and
(11) respectively. Send the results to the Coordinator
Meanwhile, if we keep the corresponding part for the
host.
boundary node set B in equation (5), we can get:
The coordinator collects xi and yi from each host,
Yg
BB VB = IB
f (7) and calculate VB based on equations (7) (8) (9). After
that, it sends VB back to each host.
where Each host i receives VB from the coordinator and
k
X calculate VAi based on equation (6).
BB = YBB
Yg YBAi YAi Ai 1 YAi B (8)
i=1 3.6.5 Dynamic connection/disconnection between mul-
k tiple instances
X
B = IB
If YBAi YAi Ai 1 IAi (9) Our platform also highlights itself by enabling the dy-
i=1 namic connections and disconnections of several inde-
Define pendent emulation instances. The emulation instances
xi = YBAi YAi Ai 1 YAi B (10) of different power networks running on different hosts
can interact with each other in run time to evaluate the
yi = YBAi YAi Ai 1 IAi (11)
impact on system dynamics when other energy systems
for all i = 1, 2, ...k. Notice that xi and yi only requires join in. This kind of analysis is critical for the transient
local information for sub system i, we employ this stability analysis of power network when the network
feature to provide the following two power network topology is reconfigured [30]. Figure 5 illustrates the
emulation paradigms in our platform. composition example of two independent power net-
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
7
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
8
50
4.2 Distributed emulation
600
40 SCORE extends its scalability by distributed emulation.
30 400 We evaluate SCOREs scalability using the previously
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 introduced test case and extend it to a much larger
Period (h)
scale. Our testing machines are 64 bits HP destop with
Fig. 7. Real time price and Total energy supply from Pentium(R) Dual-Core CPU E5700 @ 3.00GHz and 4GiB
power plant memory. Figure 8 and Figure 9 shows the peak CPU
usage and memory usage of SCORE running on one,
two and four machines when the scale of the Smart Grid
Power Plant: Broadcasting its real time energy increases. We can see from the figures that as the number
prices to all the intelligent power switches. The of emulation servers increases, the CPU and memory
energy price has only two values: HIGH (100 cents usage of each machine is decreased since each of them
per kwh) and LOW (50 cents per kwh). can take care of the instantiation, computation and com-
Intelligent Power Switch: Receiving the energy munication in parts of the Smart Grid. A single instance
price information from the power plant and then of our PC can support about 100 virtual nodes effectively.
relay the messages to the other nodes within the SCOREs distributed emulation capability greatly release
same house immediately. the burden of each emulation server and enable large
Load: Receiving energy price information from in- scale emulation.
telligent power switch. When the price is HIGH, it
120
lowers its load from 200w to 150w. When the price Running on 1 machine
Running on 2 machines
is LOW, it increases its load from 150w to 200w. 100
Running on 4 machines
Solar Panel: When h H1 = {h|h =
Average CPU usage (%)
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
9
TABLE 2
Test Case result
Period h=0 h=2 h=6 h=8 h=12 h=14 h=16 h=18 h=20 h=22
Washer(n9) 200w 200w 200w 150w 150w 150w 200w 150w 150w 150w
Solar Panel(n15) 0w 0w 21.4286w 8.82353w 9.375w 8.82353w 21.4286w 9.375w 0w 0w
Wind Turbine(n21) 42.8571w 42.8571w 21.4286w 17.6471w 9.375w 17.6471w 21.4286w 9.375w 18.75w 18.75w
Storage(n27) 0w 0w 0w 17.6471w 18.75w 17.6471w 0w 18.75w 18.75w 18.75w
Power line (n2,n3) 334.286w 334.286w 334.286w 137.647w 146.25w 137.647w 334.286w 146.25w 146.25w 146.25w
Power line (n2,n4) 411.429w 411.429w 411.429w 169.412w 180w 169.412w 411.429w 180w 180w 180w
Power line (n4,n7) 540w 540w 540w 222.353w 236.25w 222.353w 540w 236.25w 236.25w 236.25w
Power line (n5,n6) 77.1429w 77.1429w 77.1429w 31.7647w 33.75w 31.7647w 77.1429w 33.75w 33.75w 33.75w
Power line (n5,n7) 180w 180w 180w 74.1176w 78.75w 74.1176w 180w 78.75w 78.75w 78.75w
Power line (n4,n6) 102.857w 102.857w 102.857w 42.3529w 45w 42.3529w 102.857w 45w 45w 45w
Power line (n5,n6) 77.1429w 77.1429w 77.1429w 31.7647w 33.75w 31.7647w 77.1429w 33.75w 33.75 33.75w
Power line (n3,n6) 231.429w 231.429w 231.429w 95.2941w 101.25w 95.2941w 231.429w 101.25w 101.25w 101.25w
700
Running on 1 machine plant. So the load of n12 totally depends on the solar
Running on 2 machines
600 Running on 4 machines energy , random generated wind energy and the storage
energy. The desired load cannot be met. After h = 9,
Memory usage (MB)
500
the behavior of n12 is almost the same as it is in
400
subsection 4.1.until h = 17, when the two emulation
instances are disconnected. After h = 17, Smart Grid
300
instance Two forms a microgrid again, and the energy
200
consumption behavior is similar as the one before h = 9.
The fluctuations are resulted from the random generated
100 wind energy.
0
4 8 16 32 64 100 144 256 324 400
Number of nodes
Running on 1 machine
1000 Running on 2 machines
Running on 4 machines
800
Execution time (s)
600
400
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
10
250
Within single instance
Within two combined instances
Load from Washer(n12) (w)
200
Drag the side
handles to change
the width of the text
block.
150
After attack
-d flo
bi w Relay 3
50 Relay 2 192.169.0.3
192.169.0.2
Smart meter ...
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 X
...
Period (h)
Relay 1 Relay 4
$% & bi-direction data flow AMI Head-End
192.169.0.1 192.169.0.4
!
bi -
!
w
di r
flo
ec
ta
tio
!
...
da
n
n
da
tio
ta
ec
flo
dir
w
bi-
Relay 2 Relay 3
!" 192.169.0.2 bi-direction data flow 192.169.0.3
Smart meter
# X
...
' ( ...
!
)
Drag the side
handles to change
the width of the text
block.
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
11
400
consumption (kw)
normal real power consumption
neighbors will also increase. In this case, from the per- 350
Attack
attacked real power consumption
real power
300
Relay 2 Throughput
18
Attack 120
AMI Head-End(ms)
14 100
(kbps)
12 80
10
60
within the clusters of Relay 1 and 3. By making the 8
6
4
Throughput in Relay 2 40
time (h)
the data, customer X could dramatically reduces its own
reported energy usage. As shown in Figure 15, for smart Fig. 17. Throughput and Communication delay
meter X, even though the actual energy usage across
the day is 64kwh, the reported data is manipulated to
35kwh. The remaining 6435 = 29kwh are evenly added 5 C ONCLUSION AND FUTURE WORK
to the other 29 customers reported data. In this way, In this paper, we present the design, implementation
from the perspective of utility company, the total energy and operation of SCORE for Smart Grid emulation. One
consumed still conforms with the total energy being future direction would be integrating SCORE with real
billed. Moreover, from the perspective of each of the hardware testbed to create a uniform cyber-physical
other 29 customers, since only 29/29 = 1kwh is added to analysis platform. Also, a cloud based deployment for
their energy consumption, which usually results in about our platform could be built to provide universal access
0.1$ increase in their bills,it is very much likely that for the users.
the customer will just let it go. Also note that since the
R EFERENCES
80
Smart meter X Actual energy consumption [1] J. Ahrenholz, T. Goff, and B. Adamson, Integration of the core
Energy consumption
70
60
Reported energy consumption after attack and emane network emulators, in MILITARY COMMUNICA-
50 TIONS CONFERENCE, 2011 - MILCOM 2011, nov. 2011, pp. 1870
(kwh)
40 1875.
30
[2] Jeju Smart-Grid Testbed. [Online]. Available: http://smartgrid.
20
10
jeju.go.kr/eng/
0 [3] D. Stimoniaris, D. Tsiamitros, T. Kottas, N. Asimopoulos, and
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
House ID E. Dialynas, Smart grid simulation using small-scale pilot in-
stallations. - experimental investigation of a centrally-controlled
microgrid, in PowerTech, 2011 IEEE Trondheim, june 2011, pp. 1
Fig. 15. Actual energy usage and reported energy usage 6.
after attack [4] W.-Z. Song, D. De, S. Tan, S. Das, and L. Tong, A wireless smart
grid testbed in lab, Special Issue on Recent Advances in Wireless
energy price is modified to a lower value after the attack, Technologies for Smart Grid, IEEE Wireless Communications Magazine,
2012.
the real power consumption paradigm of the attacked [5] M. Stanovich, I. Leonard, K. Sanjeev, M. Steurer, T. Roth, S. Jack-
neighbors changes dramatically, compared to the normal son, and M. Bruce, Development of a smart-grid cyber-physical
situation when the correct real time energy price is given. systems testbed, in Innovative Smart Grid Technologies (ISGT), 2013
IEEE PES, 2013, pp. 16.
As shown in Figure 16, the real power consumption of [6] A. Hahn, A. Ashok, S. Sridhar, and M. Govindarasu, Cyber-
the attacked neighbors stays at a relatively higher level physical security testbeds: Architecture, application, and evalua-
all the time after the attack and the demand response tion for smart grid, Smart Grid, IEEE Transactions on, vol. 4, no. 2,
pp. 847855, 2013.
through real time pricing is not working any more. [7] Y. Guo, R. Li, G. Poulton, and A. Zeman, A simulator for
If more neighbors are involved in the attack, this will self-adaptive energy demand management, in Self-Adaptive and
severely increase load of the system, which can result in Self-Organizing Systems, 2008. SASO 08. Second IEEE International
Conference on, oct. 2008, pp. 64 73.
a higher cost of power transmission or even an outage. [8] A. Molderink, M. Bosman, V. Bakker, J. Hurink, and G. Smit,
An effective approach to detect this kind of attack is Simulating the effect on the energy efficiency of smart grid
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI
10.1109/TETC.2014.2364928, IEEE Transactions on Emerging Topics in Computing
12
technologies, in Simulation Conference (WSC), Proceedings of the [33] Hammerstrom, D. J., Pacific Northwest GridWiseTM Testbed
2009 Winter, dec. 2009, pp. 1530 1541. Demonstration Projects: Part I. Olympic Peninsula Project, Tech.
[9] P. Faria, Z. Vale, and J. Ferreira, Demsi: A demand response sim- Rep., October 2007.
ulator in the context of intensive use of distributed generation,
in Systems Man and Cybernetics (SMC), 2010 IEEE International
Conference on, oct. 2010, pp. 2025 2032.
[10] PSCAD, https://pscad.com/.
[11] A. Narayan, GridSpice-A Virtual Test Bed for Smart Grid, Tech. Song Tan received his BSc degree in Computer
Rep., 2008. Science from both Northeast Normal University
[12] D. Chassin, K. Schneider, and C. Gerkensmeyer, Gridlab-d: An (China) and Southern Polytechnic State Univer-
open-source power systems modeling and simulation environ- sity (USA) in 2010. He is currently a PhD Can-
ment, in Transmission and Distribution Conference and Exposition, didate in Sensorweb Laboratory, Georgia State
2008. T.No.x00026;D. IEEE/PES, april 2008, pp. 1 5. University, USA. His research is about Smart
[13] D. D. G. Ray D. Zimmerman, Carlos E. Murillo-Snchez, A Grid emulation, testbed design and power sys-
MATLAB Power System Simulation Package, Tech. Rep., 1999. tem modeling.
[14] Co-simulation overview. [Online]. Available: http://www.
flowmaster.com/flowmaster cosimulation.html
[15] K. Hopkinson, X. Wang, R. Giovanini, J. Thorp, K. Birman, and
D. Coury, Epochs: a platform for agent-based electric power
and communication simulation built from commercial off-the-
shelf components, Power Systems, IEEE Transactions on, vol. 21,
no. 2, pp. 548 558, may 2006. WenZhan Song is a tenured associate profes-
[16] NS2, http://www.isi.edu/nsnam/ns/. sor in Georgia State University. His research
[17] T. Godfrey, S. Mullen, R. Dugan, C. Rodine, D. Griffith, mainly focuses on sensor web, smart grid and
and N. Golmie, Modeling smart grid applications with co- smart environment where sensing, computing,
simulation, in Smart Grid Communications (SmartGridComm), 2010 communication and control play a critical role
First IEEE International Conference on, oct. 2010, pp. 291 296. and need a transformative study. His research
[18] OpenDSS, http://sourceforge.net/projects/electricdss/. has received 6 million+ research funding from
[19] M. Mallouhi, Y. Al-Nashif, D. Cox, T. Chadaga, and S. Hariri, A NSF, NASA, USGS, Boeing and etc since 2005,
testbed for analyzing security of scada control systems (tasscs), and resulted in 80+ journal articles, conference
in Innovative Smart Grid Technologies (ISGT), 2011 IEEE PES, Jan articles and book chapters in this area.
2011, pp. 17.
[20] H. Lin, S. Sambamoorthy, S. Shukla, J. Thorp, and L. Mili, Power
system and communication network co-simulation for smart grid
applications, in Innovative Smart Grid Technologies (ISGT), 2011
IEEE PES, jan. 2011, pp. 1 6.
[21] Y. Deng, H. Lin, S. Shukla, J. Thorp, and L. Mili, Co-simulating Qifen Dong received her BE degree from
power systems and communication network for accurate mod- the department of Electronics Information En-
eling and simulation of pmu based wide area measurement gineering, Zhejiang University of Technology,
systems using a global event scheduling technique, in Modeling Hangzhou, China, in 2007. She has been work-
and Simulation of Cyber-Physical Energy Systems (MSCPES), 2013 ing toward the PhD degree in the department of
Workshop on, May 2013, pp. 16. Control Theory and Control Engineering, Zhe-
[22] PSLF, http://site.ge-energy.com/prodserv/gepslf/index.htm. jiang University of Technology since 2007. Her
[23] K. Mets, T. Verschueren, C. Develder, T. Vandoorn, and L. Van- research interests including Wireless Sensor
develde, Integrated simulation of power and communication Networks, Smart Grids and Embeded system.
networks for smart grid applications, in Computer Aided Modeling
and Design of Communication Links and Networks (CAMAD), 2011
IEEE 16th International Workshop on, june 2011, pp. 61 65.
[24] OMNET++, http://www.omnetpp.org/.
[25] J. Nutaro, P. Kuruganti, L. Miller, S. Mullen, and M. Shankar, In-
tegrated hybrid-simulation of electric power and communications Dan Huang received his MS in computer sci-
systems, in Power Engineering Society General Meeting, 2007. IEEE, ence from Southeast University, China. He is
june 2007, pp. 1 8. currently a graduate student in computer sci-
[26] S. Tan, W.-Z. Song, Q. Dong, and L. Tong, Score: Smart-grid ence department at Georgia State University
common open research emulator, in The 3rd IEEE International and he works in Sensorweb Lab. His research
Conference on Smart Grid Communications (IEEE SmartGridComm), interests include distributed computing, social
2012. networks, smart grid.
[27] S. Karnouskos, Cyber-physical systems in the smartgrid, in In-
dustrial Informatics (INDIN), 2011 9th IEEE International Conference
on, july 2011, pp. 20 23.
[28] B. Zhang, S. Sun, and Z. Yan, Advance Power analysis, T. U. Press,
Ed., 2007.
[29] Y. Saad, Iterative Methods for Sparse Linear Systems, Second Edition,
2nd ed. Society for Industrial and Applied Mathematics,
Apr. 2003. [Online]. Available: http://www.amazon.com/exec/ Lang Tong joined Cornell University in 1998
obidos/redirect?tag=citeulike07-20\&path=ASIN/0898715342 where he is now the Irwin and Joan Jacobs
[30] A. Hoballah and I. Erlich, Transient stability assessment using Professor in Engineering and the Cornell site
ann considering power system topology changes, in Intelligent director of the Power Systems Engineering Re-
System Applications to Power Systems, 2009. ISAP 09. 15th Interna- search Center (PSerc). Lang Tong is a Fellow
tional Conference on, nov. 2009, pp. 1 6. of IEEE and received Best Paper Award (with
[31] R. Sarfi, B. D. Green, and J. Simmins, AMI Network (AMI Head- Min Dong) from the IEEE Signal Processing
End to/from Smart Meters), August 2012. Society, the Leonard G. Abraham Prize Paper
[32] IEEE PES Distribution System Analysis Subcommittees Distribu- Award from the IEEE Communications Society
tion Test Feeder Working Group, IEEE 37 Node Test Feeder, (with Parvathinathan Venkitasubramaniam and
Tech. Rep., September 2010. Srihari Adireddy).
This work is licensed under a Creative Commons Attribution 3.0 License. For more information, see http://creativecommons.org/licenses/by/3.0/.