Anda di halaman 1dari 16

City Data Fusion: Sensor Data Fusion in the Internet of

Things

Meisong Wang** Charith Perera+ Prem Prakash Jayaraman*++ Miranda Zhang**


Peter Strazdins**
Rajiv Ranjan*
** Reasearch School of Computer Science, Australian National University, Canberra, Australia
+The Open University, Milton Keynes, UK
*
Digital Productivity, CSIRO, Australia
++
RMIT University, Melbourne, Australia

ABSTRACT Anyplace, with Anything and Anyone, ideally using Any


Internet of Things (IoT) has gained substantial attention re- network and Any service [25].
cently and play a significant role in smart city application The term Internet of Things was firstly coined by
deployments. A number of such smart city applications de- Kevin Ashton [4] in a presentation in 1998. He has
pend on sensor fusion capabilities in the cloud from diverse also mentioned The IoT has the potential to change
data sources. We introduce the concept of IoT and present the world, just as the Internet did. Maybe even more
in detail ten different parameters that govern our sensor data so. [68]. Then, MIT presented their IoT vision in
fusion evaluation framework. We then evaluate the current 1999. Later, IoT was formally introduced by the Inter-
state-of-the art in sensor data fusion against our sensor data national Telecommunication Union (ITU) by ITU In-
fusion framework. Our main goal is to examine and sur- ternet report in 2005 [76].
vey different sensor data fusion research efforts based on The rest of the paper is organised as follows. Sec-
our evaluation framework. The major open research issues tion 2 provides an overview of sensor networks. Section
related to sensor data fusion are also presented. 3, sensor data fusion is defined and techniques are dis-
cussed. We also outline the possible extensions to im-
prove sensor data fusion. In Section4, we highlight the
1. INTRODUCTION importance of data fusion in smart city applications.
During the past decade, the Internet of Things (IoT) In Section 5 presents the evaluation framework that we
has gained significant attention in academia as well as used to evaluate different research efforts. We survey
industry [56]. The main reason behind this is the capa- various sensor data fusion efforts and its importance to-
bilities that IoT promises to offer. It promises to create wards IoT in the Section 6. Final section concludes the
a smart world where all the objects around us are con- survey by highlighting the survey results and research
nected to the Internet and communicate with each other gaps.
with minimum human intervention [68].
Even though IoT encompasses a number of ideas and
concepts, it does not have a clear definition. However, 2. SENSOR NETWORKS
Tan and Wang [45] have defined IoT in a fairly compre- Sensor networks are the major enabler of the IoT. A
hensive manner as Things have identities and virtual sensor can be defined as a device that detects or mea-
personalities operating in smart spaces using intelligent sures a physical phenomenon such as humidity, temper-
interfaces to connect and communicate within social, ature, etc. A sensor node is a physical platform that
environment, and user contexts [45, 58]. Some other hosts one or more sensors. Each sensor node has the
definitions are presented in [5]. The papers [5, 79, 58] capability to sense, communicate and process data. A
have surveyed the definition of IoT in three different typical sensor network [2] comprises two or more sen-
perspectives: things, the Internet and semantics. sor nodes which communicate between each other using
IoT enables the vision from anytime, anyplace con- wired and wireless means. In sensor networks, sensors
nectivity for anyone, we will now have the connectivity can be homogeneous or heterogeneous. Multiple sensor
for anything [76]. Further expanding this idea, the networks can be connected together through different
European Union has defined the above vision as The mechanisms. One such approach is through the Inter-
IoT allows people and things to be connected Anytime, net.
Typically, sensor nodes are deployed in densely man- about the environment as it would be focused on mea-
ner around the phenomenon which we want to sense [2]. suring a single factor such as temperature. However,
These sensor nodes are low-cost and small in size, that when we have data sensed through a number of differ-
enable large deployments. Sensor network is not a con- ent sensors, we can understand the environment in a
cept that emerged with the IoT. The concept of sensor much better way.
network and related research existed long time before Redundant means that same environmental factor is
the IoT was defined. This can be clearly seen when sensed through different sensors. It helps to increase
we evaluate the literature in the field. However, with the accuracy of the data. For example, averaging the
the emergence of the IoT has facilitated the mainstream temperature value sensed by two sensors located in the
adoption of sensor network as a major technology used same physical location would produce more accurate in-
to realise the IoT vision. formation compared to a single sensor. It also reduces
In recent times, another widely recognised source of the amount of data that need to be handled as it com-
sensor data is obtained from mobile smart devices. The bines the two set of data streams together.
ubiquitous nature of mobile smart devices such as smart Cooperative operations combine the sensor data to-
phones, tablets, smart watch to name a few and the gether to produce new knowledge. For example, read-
availability of cheap embedded sensors have completely ing RFID tags recorded in a supermarket can be used to
revolutionised the smart city application dimensions. identify the events such as shoplifting. Lets consider a
scenario where RFID reader in a supermarket shelf de-
3. SENSOR DATA FUSION tects that an item has been removed from a shelf. The
RFID sensor in the counter does not see the object dur-
In this section we introduce sensor data fusion in the ing payments. Later, the RFID sensor in the exit door
IoT domain. We also discuss its importance towards detects the item that was removed from the shelf ear-
the IoT and where the techniques would fit into the lier. This sequence of actions can be simply inferred as
IoT space. a shoplifting event.
As we discussed in earlier sections, IoT would produce
substantial amount of data [55] that are less useful un- Data Fusion in IoT A Smart
Server Level
less we are able to derive knowledge using them. We Smart City
City Perspective
Processing

start our discussion by quoting some statements. The Infrastructure


Sink Node Edge Nodes

following statements strongly emphasis the necessity of


sensor data fusion and filtering in IoT domain.
High-end Cloud
By 2020, wirelessly networked sensors in everything Filtering Filtering Computing
Complementary Complementary Devices
we own will form a new Web. But it will only be of Sensor Redundant
Cooperative
Redundant
Cooperative
Nodes
value if the terabyte torrent of data it generates can
be collected, analysed and interpreted [48].
Today, there are roughly 1.5 billion Internet-enabled Figure 1: Sensor Data processing
PCs and over 1 billion Internet-enabled mobile smart
phones. The present Internet of PCs will move to- A white paper published by Carnot Institutes [11] has
wards an Internet of Things in which 50 to 100 billion listed data fusion and data filtering as two main chal-
devices will be connected to the Internet by 2020 [68]. lenges for the IoT and its applications such as smart
We see data fusion in the IoT environment as one cities. Data fusion is a data processing technique that
of the most important challenges that need to be ad- associates, combines, aggregates, and integrates data
dressed to develop innovative services. In particular, from different sources. It helps to build knowledge about
in smart cities applications, when 50 to 100 billion de- certain events and environments which is not possible
vices start sensing [84], it would be essential to fuse, using individual sensors separately. Data fusion also
and reason about the data automatically and intelli- helps to build a context-awareness model that helps to
gently. Fusion is a broad term than can be interpreted understand situational context. The sensor data filter-
in many ways. Hall and Llinas [27] have defined the ing stresses the requirement of filtering data to avoid
sensor data fusion as a method of combining sensor large volumes of data transmission over the network.
data from multiple sensors to produce more accurate, The most basic sensor data fusion example that is
more complete, and more dependable information that used widely in smart phones is an e-compass. It uses a
could not be possible to achieve through a single sensor. combination of 3D magnetometer and the accelerome-
Nakamura et al. [52] have defined data fusion based on ter to provide compass functionality. Mainly, data fu-
three key operations: complementary, redundant, and sion operations can be applied at two levels: cloud level
cooperative. and within the network level. As shown in Figure 1,
Complementary means putting bits and pieces of a sensor nodes, smart city infrastructure, edge node, sink
large picture together. A single sensor cannot say much nodes, and low level computational devices such as mo-
bile phones belong to in-network sensor data processing.
High-end computational devices such as servers belong
to cloud level processing. Collection
The cloud can help better understand the environ-
ment by performing complex sensor data fusion opera-
tions. Cloud level devices have access to unlimited re-
sources and hence has the capability to apply complex
data mining algorithms over the data generated by large
number of lower level sensors. After understanding the
environment, the cloud can generate actions that need
to be taken appropriately.
In-network sensor data fusion is important to reduce
the data transmission cost. As data transmission re-
Figure 2: Internet of Things Monitoring Cycle
quires significant amount of energy, applying redun-
dant fusion operation can reduce the data transmission.
However, low-level nodes may not have the full view of IoT application chain is essential in order to detect rel-
the environment. Therefore, they may not be able to evant events.
perform complex operations such as cooperative opera-
tions. The main responsibility of in-network sensor data 4. SENSOR DATA FUSION FOR SMART CITY
fusion is to reduce the data transmission cost. The fol- APPLICATION
lowing rule defines how the data processing in each level
should be conducted. Data from citizens, systems, and general things flow
through our cities thanks to the wide spread adoption of
smart phones, sensor networks, social media and grow-
L = CurrentLevel; ing open release of datasets [3]. The data from Smart
if (KnowledgeRequired KnowledgeAvailable) cities present a grand challenge to researchers and smart
(DataTransmissionCost > DataFusionCost) cities promoters, as we need to take advantage of these
then ProcessAtTheCurrentLevel(L) streams of information to build new services and define
else SendDataTo(L + 1) a clear return of investment for the benefit of the society
[36].
The ultimate goal of sensor data fusion is to under- The challenge in smart city is not to build a single
stand the environment and act accordingly. This can generic model e.g. weather model based on temperature
be defined as a cycle as shown in Figure 2. We call it and humidity, complex models about noise pollution,
Internet of Things Monitoring Cycle. It has five steps: traffic etc., but to combine all these together to build
Collection, Collation, Evaluation, Decide, and Act. IoT a good predictive contextually rich model. This model
monitoring cycle has been derived by combining the In- will help understand the dynamics of the society, and
telligence Cycle [63] and the Boyd Control Loop [7]. most importantly provide vital knowledge back to the
The Collection step collects raw data from sensors and citizens in order to enhance their quality of life.
other IoT data sources (Social media, smart city in- A recent work from a group of researchers from MIT
frastructure, mobile devices etc.). The Collation step [65] demonstrate the potential of fusing data from dis-
analyse, compare and correlate the collected data. The parate data sources in smart city to understand a citys
Evaluation step fuses the data in order to understand attractiveness. The work focuses on cities in Spain and
and provide a full view of the environment. The Decide shows how the fusion of big data sets can provide in-
step decides the actions that need to be taken. The Act sights into the way people visit cities. Such a correlation
step simply applies the actions decided at the previous of data from a variety of data sources play a vital role
step. The Act step includes actuator control as well as in delivering services successfully in smart cities of the
sensor calibration and re-configuration. future.
Typically, the deployed IoT infrastructure in smart In smart cities, ability to fuse sensor data enables
cities provide a means to monitor the environmental context awareness which has a huge potential for IoT.
context [57, 59]. There is very little interest in the raw Understanding the context of the city and its citizen
sensor data. The data that is of significant interest is can help develop and provide a new world of services
information about interesting events that are happen- based on what an individual user is doing, what the in-
ing in the specific area. In order to accomplish this task, frastructure [59] is doing, what nature is doing or all
IoT applications should be able to capture and reason the above in various combinations [38]. The variety of
about the events continuously. Therefore applying sen- services that can be developed is only limited to ones
sor data fusion techniques at the different levels of the imagination. An example scenario could be a bridge
experiencing a structural issue due to adverse environ- side schemes. In-network middleware are usually de-
mental conditions can alert the city administrators and veloped using low level programming languages such as
alert all cars travelling towards the bridge to stay away nesC [18, 75] and installed on each sensor node. Those
and seek alternative routes. For such a scenario to be middleware systems have more control on low level op-
feasible, it is important, smart city applications built eration of the network such as network routing, energy
on IoT have the ability to fuse data from diverse data consumption, etc. This layer is much closer to the hard-
sources to enable context-aware decision making and ware. However, it lacks the overall knowledge about the
support. environment.
On the other hand, server-side middleware run in
5. EVALUATION FRAMEWORK cloud computing environments. Those middleware col-
lect data through gateways or sink nodes and are de-
In this section, we present the framework that we use
veloped using high level programming languages such
to evaluate different IoT sensor data fusion research ef-
as C, Java etc. However, these middleware systems
forts. The framework comprises the ten most significant
have less control over the sensor network operation.
features (parameters) related to sensor data processing
They are unable to control low level operations such
in the IoT domain. Table 1 summarises the evaluation
as routing. However, they have more knowledge about
at the end of the Section 6.
the environment as they can analyse the sensor data
5.1 Middleware Architecture Type received through different sensors. We have seen an
emerging third category of middleware solutions, hybrid
Middleware can be explained as a software layer that schemes, which combines both in-network and server
lies between the hardware and application layers. It side schemes. We believe that a hybrid middleware ap-
provides the reusable functionalities that are required proach is best suited for the IoT domain as we can com-
by the application to meet complex customer require- bine the best of both the in-network and cloud-based
ments. They are usually built to address the common server schemes.
issues in application development such as heterogeneity,
interoperability, security, and dependability [34].
A traditional goal of middleware is to provide a set 5.2 Context-awareness
of programming abstractions to help software devel- The most widely used context information is loca-
opment where heterogeneous components need to be tion [22]. However, context in the IoT is much more
connected and communicated together (e.g: Internet of broader than location. All the information about sen-
Things) [20]. However, programming abstraction comes sors can be considered as context information (e.g. ca-
at a cost. That means, when we use a middleware to pabilities of the sensors, related actuators, near by sen-
connect sensors to applications, the performance will sors, etc.). With the recent advancement of the IoT,
degrade due to additional overheads. If you manu- context-awareness has become an essential part of the
ally connect application specific sensors to applications, IoT applications. Context-awareness is no more limited
they will perform much better. However, every time we to mobile applications. Currently, the largest context
develop a new application, we have to manually connect information consumers are mobile devices and their ap-
the sensors into the application where we will end up plications. A research effort called mSense [41] has in-
with repeated code. Compared to this repeated effort, troduced a middleware solution to manage context in-
using a middleware becomes a much better approach in formation. mSense separates context-awareness man-
term of cost and development time. Middleware sys- agement functionalities into a separate layer. The IoT
tems are too general and are developed not for a single domain also requires such separation to make applica-
domain but for multiple domains. As a result, middle- tion development much easier and faster.
ware may have functionalities that are not required by Chantzara and Anagnostou [13] have identified four
one application but that may be required in another common stages in context-aware application life cycle
application. as context sensing, context processing, context dissem-
Todays IoT applications demand more and more ad- ination, and context usage. This life-cycle has been en-
vanced and non-functional properties such as context- hanced by [32]. Combining sensor data from multiple
awareness and semantic interoperability. Middleware sensors helps to understand context information much
systems can bundles those functionalities together to more accurately. Better understanding will contribute
be reused in many applications. We identify developing towards intelligent fusion and complex event detection.
middleware as the right way to address the needs of IoT The Cluster of European Research Projects (CERP-
applications. IoT) has also mentioned context awareness (location-
IoT (or sensor networks) middleware solutions can aware, environment aware) as a key characteristic of
be mainly divided into two categories based on their objects in the IoT space [68]. Identifying the context in-
installed location [31]: in-network schemes and server- formation such as geographical location, sensor capabil-
ities, near-by sensors, related actuators and supported
data formats would help to built a context model for The IoT can be considered as an application domain
each sensor that can be used to increase the autonomous where semantic web technologies can be used to enhance
interaction among sensors. Nagy et al. [51] have de- its functionalities significantly [30]. The IoT promises
fined a term called Global Understanding in related to to connect the billions of things around us together. It is
context-awareness. It means that sensor A can under- not feasible to manually connect by hard-wiring things
stand the properties and capabilities of sensor B and and applications. Automating these tasks will definitely
vice versa. This can only be achieved through semantic need the help of semantic technologies. Research con-
technologies and context awareness techniques. ducted on semantic sensor web [15] has identified sev-
A research focused on smart objects [40] has defined eral challenges that need to be addressed by semantic
three types of context-awareness: activity-aware, policy- technologies. For example, sensor configuration, con-
aware, and process-aware. Activity-aware means the text identification, complex sensor data querying, event
ability to understand the activity and the usage of a detection and monitoring, and sensor data fusion are
specific sensor. Policy-aware acts as a domain knowl- some of the tasks that can be enhanced using semantics.
edge repository where it consists of rules. For example, Annotating sensors, sensor data, and program compo-
policy-aware can identify the health and safety condi- nents will increase the ability of interaction without ex-
tions of the user via policy knowledge and act accord- plicit programming commands. Furthermore, annota-
ingly. Process-aware is the ability to detect the current tions will also increase the retrievability of sensor data.
processes carried out by the user and the surrounded More sophisticated queries can be processed over the
objects. An ideal IoT application should be able to semantic annotated data.
provide additional assistance to users to carry out their
work as mentioned above. 5.4 Dynamic Configuration
Abowd and Mynatt [1] have identified 5Ws (who,
Dynamic configuration can be interpreted at two lev-
what, where, when, why) as the minimum set of context
els: a software level dynamic configuration and a hard-
information that need to be handled in a pervasive com-
ware level dynamic configuration. Dynamic hardware
puting environment. This stays true in the IoT space
configuration stresses the adaptability of a system. IoT
as well. Context information can be divided into three
comprises tiny sensing devices (things) which are prone
categories: user context, computing (system) context,
to fail frequently. Therefore, a network built by these
and physical (Environmental) context [61]. User con-
devices is unreliable and should be able to change, con-
text means the knowledge about the user (e.g. age,
figure and adapt itself to the environment dynamically.
gender, likes, dislikes, etc.). Computing context means
Furthermore, things may need to change their configu-
the knowledge about the software and hardware used by
ration as a result of the decisions made by the cloud-
users (e.g. operating system, hardware capacity, soft-
based server as a part of the actuation control.
ware applications, etc.). Physical context means the
For example, lets consider a things (sensor node) S
knowledge of the environment such as location, tem-
that is capable of sensing light, temperature and humid-
perature, light, etc.
Issarny et al. [34] have distinguished three types of ity. It is physically located in area L. Currently, sensor
context sensitivity: context-specific systems, context- node S measures only temperature as it is the expected
dependent systems, and context-adaptive systems. Ap- requirement of the server level software to make the de-
plications that can work only in one context are called cisions. Later, the server may require to know the light
context-specific. Context-dependent applications need level of area L. The sensor node S needs to be con-
to be configured at the beginning of the application figured to measure not only temperature, but also light
for each context. Context-adaptive systems can change level as well. This new configuration setting needs to be
their behaviour dynamically during runtime when con- pushed to the sensor node from the cloud server. Figure
text changes. IoT applications demand the context- 3 presents an example of a dynamic reconfiguration for
adaptive behaviour to make the IoT vision a reality. wireless sensors nodes deployments. According to our
In order to build a comprehensive context model us- survey, this functionality is lacking among most of the
ing context information, it is necessary to acquire con- current research efforts.
text data through many different data sources. A single Furthermore, software level can also support dynamic
source would not be able to provide all necessary in- configuration capabilities. For example, software com-
formation that can be used to understand the context ponents described in semantic technologies can be com-
accurately. Therefore, combining the context informa- bined together to create complex data fusion operations.
tion retrieved through multiple sources is essential but Rather than combining these components at develop-
challenging [44]. ment time, runtime configuration can add more adapt-
ability to the system.
5.3 Semantic Interaction The complex data fusion operations should be built
High-end Low-end High-end full description on how to accomplish such tasks by us-
Sensor Nodes Sink Node Computational Computational
Devices Devices ing semantic technologies. Zafeiropoulos et al. [67] have
L described all the elements such as sensors and program-
S ming modules using semantics, where complex combi-
nations are possible.

5.6 Actuation Management


Configuration Configuration Configuration Configuration
Settings Settings Settings Settings According to our evaluation, the majority of research
efforts have left out the functionality of actuation man-
Data Flow
agement from their proposed solutions. We presented
Configuration Settings Flow
the IoT monitoring cycle in Section 3. This cycle stresses
the importance of the act step. Sensors sense data and
Figure 3: Dynamic Sensor Network Configura-
transmit it to servers. Severs then do the processing
tion
and take the decision on how to handle the situation
based on the gathered knowledge and previous experi-
by reusing the software components at runtime based ence. Then actions need to be taken. Action can be a
on the user requirements. For example, Figure 4 shows change in sensor configuration or to conduct a specific
how a system can dynamically configure the compo- task using a connected actuator. For example, actua-
nents into a work flow in order to detect events and act tion could increase the humidity by spraying more water
accordingly. into the air. According to the context, the most appro-
priate actions needs to be taken and managed by an
Sense data Detect
Activate ideal IoT software system in an efficient manner.
through shoplifting
Alarm
RFID reader Event
5.7 Type of Processing
Item Send
misplacement Notification Data processing in IoT can be done in two ways: in-
Event network processing and cloud level processing. Sen-
sors are prone to produce faulty data due to technical
Figure 4: Software Dynamic Configuration issues. Furthermore, sensors produce redundant data
that wastes the energy if they are transmitted. There-
fore, data filtering is critical to save energy. In-network
5.5 Fusion Complexity processing mechanisms can be used to address these is-
Querying data from things is one of the common data sues. In-network sensor data processing however has
fusion operations in the IoT domain [8, 24, 46, 80]. The limitations, because in-network devices such as sensor
level of complexity supported by the query may differ nodes and mobile phones perceive only limited knowl-
from the query language implementation. Sometimes, edge about the environment (local context) [54]. There-
semantic technologies such as SPARQL [47], are used fore, in-network data processing cannot make high level
to query sensor data. decision where overall knowledge is required.
Another common data fusion approach is event de- Cloud-based processing should be used to address the
tection. Events can be recognised by identifying and above problem. Cloud servers receive all the data col-
correlating sequences of action that occurred in the en- lected through a variety of different sensors. These data
vironment. Lets consider two sensors A and B, where increase the knowledge about the environment, so the
A measures temperature and B is a camera. In an ideal servers can take decisions by considering overall knowl-
system, users should be able to pose queries to retrieve edge (global context). Furthermore, cloud-based server
the video feed of a room where temperature is higher devices have more sophisticated hardware power to pro-
than 35C. In order to answer such a request, the sys- cess and understand large amounts of data compared
tem should be able to combine both sensors A and B to in-network hardware. Server level sensor data pro-
together. Another example query would be identify cessing techniques are used to fuse data in many ways
the best place to store a sculpture in a museum based according to user queries. It can also understand inter-
on the sculpture specification. A number of data fu- esting events that occur in a sensor network.
sion operation need to be used to answer such queries. It is clear that both types of processing haves their
Concretely, a query may need to be generated by using unique contribution towards sensor data fusion in the
optimum humidity level, temperature and other param- IoT domain. Therefore, the ideal way to process sensor
eters. data is to use a hybrid approach where both in-network
This kind of combining needs to be supported by se- and cloud-level sensor data processing techniques are
mantic technologies. Song et al. [67] have provided a employed.
5.8 Cross Domain Portability been addressed within the wireless sensor network re-
Cross domain portability stresses the ability of ap- search. These solutions are completely applicable with
plying a proposed solution on different domains. Most the IoT domain.
of the proposed solutions are narrowly focused on one Jara et. al. [36] have applied sensor data fusion to
domain. We believe it is ideal to implement a solution understand human behaviours in smart cities. Their
addressing more than one domain in order to prove the work analyses data obtained from the European project
cross domain portability. At the same time, it is critical Smart Santander. The work demonstrates how ubiqui-
to differentiate the domain specific and domain inde- tously available data such as traffic flows and temper-
pendent components of a solution. This increases the ature can be correlated to understand and model the
ability to apply a solution in different domains. A clear influence of temperature on traffic flow. The work con-
differentiation will enable rapid and easy expansion. siders the Poisson model and shows that the Poisson
distribution model is not always valid.
5.9 Implementation Sobolevsky et al. [65] have applied sensor data fusion
Implementation is critical in order to prove a con- to estimate the attractiveness of smart cities for visi-
cept. Challenges that cannot been seen in theoretical tors. The work focuses exclusively on cities in Spain.
process can be clearly seen in a practical implementa- To arrive at attractiveness they fuse sensor data from
tion. Implementation allows the identification of the three data source namely credit and debit card trans-
practical and technical difficulties and challenges that actions carried out by visitors, 3.5 million photos and
arise during the implementation process. The major- videos taken in spain and posted to Flickr and 700,000
ity of proposed solutions are practically implemented. geo-tagged tweets. The attractiveness of a city for the
Proper implementation should be followed by a rigorous purpose of the city was defined as the total number of
performance evaluation procedure. The choice of pro- tweets, pictures and card transactions that took place
gramming model, platform and languages significantly within it. The work produces some interesting results
impact on the future development and scalability. Mak- and demonstrated how fusion of sensor data sets (big
ing the programming code open source is a one approach data sets) can provide insights into how people use cities.
that can ensure the rapid future development and avoid In general, the work identified bigger cities attract large
repetitive work among researchers. number of visitors. However, there were also some ex-
ceptions that deviate from the above assumption. For
5.10 Performance Evaluation example certain cities such as Malaga had high level of
Performance of a system becomes critical when the visitors but the least number of Flickr activity. This is
system becomes larger and larger. In the IoT, we ex- due to the fact, these cities are considered as retirement
pect to connect millions and billions of sensors together. locations and the category of visitors tends to less use
Therefore, performance evaluation is critical to under- social media such as Flickr. This work is an excellent
stand and verify how the system would work in a real demonstration of how data fusion in smart cities can
world deployment. It also allows to optimise the solu- help create innovative services delivering value back to
tion based on the performance evaluation results. Un- its citizens and smart city developers.
fortunately, most of the proposed solutions in the IoT Antonelli et al. [3] present city sensor fusion, a big
domain have not conducted a performance evaluation data platform that collects, aggregates, analyses, se-
procedure which makes hard to decide the applicability mantically enriches and offers visual analytics from data
of the proposed solutions in real world. flows in smart cities. The work focuses on using sensor
Performance evaluation remains an open issue and data fusion to detect city scale events such as event
a challenge that needs to be achieved by researcher in lasting days, number of visitors attracted, venues that
the IoT domain. Performance evaluation can be cate- attracted significant interest etc. The platform fuses
gorised into two distinct areas: software and hardware. data from different types of data sources ranging from
Parameters such as energy, response time, data fusion social media to mobile phones to sensors such as Traffic
capability, and number of supported sensors, need to be flow, weather and pollution.
evaluated. Soldatos et al., [66] propose OpenIoT a first-of-kind
open source IoT platform enabling the semantic inter-
6. SENSOR DATA FUSION APPROACHES operability of IoT services in the cloud. OpenIoT pro-
- STATE-OF-THE-ART motes interoperability among IoT silos right from the
sensor to the cloud services. OpenIoT is built upon
In this section, we discuss some of the solutions pro- semantic web standards such as W3C Semantic Sen-
posed by different researchers. We highlight the signifi- sor Networks (SSN) ontology, which provides a com-
cances of each project in brief. At the end, a summary mon standards-based model for representing physical
of the evaluation is presented in Table 1. It is to be and virtual sensors, RDF to store, index and retrieve
noted, a number of solutions in sensor data fusion have
data, and supports virtually any IoT protocols such implemented using the NesC language in Mica Motes
as CoAP, 6LoWPAN etc. OpenIoT includes also sen- [16] that runs the TinyOS [74] operating system. The
sor middleware and sensor data fusion capability at the reasoning engine Pellet [14] is integrated in this middle-
things and at the cloud. OpenIoT eases the collection ware. New behaviours can be added into the applica-
of data from virtually any sensor, while at the same tion by adding new rules. All the communication be-
time ensuring they are embedded with proper semantic tween the nodes are done by using a XML format called
annotation. Furthermore, it offers a wide range of Do- TinyXML [73]. Knowledge is stored and processed us-
it-yourself visual tools that enable the development and ing OWL. Da Rocha et al. [17] have developed ontolo-
deployment of IoT services and applications with almost gies related to the domain and other services. Applica-
zero programming. Another key feature of OpenIoT tion driven, device driven and network driven concepts
is its support for mobile sensors and thereby enabling are defined in the ontology. Ontologies help to share
support for an emerging wave of mobile crowd sensing information such as power remaining on a sensor, capa-
applications. The OpenIoT platform is a blueprint ar- bilities of the sensors and so on.
chitecture to develop semantically interoperable smart The middleware proposed by Da Rocha et al. [17] in-
city solutions with support for complex sensor data fu- telligently shares information between different sensors
sion algorithms. based on semantic knowledge. For example, two sensors
Zanella et al., [83] offers a survey of available tech- in the same area should not share their information if
niques, architecture, and protocols for a urban IoT which those sensors are measuring two different aspects of the
are used to achieve the Smart City vision. The paper environment; for example light and corrosion. How-
describes characteristics of an urban IoT and overviews ever, if the two sensor measurements complement each
some services related to Smart City. The technical so- other, such as humidity and corrosion, then the sensors
lution proposed in this paper have been used in Padova should share their measurements and do the reasoning
(Italy) Smart City project [12]. The Padova project by combining both measurements. When many sensors
employs IPv4 and IPv6 at th network layers and uses a measure the same aspect, few of the sensors can switch
wireless sensor network gateway to collect data from de- themselves off intelligently to save energy resources.
ployed sensor network infrastructure [59]. Theodoridis Zafeiropoulos et al. [81, 82] have presented an ar-
et al., [72] illustrates challenges, socioeconomic chances chitecture to address the issues such as data aggrega-
and vital findings from the European smat city project tion, data management, and querying. The semantic
Smart Santander. The paper surveys a Logical 3-tier technologies are used to extract meaningful information
node and 3-plane architecture and highlights various from the raw sensor data. Aggregation of data contains
use cases that employ sensor data fusion in smart cities less value unless they are interpreted accurately. The
including Outdoor parking management, precision ir- interpretation is essential in order to detect interesting
rigation and home garden monitoring. Lin et al., [37] events in sensor networks. Zafeiropoulos et al. [81, 82]
presents an information framework which encompasses correctly argue that this event detection should be sup-
the complete urban information system for building a ported by data gathered through heterogeneous data
Smart City by using the Internet of Things. The pa- sources. The semantic technologies that support such
per use a Noise Mapping in Smart Cities case study to operations are content description languages, query lan-
demonstrate the architecture. guages, and annotation frameworks. The proposed ar-
Da Rocha et al. [17] have focused on developing se- chitecture comprises three layers: data layer, processing
mantic middleware for wireless sensor networks using layer, and semantic layer. The data layer is responsible
low level programming (i.e using NesC, a extension to for collecting data from sensors using event-based or
the C programming language used for embedded pro- polling-based mechanisms. The processing layer con-
gramming). The approach is based on a rule-based verts those raw data into XML files. In the semantic
reasoning engine using ontologies. The research ad- layer maps the XML data into a semantic model where
dresses the Structural Health Monitoring (SHM) appli- the XML messages are stored in the form of class in-
cation domain. Research justifies the reason of choosing dividuals. This conversion is done by XML mapping
wireless sensor networks over wired sensor networks by rules. Another set of rules called semantic rules are
pointing out the fact that wired sensor networks are used to detect events. As a result of these conversions,
time consuming to deploy, very expensive and hard to a system can query and reason the sensor data using
reconfigure [17]. semantic query languages which provide enriched capa-
Semantic sensor networks in SHM domain enable the bilities.
usage of semantic information towards monitoring and The project Hydra [21] addresses the needs of health-
handling the environment. The research incorporates care, home automation and agriculture domains. It pro-
semantic features at the middleware level using a low vides an architecture to connect sensor devices together
level programming approach. The middleware has been to detect events. The Hydra middleware is based on
a Service Oriented Architecture (SOA) and a Model as nesC.
Driven Architecture (MDA). The core architecture of Semantic Web Architecture for Sensor Networks
Hydra comprises a number of different managers, such (SWASN ) [29] is a server-side middleware that uses
as network, discovery, ontology, event, storage, and con- semantic web technologies to enrich sensor data pro-
text managers. Each of these managers are divided into cessing. This project has proposed a four layer archi-
a number of layers. For example, the context manager tecture: sensor networks data sources layer, ontology
comprises four layers. Context data acquisition, con- layer, semantic web processing layer, and application
text management, context awareness, and context rea- layer. SWASN is capable of connecting multiple sensor
soning and interpretation. The Hydra middleware does networks together. To achieve this challenge, SWASN
not differentiate the domain specific and domain inter- uses a separate local ontology for each sensor network to
preted components in its architecture, which makes it map sensor data to a common global RDF data model.
hard to extend the domain into other domains. Hydra SWASN provides sophisticated querying features using
encapsulate sensors into web services and the devices SPARQL [47]. The system is focused on building fire
are described using semantics where it enables seman- emergency domain.
tic interoperability among sensors. However, data is not u-Greenhouse [31] is a context-aware middleware that
annotated using semantics. proposed to process data collected through sensors in
Lee et al. [42] have proposed a hybrid middleware a greenhouse environment by applying wireless sensor
which comprises an in-network middleware and a server- network technologies. This middleware provides the
side middleware. The in-network middleware has the functionalities of data filtering, event processing, context-
capability to deal with operations such as energy ef- aware processing and integration of heterogeneous sen-
ficient data transmission. The server-side middleware sors. The system architecture consists of three parts:
handles the context-aware stream processing, event de- sensor network interface, data process, and application
tection and querying. The main focus is given to the service interface. The approach is to develop a hybrid
in-network middleware. Therefore, event detection and middleware that consists of in-network data processing
data fusion capabilities are very limited. The in-network middleware that are installed on each node and a server-
middleware has the intelligent capability to identify in- side data processing middleware. The u-Greenhouse
complete and false data values. architecture comprises three layers: the physical layer
Bruckner et al.[9] have proposed a framework to pro- (Sensor node and gateways), the middleware layer and
cess audio and video sensor data in a semantic manner. the application layer. Semantic capabilities are pro-
The proposed system architecture comprises seven lay- vided using and context-aware ontology. The system is
ers. The bottom layers which are closed to the sensor capable of recognising simple events in greenhouse en-
nodes do the image and audio processing and convert vironment that can trigger actions. u-Greenhouse solu-
the raw data into Low Level Symbols (LLS). Then data tion is narrowly focused on greenhouse domain.
fusion mechanisms are used to convert those symbols Siguenza et al. [64] combine states chart technol-
into High Level Symbols (HLS). Patterns and events can ogy and semantic technology to annotate and process
be recognised using these symbols. The implementation sensor data. The objective is to derive high level infor-
has been deployed in an airport domain where the sys- mation from raw sensor data. W3C State Chart eX-
tem is capable of identifying events such as unattended tensible Markup Language (SCXML) is used to imple-
luggage or gunfire. The entire architecture is narrowly ment the system. The sensor data are enriched using
focused on video and audio sensor data processing. RDF semantics and stored in an SCXML data model.
Semantic Sensors (SS ) [33] network middleware con- The possible situations are defined as states such as ad-
nects a variety of sensors to applications. The objective verseWeather. The conditions related to the adverseWeather
of the middleware is to develop a sensor network where state need to be fulfilled in order to infer the current
developers need not to be aware of the device type of state as adverseWeather.
each sensor node. SS t can identify the location and the HARMONI [28] is a context-aware system for the
relationship among the sensors. The evaluation of the healthcare domain. This project has gone beyond the
middleware has been done in a lab environment by at- objective of identifying events using sensor data fusion.
taching sensors to daily use items such as bottles and Homed et al. [28] have used their framework to reduce
books. Logical expressions are used to store information the amount of data transmission significantly. A mo-
about each object and their relationships. Very primi- bile device that is capable of filtering data is deployed
tive events are possible to recognise by the system. For in the patients room. This device is able to monitor
example, the system can answer simple queries such as the events according to the specifications defined in the
identify the state of the object (i.e moving or not) or filters. For example, doctors may need not to know all
recognise the other objects near by. The implementa- the behaviour of a patient. Doctors are only interested
tion is done using low level programming languages such to know when a patient shows any unusual behaviour
(e.g. very high heart rate). Therefore, it is not neces- Liu and Zhao [43] have identified that most of the ef-
sary to transfer all the data sensed by the sensors to forts on sensing systems today are domain specific with
the back-end server. Instead, a mobile device in the pa- very little re-usability. To solve this problem, they have
tients room can filter the sensed data and transfer only proposed a open architecture which is enriched with se-
the relevant data intelligently to the server based on mantics. XML data formats are used in the system to
the filter definition [28]. These filters need be changed store data. Service components are the main building
according to the context. For example, heart rate may block in the system. Each service is designed to take
need to be monitored based on the context. When the inputs, do some processing and give the output back.
patient is doing exercises, it is natural that heart rate Services are designed in such a way that multiple ser-
goes up. Therefore, the filters should be able to alter vices can be combined together to build a complex ser-
the filter definitions based on the context. vice. This run-time combining process is possible due to
Terziyan et al. [70] have proposed the UbiRoad mid- semantic descriptions. This programming model allows
dleware that uses semantic and agent technologies. Their the user to query the sensor data and events in abstract
focus is on the smart road and traffic control domain. ways without dealing with raw sensor data.
A sample scenario has presented to convey the ultimate SEMbySEM [10] is a sensor management framework
objective. UbiRoad addresses four main challenges: in- that focuses on isolating technical related challenges
teroperability, flexible coordination, self-management, from the applications layer by using a facade layer in-
trust and reputation. They have also identified context- between. The facade layer transforms the sensor data
aware sensor data fusion as a secondary challenge. The into semantically enriched information. The proposed
proposed solution is based on two other projects SmartRe- architecture comprises three layers: facade, core, and
source [69] and UBIWARE [39]. UbiRoad combines dif- visualisation. The core layer does the reasoning and in-
ferent ontologies to incorporate different concepts into ferring. An ontological semantic model is used to store
the system such as device ontology, context ontology, the concepts, rules and data.
data ontology, and domain ontology. For example, de- Intelligent Event Processing Agent (iEPA) [19] is an
vice ontology is used to recognise different devices in approach that combines complex event processing and
the sensor network and context ontology is used to un- multi agent systems. The research is focused on traffic
derstand the traffic control domain. management domain. A rule based system is employed
Phuoc and Hauswirth [60] have proposed the concept to identify the events. Data fusion operations such as
of combining link data towards sensor data mashups. filter, split, aggregate, and transform are used to infer
The system acquires sensor data through wrappers and events. Events are defined in a language called Espers
passes them to the upper layer for fusion operations. continuous Query Language (EQL).
The data fusion comprises many operations such as data Izumi et al. [35] have proposed a knowledge filter-
filtering, data alignment, association, correlation, pat- ing scheme for the health care support domain. Their
tern detection and classification. Fusion operations can system comprises a number of different agents, such as
be composed together to produce high-level filters. The a data stream mining agent, a inference agent, and a
acquired sensor data are stored in RDF models. There- knowledge base agent. A multi agent architecture is
fore, SPARQL is used to query the data. Each individ- used to built the system, and an ontology scheme is
ual sensor in considered as sensor component. Combi- used to store data where SPARQL queries are used for
nations of sensor components are defined as a sensing data filtering. Knowledge gathered using sensors is fil-
system. Sensor systems and fusion operation can be tered based on four different perspectives: person based
combined together to build complex work flows. An filtering, access policy based filtering, location based fil-
Ajax [23] based graphical user interface is provided to tering, and time based filtering.
build those work flows. The approach is more focused Teymourian et al. [71] present a conceptual approach
towards utilising link data concepts. to address the problem of Semantic Event Processing
Gyllstrom et al. [26] have proposed a complex event (SCEP ). SCEP combines event processing technologies
processing system over data streams called SASE. SASE and semantic technologies. This research effort is not
is narrowly focused on the RFID sensors domain. A directly related to sensor data fusion. However, the
high-level SQL like language has been defined to sup- techniques used in this area can be combined with sen-
port user queries. The system is capable of identifying sor data stream processing in order to detect events in
events such as shoplifting or inventory misplacement. the IoT environment.
Users need to syntactically define the query, and the The Sensor Web Agent Platform (SWAP ) framework
system can process the query against the data stores. [50] comprises three layers: sensor layer, knowledge layer,
Some data fusion operations such as anomaly filtering, and application layer. A multi agent technology and
temporal smoothing and duplication reduction are pro- web services technologies are employed to built the sys-
vided by SASE. tem. Each layer consists of a number of agents that are
capable of doing specific tasks. The implementation is Low (L) - Poses software level limited dynamic
focused on a fire detection domain. The number of dif- composition and configuration capabilities.
ferent agents can be combined together to answer or None () - No software or hardware compo-
detect complex situations such as wild fire. nents are dynamically configured.
7. EVALUATION OF SENSOR DATA FUSION Fusion Complexity: This feature is evaluated us-
APPROACHES ing three categories: High (H), Moderate (M), and
Low (L).
The Table 1 classifies the difference sensor data fusion
efforts based on the evaluation framework we presented High (H) - Capable of answering complex user
in section 5. queries. Program components can be com-
The parameters used to evaluate each feature of re- bined together to produce complex results.
search efforts can be explained as follows. In depth Moderate (M) - Capable of answering moder-
discussion on each feature is conducted in the Section ately complex user queries. Develop complex
5. fusion mechanism by combining simple fusion
Architecture Type: This feature evaluates whether components is not possible.
the proposed solution is proposed as a middleware Low (L) - Limited fusion techniques such as
(M) or an Application system (A). Application data filtering is possible.
systems are narrowly focused on one specific do-
main while middleware solutions possesses more Actuation Management: Does the solution pos-
domain expandability and domain independence. sesses actuation management capabilities.

Context-awareness: This feature evaluates whether Type of Processing: Is the data fusion approach
the proposed solution possesses context-awareness Centralised (C) or Decentralised (D).
capabilities or not.
Cross Domain Portability: Number of domains
Semantic Interaction: This feature is evaluated that the proposed solution is applied.
using four categories: High (H), Moderate (M),
Implementation: This feature tells that whether
Low (L), and none ().
researchers have practically implemented the pro-
High (H) - Both data and program compo- posed solution or if it is a theoretical approach
nents are annotated using semantic technolo- only.
gies. Semantic reasoning mechanisms are em-
ployed. Performance Evaluation: This feature evaluates
whether each research effort has conducted a per-
Moderate (M) - Either data elements or pro- formance evaluation procedure on their proposed
gram components are enriched using seman- system or not.
tics technologies, but not both.
Low (L) - No semantic technologies are used.
However, solutions are enriched with limited 8. CONCLUSION
semantic capabilities using different techniques
In this article, we first highlighted the importance
such as rules [9], symbols [33], etc.
of sensor data fusion in IoT application such as smart
None () - No semantic interactions posed by cities applications. We examined a number of different
the approach. sensor data fusion research efforts related to IoT with
Dynamic Configuration: This feature is evaluated particular focus on smart cities application domain.
using four categories: High (H), Moderate (M), We developed a evaluation framework by carefully
Low (L), and none (). selecting ten different metrics. We believe these ten
metrics are open challenges in the field. Some of these
High (H) - Sensor hardware and software com- challenges are addressed by the researchers significantly
ponents are dynamically configured based on and some are in its infancy. One of the major goals of
the environment. The solution possesses au- this article is to highlight the opportunities for improve-
tomated configuration of filtering, fusion and ments and research gaps in the field.
reasoning mechanism, according to the prob- Based on surveyed approaches, context-awareness in
lems at hand. IoT more specifically within the smart city domain is
Moderate (M) - Poses very limited dynamic gaining importance but still in its infancy. A lot of fo-
hardware configuration such as switch on/off cus on context awareness is towards a particular appli-
sensors. cation while to realise the true IoT-enabled smart cities
Cross Domain Portability

Performance Evaluation
Actuation Management
Dynamic Configuration
Semantic Interaction
Context-awareness

Type of Processing
Fusion Complexity
Architecture Type

Implementation

Year
Research Efforts
Gibbons et al. [24] A L L D 3 ./ 2003
Liu & Zhao [43] A H M H C 1 ./ 2005
Whitehouse et al. [77] M M L H C 1 ./ 2006
Lewis et al. [49] M H M M C 1 ./ 2006
Moodley et al. [50] M ./ L L C 1 ./ 2006
Moodley & Simonis [50] M M M H C 1 ./ 2006
Bouillet et al. [6] M ./ H L H ./ C 1 ./ ./ 2007
Brenna et al. [8] A ./ M C 1 ./ 2007
Gyllstrom et al. [26] A M C 1 ./ 2007
Noguchi et al. [26] M M H M C 1 ./ 2007
Zafeiropoulos et al. [81] M H L M C 1 ./ ./ 2008
Sheth et al. [62] A H L M C 2 ./ 2008
Bruckner et al. [9] A ./ L M D 1 ./ 2008
Huang et al. [29] M ./ H M M C 1 ./ 2008
Wood et al. [78] A ./ L M L D 1 ./ 2008
Homed et al. [28] A ./ L M H ./ D 1 ./ ./ 2008
Ni et al. [53] A ./ H M D 1 2009
Da Rocha et al. [17] M ./ M L M D 1 ./ 2009
Phuoc & Hauswirth [60] M H L H C 1 ./ 2009
Teymourian et al. [71] A ./ L L L C 2 2009
Brunner et al. [10] M H M C 1 ./ 2009
Eisenhauer et al. [21] M ./ H M H C 2 ./ 2009
Lee et al. [42] M L L D 1 ./ ./ 2010
Siguenza et al. [64] A M L C 1 ./ 2010
Izumi et al. [35] A ./ M M C 1 ./ ./ 2010
Terziyan et al. [70] M ./ M L M C 1 ./ 2010
Hwang et al. [31] M ./ L M L ./ D 1 ./ ./ 2011
Dunkel [19] A L M H ./ D 1 ./ 2011
Zanella et al. [83] Theodoridis et al. [72] Lin et al. [37] M L L M L C 1 ./ ./ 2014
Jara et al. [36] A ./ L L H ./ C 1 ./ ./ 2014
Sobolevsky et al. [65] A ./ L L H ./ C 1 ./ ./ 2015
Antonelli et al. [3] A ./ H M H ./ C 1 ./ ./ 2014
Soldatos et al. [66] M ./ H H H ./ D many(5) ./ ./ 2014

Table 1: Taxonomy of Sensor Data Fusion Research Efforts

vision, a broader non-domain focus will have to be pur- to evaluate their proposed approaches are limited. Per-
sued. Furthermore, dynamic configuration of things is formance evaluation is extremely important as we are
also not addressed by most of the proposed solutions. expecting these solutions to incorporate billions of sen-
Similarly, actuation managements is the least addressed sor devices. Finally, cross domain portability is also
feature among all. We believe actuation management is addressed poorly. The majority of the efforts are based
important as it plays a significant role in the IoT mon- on a single domain. It is hoped that future efforts will
itoring and feedback cycle. Further, performance eval- aim to address these research gaps.
uation techniques employed by most of the researchers
9. REFERENCES alliance, 2011.
[12] A. Cenedese, A. Zanella, L. Vangelista, and
[1] G. D. Abowd and E. D. Mynatt. Charting past, M. Zorzi. Padova smart city: An urban internet of
present, and future research in ubiquitous things experimentation. In A World of Wireless,
computing. ACM Trans. Comput.-Hum. Interact., Mobile and Multimedia Networks (WoWMoM),
7:2958, March 2000. 2014 IEEE 15th International Symposium on,
[2] I. F. Akyildiz, S. Weilian, pages 16, June 2014.
Y. Sankarasubramaniam, and E. Cayirci. A [13] M. Chantzara and M. Anagnostou. Evaluation
survey on sensor networks. Communications and selection of context information. In In:
Magazine, IEEE, 40(8):102114, 2002. Second International Workshop on Modeling and
[3] F. Antonelli, M. Azzi, M. Balduini, D. DellAglio, Retrieval of Context, Edinburgh, 2005.
G. Caviglia, P. Ciuccarelli, E. D. Valle, and [14] Clark & Parsia. Pellet: Owl 2 reasoner for java.
R. Larcher. Towards city data fusion: A big data Software, 2004. http://clarkparsia.com/pellet/
infrastructure to sense the pulse of a city in [Accessed: 2011-12-18].
real-time. In European Data Forum 2014, March [15] O. Corcho and R. Garca-Castro. Five challenges
19-20, Athens, Greece, 2014. for the semantic sensor web. Semantic Web
[4] K. Ashton. That internet of things thing in the Interoperability, Usability, Applicability an IOS
real world, things matter more than ideas, June Press Journal, pages 121125, 2010.
2009. [16] Crossbow Technology Inc. Crossbow-manuals
[5] L. Atzori, A. Iera, and G. Morabito. The internet getting started guide. Technical report, Crossbow
of things: A survey. Comput. Netw., 54(15):2787 Technology, September 2005.
2805, 2010. [17] A. R. Da Rocha, F. C. Delicato, J. N. de Souza,
[6] E. Bouillet, M. Feblowitz, Z. Liu, D. G. Gomes, and L. Pirmez. A semantic
A. Ranganathan, A. Riabov, and F. Ye. A middleware for autonomic wireless sensor
semantics-based middleware for utilizing networks. In Proceedings of the 2009 Workshop on
heterogeneous sensor networks. In Proceedings of Middleware for Ubiquitous and Pervasive
the 3rd IEEE international conference on
Systems, WMUPS 09, pages 1925, New York,
Distributed computing in sensor systems, NY, USA, 2009. ACM.
DCOSS07, pages 174188, Berlin, Heidelberg, [18] R. v. B. M. W. E. B. David Gay, Phil Levis and
2007. Springer-Verlag.
D. Culler. The nesc language: A holistic approach
[7] J. R. Boyd. A discourse on winning and losing.
to networked embedded systems. In Proceedings
Unpublished set of briefing slides available at Air
of Programming Language Design and
University Library, Maxwell AFB, Alabama,
Implementation (PLDI), June 2003.
1987. http://www.ausairpower.net/JRB/intro.pdf
[19] J. Dunkel. Towards a multiagent-based software
[Accessed: 2011-12-18].
architecture for sensor networks. In Autonomous
[8] L. Brenna, A. Demers, J. Gehrke, M. Hong,
Decentralized Systems (ISADS), 2011 10th
J. Ossher, B. Panda, M. Riedewald, M. Thatte,
International Symposium on, pages 441 448,
and W. White. Cayuga: a high-performance event
march 2011.
processing engine. In Proceedings of the ACM
[20] V. Dyo. Middleware design for integration of
SIGMOD international conference on
sensor network and mobile devices. In Proceedings
Management of data, pages 11001102, New York,
of the 2nd international doctoral symposium on
NY, USA, 2007.
Middleware, DSM 05, pages 15, New York, NY,
[9] D. Bruckner, J. Kasbi, R. Velik, and W. Herzner.
USA, 2005. ACM.
High-level hierarchical semantic processing
[21] M. Eisenhauer, P. Rosengren, and P. Antolin. A
framework for smart sensor networks. In Human
development platform for integrating wireless
System Interactions, 2008 Conference on, pages
devices and sensors into ambient intelligence
668 673, May 2008.
systems. In Sensor, Mesh and Ad Hoc
[10] J.-S. Brunner, J.-F. Goudou, P. Gatellier, J. Beck,
Communications and Networks Workshops, 2009.
and C.-E. Laporte. Sembysem: a framework for
SECON Workshops 09. 6th Annual IEEE
sensor management. In 1st Int. Workshop on the
Communications Society Conference on, pages 1
Semantic Sensor Web (SemSensWeb), collocated
3, june 2009.
with ESWC, 2009.
[22] K. Ellebek. A survey of context-aware
[11] Carnot Institutes. White paper: Smart networked
middleware. In Proceedings of the 25th conference
objects and internet of things. Technical report,
on IASTED International Multi-Conference:
Carnot Institutes Information Communication
Software Engineering, pages 148155. ACTA
Technologies and Micro Nano Technologies
Press, 2007. software engineering. In 2007 Future of Software
[23] J. J. Garrett. Ajax: A new approach to web Engineering, FOSE 07, pages 244258,
applications, February 2005. Washington, DC, USA, 2007. IEEE Computer
http://www.adaptivepath.com/ideas/ajax-new- Society.
approach-web-applications [Accessed: [35] S. Izumi, Y. Kobayashi, H. Takahashi,
2011.12.18]. T. Suganuma, T. Kinoshita, and N. Shiratori. A
[24] P. Gibbons, B. Karp, Y. Ke, S. Nath, and knowledge filtering scheme using sensor data for
S. Seshan. Irisnet: an architecture for a worldwide symbiotic healthcare support system. In Cognitive
sensor web. Pervasive Computing, IEEE, 2(4):22 Informatics (ICCI), 2010 9th IEEE International
33, oct.-dec. 2003. Conference on, pages 619 624, july 2010.
[25] P. Guillemin and P. Friess. Internet of things [36] A. Jara, D. Genoud, and Y. Bocchi. Short paper:
strategic research roadmap. Technical report, The Sensors data fusion for smart cities with knime: A
Cluster of European Research Projects, 2009. real experience in the smartsantander testbed. In
[26] D. Gyllstrom, E. Wu, H. jin Chae, Y. Diao, Internet of Things (WF-IoT), 2014 IEEE World
P. Stahlberg, and G. Anderson. Sase: Complex Forum on, pages 173174, March 2014.
event processing over streams. In In Proceedings [37] J. Jin, J. Gubbi, S. Marusic, and M. Palaniswami.
of the Third Biennial Conference on Innovative An information framework for creating a smart
Data Systems Research, 2007. city through internet of things. Internet of Things
[27] D. Hall and J. Llinas. An introduction to Journal, IEEE, 1(2):112121, April 2014.
multisensor data fusion. Proceedings of the IEEE, [38] K. Karimi. The role of sensor fusion in the
85(1):6 23, jan 1997. internet of things, Accessed on: May 2015.
[28] I. Homed, A. Misra, M. Ebling, and W. Jerome. [39] A. Katasonov, O. Kaykova, O. Khriyenko,
Harmoni: Context-aware filtering of sensor data S. Nikitin, and V. Y. Terziyan. Smart semantic
for continuous remote health monitoring. In middleware for the internet of things. In
Pervasive Computing and Communications, 2008. ICINCO-ICSO08, pages 169178, 2008.
PerCom 2008. Sixth Annual IEEE International [40] G. Kortuem, F. Kawsar, D. Fitton, and
Conference on, pages 248 251, march 2008. V. Sundramoorthy. Smart objects as building
[29] V. Huang and M. K. Javed. Semantic sensor blocks for the internet of things. Internet
information description and processing. In Computing, IEEE, 14(1):4451, 2010.
Proceedings of the 2008 Second International [41] J. Krosche, A. Jakl, D. Gusenbauer,
Conference on Sensor Technologies and D. Rothbauer, and B. Ehringer. Managing
Applications, pages 456461, Washington, DC, context on a sensor enabled mobile device - the
USA, 2008. IEEE Computer Society. msense approach. In Proc. IEEE Int. Conf.
[30] Y. Huang and G. Li. A semantic analysis for Wireless and Mobile Computing, Networking and
internet of things. In Intelligent Computation Communications WIMOB 2009, pages 135140,
Technology and Automation (ICICTA), 2010 2009.
International Conference on, volume 1, pages [42] K.-W. Lee, J.-H. Park, and R.-D. Oh. Design of
336339. active semantic middleware system to support
[31] J. Hwang and H. Yoe. Study on the context-aware incomplete sensor information based on
middleware for ubiquitous greenhouses using ubiquitous sensor network. In Application of
wireless sensor networks. Sensors, 11(5):4539 Information and Communication Technologies
4561, 2011. (AICT), 2010 4th International Conference on,
[32] G. Hynes, V. Reynolds, and M. Hauswirth. A pages 1 5, oct. 2010.
context lifecycle for web-based context [43] J. Liu and F. Zhao. Towards semantic services for
management services. In Proceedings of the 4th sensor-rich information systems. In Broadband
European conference on Smart sensing and Networks, 2005. BroadNets 2005. 2nd
context, EuroSSC 2009, pages 5165. International Conference on, pages 967 974 Vol.
Springer-Verlag, 2009. 2, oct. 2005.
[33] M. Imai, Y. Hirota, S. Satake, and H. Kawashima. [44] T. S. Lopez, D. Kim, K. Min, and J. Lee.
Semantic sensor network for physically grounded Dynamic context networks of wireless sensors and
applications. In Control, Automation, Robotics rfid tags. In Wireless Pervasive Computing, 2007.
and Vision, 2006. ICARCV 06. 9th International ISWPC 07. 2nd International Symposium on,
Conference on, pages 1 6, dec. 2006. feb. 2007.
[34] V. Issarny, M. Caporuscio, and N. Georgantas. A [45] T. Lu and W. Neng. Future internet: The internet
perspective on the future of middleware-based of things. In Advanced Computer Theory and
Engineering (ICACTE), 2010 3rd International (iThing), pages 775782, Besanon, France,
Conference on, volume 5, pages V5376V5380. November 2012.
[46] S. R. Madden, M. J. Franklin, J. M. Hellerstein, [58] C. Perera, A. Zaslavsky, P. Christen, and
and W. Hong. Tinydb: an acquisitional query D. Georgakopoulos. Context aware computing for
processing system for sensor networks. ACM the internet of things: A survey. Communications
Trans. Database Syst., 30:122173, March 2005. Surveys Tutorials, IEEE, 16(1):414454, 2013.
[47] S. Malik, A. Goel, and S. Maniktala. A [59] C. Perera, A. Zaslavsky, P. Christen, and
comparative study of various variants of sparql in D. Georgakopoulos. Sensing as a service model for
semantic web. In Computer Information Systems smart cities supported by internet of things.
and Industrial Management Applications Transactions on Emerging Telecommunications
(CISIM), 2010 International Conference on, Technologies (ETT), 25(1):8193, 2014.
pages 471 474, oct. 2010. [60] D. L. Phuoc and M. Hauswirth. Linked open data
[48] A. L. Mark Raskino, Jackie Fenn. Extracting in sensor data mashups. In In Proceedings of the
value from the massively connected world of 2015. 2nd International Workshop on Semantic Sensor
Technical report, Gartner Research, 2005. Networks (SSN09), volume 522, pages 116.
[49] S. X. B. A. Micah Lewis, Delroy Cameron. Es3n: CEUR Workshop at ISWC 2009, Washington DC,
A semantic approach to data management in USA, 2009.
sensor networks. In 5th International Semantic [61] B. Schilit, N. Adams, and R. Want.
Web Conference ISWC, 2006. Context-aware computing applications. In Mobile
[50] D. Moodley and I. Simonis. A new architecture Computing Systems and Applications, 1994.
for the sensor web: The swap framework. In 5th Proceedings., Workshop on, pages 85 90, dec
International Semantic Web Conference ISWC, 1994.
2006. [62] A. Sheth, C. Henson, and S. Sahoo. Semantic
[51] M. Nagy, A. Katasonov, O. Khriyenko, S. Nikitin, sensor web. Internet Computing, IEEE, 12(4):78
M. Szydlowski, and V. Terziyan. Challenges of 83, july-aug. 2008.
middleware for the internet of things. Technical [63] A. N. Shulsky and G. J. Schmitt. Silent Warfare:
report, University of Jyvaskyla, 2009. Understanding the World of Intelligence. Potomac
[52] E. F. Nakamura, A. A. F. Loureiro, and A. C. Books Inc, 3d edition edition, May 2002.
Frery. Information fusion for wireless sensor [64] A. Siguenza, J. L. Blanco, J. Bernat, and L. A.
networks: Methods, models, and classifications. Hernandez. using scxml for semantic sensor
ACM Comput. Surv., 39, September 2007. networks. In 3nd International Workshop on
[53] L. M. Ni, Y. Zhu, J. Ma, Q. Luo, Y. Liu, S. C. Semantic Sensor Networks (SSN10), 2010.
Cheung, Q. Yang, M. Li, and M. Wu. Semantic [65] S. Sobolevsky, I. Bojic, A. Belyi, I. Sitko,
sensor net; an extensible framework. Int. J. Ad B. Hawelka, J. M. Arias, and C. Ratti. Scaling of
Hoc Ubiquitous Comput., 4:157167, April 2009. city attractiveness for foreign visitors through big
[54] C. Perera, P. P. Jayaraman, A. Zaslavsky, data of human economical and social media
P. Christen, and D. Georgakopoulos. Mosden: An activity, April 2015.
internet of things middleware for resource [66] J. Soldatos, N. Kefalakis, M. Hauswirth,
constrained mobile devices. In Proceedings of the M. Serrano, J.-P. Calbimonte, M. Riahi,
47th Hawaii International Conference on System K. Aberer, P. Jayaraman, A. Zaslavsky, I. arko,
Sciences (HICSS), pages 10531062, Hawaii, L. Skorin-Kapov, and R. Herzog. Openiot: Open
USA, January 2014. source internet-of-things in the cloud. In
[55] C. Perera, C. Liu, and S. Jayawardena. The I. Podnar arko, K. Pripui, and M. Serrano,
emerging internet of things marketplace from an editors, Interoperability and Open-Source
industrial perspective: A survey. Emerging Topics Solutions for the Internet of Things, volume 9001
in Computing, IEEE Transactions on, PP(99):1 of Lecture Notes in Computer Science, pages
1, 2015. 1325. Springer International Publishing, 2015.
[56] C. Perera, C. Liu, S. Jayawardena, and M. Chen. [67] Z. Song, A. Ca andrdenas, and R. Masuoka.
A survey on internet of things from industrial Semantic middleware for the internet of things. In
market perspective. Access, IEEE, 2:16601679, Internet of Things (IOT), 2010, pages 1 8, 29
2014. 2010-dec. 1 2010.
[57] C. Perera, A. Zaslavsky, P. Christen, and [68] H. Sundmaeker, P. Guillemin, P. Friess, and
D. Georgakopoulos. Ca4iot: Context awareness S. Woelffle. Vision and challenges for realising the
for internet of things. In IEEE International internet of things. Technical report, European
Conference on Conference on Internet of Things Commission Information Society and Media, 2010.
[69] V. Terziyan. Smartresource- proactive Ubiquitous Computing, Systems, Services and
self-maintained resources in semantic web: Technologies, 2008. UBICOMM 08. The Second
Lessons learned. International Journal of Smart International Conference on, pages 116 121, 29
Home, Special Issue on Future Generation Smart 2008-oct. 4 2008.
Space, 2:3357, 2008. [82] A. Zafeiropoulos, D.-E. Spano, S. Arkoulis,
[70] V. Terziyan, O. Kaykova, and D. Zhovtobryukh. N. Konstantinou, and N. Mitrou. Data
Ubiroad: Semantic middleware for context-aware Management in the Semantic Web. Distributed,
smart road environments. In Internet and Web Cluster and Grid Computing - Yi Pan (Georgia
Applications and Services (ICIW), 2010 Fifth State University), Series Edito. novapublishers,
International Conference on, pages 295 302, may 2011.
2010. [83] A. Zanella, N. Bui, A. Castellani, L. Vangelista,
[71] K. Teymourian, O. Streibel, A. Paschke, and M. Zorzi. Internet of things for smart cities.
R. Alnemr, and C. Meinel. Towards semantic Internet of Things Journal, IEEE, 1(1):2232,
event-driven systems. In Proceedings of the 3rd Feb 2014.
international conference on New technologies, [84] A. Zaslavsky, C. Perera, and D. Georgakopoulos.
mobility and security, NTMS09, pages 347352, Sensing as a service and big data. In International
Piscataway, NJ, USA, 2009. IEEE Press. Conference on Advances in Cloud Computing
[72] E. Theodoridis, G. Mylonas, and (ACC-2012), Bangalore, India, July 2012.
I. Chatzigiannakis. Developing an iot smart city
framework. In Information, Intelligence, Systems
and Applications (IISA), 2013 Fourth
International Conference on, pages 16, July
2013.
[73] L. Thomason. Tinyxml. Software, 2010.
http://www.grinninglizard.com/tinyxml/index.html
[Accessed: 2011-12-18].
[74] TinyOS Alliance. Tinyos, July 2010.
http://www.tinyos.net/ [Accessed: 2011-12-18].
[75] UC Berkeley WEBS Project. nesc: A
programming language for deeply networked
systems, December 2004.
http://nescc.sourceforge.net/ [Accessed:
2011-12-18].
[76] I. T. Union. Itu internet reports 2005: The
internet of things. Technical report, 2005.
[77] K. Whitehouse, F. Zhao, and J. Liu. Semantic
streams: A framework for composable semantic
interpretation of sensor data. In EWSN06, pages
520, 2006.
[78] A. Wood, J. Stankovic, G. Virone, L. Selavo,
Z. He, Q. Cao, T. Doan, Y. Wu, L. Fang, and
R. Stoleru. Context-aware wireless sensor
networks for assisted living and residential
monitoring. IEEE Network, 22(4):2633, July
2008.
[79] D.-L. Yang, F. Liu, and Y.-D. Liang. A survey of
the internet of things. In International Conference
on E-Business Intelligence (ICEBI-2010),
Advances in Intelligent Systems Research.
[80] Y. Yao and J. Gehrke. The cougar approach to
in-network query processing in sensor networks.
SIGMOD Rec., 31:918, September 2002.
[81] A. Zafeiropoulos, N. Konstantinou, S. Arkoulis,
D.-E. Spanos, and N. Mitrou. A semantic-based
architecture for sensor data fusion. In Mobile

Anda mungkin juga menyukai