Chapter-1
Introduction
There isnt person anywhere who capable of doing more than he thinks; he can. Yes. We
must become the change we want to see.
-Henry Ford, Founder of FORDS group of company, USA
1.1 Motivation
Figure 1.1: Cloud service & domain provider firms based on Cloud Computing
Cloud computing is a very current topic and the term has gained a lot of traction
being sported on advertisements all over the Internet from web space hosting providers,
through data centers to virtualization software providers. Cutting through the hype of
cloud computing is not an easy task as a simple web search suffices to convince that
there are nearly as many definitions on what constitutes 'cloud computing' as there are
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
players in the market seeking to gain new territory in that promising new business field.
IBM, Amazon, Microsoft, Google, Yahoo and Apple among others are very active in the
area of cloud computing. They either already provide cloud computing commercial
solutions in one form or another, or actively sponsor research centers, pursuing
development of marketable technology. Marketing rhetoric notwithstanding, the
academic world has also provided meaning and definitions on what does or should
cloud computing aim at and what are typical services that are expected to be
encompassed by the definition of cloud computing, as evidenced for instance by the
work of the RAD lab at the University of California at Berkeley or the GRIDS lab at the
University of Melbourne. Other renown companies such as Oracle are eager to provide
new offerings that allow enterprises to benefit from the developments taking place in
the area of Cloud Computing [29], yet they attempt to steer clear out of the hype and
highlight that they have redefined cloud computing to include everything that we
already do, as stated by Oracle's Larry Ellison. [30]
Furthermore, differently colored opinions on cloud computing technology from
industry speakers and experts ranging from praise and optimism to critique on the
viability and feasibility along with concerns on privacy, security and not least cost
efficiency of the currently offered cloud computing models are available as white papers
and seem to be broadly discussed within the IT community. Such complex technology
and business models setting entails an extensive research and provides the motivation
towards writing this bachelor thesis. The main goal is to clear the air on cloud
computing and provide an unbiased and independent, albeit critical outlook of the
technology. As the title of this thesis suggests its aim is to enable the reader to gain an
overview of the vital aspects of cloud computing in a three-fold way:
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Special emphasis is put on the critical examination of each strategy as now more
than ever in the face of the global economic crisis, companies face higher refinancing
and investment costs and as any company thinking about adopting or moving to cloud
computing technology would do in practice, short-to-medium term disadvantages of the
technology have to be pragmatically and carefully weighted out against any hyped longterm potential efficiency achievements, be it strategic, technical or cost related.
Cloud Computing is an emerging trends of Distributed Computing and
generalization of Grid Computing known either as online services such as Amazon AWS
[12] & Google App Engine [13] for enabling convenient, on-demand services access to a
shared pool of configurable computing resources (e.g. Networks, Servers, Storage,
Applications, and Services) that can be rapidly provisioned and released with minimal
intelligent management efforts or service provider within interactions of regulations.
Where, virtualization is intelligent resource management facility of Cloud Computing as
service providence to Customer on support of Full-Virtualization as well as ParaVirtualization [21], [22]. Critics argue that Cloud Computing is not reliable enough due
to the tension created by incoming oppressive requests. It has features of shared
computing
infrastructure
for
hosting
multiple
applications
where
management
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 1.2 shows the dynamics of the hourly workload measured 1 during a 46days period on Yahoo! Video, the 2 nd largest U.S. online video sharing website. Applying
statistical analysis techniques including autoregressive integrated moving average
(ARIMA) and Fourier Transfer analysis, we observed that there were clear periodic
components (exampled by the workload between July 23 and July 27) in most of the
time; however, the big spikes shown in Figure 1.2 were not predictable. Therefore,
resource planning could be effective most of the time, but not always working We also
observed that the ratio of the maximum workload to the average load is as high as 5:3
(12:9 if workload was measured in half an hour interval), which makes over-provisioning
over peak load highly inefficient. Based on the above observations, we believe an
integration of proactive and reactive resource management schemes should be applied
on different components of the aggregated application workload along the time:
proactive management opportunistically achieves resource efficiency with reliable
prediction on the base workload seen most of the time, while reactive management
deterministically response to sudden workload surges in rare time with the requirement
of agile and responsive performance. [1]
Figure 1.2: Video stream workload evolution on Yahoo! Video Site (July-August, 2008)
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Analysis,
Observation
experiments, we showed
Tracery,
and
Tri-Way
Trajectory
Simulation
workload prediction in the Regular State, effective ratio of the maximum load to the
average load, Memory-Prediction-Error () in Critical State, achieve resource proficiency
and reduce data cache/replication overhead in the Critical State, and react fast (with an
speedup factor) to the changing application data popularity upon the arrival of
load spikes.
for
resolving
the
workload,
Model
defines two
states
for
resource
management:
Regular State which is original & has limited resources in dedicated application
platform in Local Internet Data Center (LDC) [2]. In this state all processes run all time
Samrat Ashok Technological Institute, Vidisha
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
and with balanced load of application & system. As processing the data volume doesnt
vary sudden and strike after removing at high workload. The LDC is expected to run in
relaxed mode and with high resource proficiency & managing facility for best utilizing
scenario even though resource provisioning for QoS guarantee.
Another is Critical State in which all resources in dedicated application platform
operated by cloud service provider & related infrastructure. This state is provisioned on
high demand and also optimizes to be on for a momentary variation of critical
oppressive runtime periods. Here, Resources are provided at large scale. Each state has
its local load balancing scheme managed according to workload present in runtime.
The origination of the Integrated Cloud Computing Model is based on dynamic
workload as Hub & Spoke Infrastructures [23]. It addresses many concepts where IT
consultants completely rely on extreme utilization of cloud services for application
hosting. At some cases, we cant predict some types of unexpected workload. It is
necessary to learn these natures of high spike & burst-time as well as find out an
efficient way to handle it once such events happen. Ongoing way of Customer Resource
Management (CRMs) [16] with Integrated Cloud Computing Model, we identified that the
resource management scheme applied through Integrated Cloud Computing Model has
efficient impact to resolve oppressive workload on different components of aggregated
applications during runtime as intelligent satisfaction for customers. This scheme
varies in our model as three ways
regular workload seen most of the time achieves through local data center.
Optimistically, response to high workload manages in rare time with the
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Cloud User
IaaS
System Mentor
PaaS
SaaS
Cloud virtualization Platform
NaaS
Workload Factoring Scheme
Network Resource
Computing Resource
Storage Resource
Figure 1.3: Proposed Integrated Cloud Computing Model with Workload Factoring Scheme
In our Proposed Model Role of Information Life-Cycle Management (ILMs) [3] refers
to a large set of regulations, policies and strategies that handle Information-Regulation
& their storage system manually or automatically through computing resources
according to system state. ILMs underused through four strategies & their regulations
these are- Infrastructure, Policy, Operational Jobs and Definitions. Actually ILMs
comprises the policies, practices, regulations, SLAs associated applications and tools
used to approach the business value of information with cost consuming IT
infrastructure before its final disposition. It is count as part of EMC (Enterprise Content
Management) also. Through logical grouping, availability and dynamic nature of
information ILM proposed for Information Centric Approach. According to our
Rationale, ILM have important role to corroboration of reducing oppressive workload in
Critical State as following functionality-
Creation
&
Receipt
adopt
request
&
create
state
and
acknowledgement.
Page
process
with
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Chapter-2
Fundamentals & Literature Survey
It is very easy to defeat someone. But it is very hard to win someone. So, always try to
win & never thinks about rest because your success is waiting for bright future specially.
-Dr. APJ Abdul Kalam, Ex-president of Republic India
Page
10
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
users website;
In house attempts to balance resources over the business solutions;
External ASP-type offerings.
It must be made clear in this context that Clouds do generally not refer to a specific
technology or framework, but rather to a set of combined technologies, respectively a
paradigm / concept.
Page
11
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
applications etc.), in a managed and elastic fashion, whereas managed means that
reliability according to pre-defined quality parameters is automatically ensured and
elastic implies that the resources are put to use according to actual current
requirements observing overarching requirement definitions implicitly, elasticity
includes both up- and downward scalability of resources and data, but also loadbalancing of data throughput. As shall be elaborated, future cloud systems should also
be able to maintain a pre-specified level of quality, respectively boundary conditions
(including performance, energy consumption, etc.) and should allow integration of
resources across organizational boundaries, integrating multiple stakeholders.
Figure 2.1: Cloud Computing Architecture based on SOMA (Service Oriented Modeling & Architecture)
Page
12
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
professionals, the concept of computing in the cloud is a wide and generic in terms of
many specific areas within online and offline both types environment. The cloud is
defined as the Internet surrounding every part of our daily lives, similar to the clouds in
the sky. However many new enterprise related buzzwords have evolved from the original
computing in the cloud concept; While a common misconception for cloud computing
is merely workload on the Internet, the cloud offers many services, infrastructure
benefits and scalability which may not be possible within ordinary local data center.
When cloud storage is used as the primary location of files and documents, there is no
guarantee to certain trust is left in the hands of the storage provider to ensure certain
steps are taken to prevent data loss and maintain the integrity of the file system;
enabling maximum uptime, reducing downtime and sustain the highest levels of
physical protection and data security at oppressive workload.
Page
13
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
14
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
15
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
The researchers thus emphasize that a 'cloud' is thereby not only a combination of
clusters and grids, but is also extended by the implied usage of virtualization
technologies such as Virtual Machines (VMs) to meet a specifically negotiated service
quality level. This definition implies and captures two potentially problematic issues of:
the business issue of negotiating the proper SLA from the customer's perspective
of having the technical capacity to correctly account for and
Guarantee the service outlined in that SLA at all (resource monitoring, failure
redundancy, rebalancing of workloads, etc. from the provider's perspective).
Hence, GRIDS' definition seems somewhat more neutral than Berkeley's one:
Cloud Computing refers to both the applications delivered as services over the
Internet and the hardware and systems software in the datacenters that provide those
services (Software as a Service - SaaS). The datacenter hardware and software is what
we will call a Cloud. When a Cloud is made available in a pay-as-you-go manner to the
public, we call it a Public Cloud; the service being sold is Utility Computing. [35]
Berkeley's
researchers
moreover
limit
their
definition
with
several
additional
assumptions
Page
16
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
refrains
specifically
of
the
usage
of
the
terminology
Storage-as-a-Service
Database-as-a-Service
Information-as-a-Service
Process-as-a-Service
Application-as-a-Service
Integration-as-a-Service
Security-as-a-Service
Management/Governance-as-a-Service
Testing-as-a-Service
Page
17
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
18
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
19
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
below), i.e. hypervisors. Compute Cloud Providers therefore typically offer the capability
to provide computing resources (i.e. raw access to resources unlike PaaS that offer full
software stacks to develop and build applications), typically virtualized, in which to
execute cloudified services and applications. IaaS (Infrastructure as a Service) offers
additional capabilities over a simple compute service.
Examples: Amazon EC2, Zimory, Elastichosts.
Page
20
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
21
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
to
customers.
Though
the
provider
could
actually
resell
the
Page
22
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
cloud features for his / her own purposes also allows other enterprises to outsource
their services to such cloud providers, thus reducing costs and effort to build up their
own infrastructure. As noted in the context of cloud types, the scope of functionalities
thereby may different.
Example: Amazon, Google Apps, Windows Azure.
Page
23
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 2.8: Integrated View of Cloud Deployment Models (Private, Public, Hybrid)
Page
24
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 2.9: Working Profiles of Workload Factoring at Hybrid Cloud Deployment Model
Critics argue that Cloud Computing is not secure enough due to the tension created
by incoming of oppressive requests. Cloud Computing has features of shared computing
infrastructure hosting multiple applications where management complexity is hidden
and resource multiplexing leads to proficiency. More computing resources are allocated
on demand to application when its workload incurs more resource demand than it is
currently allocated. We focus on Workload Factoring [1] as solution in this paper as it is
a unique functionality requirement by Integrated Cloud Computing architecture.
Besides the presentation consolidation, we describe and evaluate our technologies in
context of video streaming and flow of information as applications throughout this white
paper. This paper proposes an Integrated Cloud Computing model which enterprise IT
consultants can base to design and plan their computing platform for hosting Internet
based applications with highly dynamic workload. The cloud computing model features
two analytical ideas as: ESRWF & ESRATE and also two states for system which is
naturally and randomly appeared different components in aggregate workload of
Samrat Ashok Technological Institute, Vidisha
Page
25
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Internet applications: Regular State and Critical State are explicitly arranged in separate
CRMs, SLAs & ILMs with consistory of management.
Figure 2.10: Working Profiles of Load balancing at Hybrid Cloud Deployment Model
Page
26
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
video streaming service testbed as a showcase of the hybrid cloud computing model. It
has a local cluster as the regular load resource zone and the Amazon EC2
infrastructure [1] as the critical zone; the workload factoring scheme was implemented
as a load controller to arbitrate the stream load distribution between the two zones.
With extensive analysis, trace-driven simulations, and testbed experiments, IWF showed
the workload factoring technology can enable reliable workload prediction in the base
load zone (with simple statistical technique), achieve resource efficiency (e.g., 78%
higher server capacity than that in base load zone) and reduce data cache/replication
overhead (up to two orders of magnitude) in the trespassing load zone, and react fast
(with an
Page
27
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Chapter-3
Problem Statement
If friendship is your weakest point, then you are the strongest person in the world. Its one
of the life-long achievement & inspirable moment.
Abraham Lincoln, Ex-President, USA
network utilization.
Authentication and Protocol for Services for secure trusting.
Cheap data and data analysis.
Cost-effective defense of availability.
Increased authentication demands.
Mash-up authorization.
Green Cloud Computing Mechanisms.
Work Overloading
Page
28
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Services,
Ruled Databases
and
their
excellent
performance
at
utilization. Now a time we miss such type of any approach as well as their maintenance
& storage. These are general description of problem but at networking level processing,
importance of such problem is increase in absence of any recommended technology.
Page
29
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
frequent data item detection algorithm, which enables factoring incoming request not
only on volume but also on data content, upon changing application data popularity.
Application Request
Base Zone
Trespassi
ng Zone
Workload Profiling
Fast factoring
There are fast partition solutions proposed like the bi-section partition scheme
[11]. For video streaming services where request-data relationship is simple and there is
no net cut as one request accesses only one data item, the partition problem
degenerates to the knapsack problem where our greedy scheme is moving vertices from
the base zone one by one ranked by their popularity until reaching the trespassing
zone's capacity. This is equal to redirect the requests for the most popular data items in
a top-k list into the trespassing zone, and the remaining question is on how to quickly
generate the correct top-k list during a popularity transition time disturbed by the
workload burst.
Page
30
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
IWF call the fast frequent data item detection algorithm FastTop-K. As shown in
Figure 3.2, it has the following data structures: a FIFO queue to record the last c
requests, a list to record the current top-k popular data items, a list to record the
historical top-k popular data items, and a list of counters to record the data items
access frequency. Given a request r, the algorithm outputs base if r will go to the base
zone otherwise trespassing. The key ideas in the fastTop-K algorithm for speeding up
frequent data item detection have two: speeding up the top-k detection at changing data
popularity distributions by pre-filtering old popular data items in a new distribution,
and speeding up the top-k detection at a data popularity distribution by pre-filtering
unpopular data items in this distribution.
Page
31
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
size of a net
C( n j )
nj
N . Each net
v i V
n j N
H=(V , N )
W ( v i)
vi
V . The
vi
are called
is the expected workload caused by this data item, which is calculated as its
popularity multiplied by average workload per request to access or process data. The
cost
C( n j )
of a net
n j N
request type, which is calculated as the expected number of request of this type
multiplied by the sum of its neighboring data objects size.
{v 1 , v 2 , . , v k }
vk
empty. Parts are pair wise disjoint and the union of parts gives
V . In
is non-
, a net is
said to connect a part if it has at least one pin in that part. The Connectivity Set
of a net
nj
Page
32
nj
. The connectivity
j=| j|
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
nj
of a net
n j is an internal net. If
nj
=1 , then
. If
{v 1 , v 2 , , v k }
partition
H=(V , N )
such that a
partitioning objective defined over the nets is optimized while a partitioning constrained
is maintained. The K-way Hypergraph partition, an NP-Hard problem [4] is to assign all
vertices data objects to K (K=3 in our case) disjoint non empty locations without the
expected workload beyond their capacities. In general the partitioning objective is to
minimize
cost
function
defined
over
S i1
the
and
Net-Cut-Cost.
S i2
of a vertex
Then
v i V
is
data size of this objects then achieve minimal partition cost or Net-Partition-Cost-
Min
n j N cut
C j+ j
vi V critic al
S1
v i V criticaldrain
S2
}]
Where,
n j N cut
Cj
, Net-Cut-Cost defines total weights of the nets that span more than one
v i V critical
S i1
v i V critical drain
Si2
Page
33
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
i
i
S 1 and S 2 another weights of a vertex v i V
We identified through our initial simulation process, for video streaming service
or flow of requests (for such as image, audio, PDFs) where request-data relationship has
no Net-Partition-Cost. Yes, to make effective partitioning technique we move on
System-State Partitioning approach from [4] where requests in Regular State one by one
ranked by their popularity until reaching the Empirical Threshold & CN-46 follow-ship
of the system to dispatch in the Critical State processing. This is equivalent to redirect
the requests of higher popularity revenuer data item have State-Rank 1 or in
ESRATE[5] into the Critical State. Then question arises that how can we generate
efficient State-Rank at continue runtime with high workload during popularity revenue
measurement.
Page
34
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
issues raised from Integrated Cloud Computing model. Through Content Distributed
Network (CDN) and web caching workload factoring happen between a local web server
and proxy servers. The typical method is DNS redirecting and the workload factoring
decision is predefined manually over a set of most popular web objects. When current IT
systems evolve from the dedicated platform model to the shared platform model along
the cloud computing trend, we believe a core technology component is required on
flexible workload management working for such models mentioned above, and our
workload factoring technology (ESRWF) is proposed as one answer for it.
Page
35
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
maximum flow rate is small and a loose upper bound is known a priori. In general, all
the proposed mechanisms tend to trade reduced estimation accuracy and/or increased
sampling time for lower memory cost. For a given sampling time, nave counting scheme
can still produce the most accurate results regardless of flow rate but at the expense of
much higher memory requirements. Other side, CATE [7] extends RATE with using the
width of the coincidence interval of the naive counting scheme as the benchmark to
determine the effectiveness of the sampling schemes developed. Fast Top-K [1] is the
first paper which contributes request patterns instead of flow mechanism with fully
inspiration of CATE. Follow same ideals of Fast Top-K, here we use State-Rank
terminology to access rate-estimation as well as efficient rate-concentration with
memory usage also.
Page
36
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Chapter-4
Proposed Works
Gravitation is not being held responsible for people falling in love. It is only a matter to
which science or any technology cant reach.
-Albert Einstein. Two times NOBEL Prizes honored Great Scientist
, Drain
State-Rank Distributor
RSystem Mentor
1 Migration 1, Cloud
0 Controller
0, LDC
Rank Distributor, Migration Controller and Resource & Workload Manager. The System
Mentor updates the information of currently running system in case of workloads upon
incoming requests and also keeps track of system performance and response to request
of each data item. State-Rank Distributor distributes state-rank to each request as 0 (for
Regular State) & 1 (for Critical State) to follow empirical threshold of empirical
threshold indicator.
Figure 4.1: Inspirational Logic View of ESRWF with their elementary parts
Resource & Workload Manager has two components these are Empirical Resource
Estimator & Threshold Indicator may be say as primary & secondary component also
Page
37
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
respectively. The primary component checks the system state and estimates the request
rate and request weight coefficient. This specifies the system performance & capacity,
availability of resources and maximum loads that can be handled by system in Regular
State. It may be set through previous information of system history that may be
managed through predefined instructions with automatically or may be manually
operated based on average records of previous Regular State which are used as resource
provision decision. And secondary component of Resource & Workload Manager is
based on empirical threshold of system is only and only applied to request has staterank 1 in Critical State, it may be considered as anomalous entity so it redirect to
cloud services otherwise drained for reliable & secure system from high unacceptable
workload.
After tagging state-rank and designation of threshold as 0, 1 in which 1 stateranked request again ranked by Migration Controller for redirecting or draining. If it
overhead the empirical threshold and MWL than it must be processed to drain with
state-rank updated as . So, Migration Controller takes decision according to
prerequisite conditions that which request type or rank type be redirecting to LDC or
Cloud Services or Drained.
Page
38
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Stateless Predecessor Table (SPT) maintains the first request which have no
identical states since pick in CSRT to the system. It is FIFO based primary table
of data item
F , which already
Counting
Stateless
Predecessor
Table
Filtering
R R1 R2
+
Matching
R
state-rank
1 otherwise drained from this approach. It works as followed [5]:
if it has
If the system is in Regular State, the CSRT (Count & State-Rank Table) is always
set as Empty when first request R is arrived.
Page
39
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
If R matches any data item of CSRT (for asking same data) increase the counter
from SPT, because there is no mean of that request to keep continue in SPT.
At starting, if any data item requested at Critical State then it follow same
procedure as when it is entered in Regular State. If data item of request R
doesnt belong to CSRT then add R into SPT FIFO queue for request logs &
returns.
In Critical State, reset all counters to 0 and set state-rank 1 and calculating
the request rate of each data item participated in CSRT. For each data item in
CSRT, the request rate is its counter value divided by total requests arrives since
entering the system in Critical State. Also, calculate estimated request rate
request rate in cloud is that, the user feels request behavior inflicts two types of request
rates: Peak Request Rate (20 videos per 6 seconds) which discriminates with less
request weight coefficient & LWL basis to cloud services, other is Average Request Rate
(20 videos per 60 seconds), the ARR is a long term rate while the PRR is a temporal
rate have MWL be undertaken by LDC.
Page
40
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
41
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
upcoming requests.
Unwanted Time-out conditions.
Resource Availability, Speedup and their proficiency.
Data cache and Replication overhead/ Consistency in Critical State.
Estimation Time, Memory Size, Bandwidth Allocation.
Security and Limitation of authorization levels.
Prediction-Errors and Strong SLAs & ILMs.
Data item Popularity and arrivals of load spikes.
4.4 Notations
We assume that each request belongs one of
denoted by
Pf =
rf
rf
= r f
fF
denote the proportion of request rate or actual request rate to the system
rf
and let
for each
Page
42
^
Pf
of
Pf
for each
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
^
Pf
f F . Then we use
r f . We can view
to estimate
Pf
F . We assume that
as the probability
Pf
is static or
stationary over the time in which the estimation is done. We also assume that the
probability that an arriving request belongs to a given data item is independent of all
other requests. We can sample randomly in order to reduce this dependence. We now
give the accuracy requirement for ESRATE-
^
Pf
such that-
^
Pf Pf , P f + if P f
2
2
^
P f Pf , P f +
if Pf >
2
2
for all
for all
and parameter
and an error of
with
Pf
0 1
, we still want the estimation to have a guaranteed performance but we are willing
to sacrifice the quality of guarantee somewhat. The ESRATE will estimate
Page
43
Pf
with
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
[ ]
1
,1
2
. We use
=99.9
to denote the
then
Z =4.00 .
percentile
Lemma 1: Given the modified accuracy requirement, let N be the number of request
samples required by ESRATE. If the accuracy requirement for large data item can be
relaxed to-
2
1
+1
2
3 +1
( )
( )
Then setting,
Proof: Let
and
1 1
k = ( +1)
2
be the desired estimation accuracy for all data items with request rate
the desired
^
Pf Z
^ 2f
Nk
Page
44
percentile
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
1 1
k = ( +1) ,
2
When
(2 k1)P f 1
with
Pf
. Based
on N, for these data item the minimum request sample size N in order to satisfy the
accuracy required is given by-
N=
3 Z 2
6 Z 2
=
k 2 ( 1 +1) 2
2
f
^
Z
Nk
^ 2f
k2
4 k1
=
Nk
2
k2
4 k1
k , then-
2
1
+1
2
3 +1
( )
( )
Therefore ESRATE scheme will meet the accuracy requirement for any data item
with
Pf >
as long as
2
1
+1
2
3 +1
( )
( )
4.5.1 Analysis
The analysis of ESRATE is significantly more complicated than RATE, CATE and Fast
Top-K. This is because that the different comparison in ESRATE is not independent.
Therefore we need to account for the covariance between different comparisons in order
to accurately compute the variance of estimation of proportions. In this section we
Page
45
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
concentrate on data item and assume that the Stateless Predecessor Table (SPT)
maintains all k-requests to the system. Therefore when there are total N requests to the
system. We would have made
Nk
the first k request arrival since k is small compared to N; we ignore this in the rest of
the analysis.
We assume that requests to system are approached as iid (Independent
and Identically Distributed random variable) [8] where the probability that request
belongs to data item
is given by
Cijs ( f )= 1 if i, j , s f
0, ot h erw ise
Let
M (N , f )
after N requests.
Thereforei1
M ( N , f )=
i N j =ik
Cijs ( f )
Lemma 2: Let
Cijs (f )
E [ Cijs (f ) ]=P f
Page
46
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Proof: this result follows directly from the assumption that request are independent and
is
comparisons are not always independent of each other. Let use the comparison
Cijs (f )
and
Cimr (f )
where
due
to
( i j m) (r s)
independency
of
requests.
But
Cijs (f )
and
Cimr (f )
are
independent if and only if all the indices are distinct. If any two of the indices are
identical, then the comparisons are dependent. For example,
Cijs (f )
and
Cimr (f )
are dependent. The next result gives the correlation between the random variables
Lemma 3: Consider
Cijs (f )
and
Cimr (f )
for
Then-
Proof: Let
Page
47
ik j , m i1
and
rs .
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
probability
i, j , m
and
P4f (1P2f )
for any
two comparisons that are correlated. We can now derive the Mean and Variance for the
f .
Lemma 4: Let
M (N ,f )
M (N ,f )
E [ M ( N , f ) ] =Nk Pf
Page
48
after N
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
2(2 k1) P f
1+ Pf
[
i1
E [ M ( N , f ) ] =E
i N j=ik
C ijs ( f )
E [ M ( N , f ) ] =Nk Pf
To simplify the notation we assume that we index the comparisons using a single index
I m (f )
where
E [ M ( N , f ) ] =Nk P3f
Now,
E [ M (N , f ) ]=E
i=1
[
Nk
[
Nk
i=1
Nk
I ( f )+
2
is
i=1 i=1 ;1 j Nk ; j i
I is ( f ) I js ( f )
{I 2i ( f ) } =Nk P4f
Now,
i=1;1 j Nk ; j i
I is ( f ) I js ( f ) =E
COV [ I is ( f ) I js ( f ) ]
Nk
i=1
COV [ I is ( f ) I ls ( f ) ]
I is ( f ) I js ( f ) +
j ;1 j Nk ; j i
Page
l ;1 l Nk ;l i
49
I is ( f ) I ls ( f ) }
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Notice that
2(2 k 1) Pf
]
1+ P f
independent from each other, therefore the correlations among request samples in
M (N , f )
by factor of
2( 2 k1)P f
. Since we
1+ Pf
know the mean and variance of the number of requests are matched. We now use the
Central Limit Theorem to obtain a normal approximation for the number of request
match than use the result to estimate the proportion. The next theorem gives the
expression for estimator of the proportion along with its variance.
Lemma 5: Let
Nk
Where,
M (N , k )
Pf N [0, 2f ]
Nk
(1P2f )
2f =
1+
2 (2 k 1 ) P f
1+ P f
Page
50
after
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Proof: Though the comparisons are not independent, the comparisons are a stationary
k2
dependent sequence with finite exception and variance. The following the central
limit theorem for dependent sequence [1]. We can show that for large N-
Nk
Where,
M (N , k )
P3f N [0, 2f ]
Nk
2f =P4f ( 1P 2f ) 1+
2 ( 2 k 1 ) P f
1+ P f
^
Pf
}
of
Pf
is-
M (N ,k)
^
Pf =
Nk
(1 ^P2f )
^ 2f =
1+
^f
2 (2 k 1 ) P
^f
1+ P
Pf
We know this expression for variance of the estimator and derive upper bounds on its
value. This bound is derived in two regions. The first upper bound on the variance hold
in the entire
[0,1]
threshold.
Page
51
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Lemma 6: Let
2f
(1 ^P2f )
2f =
1+
^f
2 (2 k 1 ) P
^f
1+ P
then-
k
4 k1
2f 0.33if P f <
1
2k 1
Pf <
2f
1
2 k1
Pf
32 P f P2f
9
1
3
when
Pf =0
the variance can now be used to compute the sample size and estimation accuracy of
ESRATE. Note the setting
2
f
^ =
2
f
^ =
(1+2 Pf 3 P2f )
9
(1+2 Pf 3 P2f )
3
1
3
Page
52
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
(2 k1)P f 1 , let
desired
with
the
3Z
N= 2
k
ESRATE
CATE
=N
Fast Topk
3 Z
k
1
RATE
N
0.46 k
Page
53
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
ARR
where
ARR
R(t)
in the requests is particular requests counter value divided by total requests arrives
since entering the system in Critical State. Let
W ( r )=
W (r ) is-
{()
r 0,
r0
, >
Where,
r0
M (N , f )
t ,
, Previous Request Rate at time
Nk
We require that,
means
M (N ,f )
is binomial function.
With help of using request weight coefficient, we have to balancing load on basis
of Least Workload Left and Maximal Workload Left with RR, WFQ or APFQ [26] like
scheduling algorithm to transmit request to their particular state processing with
following State-Rank.
Page
54
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
4.5.6 Speedup
Lemma 7: Given the accuracy requirement described above in Section-V and N be the
number of request sample in CSRT is required for ESRATE-
3 Z2
N CSRT , Matching = 2
k
(2)
Rafter
Rbefore
(3)
number
N SPT , Filtering
well as
of
request
samples
required
for
N CSRT , Matching
ESRATE-CSRT(Matching)
be
and
N DRT , Draining
(Draining).
N SPT , Filtering =
N SPT , Filtering =
As well
as
N Draining
Draining.Therefore we have
N CSRT , Matching
2
(4)
(5)
required for
Page
55
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
information filtering.
Now we focus on the worst case expected memory requirement for ESRATE [5]. The
memory requirement for the estimation scheme is proportional to the size of this subset
of data items for which request rate and request weight coefficient are maintained. So,
we calculate the worst case expected memory requirement due to dependencies of
for an allocation of
Pf .
Z 2
(6)
Z 2 1 2
at Critical State , E [ L ( N ) ] 1.174
+ [ Z k ]
2 3
3
E[ L ( N )] 1.174
Proof: where,
[ ]
Z 2
2
3
1 2
[ Z k]
3
(7)
1 2
[ Z k ] . Follow the results of Lemma-7 from ESRATE [5]. From
3
1
P i= i
n
Page
56
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
n 1exp
( Nk
n ))
3
Assuming that
n . We get-
1exp
( )(
Nk
3
n
If we set
3 Nk
+1 =0
3
n
Nk
=
n3
1e (3 +1 )=0
Solving for
n=
we get
=1.903 . Therefore,
Nk
3
=0.81 Nk
1.903
(
E[ L( N )] 0.81 Nk [ 1e
3
Nk
3
3
(0.81 Nk )
)]
Page
57
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
E[ L( N )] 0.687 Nk
Corollary-1 at Local Web Server or Regular State: given the width of the confidence
interval
E[ L ( N )]=0.687
3 Z 2
k 2
2
Z 23
3 Z
3
E[ L ( N )]=1.174
=1.174 Where , = 2
( )
This expression is particularly for local web server. But after performing analytical
simulation & trace memory usage we found that the memory size at proxy server has
Error,
1 2
[ Z k ]
3
named as Memory-Prediction-
predict about memory usage at proxy server as well as perform estimation for actual
memory used.
Corollary-II at Proxy Server or Critical State: given the width of the confidence interval
E [ L ( N ) ]=0.687
3 Z 2
k
k+
1 2
[Z k ]
3
2
Z 23 1 2
3 Z
3
1 2
E [ L ( N ) ]=1.174
+ [ Z k ] =1.174 + [ Z k ] Where , = 2
3
3
( )
Page
58
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Summary: Let
L(T )
comparison up to
f =1
f =1
And
E [ L ( N ) ] 0.638 Nk
Here
1 2
[Z k ]
3
1.11 Z 1 2
[ Z k ]
is Memory-Prediction-Error, factor of
1
3
comparison. So
Page
59
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Chapter-5
Implementation
Dont leave true & hardness during your work because your work is to discover your
world and then with all your heart give yourself to it.
-God Buddha, a Miracle Aviator & Founder of Buddhism, India
Through the performance evaluation, we target to answer following three questions
arise from some technical misconception of Workload Factoring and traffic estimation
over network through incoming requests for web services. We would like to solve such
difficulties
Page
60
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
parts: a local data center platform, a cloud service platform and a server with ESRWF
simulator (which is also part of LDC but for understanding we show server & LDC
differently) set up at large cloud service provider such as Amazon AWS EC2 and S3
services. In the local data center, around 15 open source RTP/RTSP streaming servers
such as QuickTime, Helix Universal & DNA, Wowza Media, Darwin, pvServer, Feng and
VideoLAN are provisioned all the time, while the streaming server instances are
activated on demand. The ESRWF component was implemented as a load controller for
the stream workload. When request for a video clip comes into the Tri-Way Trajectory
Simulation as a HTTP request, the Apache web server parses the request and asks
ESRWF for which stream server (either a LDC server or a cloud server) the video clip
will be served; it then returns with a dynamic HTML page which automatically starts
the media player for video streaming at the user machine.
Figure 5.1: Proposed Integrated Cloud Computing Model and Tri-Way Trajectory Simulation overview
The load controller also contains the implementation of two well-known load
balancing algorithms: the Least Connections balancing algorithm for the local data
center and the Round-Robin balancing algorithm for the cloud service provider. We
developed a distributed workload generator based on RTSP (Real Time Streaming
Protocol) to generate real video streaming load.
Page
61
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 5.2: Video stream workload evolution on Yahoo! Video Site for ESRWF (January-March, 2012)
Now for active tracery, we used the Yahoo! Video (India) [9], is 3 rd ranked online video
website just after YouTube and MetaCafe in terms of total number of video views,
uploading & downloading during January 2011, delivered totally 30.2 millions of video
streams to 17.56 million of unique Indian viewers [10]. It is 72% of the online
Page
62
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
population of India who take services of video streaming. We trace the Yahoo! Video site
for 2 months (from January 11 to March 12, 2012), and the data was collected in every
30 minutes to 1 hour. Due to large scale of Yahoo! Video site, we limited the data
collection to the first 10 pages of each category. Since each page contains 10 video
objects, each time the measurement collects dynamic workload information for 1230
video files in total. Throughout the whole collection period, we recorded 2,843 unique
videos which durations range from 2 to 6350 seconds and a total of 1,755,186 video
views. This can be translated into a daily video request rate of 29253. There is nearly
dissimilarity in statistics to calculate mean duration between sites.
TABLE-I
Customer viewed video stream quality
Applied Schemes
Random
2420
Choke
2000
RATE
560
CATE
91
Fast Top-K
36
ESRATE
23
Page
63
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 5.3: Customer viewed Video stream quality at both system states
()
=95
State.
TABLE-II
Samrat Ashok Technological Institute, Vidisha
Page
64
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Concurrent
Request Stream
Critical State Server
Drain Resolver
12
12
12
16
16
16
20
20
20
24
24
24
28
28
28
32
32
32
36
36
36
10
40
40
40
11
44
44
44
12
48
48
48
13
52
52
52
14
56
56
56
15
60
60
60
16
64
64
64
17
68
68
68
18
72
72
72
19
76
76
76
20
80
80
80
Connections
Page
65
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
21
84
84
84
22
88
87
87
23
92
86
87
24
96
85
87
25
90
84
87
26
91
83
87
27
92
82
87
28
93
81
87
29
94
80
87
30
95
87
87
31
96
86
87
32
90
85
87
33
91
84
87
34
92
83
87
35
93
82
87
36
94
81
87
37
95
80
87
38
96
87
87
39
90
86
87
40
92
85
87
41
94
84
87
42
96
83
87
43
98
82
87
44
100
81
96
45
102
80
98
Page
66
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
46
90
87
87
47
93
85
87
48
96
83
87
49
99
81
87
50
97
79
87
51
95
77
87
52
93
84
87
53
90
83
87
54
94
82
87
55
98
81
87
56
94
80
87
57
98
87
87
58
102
86
93
59
98
85
87
60
90
84
87
61
91
83
87
62
92
82
87
63
94
81
87
64
95
86
87
65
96
84
87
66
97
82
87
67
90
80
87
68
92
87
87
69
94
85
87
70
96
83
87
Page
67
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
71
98
81
87
72
100
79
95
73
102
77
95
74
90
75
87
75
92
73
87
76
94
71
87
77
96
71
87
78
98
84
87
79
100
83
95
80
92
82
87
81
90
81
87
82
92
80
87
83
94
79
87
84
96
78
87
85
98
85
87
86
90
75
87
87
95
74
87
88
96
80
87
89
97
80
87
90
98
70
87
91
99
70
87
92
90
70
87
93
101
85
90
94
102
83
92
95
92
81
87
Page
68
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
96
93
79
87
97
94
77
87
98
90
77
87
99
96
75
87
100
97
75
87
101
90
85
87
102
92
75
87
103
94
65
87
104
90
55
87
105
98
55
87
106
100
57
92
107
92
58
87
108
94
60
87
109
96
70
87
110
89
80
87
111
100
80
95
112
102
75
95
113
91
65
87
114
93
60
87
115
95
55
87
116
90
50
87
117
101
50
92
118
101
52
92
119
95
54
87
120
96
75
87
Page
69
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
121
97
80
87
122
97
80
87
123
99
45
87
124
100
35
95
125
91
25
87
126
91
25
87
127
95
21
87
128
90
21
87
129
101
75
92
130
101
75
95
131
102
50
98
132
97
15
87
133
98
15
87
134
87
15
87
135
100
20
92
136
101
25
95
137
102
30
98
138
90
40
87
139
92
55
87
140
96
65
87
141
96
75
87
142
98
75
87
143
100
78
95
144
102
78
98
145
92
60
87
Page
70
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
146
92
50
87
147
94
40
87
148
96
30
87
149
98
20
87
150
100
10
89
151
102
91
152
92
87
153
92
87
154
94
87
155
96
57
87
156
101
61
95
157
102
65
98
158
91
69
87
159
91
72
87
160
102
72
89
161
102
60
91
162
104
45
93
163
104
30
95
164
89
15
87
165
93
87
166
99
87
167
102
97
168
105
20
98
169
108
25
99
170
92
30
87
Page
71
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
171
94
66
87
172
98
68
87
173
102
70
99
Figure 5.4: Customer viewed concurrent request stream quality at both system states
complicated and have desired high accuracy with sufficient ample stock of memory at
Critical State. So, such dynamic tenancy of memory is effective runtime example of
creation, storing & processing of memory block according to provisioning of incoming
request. As Figure 5.7, we also note that ESRATE use the typical amount of memory by
the time they capture all medium-sized requests, which signifies that they need less
memory size for estimation accuracy at both states. As a prior think is that to see
Figure 5.10, this technique leads only best resource planning & management appeal
Samrat Ashok Technological Institute, Vidisha
Page
72
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
with comparison of IWF (Intelligent Workload Factoring) [1], which perform better in
each case and may improve the quality of the IWF.
TABLE-III
Memory cost for ESRWF
Number of Requests in memory at
Total Number of Request Arrived
Critical State
Regular State
0.00E+00
1.00E+00
1.00E+00
1.00E+01
1.00E+02
10
10
1.00E+03
15
20
1.50E+04
20
30
2.00E+05
30
40
3.50E+05
40
50
4.00E+05
50
60
4.50E+05
60
70
5.00E+05
70
80
5.50E+05
80
90
6.00E+05
90
100
6.49E+05
100
200
6.78E+05
200
300
6.98E+05
300
400
7.17E+05
400
410
Page
73
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
7.73E+05
500
420
7.91E+05
600
430
8.50E+05
700
440
9.50E+05
800
450
1.00E+06
850
460
1.25E+06
900
470
1.65E+06
920
480
1.88E+06
930
490
2.00E+06
940
500
2.16E+06
950
510
2.56E+06
960
520
2.91E+06
970
530
3.13E+06
980
540
4.22E+06
990
550
5.13E+06
1000
560
6.31E+06
1010
570
7.45E+06
1020
580
8.65E+06
1030
590
9.78E+06
1040
600
1.00E+07
1050
610
1.11E+07
1060
620
1.24E+07
1070
630
1.30E+07
1080
640
1.40E+07
1090
650
1.55E+07
1100
660
Page
74
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
1.72E+07
1110
670
1.90E+07
1120
680
Page
75
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 5.5: Workload factoring performance: Memory Cost in Critical State for ESRWF
Figure 5.6: Workload factoring performance: Memory Cost in Regular State for ESRWF
Figure 5.7: Workload factoring performance: Memory Cost at both State (Combined) for ESRWF
Page
76
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Number
of
Bandwidt
h
Allocated
(kbps)
250.00
Total
(%)
(%)
No. of
Reques
General
ESRWF
General
ESRWF
Arrived
Schemes
Schemes
Schemes
Schemes
0.81
0.52
0.63
0.54
0.52
Page
77
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
260.00
0.87
0.54
0.72
0.56
0.54
270.00
0.88
0.54
0.70
0.59
0.56
280.00
0.90
0.57
0.73
0.61
0.58
290.00
0.96
0.56
0.79
0.63
0.59
300.00
0.95
0.60
0.78
0.65
0.61
310.00
0.97
0.61
0.81
0.67
0.64
320.00
0.93
0.60
0.78
0.70
0.67
330.00
0.91
0.62
0.85
0.73
0.68
340.00
0.95
0.66
0.85
0.72
0.71
350.00
0.96
0.65
0.91
0.75
0.73
360.00
0.97
0.68
0.85
0.79
0.75
370.00
0.98
0.69
0.88
0.80
0.79
380.00
0.96
0.72
0.93
0.84
0.81
390.00
0.98
0.73
0.92
0.86
0.82
400.00
0.98
0.71
0.93
0.88
0.85
410.00
0.96
0.75
0.93
0.89
0.84
420.00
0.99
0.78
0.95
0.90
0.87
430.00
1.00
0.80
0.96
0.90
0.87
440.00
0.99
0.81
0.92
0.91
0.90
450.00
1.00
0.86
0.97
0.93
0.90
460.00
1.00
0.84
0.95
0.93
0.91
470.00
0.99
0.83
0.97
0.93
0.90
480.00
0.99
0.86
0.97
0.95
0.92
490.00
0.98
0.93
0.99
0.97
0.92
500.00
1.00
0.89
0.99
0.96
0.93
Page
78
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
510.00
1.00
0.84
1.00
0.96
0.94
520.00
0.99
0.91
0.99
0.97
0.94
530.00
1.00
0.91
1.00
0.96
0.95
540.00
0.99
0.92
1.00
0.98
0.95
550.00
1.00
0.90
1.00
0.97
0.97
560.00
1.00
0.92
1.00
0.98
0.96
570.00
1.00
0.95
1.00
0.99
0.97
580.00
1.00
0.93
1.00
0.98
0.96
590.00
1.00
0.98
1.00
0.99
0.98
600.00
1.00
0.96
0.98
0.99
0.97
610.00
1.00
0.95
1.00
0.99
0.98
620.00
0.99
0.97
1.00
0.99
0.99
630.00
1.00
0.96
1.00
0.99
0.98
640.00
1.00
0.96
1.00
0.99
0.99
Figure 5.8: Workload factoring performance: Allocated Bandwidth (Regular Requests) for ESRWF
Page
79
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 5.9: Workload factoring performance: Allocated Bandwidth (Oppressive Requests) for ESRWF
Workload
Strategy
IWF Scheme
ESRWF Scheme
IWF Scheme
ESRWF Scheme
1.00
1.00
1.00
1.00
1.00
1.00
1.00
1.00
1.00
1.00
1.00
1.00
Page
80
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
1.00
1.00
1.00
0.99
1.00
1.00
1.00
1.00
1.00
1.00
1.00
0.99
1.00
1.00
1.00
0.99
1.00
1.00
1.00
0.98
1.00
1.00
1.00
1.00
10
1.00
1.00
1.00
0.99
11
1.00
1.00
1.00
0.98
12
0.99
1.00
0.99
0.99
13
0.99
1.00
1.00
0.97
14
0.97
1.00
0.99
0.95
15
0.96
1.00
0.98
0.94
16
0.94
1.00
0.98
0.92
17
0.91
1.00
0.96
0.90
18
0.89
1.00
0.97
0.87
19
0.87
1.00
0.95
0.82
20
0.85
1.00
0.93
0.78
21
0.81
1.00
0.93
0.77
22
0.79
1.00
0.90
0.72
23
0.78
1.00
0.89
0.71
24
0.76
1.00
0.88
0.67
25
0.74
1.00
0.86
0.65
26
0.72
1.00
0.84
0.63
27
0.71
1.00
0.83
0.61
28
0.69
1.00
0.82
0.60
Page
81
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
29
0.67
0.99
0.80
0.58
30
0.66
1.00
0.79
0.57
31
0.64
0.99
0.77
0.55
32
0.63
1.00
0.76
0.53
33
0.62
0.98
0.75
0.53
34
0.61
0.96
0.74
0.52
35
0.60
0.95
0.73
0.51
36
0.59
0.92
0.72
0.50
37
0.57
0.89
0.70
0.50
38
0.56
0.88
0.70
0.50
39
0.56
0.86
0.69
0.49
40
0.54
0.85
0.68
0.48
41
0.53
0.84
0.67
0.48
42
0.53
0.82
0.66
0.47
43
0.51
0.81
0.65
0.47
44
0.50
0.80
0.65
0.45
45
0.50
0.79
0.64
0.45
46
0.49
0.77
0.63
0.45
47
0.48
0.74
0.62
0.45
48
0.47
0.74
0.62
0.44
49
0.47
0.72
0.61
0.44
50
0.46
0.72
0.60
0.43
Page
82
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 5.11: Workload Handling Strategy managed by IWF & ESRWF (Adopting of Requests)
Page
83
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Figure 5.12: Formulative Descriptions for Workload Factoring Scheme through ESRATE
Page
84
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Equipment Required
Annual Costs
Requests Concurrency
Resource Proficiency
=95
=1.94
Figure 5.13: Fair Comparison between IWF & ESRWF (for RAM, CPU Speed, Speed up, Memory Used)
Page
85
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Chapter- 6
Conclusion & Future Works
In this life, we cannot do great things. We can only do small things with great inspirable
technologies or inventions with motivation or love.
-Arstole, Great Greek Philosopher, Greece
In this paper, we present the design of an Extreme State-Rank based
Integrated Cloud Computing Model. For the future work, extending the Integrated Cloud
Computing Model to stateful & provision based applications such as n-tier web services
is a natural and challenging step. Many new problems arise such as session
maintenance, service time estimation, and data consistency due to data dispatching in
different states to process. We are working on a fast data on demand service and
integrating the dynamic web service scaling approach in our system; there are many
concepts missed for discussion such as load balancing schemes in states, data
replication & consistency management in the Critical State,0 security management for a
Integrated cloud platform, and more. In this paper we have also developed an Extreme
State-Rank bAsed Traffic Estimation scheme called ESRATE that uses Matching &
Counting between different arriving requests to estimate the request rate. We have
shown through both theoretical analyses of Observation Tracery and Tri-Way Trajectory
Simulations that ESRATE is fast and memory-efficient. It estimates small data items
very quickly and accurately, and still gives good estimation accuracy for large data
items. Dependence within request arrivals may affect the estimation accuracy. Although
the buffer-based approach can alleviate the problem, a better approach that can further
minimize the impact of dependence without additional over-head may be more
preferable. We attempt to address this issue as part of future work also.
Page
86
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
Page
87
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
References
[1]
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
ComScore Video Metrix report: India Viewers Watched an Average of 3 Hours of Online
Video in July, Available:
http://www.comscore.com/Press_Events/Press_Release/2011/3/7_of_10_Indian_Web_U
sers_Watch_Online_Video_in_a_Month/.
[11]
Youtube, http://www.youtube.com/.
[12]
[13]
[14]
[15]
Page
88
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
http://developer.apple.com/darwin/projects/streaming/.
[16]
Openrtsp, Available:
http://www.live555.com/openRTSP/.
[17]
Wikipedia- CRM,http://www.wikipedia.com/.
[18]
[19]
A. Kumar, M. Sung, J. xu, and J. Wang, Data streaming algorithms for efficient and
accurate estimation of flow distribution, in Proc. Of ACM SIGMETRICS, June 2004, to
appear.
[20]
[21]
[22]
Dr. Kumar Saurabh, Cloud Computing: Insights into New Era Infrastructure. WILEYINDIA, First Edition-2011.
[23]
[24]
Amazon, http://aws.amazon.com/cloudfront/.
[25]
[26]
[28]
[29]
Page
89
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
[30]
Farber D., Oracles Ellison Nails Cloud Computing, in CNET Outside the Lines,
Available:
http://news.cnet.com/8301-13953_3-10052188-80.html, retrieved 14th May 2009
[31]
Boss G., Malladi P., Quan D., Legregni L., Hall H., IBM on Cloud Computing; High
Performance On-Demand Solutions, IBM, 8th Oct 2007
[32]
Armbrust M., Fox A. et al, Above the Clouds: A Berkeley View of Cloud Computing,
Available:
http://radlab.cs.berkeley.edu/; Feb 10, 2009
[33]
Twenty-One Experts Define Cloud Computing, Cloud Computing Journal, July 2008;
http://cloudcomputing.syscon.com/node/612375/print
[34]
Buyya R., Yeo C.S., Venugopal S., Market-Oriented Cloud Computing: Vision, Hype, and
Reality for Delivering IT Services as Computing Utilities, Keynote Paper, Proceedings of
the 10th IEEE International Conference on High Performance Computing and
Communications, Sept. 25-27, 2008, Dalian, China
[35]
Geelan J., Cloud Storage: How Can Enterprises Build Secure Private Clouds, Available:
http://cloudcomputing.sys-con.com/node/830646; Cloud Computing Journal; Feb 29,
2009
[36]
Duffield N., Lund C., and Thorup M., Charging from Sampled Network Usage,
SIGCOMM internet Workshop 2001.
[37]
Duffield N, and Grossglauser M., Trajectory Sampling for Direct Traffic Observation,
Proceedings of ACM SIGCOMM 2000.
[38]
Hao F., Kodialam M., and Lakshman T. V., "ACCEL-RATE: a faster mechanism for
memory efficient per-flow traffic estimation", proceedings of ACM SIGMETRICS 2004.
[39]
Fang W., and Peterson L., Inter-as Traffic Patterns and their Implications, Proceedings of
IEEE GLOBECOM 1999.
[40]
[41]
[42]
Aldous D., Probability Approximations via the Poisson Clumping Heuristic, SpringerVerlag, 1987.
Page
90
ESRWF: Extreme State-Rank based Workload Factoring for Integrated Cloud Computing Model
[43]
Estan C. and Varghese, G., "New Directions in Traffic Measurement and Accounting",
Proceedings of ACM SIGCOMM 2002.
[44]
Ferguson T. S., "A Course in Large Sample Theory", Chapman and Hall, 1996.
[45] Estan C., Savage, S., and Varghese, G., Automatically Inferring Patterns of Resource
Consumption in Network Traffic", Proceedings of ACM SIGCOMM 2003.
Page
91