Cloud Computing

Cloud Computing
What is it?
“Cloud computing is a style of computing in which
dynamically scalable and often virtualized resources
are provided as a service over the Internet” - Wikipedia
01 Silvio Revelli
01- 06 - 2009
Company Name Cloud Computing vs Traditional ICT
Cloud Computing
What is it?
a software system designed to support interoperable machine-to-machine interaction over a network.

Your machine asks, (you pay) you get.
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
What is it?
Computational Power (A virtual Machine), Memory (A virtual Storage), DB (A virtual Database)

but also:
Buffer, MapReduce, Content Distribution Obtimizers....
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
Why Cloud Computing?
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
Why Cloud Computing?
Money!
no large investments - no opportunity costs - no customers lost
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
Cloud computing is a business solution!
It’s a device that allows costs-curve to follow the needs-curve.
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
TWITTER
ANIMOTO Social Network
Startup
Uses the Cloud for 1 Billion $ market cap
creating videos from images and sounds. Uses the Cloud for
static content storage
ELi LILLY NY TIMES

Pharmaceutical company Journal
34.5 Billion $ market cap
Used the Cloud for
Used the Cloud for converting 4TB of TIFFs into PDFs
clustering and research.
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
TWITTER
ANIMOTO Social Network
Startup
Uses the Cloud for 1 Billion $ market cap
creating videos from images and sounds. Uses the Cloud for
static content storage
ELi LILLY NY TIMES

Pharmaceutical company Journal
34.5 Billion $ market cap
Used the Cloud for
Used the Cloud for converting 4TB of TIFFs into PDFs
clustering and research.
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
AUGUST 2006 - FOUNDED

They had an Idea and a source code (including the conversion algorithm)
SUNDAY, 13 -APRIL 2008

They had 25,000 registered users, but not very active in video making.
They decide to let Facebook users make a free video with their own photos.
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
MONDAY
They had an 25.000 users.
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
TUESDAY
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
THURSDAY
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
It’s quite clear that in order to support such a rapid growth,

they didn’t buy physical server machines.
They used (and still using) the computational power provided

by Amazon EC2.
The CLOUD gives Animoto all the computational power on demand,

switching on new server instances when required
swithing off server instances when unused.
01 Silvio Revelli
01- 06 - 2009
MAIL: silviorevelli@gmail.com
WEBSITE: www.silviorevelli.com
Cloud Computing vs Traditional ICT
Cloud Computing
A case study:
Thursday (17-04-2008)
3500 server instances
Monday (14-04-2008)
35 server instances
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
If you think it phisically it means that you can turn this:
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
into this
(x1000)
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
A case study:
into this
(x1000)
in just 3 days!!!
01 Silvio Revelli
01- 06 - 2009
Cloud Computing
By the way: in June 2009 Animoto was already cash-flow positive,
received funding for $4.4M, had 13 employees, and more than 8 millions videos converted.
Amazon Web Services:

In the following slides we’re going to brief these Amazon WS:
EC2 (CloudWatch & MapReduce)

S3
But we won’t discuss SimpleDB as it is a new school datastore paradigms

(like Google BigTable) specifically designed for scalability, among other things.
01 Silvio Revelli
01- 06 - 2009
Amazon EC2
You (or your automated application) can launch instances within seconds
using REST or SOAP messages.
An instance can be small, medium or large. A small instance has:

1.7 GB of memory,
1.0-1.2 GHz 2007 Xeon processor (Single Core)
160 GB of instance storage
32-bit platform
$0.10/hour
01 Silvio Revelli
01- 06 - 2009
Amazon EC2
You (your application) have the full root control on the machine:
this means that you can customize everything, also the OS.
However, when you launch an EC2 instance, you don’t want

to have a “virgin” machine whithout OS, or without installed applications.
So you can launch an AMI (Amazon Machine Image).
An AMI is somewhat like a “photo of a machine”. Amazon gives you

a public archive of AMIs with pre-installed OS (commonly Linux),
pre-installed useful applications (such as Apache)
and full access control (commonly using SSH).
01 Silvio Revelli
01- 06 - 2009
Amazon EC2
You can also create your AMI: after customizing your machine
you can boundle it into an AMI (it’s like taking a photo).
Then you must store it into your S3 bucket.
Depending on ACL, only you or everyone can use that AMI.
When you launch an instance from an AMI you should set

your firewall configuration (eg: 80 HTTP, 22 SSH, 443 HTTPS, 3306 MySQL )
01 Silvio Revelli
01- 06 - 2009
Amazon EC2 - CloudWatch
When your application is up and running on your EC2 instance,
you can monitor its status (CPU, Memory, Delays, I/O)
with the recently introduced CloudWatch.
CloudWatch includes 2 sub-features:

Elastic Load Balancer (ELB)
Autoscale
01 Silvio Revelli
01- 06 - 2009
Using Elastic Load Balancing, you can distribute incoming
traffic across your Amazon EC2 instances.
Elastic Load Balancing automatically scales its request processing

capacity in response to incoming application traffic.
Elastic Load Balancing can detect the health of Amazon EC2 instances.
When it detects unhealthy load-balanced Amazon EC2 instances,

it no longer routes traffic to those Amazon EC2 instances instead
spreading the load across the remaining healthy Amazon EC2 instances.
01 Silvio Revelli
01- 06 - 2009
Auto Scaling enables you to set conditions (triggers on avarage
fleet CPU, Memory, Delays, I/O) for when you want to scale up or down
your Amazon EC2 usage.
When one of the conditions is met, Auto Scaling automatically applies

the action you’ve defined.
Auto Scaling enables your application to scale up Amazon EC2 instances

seamlessly and automatically when demand spikes.
Auto Scaling allows you to automatically shed unneeded Amazon

EC2 instances and save money when demand subsides.
01 Silvio Revelli
01- 06 - 2009
Amazon EC2 - MapReduce
Using Amazon Elastic MapReduce, you can instantly provision
as much or as little capacity as you like to perform data-intensive
tasks for applications such as web indexing, data mining,
log file analysis, machine learning, financial analysis,
scientific simulation, and bioinformatics research.
Example: starting from a corpus we want to have the vector model.
01 Silvio Revelli
01- 06 - 2009
Let’s start from the final result.
The Output should be something like this: ((word,docname),TF*IDF)
01 Silvio Revelli
01- 06 - 2009
In order to calculate this: ((word,docname),TF*IDF)
we need to arrive to: ((word,docname),(tf,nt,df )) and N
where:
tf = term frequency in the document
nt = total number of terms in document
df = number of documents that contains term
assuming that:
TF = tf/nt
IDF = log(N/df )
01 Silvio Revelli
01- 06 - 2009
An so we cod a MapReduce function like this:
TERM FREQUENCY
Mapper
Input: (docname,contents)
Output: ((word,docname),1)
Reducer:
Sums the word in the document
Outputs: ((word,document),tf )
01 Silvio Revelli
01- 06 - 2009
WORD COUNTS
Mapper
Input: ((word,document),tf )
Output: (docname,(word,tf ))
Reducer:
Sums the frequency of individual n’s in the document
feeds original data
Outputs: ((word,document),(tf,nt))
01 Silvio Revelli
01- 06 - 2009
WORD FREQUENCY IN CORPUS
Mapper
Input: ((word,document),(tf,nt))
Output: (word,(docname,tf,nt,1))
Reducer:
Sums counts for word in corpus
Outputs: ((word,document),(tf,nt,df ))
That was what we need. With only a mapping activity we arrive at the
vector space table: ((word,document),TF*IDF)
01 Silvio Revelli
01- 06 - 2009
With Amazon MapReduce you can perform the map-reducing task
with a potentially unlimited computational power.
This is a screeshot of the implementation of tf on AWS (wordSplitter.py):
01 Silvio Revelli
01- 06 - 2009
The higher the number of map-reduce instances the shorter the time
to perform the entire job-flow.
01 Silvio Revelli
01- 06 - 2009
Amazon EC2 - S3
Amazon S3:
Write, read, and delete objects containing from
1 byte to 5 gigabytes of data each.
The number of objects you can store is unlimited.
Each object is stored in a bucket and retrieved via a unique,

developer-assigned key.
Objects can be made private or public,

and rights can be granted to specific users.
Uses standards-based REST and SOAP interfaces

designed to work with any Internet-development toolkit.
01 Silvio Revelli
01- 06 - 2009
Bye!
Send me comments!
silviorevelli@gmail.com
http://silviorevelli.com
“Stay hungry stay foolish” - Steve Jobs
01 Silvio Revelli
01- 06 - 2009

Cloud Computing

Diunggah oleh

Informasi Dokumen

Deskripsi Asli:

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Cloud Computing

Diunggah oleh

Hak Cipta:

Format Tersedia

Cloud Computing

a software system designed to support interoperable machine-to-machine interaction over a network.

Computational Power (A virtual Machine), Memory (A virtual Storage), DB (A virtual Database)

ELi LILLY NY TIMES

ELi LILLY NY TIMES

AUGUST 2006 - FOUNDED

SUNDAY, 13 -APRIL 2008

It’s quite clear that in order to support such a rapid growth,

They used (and still using) the computational power provided

The CLOUD gives Animoto all the computational power on demand,

Amazon Web Services:

EC2 (CloudWatch & MapReduce)

But we won’t discuss SimpleDB as it is a new school datastore paradigms

An instance can be small, medium or large. A small instance has:

However, when you launch an EC2 instance, you don’t want

An AMI is somewhat like a “photo of a machine”. Amazon gives you

Depending on ACL, only you or everyone can use that AMI.

When you launch an instance from an AMI you should set

CloudWatch includes 2 sub-features:

Elastic Load Balancing automatically scales its request processing

When it detects unhealthy load-balanced Amazon EC2 instances,

When one of the conditions is met, Auto Scaling automatically applies

Auto Scaling enables your application to scale up Amazon EC2 instances

Auto Scaling allows you to automatically shed unneeded Amazon

Example: starting from a corpus we want to have the vector model.

we need to arrive to: ((word,docname),(tf,nt,df )) and N

WORD FREQUENCY IN CORPUS

The number of objects you can store is unlimited.

Each object is stored in a bucket and retrieved via a unique,

Objects can be made private or public,

Uses standards-based REST and SOAP interfaces

“Stay hungry stay foolish” - Steve Jobs

Anda mungkin juga menyukai