Cluster
DanThanhTon
UniversityofColoradoDenver
2010SIParCSInternship
Mentor:IrfanElahi
Overview
InstalledtwooperaDngsystemsonone
computer
Installedtwovirtualmachinesoneach
operaDngsystem
WroteandusedbenchmarkrouDnestotest
theperformanceofCPU,memory,harddrive
Builtacloudclusterfrombaremetalonthe
Thundersupercomputerandinstalledvirtual
machinesonit
VirtualMachine
Avirtualmachine(VM)
isasoOware
implementaDonofa
machinethatexecutesa
programlikeaphysical
machine.
OracleVMVirtualBox
Itinstallsmanydierent
operaDngsystemsonan
exisDngoperaDngsystem
suchas:
WindowsandLinuxon
Mac
WindowsServer2008on
Linuxserver
LinuxonWindowsPC
WhyisvirtualizaDonuseful?
OperaDngsystemsupport
TesDnganddisasterrecovery
InfrastructureconsolidaDon
EasiersoOwareinstallaDon
Benchmarks
BenchmarkrouDnesareusedtomeasurea
certainaspectofperformance
oCPUperformance
oMemoryperformance
oHarddriveperformance
oNetworkperformance
CPUBenchmark
TestCPUperformance
ThesametestwasusedtobenchmarkCPU
performanceonbothsystems
CPUPerformance
WindowsServer2008hypervisor
80
80
70
70
Performance(Seconds)
Performance(Seconds)
Ubuntu/Linuxhypervisor
60
50
40
30
20
60
50
40
30
20
10
10
Sizeofdata(Mb)
UbuntuVM
WindowsServer2008VM
Sizeofdata(Mb)
UbuntuVM
WindowsServer2008VM
HardDriveBenchmark
Testharddriveperformance
Thesametestwasusedtobenchmarkhard
driveperformanceonbothsystems
HardDrivePerformance
WindowsServer2008hypervisor
140
140
120
120
Performance(Seconds)
Performance(Seconds)
Ubuntu/Linuxhypervisor
100
80
60
40
20
0
100
80
60
40
20
0
Sizeofle(Mb)
UbuntuVM
WindowsServer2008VM
Sizeofle(Mb)
UbuntuVM
WindowsServer2008VM
MemoryBenchmark
Testmemoryperformance
Thesametestwasusedtobenchmark
memoryperformanceonbothsystems
Size(Mb)
UbuntuVM
WindowsServer2008VM
Size(Mb)
UbuntuVM
WindowsServer2008VM
6.41
6.1
5.8
5.49
5.19
4.88
0
4.58
0
4.27
10
3.97
10
3.66
20
3.36
30
3.05
40
2.75
50
2.44
50
2.14
60
1.83
60
Performance(Seconds)
Ubuntu/LinuxOShypervisor
1.53
6.41
6.1
5.8
5.49
5.19
4.88
4.58
4.27
3.97
3.66
3.36
3.05
2.75
2.44
2.14
1.83
1.53
Performance(Seconds)
MemoryPerformance
WindowsServer2008hypervisor
40
30
20
PystoneBenchmark
TestCPUandmemoryperformance
ThesametestwasusedtobenchmarkCPU
andmemoryperformanceonbothsystems
20000
20000
10000
10000
0
0
Numberofloops
UbuntuVM
WindowsServer2008VM
Numberofloops
UbuntuVM
WindowsServer2008VM
3300000
3100000
2900000
2700000
2500000
2300000
2100000
1900000
30000
1700000
40000
1500000
50000
1300000
60000
1100000
60000
900000
70000
700000
70000
500000
80000
300000
80000
pystones/second
90000
100000
Ubuntu/Linuxhypervisor
90000
50000
3300000
3100000
2900000
2700000
2500000
2300000
2100000
1900000
1700000
1500000
1300000
1100000
900000
700000
500000
300000
100000
50000
pystones/second
PystoneBenchmark
WindowsServer2008hypervisor
50000
40000
30000
RichardBenchmark
TestCPUandmemoryperformance
ThesametestwasusedtobenchmarkCPU
andmemoryperformanceonbothsystems
RichardsBenchmark
Ubuntu/Linuxhypervisor
WindowsServer2008hypervisor
100
100
80
80
Time(sec)
120
60
60
40
20
20
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
200
210
40
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
190
200
210
Time(ms)
120
NumberofiteraIons
NumberofIteraIon
UbuntuVM
WindowsServer2008VM
UbuntuVM
WindowsServer2008VM
ReviewAnalysis
Ubuntuperformedbe`erthanWindows
UnderharddrivetheamountofDmetoread
signicantlyless
ImprovedresultsinCPU&Memorytests
ComputaDonofPystone/secondsgreaterthan
Windows
RichardsbenchmarkcomputedinlessDmeper
iteraDons
RelevantUseCase
Givenanopportunityto
buildacloudcluster
Providedwithhardware
toassemblecluster
CloudCompuDng
Deliverhostedservicesoverthe
Internet
AcloudservicehasthreedisDnct
characterisDcsthatdierenDateit
fromtradiDonalhosDng
Soldondemand
elasDc
fullymanagedbytheprovider
Thereare2kindsofcloudcompuDng:
Public
Private
CreaDngThunderHPCCloud
Deploymasternode
Deployclusternodes
Deployvirtualmachines
MasterNode
o UseSystemRescuebootdisktobootthemasternode
o Congurethenetwork
o Downloadandextracttheinstallscriptthenruntheinstall
scripttoinstallthenode
o Generatersaanddsakeys
o Reboot
o Connecttomasternodeviassh
o RestoretheinstallaDonRepo
ClusterNodes
o TheclusterissplitupintotwoDers
o Updateallthesefngs
o InstalltherstDer
o RebootallthenodesintherstDer
o CheckthatallthenodesareupbyconnecDngtoallthenodes
o InstallthesecondDer
o RebootallthenodesinthesecondDer
o Checkthatallthenodesareup
DeployVirtualMachines
o DownloadalistofVMs
o PushVMstoassignedservers
o ConnecttoeachnodeandcheckifVMswereinstalled
correctly
sshtoeachnode
Sources
OracleVMVirtualBoxOracleCorpora+on
h`p://www.virtualbox.org/manual/UserManual.html
SpecializedHPCClustersintheCloudJasonStowe
h`p://www.syscon.com/node/1447223
CloudCompuDng
h`p://en.wikipedia.org/wiki/Cloud_compuDng
h`p://searchcloudcompuDng.techtarget.com
PegasusXenClusterNathanRiniNCAR
VirtualizaDonNathanRiniNCAR
QuesDons?