Sun Cluster Ldom

Solaris™ Cluster 3.
2
With Two Logical Domains
on the Same Host
Vijay Shankar Upreti

April 2009
A BigAdmin Community Submission
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights
reserved.
U.S. Government Rights - Commercial software. Government users are subject to the Sun Microsystems, Inc.
standard license agreement and applicable provisions of the FAR and its supplements. Use is subject to license terms.
This distribution may include materials developed by third parties.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is
a registered trademark in the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.
X/Open is a registered trademark of X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, Java, JumpStart, Solaris, Sun BluePrints, Sun Fire, and SunSolve are
trademarks or registered trademarks of Sun Microsystems, Inc. or its subsidiaries in the United States and other
countries.
This product is covered and controlled by U.S. Export Control laws and may be subject to the export or import laws
in other countries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether
direct or indirect, are strictly prohibited. Export or reexport to countries subject to U.S. embargo or to entities
identified on U.S. export exclusion lists, including, but not limited to, the denied persons and specially designated
nationals lists is strictly prohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS,

REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE
EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Solaris Cluster 3.2 With Two Logical Domains on the Same Host 2
Table of Contents
Introduction................................................................................................................................................4
Setting Up the Guest Domains...................................................................................................................4
Installing Solaris Cluster 3.2 1/09 on Both Guest Domains......................................................................8
Configuring the Cluster Setup Under LDoms..........................................................................................14
Verifying the Cluster Setup......................................................................................................................30
For More Information..............................................................................................................................32
Licensing Information..............................................................................................................................33
Introduction
Solaris™ Cluster (formerly known as Sun™ Cluster) is a clustering solution that can be used between
two physically isolated hosts. The setup in this community-submitted article is a proof of concept for
using Solaris Cluster 3.2 1/09 in a virtualized hosting environment such as Logical Domains (LDoms)
on one host running the Solaris 10 10/08 OS (AKA U6). (Note: Some testing was done on Solaris
Cluster 3.2 2/08, but it is advised to use release 1/09.)
Note: This document describes only the basic cluster setup. It does not include information about
configuring device groups, configuring resource groups, or configuring resources.
To begin, follow the instructions for setting up LDoms and share a common volume to be seen by both
logical guest domains. Then set up the guest domains as follows.
Setting Up the Guest Domains

1. Set up the first guest domain, ldg1:
ldm add domain ldg1
ldm add-vcpu 4 ldg1
ldm add-memory 2G ldg1
ldm add-vnet vnet1 primary-vsw0 ldg1
ldm add-vdisk vdisk1 vol1@primary-vds0 ldg1
ldm add-vdsdev /export/home/LDG1 vol1@primary-vds0
ldm add-vdisk vdisk2 vol2@primary-vds0 ldg1
ldm add-vdiskserverdevice /dev/dsk/c0t1d0s2 vol2@primary-vds0
ldm set-var auto-boot\? true ldg1
ldm bind-domain ldg1
ldm start-domain ldg1
2. Then set up the second guest domain, ldg2:

ldm add domain ldg2
ldm add-vcpu 4 ldg2
ldm add-memory 2G ldg2
ldm add-vdisk vdisk2 vdisk2@primary-vds0 ldg2
ldm add-vdsdev /export/home/LDG2 vdisk2@primary-vds0
ldm add-vdisk vdisk1 vdisk1@primary-vds0 ldg2
ldm add-vdiskserverdevice /dev/dsk/c0t1d0s2 vdisk1@primary-vds0
ldm set-var auto-boot\? true ldg2
ldm bind-domain ldg2
ldm start-domain ldg2
Here are the device alias entries on ldg1 and ldg2.
Alias entries on ldg1:
>ok devalias
vdisk2 /virtual-devices@100/channel-devices@200/disk@1
vnet4 /virtual-devices@100/channel-devices@200/network@3
net /virtual-devices@100/channel-devices@200/network@0
disk /virtual-devices@100/channel-devices@200/disk@0
virtual-console /virtual-devices/console@1
name aliases
Alias entries on ldg2:

>ok devalias
net /virtual-devices@100/channel-devices@200/network@0
disk /virtual-devices@100/channel-devices@200/disk@0
virtual-console /virtual-devices/console@1
name aliases
3. After both guest domains are configured, install the Solaris 10 Operating System on both guest
domains either using the JumpStart™ method or using the CD/DVD.
The final LDoms configuration (ldm ls -l) should look something like this:
NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
primary active -n-cv SP 4 1G 0.2% 9d 8h 47m
SOFTSTATE
Solaris running
VCPU
VID PID UTIL STRAND
0 0 0.3% 100%
1 1 0.1% 100%
2 2 0.1% 100%
3 3 0.1% 100%
MAU
ID CPUSET
0 (0, 1, 2, 3)
MEMORY
RA PA SIZE
0x8000000 0x8000000 1G
IO
DEVICE PSEUDONYM OPTIONS
pci@780 bus_a
pci@7c0 bus_b
VCC
NAME PORT-RANGE
primary-vcc0 5000-51000
VSW
NAME MAC NET-DEV DEVICE MODE
primary-vsw0 00:14:4f:fb:a1:f6 e1000g0 switch@0
VDS
NAME VOLUME OPTIONS DEVICE
primary-vds0 vol1 /export/home/LDG1
vdisk2 /export/home/LDG2
vdisk1 /dev/dsk/c0t1d0s2
vol2 /dev/dsk/c0t1d0s2
VCONS
NAME SERVICE PORT
SP
------------------------------------------------------------------------------

ldg1 active -n--- 5000 4 2G 0.3% 7d 18h 32m
SOFTSTATE
Solaris running
VCPU
VID PID UTIL STRAND
0 4 4.3% 100%
1 5 1.1% 100%
2 6 0.2% 100%
3 7 0.6% 100%
MEMORY
RA PA SIZE
0x8000000 0x48000000 2G
VARIABLES
auto-boot?=true
boot-device=/virtual-devices@100/channel-devices@200/disk@0:a disk net
keyboard-layout=US-English
NETWORK
NAME SERVICE DEVICE MAC
vnet1 primary-vsw0@primary network@0 00:14:4f:fa:bd:e7
vnet2 primary-vsw0@primary network@1 00:14:4f:fa:cb:cd
vnet3 primary-vsw0@primary network@2 00:14:4f:f8:96:9c
vnet4 primary-vsw0@primary network@3 00:14:4f:f8:e4:be
DISK
NAME VOLUME TOUT DEVICE SERVER
vdisk1 vol1@primary-vds0 disk@0 primary
vdisk2 vol2@primary-vds0 disk@1 primary
VCONS
NAME SERVICE PORT
ldg1 primary-vcc0@primary 5000
------------------------------------------------------------------------------
ldg2 active -n--- 5001 4 4G 0.3% 7d 18h 33m
SOFTSTATE
Solaris running
VCPU
VID PID UTIL STRAND
0 8 21% 100%
1 9 3.1% 100%
2 10 1.2% 100%
3 11 5.7% 100%
MAU
ID CPUSET
2 (8, 9, 10, 11)
MEMORY
RA PA SIZE
0x8000000 0xc8000000 4G
VARIABLES
auto-boot?=false
keyboard-layout=US-English
NETWORK
NAME SERVICE DEVICE MAC
vnet2 primary-vsw0@primary network@0 00:14:4f:fa:cf:9a
vnet1 primary-vsw0@primary network@1 00:14:4f:fa:af:cc
vnet3 primary-vsw0@primary network@2 00:14:4f:fa:65:01
vnet4 primary-vsw0@primary network@3 00:14:4f:f8:ae:de
DISK
NAME VOLUME TOUT DEVICE SERVER
vdisk2 vdisk2@primary-vds0 disk@0 primary
vdisk1 vdisk1@primary-vds0 disk@1 primary
VCONS
NAME SERVICE PORT
ldg2 primary-vcc0@primary 5001
Installing Solaris Cluster 3.2 1/09 on Both Guest Domains
After guest domains ldg1 and ldg2 are set up, use the following steps to install and configure
Solaris Cluster on both guest domains.
1. Download the Solaris Cluster 3.2 1/09 binary from

http://www.sun.com/download/products.xml?id=4581ab9e.
2. Before you install the software, make sure you perform the following mandatory preparations:
a) Update the cluster node names in each logical guest domain's /etc/hosts file.
b) Ensure that you can connect using SSH from one guest domain to the other as root without a
password.
c) Plan the layout of your cluster configuration and prepare to install the software.
d) Make sure the /globaldevices mount point is set up as a global device mount point.
3. Start the Sun Java™ Availability Suite wizard and accept the license agreement to proceed
further with the installation:
4. Select all necessary packages and click Next to proceed:
The system requirements are verified.

5. Click Next to proceed.
6. Select the Configure Now configuration type, as shown in the following figure:
7. After you select the configuration type and you click Next, information is provided about which
products cannot be configured during installation process. Click Next.
8. In the next screen, select Yes to enable support for remote configuration, and also note that after
the installation, you need to run scinstall to set up a passwordless SSH connection.
9. In the next screen, configure High Availability Session Store:
10. The next screen shows what will be installed. Click Next to continue.
The final screen shows the installation progress.
Configuring the Cluster Setup Under LDoms
After the installation of Solaris Cluster on ldg1 is complete, perform the following steps to configure
the cluster setup under the logical guest domains.
1. Run scinstall to configure Solaris Cluster:
2. Select option 1 to set up a new cluster.
3. Select option 1 to create a new cluster:
4. Select yes to continue creating the new cluster:
5. Choose Custom to configure the cluster for logical guest domain.
6. Provide a name for the cluster (for example, ldg-clus):
7. Provide node names for both logical domains (for example, ldg1 and ldg2):
8. Select the default choice for DES authentication requests (no).
9. Choose yes to indicate the cluster should use at least two private networks:
10. LDoms do not use switches (unless specified ), so choose no in the following screen:
11. Define a cluster transport adaptor, vnet1, and make sure this adaptor is plumbed:
12. Define a second adaptor, vnet3, and make sure it is plumbed:
13. Accept the default network adaptor addresses for a private network (172.16.0.0) unless that
address is in use internally.
14. Accept the default (no) for global fencing:
15. Accept the default quorum configuration. (Make sure a file system with /globaldevices
has been configured.)
16. Accept /globaldevices as the default global device area:
17. The next screen shows /globaldevices in both guest domains (ldg1 and ldg2). Choose
yes to create the new cluster.
The cluster creation starts:
The systems boots, as follows.
18. Select option 1 to set up a quorum device:
Select option 1 to add a quorum device:
19. Select yes to continue and choose option 1 for directly attached shared disk (shared from
control domain):
20. Add a SCSI quorum disk. (Use the scdidadm -L or cldevice status command to
determine the common device instance to be used for quorum.)
Verifying the Cluster Setup
Use scstat to verify the base cluster setup:
bash-3.00# scstat
------------------------------------------------------------------
-- Cluster Nodes --
Node name Status
--------- ------
Cluster node: ldg1 Online
Cluster node: ldg2 Online
------------------------------------------------------------------
-- Cluster Transport Paths --
Endpoint Endpoint Status

-------- -------- ------
Transport path: ldg1:vnet2 ldg2:vnet3 Path online
Transport path: ldg1:vnet3 ldg2:vnet2 Path online
------------------------------------------------------------------
-- Quorum Summary --
Quorum votes possible: 3

Quorum votes needed: 2
Quorum votes present: 3
-- Quorum Votes by Node --
Node Name Present Possible Status
--------- ------- -------- ------
Node votes: ldg1 1 1 Online
Node votes: ldg2 1 1 Online
-- Quorum Votes by Device --
Device Name Present Possible Status

----------- ------- -------- ------
Device votes: /dev/did/rdsk/d2s2 1 1 Online
------------------------------------------------------------------
-- Device Group Servers --
Device Group Primary Secondary

------------ ------- ---------
-- Device Group Status --
Device Group Status

------------ ------
-- Multi-owner Device Groups --
Device Group Online Status

------------ -------------
------------------------------------------------------------------
-- Resource Groups and Resources --
Group Name Resources

---------- ---------
Resources:
-
-- Resource Groups --
Group Name Node Name State Suspended

---------- --------- ----- ---------
Group:
--------- ----- ------ ------- ------

IPMP Group: ldg1 sc_ipmp0 Online vnet0 Online
IPMP Group: ldg2 sc_ipmp0 Online vnet0 Online
-- IPMP Groups in Zones --
Zone Name Group Status Adapter Status

--------- ----- ------ ------- ------
------------------------------------------------------------------
After the base setup is complete and verified, create device groups, create resource groups, and
configure resources.
For More Information
Here are some additional resources:
● Solaris Cluster 3.2 download site:
http://www.sun.com/download/products.xml?id=4581ab9e
● Solaris Cluster web site: http://www.sun.com/software/solaris/cluster/index.xml
● Chapter 2, “Installing Software on the Cluster,” in the Sun Cluster Software Installation Guide
for Solaris OS: http://docs.sun.com/app/docs/doc/819-
2970/z40001fb1003552?a=view
● LDoms information and download site:
http://www.sun.com/servers/coolthreads/ldoms/index.jsp
● Logical Domains (LDoms) 1.0.3 Administration Guide (pdf, 154 pp.):
http://dlc.sun.com/pdf/820-4894-10/820-4894-10.pdf
● Other product documentation at http://docs.sun.com
or the Documentation Center: http://www.sun.com/documentation/
● Resources for System Administrators on BigAdmin:
● Logical Domains (LDoms)
http://www.sun.com/bigadmin/hubs/ldoms/
● Virtualization:
http://www.sun.com/bigadmin/topics/virtualization/
● Sun training courses at http://www.sun.com/training/, for example:
● Sun Cluster 3.2 Advanced Administration (ES-445)
● Sun Virtualization: Solaris 10 Logical Domains Administration (SA-345-S10)
● LDom Installation and Configuration for UltraSPARC T1-Based Systems (WET-6343)
● Forums such as:
● Sun forums: http://forums.sun.com/index.jspa
● BigAdmin Discussions collection: http://www.sun.com/bigadmin/discussions/
● Sun wikis such as:
● Sun BluePrints™ wiki: http://wikis.sun.com/display/BluePrints/Main
● BigAdmin wiki, http://wikis.sun.com/display/BigAdmin/Home, especially the
Availability page: http://wikis.sun.com/display/BigAdmin/Availability
● Blogs such as Announcing Solaris Cluster Support in LDoms I/O domains:
http://blogs.sun.com/sc/entry/announcing_solaris_cluster_support_in
● Support:
● Sun resources:
● Register your Sun gear: https://inventory.sun.com/inventory/
● Services: http://www.sun.com/service
● SunSolveSM: http://sunsolve.sun.com
● Community system administration experts:
http://www.sun.com/bigadmin/content/communityexperts
● Events of interest to users of Sun products:
● Worldwide Developer Events: http://developers.sun.com/events/
● Current Events: http://www.sun.com/events/index.jsp
Licensing Information
Unless otherwise specified, the use of this software is authorized pursuant to the terms of the license
found at http://www.sun.com/bigadmin/common/berkeley_license.html.
This content is submitted by a BigAdmin user. It has not been reviewed for technical accuracy by Sun
Microsystems, though it may have been lightly edited to improve readability. If you find an error or
would like to comment on the article, please contact the submitter or use the comment link at the
bottom of the article landing page.

Sun Cluster Ldom

Diunggah oleh

Informasi Dokumen

Deskripsi Asli:

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Sun Cluster Ldom

Diunggah oleh

Hak Cipta:

Format Tersedia

Solaris™ Cluster 3.

Vijay Shankar Upreti

DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS,

Setting Up the Guest Domains

2. Then set up the second guest domain, ldg2:

Alias entries on ldg2:

NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME

1. Download the Solaris Cluster 3.2 1/09 binary from

The system requirements are verified.

1. Run scinstall to configure Solaris Cluster:

2. Select option 1 to set up a new cluster.

5. Choose Custom to configure the cluster for logical guest domain.

8. Select the default choice for DES authentication requests (no).

Select option 1 to add a quorum device:

-- Cluster Transport Paths --

Endpoint Endpoint Status

Quorum votes possible: 3

-- Quorum Votes by Node --

Node Name Present Possible Status

-- Quorum Votes by Device --

Device Name Present Possible Status

-- Device Group Servers --

Device Group Primary Secondary

-- Device Group Status --

Device Group Status

-- Multi-owner Device Groups --

Device Group Online Status

-- Resource Groups and Resources --

Group Name Resources

Group Name Node Name State Suspended

--------- ----- ------ ------- ------

IPMP Group: ldg2 sc_ipmp0 Online vnet0 Online

-- IPMP Groups in Zones --

Zone Name Group Status Adapter Status

Anda mungkin juga menyukai