Hitachi Thunder 9200 Dual Active ID Succession (5800/9200) User's Guide

Hitachi Freedom Storage
Thunder 9200
Dual Active ID SuccessionTM
(5800/9200)
Users Guide
2001 Hitachi Data Systems Corporation, ALL RIGHTS RESERVED

Notice: No part of this publication may be reproduced or transmitted in any form or by any
means, electronic or mechanical, including photocopying and recording, or stored in a
database or retrieval system for any purpose without the express written permission of Hitachi
Data Systems Corporation.
Hitachi Data Systems reserves the right to make changes to this document at any time without
notice and assumes no responsibility for its use. Hitachi Data Systems products and services
can only be ordered under the terms and conditions of Hitachi Data Systems applicable
agreements. All of the features described in this document may not be currently available.
Refer to the most recent product announcement or contact your local Hitachi Data Systems
sales office for information on feature and product availability.
This document contains the most current information available at the time of publication.
When new and/or revised information becomes available, this entire document will be updated
and distributed to all registered users.
Trademarks
Hitachi Data Systems is a registered trademark and service mark of Hitachi, Ltd., and the
Hitachi Data Systems design mark is a trademark and service mark of Hitachi, Ltd.
IBM is a registered trademark of International Business Machines Corporation.
RS/6000 is a registered trademark of International Business Machines Corporation.
AIX is a registered trademark of International Business Machines Corporation.
NCR is a registered trademark of NCR Corporation.
VxVM (VERITAS Volume Manager) is a registered trademark of VERITAS Software
Corporation.
All other brand or product names are or may be trademarks or service marks of and are used to
identify products or services of their respective owners.
and trademark designations are not used in this manual.
Notice of Export Controls

Export of technical data contained in this document may require an export license from the
United States government and/or the government of Japan. Please contact the Hitachi Data
Systems Legal Department for any export compliance questions.
Hitachi Thunder 9200 Dual Active ID Succession Users Guide
iii
Document Revision Level

Revision
Date
Description
MK-90DF525-P
April 2001
Preliminary Release.
MK-90DF525-0
May 2001
Initial Release. Supersedes and replaces MK-90DF525-P.
Source Document Revision Level

The following source document was used to produce this 5800/9200 user guide:
DF-F500-WD ID Take-over control function Users Guide, Second Edition.
Changes in this Revision

!
!
iv
Removed Preliminary from the headers.

Changed the title page to: Hitachi Freedom Storage Thunder 9200 Dual Active ID
Succession (5800/9200) Users Guide.
Preface
Dual Active ID Succession is installed on your Thunder 9200 disk array unit. Before using
Dual Active ID Succession, read the operating procedures and notices included in this guide.
Carefully follow the safety precautions and instructions.
The Hitachi Freedom Storage Thunder 9200 Dual Active ID Succession Users Guide
assumes that:
!
The user has a background in data processing and understands direct-access storage device
subsystems and their basic functions.
The user is familiar with the Hitachi Freedom Storage Thunder 9200 array subsystem.
For further information on Hitachi Data Systems products and services, please contact your
Hitachi Data Systems account team, or visit the Hitachi Data Systems worldwide web site at
http://www.hds.com. For specific information on the supported host systems and platforms for
the 9200, please refer to the user documentation for the product, or contact the vendors
customer support service.
Note: The term 9200 refers to the Hitachi Thunder 9200 subsystem, unless otherwise
noted. Please refer to the Hitachi Thunder 9200 User and Reference Guide (MK-90DF504)
for further information on the 9200 disk array subsystem.
Note: The use of Dual Active ID Succession and all other Hitachi Data Systems products is
governed by the terms of your license agreement(s) with Hitachi Data Systems.
Safety Precautions
Note the following when using Dual Active ID Succession:
!
Only administrators, system engineers, and field engineers who are familiar with Hitachi
Data Systems disk array units are allowed to run the Dual Active ID Succession function.
Make certain you read and fully understand this guide before you operate the Dual Active
ID Succession function.
Carefully follow instructions included with the CAUTION label.
CAUTION
Failure to follow these instructions can result in serious system damage and/or the loss of
system data.
vi
Preface
Contents
Chapter 1
Introducing Dual Active ID Succession ..................................................... 1

1.1
1.2
Chapter 2
Installing and Uninstalling Dual Active ID Succession .................................. 9

2.1
2.2
2.3
Chapter 3
Specifications................................................................................................................. 4
Restrictions .................................................................................................................... 6
1.2.1 Restrictions on configuration............................................................................. 6
1.2.2 Restrictions on configuration setting................................................................. 6
1.2.3 Restrictions on the host...................................................................................... 7
1.2.4 Restrictions on operation ................................................................................... 7
Installation...................................................................................................................... 9
Uninstallation............................................................................................................... 14
Setting to Enable or Disable ........................................................................................ 18
Setting and Canceling the Dual Active ID Succession Function ......................21
List of Figures
Figure 1.1
Figure 1.2
Figure 1.1
Figure 1.2
Figure 1.3
Figure 1.4
Dual Active ID Succession and Transition of System Operation Failure or

Recovery (Fibre Channel)...................................................................................... 2
Dual Active ID Succession and Transition of System Operation Failure or
Recovery (Parallel SCSI)....................................................................................... 3
Combined System Configuration of Host Cluster Configuration and
Dual Active ID Succession (two HUB)................................................................. 5
Combined System Configuration of Host Cluster Configuration and
Dual Active ID Succession (one HUB) ................................................................. 5
Dual Active ID Succession Prohibited System with Fibre (two 9200
connected per loop) ............................................................................................... 5
Dual Active ID Succession (Parallel SCSI model)................................................ 5
List of Tables
Table 1.1
Support for the Dual Active ID Succession Function ........................................... 4
vii
viii
Contents
Chapter 1 Introducing Dual Active ID Succession

The Dual Active ID Succession feature provides the following functions:
!
When one controller in a dual controller configuration is blocked due to a failure, the
other controller takes over the Port-ID of the blocked controller. It automatically switches
the path to continue processing.
When an array unit is operated in hot-standby mode and a controller blockade occurs in
one controller due to a failure, the other controller can continue processing with the same
level of performance as that prior to the failure.
When an array unit is operated in dual-active mode (with two ports per controller
attached) and a controller blockade occurs in one controller due to a failure, the other
controller continues processing the same as it does in hot-standby mode.
When a controller blockade occurs in dual-active mode, only one of two controllers
performs the processing; therefore performance is similar to that of an array unit with a
single controller configuration. However, if an array unit is operated in dual-active mode
and the array unit is restored to the original path condition by recovering a failed
controller while the array unit is in operation, performance of the array unit at run-time
can be restored to the same performance level as that prior to the failure.
Note: The Dual Active ID Succession function is effective only when a controller failure
occurs. It is not effective in the event of host-side HBA (Host Bus Adapter) and cable failures
(including HUB failures).
This section includes diagrams of Dual Active ID Succession functioning in both Fibre
Channel and Parallel SCSI modes.
Fibre Channel model

The corresponding ports of both controllers are connected via a HUB. In case of a controller
failure, the failed controller is disconnected and the active controller continues the I/O
processing.
# Normal
" CTL0
failure
Host
Host
0
HUB
HUB
HUB
HUB
B
CTL0
A
B
CTL1
A
B
CTL0
A
B
CTL1
CTL0
failure
CTL1
replacing while online
$ CTL1
failure
CTL0
% Normal
Host
0
Host
0
HUB
HUB
HUB
HUB
A
B
CTL0
A
B
CTL1
A
B
CTL0
A
B
CTL1
CTL1
failure
Figure 1.1
Dual Active ID Succession and Transition of System Operation Failure or Recovery (Fibre
Channel)
Note: If an array unit is operated in hot-standby mode, LUs are accessed from only one of the
two controllers at normal operation time. Additionally, though a blocked controller is replaced
while the array unit is in operation, processing is continued with the same path as before
replacement.
2
Chapter 1
Introducing Dual Active ID Succession
Parallel SCSI model

The corresponding ports of both controllers are daisy chained. When a controller failure
occurs, the failed controller does not respond to the selection from the host; the active
controller continues the I/O processing.
# Normal
" CTL0
failure
Host
A
CTL1
A
CTL0
Host
0
A
CTL0
A
CTL1
CTL0
failure
CTL1
$ CTL1
failure
CTL0
% Normal
Host
A
CTL0
Host
A
CTL1
A
CTL0
A
CTL1
CTL1
failure
Figure 1.2
Dual Active ID Succession and Transition of System Operation Failure or Recovery

(Parallel SCSI)
1.1
Specifications
The specifications of the Dual Active ID Succession function are as follows:
1. A dual controller configuration is required.
2. If an array unit is operated in dual-active mode, two ports are required for each controller.
For the Parallel SCSI model, hot-standby mode is necessary because this model has only
one port for each controller.
3. The supported Dual Active ID Succession port models are listed in the following table.
Table 1.1
Support for the Dual Active ID Succession Function
Device name
9200
Port Specifications
SCSI
Fibre
Supported
Supported
4. Cable connections and Port-ID/Target ID settings are as follows:

For the Fibre Channel model, connect the same ports of both controllers to the same loop
(HUB) and assign the same Port-ID.
Figure 1.3 and Figure 1.4, show configurations of cable connections for the Fibre Channel
model.
Figure 1.5 shows a configuration of the Dual Active ID Succession function prohibited
system for the Fibre Channel model.
Figure 1.6 shows a configuration of cable connections for the Parallel SCSI model.
5. The Dual Active ID Succession function is a licensed option (DF-F500-WD). To install
this function, an option FD provided with the optional feature or the key code is required.
Chapter 1
Figure 1.3
Host
0
Host
0
HUB
HUB
A B
CTL0
A B
CTL1
Combined System Configuration of Host

Cluster Configuration and Dual Active ID
Succession (two HUB)
HUB
A B
CTL0
Figure 1.4
A B A B
CTL0 CTL1
Figure 1.5
A B
CTL1
Combined System Configuration of Host

Cluster Configuration and Dual Active ID
Succession (one HUB)
Host
Host
0 1
HUB
Host
0
Host
0
HUB
A
CTL0
CTL1
A B A B
CTL0 CTL1
Dual Active ID Succession Prohibited

System with Fibre (two 9200 connected
per loop)
Figure 1.6
Dual Active ID Succession (Parallel SCSI

model)
1.2
Restrictions
This section includes restrictions for the Dual Active ID Succession function.
1.2.1 Restrictions on configuration

!
A two-ports-per-controller configuration is prerequisite for dual-active mode.

(This function can be used only with the hot-standby mode in case of the Parallel SCSI
model or RKL model.)
In case of Fibre Channel model, connection through a Fabric Switch is not available.
Connection between a DF500 unit and the host is available only through a HUB to use the
DF500.
1.2.2 Restrictions on configuration setting

!
In case of Fibre Channel model, set the topology of all ports to LOOP.
The Port-IDs/Target IDs of ports with the same port number between the two controllers
are set to the same ID (an Port-ID/Target ID of controller 0 is copied to that of controller
1).
The same Port-ID/Target ID should be corresponding to the same LUN.

In addition, map an LU to a port of a controller using the LU mapping so that the mapped
LU cannot be recognized by other ports of the same controller.
The ownership of LUN should be on the active-port control side of the ports on which the
LUN is mapped.
The take-over mode cannot co-exist together with the following types of the host
connection mode specified by the system parameter and each mode specified by the
system start attribution.
Host connection mode
System start attribution
TRESPASS
DATA SHARE MODE=ON
WOLFPACK
VxVM DMP
IBM 7135 I/O Path Switch
NCR I/O Path Switch
Chapter 1
1.2.3 Restrictions on the host

!
To change the controller accepting a command when recovering a controller, a command

issued to the other controller is internally reset. Also, a failure may be recorded on a host
log because a LIP (in case of Fibre Channel model) may be issued at the controller
replacement.
When switching on the host (server), switch on DF500 first and then switch on the host
(server) after confirming that DF500 becomes READY. If this order is reversed, DF500
may not be recognized by the host.
After switching the path, a Unit Attention factor of PS/ON reset is reported to a command
from the host.
1.2.4 Restrictions on operation

!
When installing (unlocking) and uninstalling (locking) the Dual Active ID Succession
function, and making and changing the setting of enable and disable, be sure to restart a
disk array unit (by selecting restart with the Disk Array Management Program, or turning
off (orderly shutdown) and then on a disk array unit) before using.
Chapter 1
Chapter 2 Installing and Uninstalling Dual Active

ID Succession
This chapter is divided into the following sections:
2.1
Installation
Uninstallation
Setting to Enable or Disable
Installation
The ID take-over control function which is a kind of option is usually unselectable (closed).
To make the ID take-over control function available, you must install the option of the ID
Take-over control function (DF-F500-WD) and make its functions selectable (open). To install
this function, an option FD provided with the optional feature or the key code is required.
Follow the instructions below to install the ID Take-over control function (DF-F500-WD).
The ID take-over control function is installed and uninstalled using the Disk Array
Management Program. For operating procedures of the Disk Array Management Program,
refer to the Disk Array Management Program (for GUI) Users Guide.
Note: Before installing and uninstalling, make sure that an array unit which to operate is
normal. If a failure such as a controller blockade has occurred, installing and uninstalling
operations cannot be performed.
The following describes installation procedures performed by using the Disk Array
Management Program via GUI.
1. Starts the Disk Array Management Program and switches the mode of operating to
Management Mode. Registers an array unit in which to install the ID take-over control
function and connects to the registered array unit. A unit window for the connected array
unit will be displayed.
2. Click the Parameters button, then the Option tab.
3. Unlocks the optional feature using the key FD or the key code.
!
Unlocking with the key FD

a) Inserts the key FD into the FDD of a machine in which the Disk Array Management
Program has been installed.
b) Click the Directory radio button to set in the text box a path to the FD.
c) Click the Open button.
d) A screen for confirming that you want to unlock the ID take-over control function will
be displayed, so click the OK button.
e) A message indicating that the priced optional feature has been unlocked will be
displayed. A message confirming your request for restarting will be displayed, so click
the OK button when restarting.
10
Chapter 2
Installing and Uninstalling Dual Active ID Succession
To set effective the unlocking of the optional feature that you have operated, restart the
array unit. The feature is not yet unlocked until restarting. When restarting is initiated, the
array unit is not ready to accept an access from the host for duration from initiation until the
restarting terminates. Therefore, after making sure that the host has stopped accessing, initiate
restarting.
Note:
Unlocking with the key code

a) Click the Key Code radio button to set in the text box a key code.
b) Click the Open button.
c) A screen for confirming that you want to unlock the ID take-over control function will be
displayed, so click the OK button.
11
d) A message indicating that the priced optional feature has been unlocked will be
Note: To set effective the unlocking of the optional feature that you have operated, restart the
array unit. The feature is not yet unlocked until restarting. When restarting is initiated, the
array unit is not ready to accept an access from the host for duration from initiation until the
restarting terminates. Therefore, after making sure that the host has stopped accessing, initiate
restarting.
4. When not restarting an array unit, a screen will be displayed with the set-up priced
optional feature being updated.
When instructing to restart an array unit, the time the restarting has begun is displayed.
The restarting takes about two to six minutes.
12
Chapter 2
Note: It may take time for an array unit to respond, depending on the condition of the array
unit. If it does not still respond after 10 minutes or more passes, check the condition of the
array unit.
A message indicating that the restarting has terminated is displayed, so click the OK button.
When clicking the OK button, the unit window is closed. To perform other operations, select
again on the main window an array unit which to operate, and open the unit window.
13
2.2
Uninstallation
Follow the instructions below to uninstall the ID take-over control function. When the ID takeover control function is uninstalled, the ID take-over control function is not available (locked)
until it is opened by the Option floppy disk or the key code. To uninstall the ID
take-over control function, the key FD provided with the ID take-over control function feature
or the key code described in the key FD is required.
Follow the instructions below to uninstall the ID Take-over control function (DF-F500-WD).
Management Mode. Registers an array unit in which to uninstall the ID take-over control
2. Click the Parameters button, then the Option tab.
3. Locks the optional feature using the key FD or the key code.
!
Locking with the key FD

a) Inserts the key FD into the FDD of a machine in which the Disk Array Management
Program has been installed.
b) Click the Directory radio button to set in the text box a path to the FD.
c) Click the Close button.
14
Chapter 2
d) A screen for confirming that you want to lock the ID take-over control function will
e) A message indicating that the priced optional feature has been locked will be
Note: To set effective the locking of the optional feature that you have operated, restart the
array unit. The feature is not yet locked until restarting. When restarting is initiated, the
array unit is not ready to accept an access from the host for duration from initiation until
the restarting terminates. Therefore, after making sure that the host has stopped accessing,
initiate restarting.
!
Locking with the key code

a) Click the Key Code radio button to set in the text box a key code.
b) Click the Close button.
15
c) A screen for confirming that you want to lock the ID take-over control function will
d) A message indicating that the priced optional feature has been locked will be
Note: To set effective the locking of the optional feature that you have operated, restart
the array unit. The feature is not yet locked until restarting. When restarting is initiated,
the array unit is not ready to accept an access from the host for duration from initiation
until the restarting terminates. Therefore, after making sure that the host has stopped
accessing, initiate restarting.
16
Chapter 2
Note: It may take time for an array unit to respond, depending on the condition of the
array unit. If it does not still respond after 10 minutes or more passes, check the condition
of the array unit.
A message indicating that the restarting has terminated is displayed, so click the OK
button. When clicking the OK button, the unit window is closed. To perform other
operations, select again on the main window an array unit which to operate, and open the
unit window.
17
2.3
Setting to Enable or Disable

For the ID take-over control function feature, the ID take-over control function can be set to
Disable or Enable under the condition in which the feature has been installed.
The following describes a procedure for setting the function to Disable or Enable while the ID
take-over control function feature stays in an unlocked state.
The following describes setting procedures performed by using the Disk Array Management
Program via GUI.
Management Mode. Registers an array unit in which to set the ID take-over control
2. Click the Parameters button, then click the Option tab.
3. Click on ID-TAKING-OVER in the Option Name text box, and then click Status
button.
4. The Option Status screen will be displayed, so selects Enable or Disable with a radio
button, and click the OK button.
18
Chapter 2
5. A message indicating that the priced optional feature has been set will be displayed. A
message confirming your request for restarting will be displayed, so click the OK button
when restarting.
Note: To set effective the setting of the optional feature that you have operated, restart the
array unit. The feature is not yet set until restarting. When restarting is initiated, the array
unit is not ready to accept an access from the host for duration from initiation until the
restarting terminates. Therefore, after making sure that the host has stopped accessing,
initiate restarting.
19
of the array unit.
operations, select again on the main window an array unit which to operate, and open the
unit window.
20
Chapter 2
Chapter 3 Setting and Canceling the Dual Active

ID Succession Function
The ID take-over control function is set up using the Disk Array Management Program. The
following describes set up procedures performed by using the Disk Array Management
Program.
The system parameter the disk array unit is set in the wizard format.
Note: Before setting the system parameter of ID take-over control function, you must install
the option of the ID Take-over control function (DF F500-WD) and make its functions
selectable (open). (See Installing and Uninstalling)
If one of the controllers is blocked when connecting to the dual system, you cannot set the
system parameter. Check that the disk array unit is in the warning state before setting.
When you set the dual system though RS232C, be sure to do so from the controller 0 side.
Management Mode. Registers an array unit in which to uninstall the ID take-over control
Click on the Param Wizard button in the main window of Disk Array Management
Program.
The Param Wizard button can be operated regardless of the unit window currently
displayed.
21
2. Click the Standard Setup radio button as shown in the following figure and then click on
the NEXT > button.
The following system parameter setting window is displayed.
22
Chapter 3
Setting and Cancelling the Dual Active ID Succession Function
3. Click the Dual Active Mode or Hot Standby Mode radio button in the System Startup
Attribute settings of the system parameter setting window. In SCSI ID/Port ID Takeover Mode, click the Used radio button.
4. If an array unit is operated in dual active mode, select a controller which to set active in
individual ports for the Default Controller setting item on the system parameter setting
screen, by clicking the CTL0 or CLT1 radio button.
5. The following operation differs depending on the host system connected. Therefore,
follow the appropriate operation according to the host system connected.
When connecting to the RS/6000 (AIX) host system, click the Port xx (xx is port
number of connecting to the RS/6000) button in the system parameter setting window
and then go to procedure 6.
When connecting to the host system other than RS/6000 (AIX), click the OK button
in the system parameter setting window and then go to procedure 7.
6. On the next screen, click the check box of the UA(06/2A00) suppress mode enable
option for the Host Connection Mode2 setting item, and next click the OK button.
Set up all ports with which an RS/6000 is connected in the same way as described above.
23
7. Click the Yes radio button in the FD Backup settings in the following window and then
makes sure that a backup FD has been inserted in the FDD of the array unit and then click
the OK button.
FD Backup: The system parameter information is saved in the backup FD for the disk
array unit. When the setting is changed, reserving is required. Therefore, be sure to select
Yes.
8. When the setting ends, the following message is displayed. Click the OK button. When
clicking the OK button, the array unit will be restarted, and the set system parameter will
be validated.
Note: To make a changed system parameter valid, restart the array unit. A part of host
command or Disk Array Management Program function cannot be executed until the unit
is restarted.
24
Chapter 3
of the array unit.
operations, select again on the main window an array unit which to operate and open the
unit window.
This is the end of the setting of the ID take-over control function. When setting change is
required, conduct the setting operation again.
25
26
Chapter 3

Hitachi Thunder 9200 Dual Active ID Succession (5800/9200) User's Guide

Diunggah oleh

Informasi Dokumen

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Hitachi Thunder 9200 Dual Active ID Succession (5800/9200) User's Guide

Diunggah oleh

Hak Cipta:

Format Tersedia

Hitachi Freedom Storage

2001 Hitachi Data Systems Corporation, ALL RIGHTS RESERVED

Notice of Export Controls

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Document Revision Level

Initial Release. Supersedes and replaces MK-90DF525-P.

Source Document Revision Level

Changes in this Revision

Removed Preliminary from the headers.

Carefully follow instructions included with the CAUTION label.

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Introducing Dual Active ID Succession ..................................................... 1

Installing and Uninstalling Dual Active ID Succession .................................. 9

Setting and Canceling the Dual Active ID Succession Function ......................21

Dual Active ID Succession and Transition of System Operation Failure or

Support for the Dual Active ID Succession Function ........................................... 4

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Chapter 1 Introducing Dual Active ID Succession

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Fibre Channel model

Introducing Dual Active ID Succession

Parallel SCSI model

Dual Active ID Succession and Transition of System Operation Failure or Recovery

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Support for the Dual Active ID Succession Function

4. Cable connections and Port-ID/Target ID settings are as follows:

Introducing Dual Active ID Succession

Combined System Configuration of Host

Combined System Configuration of Host

Dual Active ID Succession Prohibited

Dual Active ID Succession (Parallel SCSI

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

1.2.1 Restrictions on configuration

A two-ports-per-controller configuration is prerequisite for dual-active mode.

1.2.2 Restrictions on configuration setting

The same Port-ID/Target ID should be corresponding to the same LUN.

Host connection mode

System start attribution

DATA SHARE MODE=ON

Introducing Dual Active ID Succession

1.2.3 Restrictions on the host

To change the controller accepting a command when recovering a controller, a command

1.2.4 Restrictions on operation

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Introducing Dual Active ID Succession

Chapter 2 Installing and Uninstalling Dual Active

Setting to Enable or Disable

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Unlocking with the key FD

Installing and Uninstalling Dual Active ID Succession

Unlocking with the key code

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Installing and Uninstalling Dual Active ID Succession

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Locking with the key FD

Installing and Uninstalling Dual Active ID Succession

Locking with the key code

b) Click the Close button.

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Installing and Uninstalling Dual Active ID Succession

Hitachi Thunder 9200 Dual Active ID Succession Users Guide

Setting to Enable or Disable

Installing and Uninstalling Dual Active ID Succession