Anda di halaman 1dari 180

Storage Center

CT-SC040 and SC8000 Connectivity Guide

Storage Center CT-SC040 and SC8000 Connectivity Guide


Document Number: 680-027-013 Revision Date
A December 2012

Description
Initial release of software-version-independent publication.

Notes, Cautions, and Warnings


Note: Indicates important information that helps you complete a procedure.

Caution: Indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. Warning: Indicates that failure to follow directions could result in property damage, personal injury, or death.

Copyright Notice and Trademarks


2012 Dell Inc. Trademarks used in this text: Dell, the Dell logo, and Compellent are trademarks of Dell Inc.

Contacting Dell Technical Support Services


For technical support, go to support.dell.com/compellent/.

FCC Radio Frequency Interference Statement


This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense.

Contents
1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Safety Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Electrostatic Discharge (ESD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Weight . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Electrical . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Environmental . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Storage Center Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Controller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Front End . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Back End . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . System Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1
2 2 2 2 2 3 3 4 5 5 6 6 6

2 Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SC8000 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . LCD Panel Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . NIC Indicator Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IO Card Slot Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Seating IO Cards Properly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Communication Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IO Card Slot Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

7
7 9 9 10 11 12 13 14 15 16

3 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC200/220 Enclosure Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC200/220 Enclosure Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enclosure Management Module (EMM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS Enclosure Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS Enclosure Rear View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Storage Bridge Bay (SBB) Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS 6 Gb and 3 Gb IO Module Comparison . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD IO Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

17
18 18 19 20 21 21 22 23 24 25 26

Dell Compellent

iii

Contents

SBOD Port ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enclosure Speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Service Control Modules (SCMs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Enclosure ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disk Drive Speeds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS Disk Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD and SATA Disk Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enterprise Plus Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Standard SAS Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removing Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Installing Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

27 27 28 29 29 30 30 31 32 33 34 35 36

4 Back End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .


SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Direct-Connect IPC for Dual-Controller, Single Chain Configurations . . . . . . . . . . . . . . . . . . . . SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Cabling Best Practices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

37
37 37 38 38 47 54 54 55 63 70 70 71 76 81 81 81 88

5 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Server HBA Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Best Practices for Fibre Channel Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . WWN Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Port Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . System Manager WWN Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Multipath IO (MPIO) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ethernet Management and iDRAC Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single-Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fibre Channel Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iSCSI Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iSCSI Failover Example (Legacy Mode) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

93
94 94 94 95 96 96 96 97 98 98 98 100 101 102 103 105 108 109

iv

Storage Center CT-SC040 and SC8000 Connectivity Guide

Contents

CT-SC040 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ethernet Management Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Dual Controller Ethernet Management Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fibre Channel (Virtual Ports) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fibre Channel Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iSCSI Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

113 113 114 115 117 118 119 120 121 124

6 Adding or Removing an Enclosure . . . . . . . . . . . . . . . . . . . . . . . 129


Using Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . View Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure Local Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Creating a New Chain of SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding to an Existing SAS Enclosure Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding a Second SAS Enclosure, Second Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removing SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Release Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removing a SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Creating a New Chain for SAS 12- or 24-Drive Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding to an Existing SAS Enclosure Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding a Second SAS Enclosure, Second Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removing EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Release Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removing a SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding SBOD or SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Before you Begin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding an SBOD or SATA Enclosure to a New Loop . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Adding an SBOD or SATA Enclosure to an Existing Loop . . . . . . . . . . . . . . . . . . . . . . . . . . . . Connect Back-end Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129 130 131 131 132 134 139 141 141 141 146 146 148 153 155 155 156 160 160 160 160 163

Dell Compellent

Contents

vi

Storage Center CT-SC040 and SC8000 Connectivity Guide

List of Figures
Figure 1. Dell Compellent Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 2. SC8000 Controller Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 3. SC8000 Front View Features and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 4. LCD Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 5. SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 6. NIC Indicator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 7. IO Card Guide Slots . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 8. CT-SC040 Front View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 9. CT-SC040 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 10. CT-SC040 Communication Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 11. SC200/220 Enclosures Front View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . Figure 12. SC200/220 Enclosure Back View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . Figure 13. IO Module Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 14. SAS Enclosures Front View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 15. SAS Enclosure Rear View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 16. IO Module Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 17. Rear View of an SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 18. SBOD Ports (4 Gb IO Card) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 19. Enclosure ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 20. Rear View of a SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 21. SATA SCM Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 22. Enclosure ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 23. SAS Disk Numbering, 12-Disk Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 24. SATA/SBOD Disk Numbering (Front View) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 25. Enterprise Plus Drive Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 26. Standard SAS Drive Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 27. Removing a Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 28. Installing a Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 29. Single SC8000 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 30. Single SC8000 Controller, Single SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 31. Single SC8000 Controller, Four SAS Enclosures, Two IO Cards, Two Chains . . . . . . . . . . Figure 32. Dual SC8000 Controllers, One Enclosure, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 33. Dual SC8000 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 34. Dual SC8000 Controllers, Four Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 35. Dual SC8000 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 36. Single CT-SC040 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 37. Single CT-SC040 Controller, Single SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 38. Single CT-SC040 Controller, Four SAS Enclosures, Two IO Cards, Two Chains . . . . . . . . Figure 39. Dual CT-SC040 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 40. Dual CT-SC040 Controllers, Four Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . Figure 41. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . 4 5 7 9 9 10 12 13 14 15 18 19 20 21 22 23 25 26 27 28 29 29 31 32 33 34 35 36 39 40 41 42 43 44 46 47 48 49 50 51 53

Dell Compellent

vii

List of Figures

Figure 42. Single SC8000 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 43. Single SC8000 Controller, Single 6 Gb Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 44. Single SC8000 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains . . . . . . . . . . Figure 45. Dual SC8000 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 46. Dual SC8000 Controllers, Two Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 47. Dual SC8000 Controllers, Four Enclosures, One IO Card, One Chain . . . . . . . . . . . . . . . . . Figure 48. Dual SC8000 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 49. Single CT-SC040 Controller, Single 6 Gb Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 50. Single CT-SC040 Controller, Single 6 Gb Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 51. Single CT-SC040 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains . . . . . . . . Figure 52. Dual CT-SC040 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 53. Dual CT-SC040 Controllers, Two Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . Figure 54. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . Figure 55. Single SC8000 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 56. Single SC8000 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 57. Single SC8000 Controller, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 58. Dual SC8000 Controllers, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 59. Dual SC8000 Controllers, Multiple Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 60. Single CT-SC040 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 61. Single CT-SC040 Controller, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 62. Dual CT-SC040 Controllers, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 63. Dual CT-SC040 Controllers, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 64. Dual CT-SC040 Controllers, Multiple Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 65. Single SC8000 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 66. Single SC8000 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 67. Single SC8000 Controller, Two SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 68. Single SC8000 Controller, Five SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 69. Two SC8000 Controllers, Four SATA Enclosures, Single Loop . . . . . . . . . . . . . . . . . . . . . . Figure 70. Two SC8000 Controllers, Seven SATA Enclosures, Two Loops . . . . . . . . . . . . . . . . . . . . . Figure 71. Single CT-SC040 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 72. Single CT-SC040 Controller, Two SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 73. Single CT-SC040 Controller, Five SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 74. Two CT-SC040 Controllers, Four SATA Enclosures, Single Loop . . . . . . . . . . . . . . . . . . . . Figure 75. Two CT-SC040 Controllers, Seven SATA Enclosures, Two Loops . . . . . . . . . . . . . . . . . . . Figure 76. Dual-Controller FC Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 77. Port WWNs in Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 78. Single Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 79. Dual-Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 80. Single Controller, Single Server, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 81. Single Controller, Multiple Servers, Fibre Channel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 82. Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 83. Front-End Legacy Mode FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 84. Front-End Virtual Ports FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 85. FC Failover, Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 86. FC Failover, Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 87. iSCSI Failover in Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 88. iSCSI Failover with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 89. Single Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 90. Dual Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 91. Single Controller, Single Server, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 92. Single Controller, Single iSCSI Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 93. Single Controller, Multiple Servers, iSCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 94. Single Controller, Multiple Servers, Fibre Channel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 95. Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

55 56 57 58 59 60 62 63 64 65 66 67 69 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 87 88 89 90 91 92 95 97 98 99 100 101 102 103 104 106 107 110 112 113 114 115 115 116 117 118

viii

Storage Center CT-SC040 and SC8000 Connectivity Guide

List of Figures

Figure 96. Front-End Legacy FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 97. Front-End FC with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 98. FC Failover, Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 99. FC Failover, Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 100. iSCSI MPIO in Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 101. iSCSI Failover with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 102. List of Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 103. Configure Local Ports Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 104. Connecting a New SC200/220 SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 105. Connect SC200/220 Enclosures to A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 106. Reconnect SC200/220 A-side Cables to Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 107. Connect SC200/220 Enclosures to B Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 108. Reconnect SC200/220 B-side Cables to Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 109. Adding an SC200/220 SAS Enclosure, Step 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 110. Adding an SC200/220 SAS Enclosure, B side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 111. Disconnecting the SC200/220 Enclosure from the A side . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 112. Reconnecting the SC200/220 A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 113. Disconnecting the SC200/220 Enclosure from the B-side Chain . . . . . . . . . . . . . . . . . . . . Figure 114. Top SC200/220 Enclosure Disconnected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 115. Connecting a New SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 116. Connect Enclosures to A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 117. Reconnect A-side Cables to Controllers A and B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 118. Connect Enclosures to B Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 119. Reconnect B-side Cables to Controllers A and B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 120. Adding a SAS Enclosure, Step 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 121. Adding a SAS Enclosure, B side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 122. Disconnecting the Enclosure from the A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 123. Reconnecting the A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 124. Disconnecting the Enclosure from the B-side Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 125. Top Enclosure Disconnected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 126. Licensed Features Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 127. 4 Gb and 2 Gb Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 128. SBOD and SATA IO Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 129. Connect Controller A to New Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 130. Connect Enclosure 1 to Enclosure 2 (B side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 131. Connect Controller A to Enclosure 2 (A side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 132. Connect Enclosure 1 to Enclosure 2 (A side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

119 120 122 123 125 127 130 131 133 135 136 137 138 139 140 142 143 144 145 147 149 150 151 152 153 154 156 157 158 159 161 162 163 164 165 166 167

Dell Compellent

ix

List of Figures

Storage Center CT-SC040 and SC8000 Connectivity Guide

Introduction

This chapter includes general hardware safety information to protect the installation and basic system information to help understand concepts throughout the manual.

Contents
Safety Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Storage Center Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

Dell Compellent

Chapter 1 Introduction

Safety Considerations
Note: See the safety and regulatory information that shipped with each Storage Center component. Warranty information may be included within this document or as a separate document. If equipment described in the document is used in a manner not specified by Dell Compellent, the protection provided by the equipment may be impaired. For your safety and protection, observe the following rules:

Electrostatic Discharge (ESD)


Observe all conventional ESD precautions when handling plug-in modules and components. Use a suitable ESD wrist or ankle strap. Avoid contact with backplane components and module connectors.

Weight
An enclosure can weigh up to 26 kg (57 lb). Do not lift it without assistance. Do not lift an enclosure by the handles of the Power Cooling Modules (PCMs). They are not designed to hold the weight of the entire enclosure, and the enclosure cover may become bent. Before moving an enclosure, remove the PCMs to minimize weight.

Electrical
Provide a suitable power source with electrical overload protection. All components in the Storage Center must be grounded before applying power. Make sure there is a safe electrical earth connection to power supply cords. Check the grounding before applying power. The plugs on the power supply cords are used as the main disconnect device. Make sure that the socket outlets are located near the equipment and are easily accessible. Do not remove covers from the Power Control Module (PCM). Disconnect the power connection before removing a PCM from the enclosure. Do not remove a faulty PCM unless you have a replacement model of the correct type ready for insertion. A faulty PCM must be replaced with a fully operational module within 24 hours. Permanently unplug the enclosure before you move it or if you think it has become damaged in any way. When powered by multiple AC sources, disconnect all supply power for complete isolation.

Environmental
In order to comply with applicable safety, emission, and thermal requirements, do not remove bay covers from enclosures. Make sure that all bays are populated with plug-in modules. Do not remove bay covers or drives until ready to replace them.

Storage Center CT-SC040 and SC8000 Connectivity Guide

Storage Center Hardware Components

Storage Center Hardware Components


A Dell Compellent Storage Center consists of one or two controllers, switches, and one or more enclosures.

Controller
The Storage Center controller provides the central processing capability for the Storage Center. A Storage Center can be configured with a single controller (single-controller Storage Center) or a pair of controllers (dual-controller Storage Center). Figure 1 on page 4 shows the Storage Center controllers supported by this manual. The supported controllers are: CT-SC040 SC8000

The controller functional specifications are given below. Controllers are described in more detail in Chapter 2 on page 7. IO cards are located inside the controller and provide communication between the server and the storage enclosures. IO cards are described in more detail in Chapter 2 on page 7. In a dual-controller Storage Center configuration, the pair of controllers must be the same controller model. For example, a pair of SC8000 controllers. A dual-controller Storage Center does not support mixed controller models. SC8000
Processor Bus Speed System Cache Cache Card Expansion Slots 2.56 GHz Dual 6 core 1333 MHz 16 GB (expandable to 64 GB) 512 MB, PCIe (Slot 7) Gen 3 PCIe: Three full height, Three low profile 8 Gb 10 Gb 3 Gba, 6 Gb 1 Gb, 10 Gb 14 (Using two 4-port IO cards plus three 2-port IO cards) 12 (Using three 4-port IO cards) 6 168 drives/chain = 1008 48 drives/chain = 288 2U 2 6

CT-SC040
2.53 GHz Quad-Core 1333 MHz 6 GB (expandable to 12 GB) 512 MB, PCIe (Slot 7) Six PCIe, 2.5 GHz

Transport Speeds Fibre Channel FCoE SAS iSCSI Maximum Front-End (FC) Ports

4 Gb, 8 Gb 10 Gb 3 Gb, 6 Gb 1 Gb, 10 Gb 20 (Using five 4-port IO cards) 20 (Using five 4-port IO cards) 10 168 drives/chain = 1680 48 drives/chain = 480 3U 2 5

Maximum Back-End Ports Maximum Back-End SAS Chains Supported Maximum 6 Gb SAS Drives Maximum 3 Gba. SAS Drives Form Factor Power Supplies Fans

a. For SC8000 migrations only: 3 Gb SAS enclosures are supported using a 6 Gb IO Card.

Dell Compellent

Chapter 1 Introduction

CT-SC040 Controller

SC8000 Controller

Figure 1. Dell Compellent Controllers

Switches
Dell Compellent offers Fibre Channel (FC) switches and IO cards as part of the total Storage Center product package. Switches provide robust connectivity to servers, allowing for the use of multiple controllers and redundant transport paths. Cabling between the controller IO cards and switches (and servers) is referred to as front-end connectivity.

Storage Center CT-SC040 and SC8000 Connectivity Guide

Communication Links

Enclosures
Enclosures house and control disks that provide storage. The enclosures are connected directly to controller IO cards, and is referred to as back-end connectivity. New Storage Centers contain 2U-size Serial Attached SCSI (SAS) enclosures. Fibre Channel Switched Bunch of Disks (SBOD) and Serial Advanced Technology Attachment (SATA) enclosures are supported for existing Storage Centers and for controller migrations only (for example, upgrading an existing Storage Center by migrating from a CT-SC040 controller to an SC8000 controller).

Enclosures and connectivity requirements are described in more detail in Chapter 3: Enclosures, on page 17.

Communication Links
A Storage Center controller uses multiple types of communication links for both data transfer and administrative functions.
Fibre Channel Server, 8 Gb Fibre Channel over Ethernet (FCoE) Server, 10 Gb iSCSI, or iSCSI Server, 1 Gb Ethernet

Fibre Channel Switches

Ethernet Switches

Controller

SAS Enclosure* 3 Gb/6 Gb per channel

Ethernet 10 Mb, 100 Mb, 1 Gb

Serial, 115,200 Kbps

* FC Enclosures are supported in CT-SC040 controllers and for SC8000 controller migrations. New systems contain 6 Gb SAS Enclosures.

Figure 2. SC8000 Controller Communication Links

Dell Compellent

Chapter 1 Introduction

Front End
Front-End connectivity provides connections from servers to controllers using either Ethernet (iSCSI) or Fibre Channel switches. Front-End connectivity also supports all replication traffic. See page 3 for specific transport speeds. iSCSI connections provide reads and writes from a server to a controller through an Ethernet switch. Fibre Channel Over Ethernet (FCoE) uses the FCoE protocol for data on the front end for lossless transmission of data. Fibre Channel (FC) connections on the front end are used to provide reads and writes from a server to a controller.

Back End
Back-end connectivity is strictly between the controllers and enclosures. The following protocols are supported to communicate with the enclosures. See page 3 for specific transport speeds. Fibre Channel connections on the back end provide reads and writes to the enclosures for CT-SC040 controllers. Fibre Channel IO cards can be migrated from CT-SC040 controllers to SC8000 controllers. SAS uses a point-to-point switched topology on four lanes. Each lane can perform concurrent IO transactions at 6 Gb/sec. (Transfer speeds for earlier versions are 3 Gb/sec.)

System Administration
The following connections are used for communicating with computers outside of Storage Center: Serial: Used for initial configuration and other service-related tasks. Ethernet: The Ethernet ports on the back of the controller can operate at 10 Mb or 1 Gb (the SC8000 has four ports and the CT-SC040 has two ports). These ports are not used for server or enclosure connectivity, but instead are used internally for: ETH 0 port: configuration, administration, and management of a Storage Center. ETH 1 port: Inter-Process Communications (IPC) between controllers.

iDRAC: For SC8000 controllers, a dedicated 1 Gb Ethernet port provides access to the Integrated Dell Remote Access Controller (iDRAC) for integrated peer controller management.

Storage Center CT-SC040 and SC8000 Connectivity Guide

Controllers

This chapter describes Dell Compellent Controllers including ports, card slots, and buttons and indicators.

Contents
SC8000 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 CT-SC040 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 CT-SC040 Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

SC8000 Controller Front View


The front panel of the controller contains power and reset switches, and an LCD panel that shows system ID, status, and error information.
1 2 3 4 5 6

Figure 3. SC8000 Front View Features and Indicators

Warning: Turning off system power with the power switch removes the main power but keeps standby power supplied to the Storage Center.

Dell Compellent

Chapter 2 Controllers

Item Name
1 2 Power indicator, power button NMI button

Icon Description
The power indicator is illuminated when the system power is on. The power button controls the power supply output to the controller. The non-maskable interrupt button is used to troubleshoot software and device driver errors. For the SC8000, this button is disabled in the BIOS. Used to locate a particular system within a rack. When a System ID button on the front or back panel is pressed, the front LCD panel and the back system status indicator flash until one of the buttons is pressed again. Press to toggle the system ID on and off. If the system stops responding during POST, press and hold the system ID button for more than five seconds to enter BIOS progress mode.

System identification button

4 5 6

Video connector LCD menu buttons LCD panel

Allows you to connect a VGA display to the system. Allows you to navigate the control panel LCD menu (see page 9 for more information). Displays system ID, status information, and system error messages. The LCD lights blue during normal system operation. The LCD lights amber when the system needs attention, and displays an error code followed by descriptive text.

Note: If the system is connected to a power source and an error is detected, the LCD lights amber regardless of whether the system is turned on or off. 7 8 9 vFlash media card slot USB connectors (2) EST panel Not used for the SC8000. Allows you to connect USB devices to the system. The ports are USB 2.0 compliant. A slide-out panel for system information including the Express Service tag, embedded NIC MAC address, and iDRAC7 Enterprise card MAC address.

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Back View

LCD Panel Features


The system's LCD panel provides system information, status, and error messages to signify when the system is operating correctly or when the system needs attention. The LCD backlight lights blue during normal operating conditions and lights amber to indicate an error condition. When the system is in standby mode, the LCD backlight is off and can be turned on by pressing either the Select, Left or Right button on the LCD panel. The LCD backlight will remain off if LCD messaging is turned off through the iDRAC utility, the LCD panel, or other tools.
Left Select Right

Figure 4. LCD Panel

Button
Left Select Right

Description
Moves the cursor back in one-step increments. Selects the menu item highlighted by the cursor. Moves the cursor forward in one-step increments. During message scrolling: Press once to increase scrolling speed. Press again to stop. Press again to return to default scrolling speed. Press again to repeat the cycle.

SC8000 Controller Back View


The SC8000 back view is shown in the following figure.
1 2 2 1 4 3 2 1

1 1 2 3 4 5 6 7

3 IPC

0 2 MGMT 8 9

Figure 5. SC8000 Controller Back View

Item

Control/Feature

Description
Ports are numbered beginning with port 1 on the left. Ports are numbered beginning with port 1 on the right. Cache card (CHA3) is always located in this slot.

Slots 13 Low profile IO card slots Slots 46 Standard profile IO card slots Slot 7 Standard profile cart slot

Dell Compellent

Chapter 2 Controllers

Item
1

Control/Feature
System identification button

Description
Used to locate a particular controller within a rack. When a System ID button on the front or back panel is pressed, the front LCD panel and the back system status indicator flash until one of the buttons is pressed again. Press to toggle the system ID on and off. If the controller stops responding during POST, press and hold the system ID button for more than five seconds to enter BIOS progress mode.

2 3 4 5 6 7

System identification connector iDRAC Serial port Video connector USB connectors Internal Ethernet connectors

Connects the optional system status indicator assembly through the optional cable management arm. Connects to the Ethernet switch in the rack. Connects to the Comtrol Ethernet server by means of serial interface. Connects a monitor to the controller. Connect USB devices to the controller. The ports are USB 2.0 compliant. Connect the controller to the Ethernet switch and to the other controller in the rack. The ports function as follows: Port 1: ETH 110GbE capable, configured for 1GbE. Used for interprocessor communication (IPC) between controllers in a dualcontroller system. Port 0: ETH 01GbE. Management port connects to Ethernet switch for system login, email, alerts, SNMP traps, phone home data, and access for software.

Note: Ports 2 and 3 are not used. 8 9 Power Supply 1 Power Supply 2 Hot-swappable, 750 W AC 100-240 V AC, auto-ranging, 50/60 Hz

NIC Indicator Codes


The following figure shows the indicators on the embedded Ethernet connectors.
Link indicator Activity indicator

Figure 6. NIC Indicator

Feature
Link indicator

Indicator Code
Off: The NIC is not connected to the network. Green: The NIC is connected to a valid network at its maximum port speed (1 Gbps or 10 Gbps). Amber: The NIC is connected to a valid network at less than its maximum port speed. Blinking: Indicates transmit/receive activity Steady: Indicates valid network connection

Activity indicator

10

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Back View

IO Card Slot Priority


Populate the slots as follows, making sure that the cards are seated properly as shown in Figure 7: Install low-profile IO cards in slots 3 through 1. After filling these slots, low-profile cards may be installed in slots 4, 5, and 6 when used with the adaptive bracket. Install full-height IO cards beginning in slot 6, followed by slot 5, then slot 4 if needed. Slot 7 is reserved for the Cache Card. Note: All low-profile IO cards are shipped with an adaptive full-height bracket that must be installed to use the IO card in a slot designed for a full-height IO card. Type
iSCSI iSCSI iSCSI SAS Fibre Channel Fibre Channel Fibre Channel Fibre Channel Fibre Channel FCoE

Card
Chelsio S320E-LP-CR Chelsio S320E-CR* QLogic QLE4062 LSI SAS9201-16E Emulex LPe12004-M8* Emulex LPe12002-M8* QLogic QLE2662 QLogic QLE2562 QLogic QLE2564 Qlogic QLE8152 (with or without an SFP+ transceiver) Dell CHA3

Height

Number of Speed (Gb) Ports


2 2 2 4 4 2 2 2 4 2

Card Slot Priority Priority


10 9 7 2 9 5 3 4 8 6 3, 2, 1, 4, 5 4, 5, 6 3, 2, 1, 4, 5 6, 5, 4 4, 5, 6 3, 2, 1, 4, 5 3, 2, 1, 4, 5, 6 3, 2, 1, 4, 5, 6 4, 5, 6 3, 2, 1, 4, 5

Low profile 10 Full height 10

Low profile 1 Full height Full height 6 8

Low profile 8 Low profile 16 Low profile 8 Full height 8

Low profile 10

Cache card

Full height

n/a

n/a

* These IO cards cannot be ordered for SC8000 controllers. An SC8000 controller can contain these IO cards only if they were transferred to the SC8000 controller during an upgrade from a CT-SC030 or CT-SC040 controller.

Dell Compellent

11

Chapter 2 Controllers

Seating IO Cards Properly


Caution: When installing cards in the SC8000 controller slots, make sure they are fully seated in the guide slots. Cards that are not in full contact with the connector cause unpredictable failures in the Storage Center.

Figure 7. IO Card Guide Slots

12

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Controller Front View

CT-SC040 Controller Front View


Indicators on the front of the controller provide information about the controller status. The power and reset switches are also located on the front panel.
1 2 3 4 5 6 7 8

Figure 8. CT-SC040 Front View Controls and Indicators

Warning: Turning off system power with the power switch removes the main power but keeps standby power supplied to the Storage Center.

Item
1 2 3 4 5 6 7 8

Control/Feature
Power supply failure Overheat and/or fan failure ETH 0 ETH 1 Disk activity AC power Reset button Power button

Description
Illuminated: One of the redundant power supplies has failed. Flashing light: Fan failure Steady light: Overheated condition

Flashing light: Network activity on Ethernet Port 0 (Management port) Flashing light: Network activity on Ethernet Port 1 (IPC) Illuminated: Activity on the bootable Flash Card IO channel Illuminated: AC power is being supplied to the power supplies Resets the controller Applies or turns off controller power.

Dell Compellent

13

Chapter 2 Controllers

CT-SC040 Back View


The CT-SC040 controller can hold up to six PCIe cards. Populate the slots as follows: Insert the Cache Card in Slot 7. Insert IO cards with front-end ports (iSCSI, FCoE) beginning with slot 6 and fill toward slot 1. Insert IO cards with back-end ports (Fibre Channel) beginning with slot 1 and fill toward slot 6. Note: When installing three or more 10 Gb iSCSI IO cards, ensure that slots 1, 2, and 3 are not all populated with the 10 Gb iSCSI card type. Instead place two of the 10 Gb iSCSI cards in slots 1 and 2, and insert the remaining 10 Gb iSCSI card(s) in any slot other than PCI Slot 3.

Slots are numbered from right to left


1 2

Ports are numbered from top to bottom

Cache

2 3 4

Cache card (PCIe)

Front-end IO cards populated left to right

Back-end IO cards populated right to left

Figure 9. CT-SC040 Controller Back View

Item

Control/Feature

Description
Front-end IO cards starting in slot 6, back-end IO cards starting in slot 1 Cache card (CHA3) Two hot-swappable AC power supplies. Two of five shown. See Figure 10 on page 15

Slots 16 Standard profile card slots Slot 7 1 2 3 Standard profile cart slot Power Supplies Fans System/internal communication ports

14

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Back View

CT-SC040 Communication Ports


Communication ports are used for system setup, maintenance, and internal connections between controllers.
1 2 3 4

10

Figure 10. CT-SC040 Communication Ports

Item
1 2 3

Control/Feature
Mouse connector IPMI connector Link activity LED

Description
Connects to mouse or other pointing device Not Used Flickering light: Indicates transmit/receive activity Steady light: Indicated valid network connection

IO speed LED

Amber: 1 Gpbs Green: 100 Mbps No light: 10 Mbps

5 6 7 8 9 10

Disk keyboard connector USB connector COM 1 connector Video connector ETH 0 ETH 1

Connects to external keyboard Connect USB devices to the controller Serial connection to external devices Connects a VGA monitor to the controller. Management port. IPC.

Note: Ethernet ports marked ETH 0 and ETH 1 do not support iSCSI communication; iSCSI connections are supported by PCI-based IO ports on the IO card.

Dell Compellent

15

Chapter 2 Controllers

IO Card Slot Priority


Populate the slots as follows, making sure that the cards are seated properly. Description
iSCSI, 1 Gb, 2 port, Full Height iSCSI, 10 Gb, 2 port, Full Height FCoE, 10 Gb, 2 Port, Full Height FC, 4 Gb, 4 port, Full Height FC, 4 Gb, 2 port, Full Height FC, 8 Gb, 2 port, Low Profile FC, 8 Gb, 4 port, Full Height SAS, 3 Gb, Full Height SAS, 6 Gb, Full Height

Use
Front end Front end Front end Front end/ Back end Front end/ Back end Front end/ Back end Front end/ Back end Back end Back end

Slot Priority
6, 5, 4 6, 5, 4 6, 5, 4 6, 5, 4/ 1, 2, 3 6, 5, 4/ 1, 2, 3 6, 5, 4/ 1, 2, 3 6, 5, 4/ 1, 2, 3 1, 2, 3 1, 2, 3

16

Storage Center CT-SC040 and SC8000 Connectivity Guide

Enclosures

This chapter describes Dell Compellent disk enclosures including disk types, ports, and buttons and indicators.

Contents
SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

Dell Compellent

17

Chapter 3 Enclosures

SC200/220 SAS Enclosures


SAS enclosures hold disks for data storage and connect to the controllers through back-end ports. SAS enclosures are configured to hold either 12-3.5" drives or 24-2.5" drives.

SC200/220 Enclosure Front View


The enclosure front panel provides indicators to show the enclosure status. Insert the enclosure into a rack so that the LED display is on the left side.
1 2 SC200 Enclosure

SC220 Enclosure

Figure 11. SC200/220 Enclosures Front View Controls and Indicators

Item
1

Control/Feature
Enclosure status

Icon

Description
Illuminates when the enclosure power is on: Steady blue: Normal operation Flashing blue: Indicates that Storage Center is identifying the enclosure. Steady amber: Enclosure is turning on or reset. Flashing amber: Enclosure is in fault state.

Power status

Illuminates when at least one power supply is supplying power to the enclosure

18

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

SC200/220 Enclosure Back View


The enclosure back panel provides controls to power up and reset the enclosure, indicators to show the enclosure status, and connections for back-end cabling.
1 2 3

Compellent SC2

Compellent SC2

Figure 12. SC200/220 Enclosure Back View Controls and Indicators Table 1.

Item
1

Control/Feature
PCM status indicator

Icon

Description
Green: Normal operation Amber: Power supply failure Green: Normal operation Amber: Fan failure Green: Normal operation Amber: No AC power

Fan indicator

AC power indicator

4 5 6

Power switch Power Cooling Module (PCM)one of two Enclosure Management Module (EMM)one of two

Controls power for the enclosure Contains fans that provide cooling for the enclosure See Enclosure Management Module (EMM) on page 20

Dell Compellent

19

Chapter 3 Enclosures

Enclosure Management Module (EMM)


SAS enclosures include two EMM IO modules in two interface slots. Each EMM can discover the type and capabilities of its partner EMM within the enclosure. Incompatible configurations result in an enclosure system alarm. The EMM indicators provide status as described below.

Compellent SC2

Figure 13. IO Module Indicators

Item
1

Control/Feature
System status indicator

Icon

Description
Not used on SC200/220 enclosures

Debug port

For engineering use only

SAS port A (in)

Connects to the controller or to other enclosures

Port A link status

Green: All the links to the port are connected Amber: One or more links are not connected Off: Enclosure is not connected

SAS port B (out)

Connects to the controller or to other enclosures

Port B link status

Green: All the links to the port are connected Amber: One or more links are not connected Off: Enclosure is not connected Steady Green: Normal operation Amber: Enclosure did not boot or is not properly configured Flashing Green: Automatic update in process Flashing Amber Twice: Enclosure is unable to communicate with other enclosures Flashing Amber Four Times: Firmware update failed Flashing Amber Five Times: Firmware versions are different between the two EMMs

EMM status indicator

20

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

EN-SASx6x12/24 Enclosures
SAS enclosures hold disks for data storage and connect to the controllers through back-end ports. SAS enclosures are configured to hold either 12-3.5" drives or 24-2.5" drives.

SAS Enclosure Front View


The enclosure front panel provides controls to power up and reset the enclosure and indicators to show the enclosure status. Insert the enclosure into a rack so that the LED display is on the left side.
1 2 3 4 5 EN-SASX6X12 Enclosure

EN-SASX6X24 Enclosure

Figure 14. SAS Enclosures Front View Controls and Indicators

Item
1

Control/Feature
Mute button

Icon

Description
Mutes the alarm

System power indicator

Green: Power is on Amber: Unit is on standby

Module fault indicator

Amber: Enclosure module failure (PCM fault, Fan fault, SSB module fault. Check indicators on individual modules) Amber: Disk drive failure Flashing Amber: Unexpected enclosure ID (Module Fault will also be flashing amber)

Logical fault indicator

LED display

Indicates the enclosure ID numberthis number is set by the software during installation, and matches the Disk ID displayed in the Storage Center System Manager

Dell Compellent

21

Chapter 3 Enclosures

SAS Enclosure Rear View

1 2

5 6

Figure 15. SAS Enclosure Rear View Controls and Indicators

Item
1

Control/Feature
AC power indicator

Icon

Description
Green: Normal operation Amber: No AC power Green: Normal operation Amber: Fan failure Green: Normal operation Amber: Power supply failure Green: Normal operation Amber: No DC power

Fan indicator

PCM status indicator

DC power indicator

5 6 7

Power switch Power Cooling Module (PCM)one of two Storage Bridge Bay (SBB)one of two

Controls power for the enclosure Contains fans that provide cooling for the enclosure See Storage Bridge Bay (SBB) Module on page 23

22

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Storage Bridge Bay (SBB) Module


SAS enclosures include two SBB IO modules in two SBB-compliant interface slots. Each SBB IO Module includes an EEPROM that holds data describing the function and capability of the SBB module. Each SBB module can discover the type and capabilities of its partner SBB module within the enclosure. Incompatible configurations result in an enclosure system alarm. Each port has four separately arbitrated physical lanes. The status of each lane is indicated by a green LED. The IO Module and Fault indicators provide status as described below.
3 Gb Module 1 2 3

6 Gb Module 1 2

Figure 16. IO Module Indicators

Item
1

Control/Feature
IO Module indicator

Icon

Description
On Steady: Normal operation

IO Module fault indicator

On: IO module error

3 4 5

Lane LEDs Controller connection (3 Gb SAS) Controller connection (6 Gb SAS)

Solid Green: Connected, No activity Flashing: Activity

The port with the in/out arrow connects to the controller. The 6 Gb C-port always connects to the controller.

Dell Compellent

23

Chapter 3 Enclosures

SAS 6 Gb and 3 Gb IO Module Comparison


6 Gb IO Module Enclosure Compatibility Drive Configuration Drive Speed
6 Gb controller IO card Other 6 Gb enclosures 3.5" 12-drive enclosure 2.5" 24-drive enclosure 3 Gb or 6 Gb drives Note: A 6 Gb drive in a 3 Gb enclosure can transfer data at no more than 3 Gigabits per second Labeled SAS but speed is not indicated Input port: Arrow pointing toward a port Output port: Arrow pointing away from the port Either In or Out: Double-arrow

3 Gb IO Module Enclosure
3 Gb controller IO card Other 3 Gb enclosures

3.5" 12-drive enclosure

3 Gb or 6 Gb drives Note: A 3 Gb drive in a 6 Gb enclosure can transfer data at no more than 3 Gigabits per second.

Speed Indicator Labeled 6 Gb SAS IO


Input port: A Output port: B Either In or Out: C

Controller Connection Number of Drives

Port C

Double arrow

Each cabling side can contain up to 14 IO Each cabling side can contain up to four IO Modules in the chain, which creates a maximum Modules in the chain, which creates a limit of 14 enclosures. maximum limit of four enclosures If all 14 enclosures are fully populated the maximum number of drives is 168 per chain. If all four enclosures are fully populated with 2.5 drives, the maximum number of drives is 96 per chain

24

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

SBOD Enclosures
Switched Bunch of Disk (SBOD) enclosures connect using two SBD modules. The SBOD enclosures are internally connected using a Switched Fabric architecture, in which data can be distributed directly to each disk. This architecture supports up to seven SBOD enclosures on a loop. SBOD can NOT coexist on a loop with a SATA enclosure One loop can contain a maximum of seven SATA enclosures An SBOD enclosure can contain only Fibre Channel drives
On/Off Switch SBD Modules Enclosure ID Switch

DIP Switches

On/Off Switch

Figure 17. Rear View of an SBOD Enclosure

Dell Compellent

25

Chapter 3 Enclosures

SBOD IO Modules
An SBOD IO module has four ports. Ports on the right IO Modules are numbered Host 0, Host 1, Host 2, and Host 3 from top to bottom. Ports on the left are numbered Host 3, Host 2, Host 1, and Host 0 from top to bottom. Host 0 is the input port, Host 1 is the output port.

Host 0 Input Port Host 1 Output Port

Host 0

Host 3

Host 2

Host 2 and Host 3 are not used

Host 1 Output Port Host 0 Input Port

Host 0

Host 1

Figure 18. SBOD Ports (4 Gb IO Card)

26

RS232

RS232

Host 1 Host 2 Host 3

Host 2 and Host 3 are not used

Speed Indicator

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

SBOD Port ID
Each enclosure on a fibre channel loop must have a unique ID number. Set the enclosure ID to a unique number from 17 using the Enclosure ID switch. New/changed ID settings are read only at power up, so cycle power on the enclosure to implement the changed setting. Note: Duplicate enclosure ID numbers are one of the most common configuration errors.

Enclosure Speed
SBOD enclosures are shipped set to 4 Gb, so by default only 4 Gb drives can be used. In addition: If a 2 Gb drive is installed in a 4 Gb enclosure, the drive goes into bypass mode and is not recognized by the system. A 2 Gb enclosure can be changed to 4 Gb by changing the DIP switches. If the disks on a loop are configured at 2 Gb, change the enclosure DIP switches to the 2 Gb setting as shown in Figure 19. 4 Gb enclosures can only exist in their own loop. Small form plugable transceivers (SFPs) can only be used in 4 Gb enclosures. The controller IO cards must be 4 Gb type.
4 Gb Switch Mode 2 Gb Switch Mode

Change From 2 Gb to 4 Gb Mode


Change the speed setting of the enclosure to 4 Gb. 1 Set switch 7 from On to Off. 2 Set Switch 8 from Off to On. All other switches remain in their default settings.

DIP Switches

1 2 3 4 5 6 7 8 9 10 11 12

1 2 3 4 5 6 7 8 9 10 11 12

Key:

DIP Switch set to ON DIP Switch set to OFF

Figure 19. Enclosure ID Switch

Dell Compellent

27

Chapter 3 Enclosures

SATA Enclosures
SATA disk enclosures support Fibre Channel connectivity to the controller and other enclosures. SATA disks are internally connected by an Arbitrated Loop, and all disks share resources on the Fibre Loop. This means that to write to the target disk, the communication path must go through all preceding disks, which limits the maximum number of SATA enclosures on a loop to five. SATA can not coexist on a loop with an SBOD enclosure SATA can coexist on a loop with a JBOD enclosure One loop can contain a maximum of five (5) SATA enclosures
On/Off Switch Service Control Modules (SCMs) Enclosure ID Switch

DIP Switches

On/Off Switch

Figure 20. Rear View of a SATA Enclosure

Note: When installing an enclosure into the rack, make sure that it is oriented so that the DIP switches are located at the bottom.

28

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

SATA Service Control Modules (SCMs)


SATA enclosures are connected to the system through the blue ports in the SCM. Arrows pointing toward the port opening are input ports. Arrows pointing away from the port opening are output ports. Dell Compellent supports up to five SATA enclosures per FC loop in a Storage Center system.

Output Port: Arrow points away from port Input Port: Arrow points toward port

Input Port: Arrow points toward port

Output Port: Arrow points away from port

Figure 21. SATA SCM Ports

Note: SATA uses arrows to indicate data transmission direction. Always use the blue ports.

SATA Enclosure ID
Each enclosure on a FC loop must have a unique ID number. Set the enclosure ID to a unique number from 1 to 7 using the Enclosure ID switch. New/changed ID settings are read only at system power up, so if changes are made, the entire system needs to be restarted. Note: Incorrectly numbered enclosures are one of the most common configuration errors.

Invalid Address LED

Power On LED

Alarm Mute Switch System Fault LED Hub Mode (not used)
1

1
2 3 4 5 6 7 8 9 10 11 12

Enclosure ID Switch Power/Temp Fault LED 2 Gb Link Speed LED

DIP Switches On Off

Figure 22. Enclosure ID Switch

Dell Compellent

29

Chapter 3 Enclosures

Disk Drives
Consolidate drives into as few enclosures as possible. Because drives are massed into a virtual pool of storage, the exact location of a drive is not important. Caution: Always fill every slot in the enclosure, either with a disk or with an empty carrier. Operating a Storage Center with any modules missing disrupts airflow, which prevents the drives from being cooled sufficiently. Observe the following guidelines for handling drives: Insert an empty drive carrier in each unused drive bay to maintain a balanced airflow. Protect the drive from static discharge. Keep each drive in its protective packing container until ready to install. Always wear a grounded wrist or ankle strap. Install one drive at a time. Handle the drives by the edges of the frames. Handle drives with care, being careful not to drop or jar the drive.

Disk Drive Speeds


Storage Center enclosures support 7200 RPM, 10,000 RPM, 15,000 RPM, and Enterprise Solid State Drive (ESSD) drives. Drive speeds supported in each enclosure are given below. Enclosure Type
SC200/220 SASa EN-SASx6x12/24 SATA SBOD

7.2K

10K

15K

ESSD

a. SC200/220 enclosures support only Dell Enterprise Plus drives.

Caution: Populating drives of different spindle rates (7.2K, 10K, or 15K) in the same column creates vibration that can slow IO and possibly produce errors. Make sure that each column contains drives of the same spindle rate.

30

Storage Center CT-SC040 and SC8000 Connectivity Guide

Disk Drives

SAS Disk Locations


SAS enclosures may contain up to 24 drives installed vertically side by side, or may hold up to 12 drives installed horizontally in a four-column, three-row configuration. Note: Dell Enterprise Plus drives can only be installed in SC200/220 enclosures. In a 24-disk enclosure, disks are installed vertically, and are numbered from left to right. SC220 enclosure disks begin with drive 0. EN-SASx6x24 enclosure disks begin with drive 1.

In a 12-disk enclosure, disk drives are installed horizontally, and are numbered as shown in Figure 23.
SC200 Enclosure Disk 0 Disk 4 Disk 8 Disk 1 Disk 5 Disk 9 Disk 2 Disk 6 Disk 10 Disk 3 Disk 7 Disk 11

EN-SASx6x12 Enclosure Disk 1 Disk 5 Disk 9 Disk 2 Disk 6 Disk 10 Disk 3 Disk 7 Disk 11 Disk 4 Disk 8 Disk 12

Figure 23. SAS Disk Numbering, 12-Disk Enclosure

When installing drives into the 12-disk enclosure, make sure that all drives in a column are of the same spindle rate as shown in the example below. Column 1 Row 1 Row 2 Row 3
7.2K 7.2K 7.2K

Column 2
15K 15K 15K

Column 3
10K 10K 10K

Column 4
15K 15K 15K

Enterprise Solid State Drives (ESSDs)


When present, ESSDs are automatically assigned to Tier 1 by the Storage Center System Manager. These drives can only be used in SC200/220 SAS enclosures. Because solid state drives do not spin, they can be inserted in any column.

Dell Compellent

31

Chapter 3 Enclosures

SBOD and SATA Disk Locations


SBOD and SATA enclosures support up to 16 disks. Disks are accessed from the front and are numbered 116, starting with the upper left disk and ending with the lower right disk as shown in Figure 24. Install drives in columns, starting with the outer columns first. Make sure that all drives in a column are of the same spindle rate. There must be a spinning disk in position 1 and in position 16 in every active enclosure. If an enclosure contains fewer than 16 drives, insert an empty drive carrier into the unused slots to preserve the cooling air flow.

Enterprise Solid State Drives (ESSDs)


When present, ESSDs are automatically assigned to Tier 1 by the Storage Center System Manager. These drives can be located only in slots 2 through 15 and can only be used in 4 Gb enclosures. Because solid state drives do not spin, they can be inserted in any column, other than the first and last drive slots as mentioned above. Caution: Drives of different spindle rates (7.2K, 10K, or 15K) installed in the same column cause vibrations that can slow IO and possibly produce errors. Make sure that each column contains drives of the same spindle rate.

Disk 1 Disk 5 Disk 9 Disk 13

Disk 2 Disk 6 Disk 10 Disk 14

Disk 3 Disk 7 Disk 11 Disk 15

Disk 4 Disk 8 Disk 12 Disk 16

Figure 24. SATA/SBOD Disk Numbering (Front View)

32

Storage Center CT-SC040 and SC8000 Connectivity Guide

Disk Drives

Enterprise Plus Drives


Enterprise Plus Drives can only be installed in SC200/220 enclosures. Drives are installed either vertically (SC220) or horizontally (SC200) in the enclosure. Indicators give status and activity information as described below.
1 2

2 1

Figure 25. Enterprise Plus Drive Indicators

Item
1 2

Control/Feature
Hard drive activity indicator

Description
Flashing green: Indicates drive activity Steady green: Indicates no drive activity Steady green: Normal operation Off: No power to the drive Flashes amber four times per second: Drive failed

Hard drive status indicator

Dell Compellent

33

Chapter 3 Enclosures

Standard SAS Drives


Standard SAS drives can only be installed in EN-SASx6x12/24 enclosures. Drives are installed either vertically or horizontally in the enclosure. Indicators give status and activity information as described below.
3 4 1

Figure 26. Standard SAS Drive Indicators

Item
1 2

Control/Feature
Amber LED Green LED

Description
Off: No drive, or drive is operating On: Drive fault Green: Connected, No activity Flashing: Activity Red: Locked Black: Unlocked

3 4

Anti-tamper Indicator (when present) Lock (when present)

Insert key or T10 Torx driver and turn to lock/unlock

34

Storage Center CT-SC040 and SC8000 Connectivity Guide

Disk Drives

Removing Disks
Failed disks may be removed without system downtime. The following instructions show removal of a Dell Enterprise Plus drive from a 24-disk enclosure. Other drive and carrier models are removed in a similar manner.

Figure 27. Removing a Disk

1 Press the release button. 2 Open the hard drive carrier. 3 Slide the drive out until it is free of the hard drive bay.

Dell Compellent

35

Chapter 3 Enclosures

Installing Disks
The following instructions show installation of the Dell Enterprise Plus drive into a 24-disk enclosure. Dell Enterprise Plus drives can only be installed in SC200/220 enclosures, however other drive and carrier models are installed in a similar manner.

Figure 28. Installing a Disk

1 Insert the hard drive carrier into the hard drive bay. 2 Slide the drive into the bay until the carrier contacts the backplane. 3 Close the hard drive carrier handle to lock the hard drive in place. 4 Continue to push firmly until you hear a click and the handle fully engages.

36

Storage Center CT-SC040 and SC8000 Connectivity Guide

Back End Cabling

This chapter describes how to connect Dell Compellent controllers to Dell Compellent enclosures.

Contents
SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

SC200/220 SAS Enclosures


Redundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). Each enclosure chain begins with an initiator port on the IO Card and ends with a target port on the IO Card to provide a complete communications path. Controller ports 1 and 2 on SAS IO Cards function as initiator ports, and ports 3 and 4 are considered target ports. The A side of a chain starts at port 1 (initiator) and lands on the A port of the SAS enclosure (target). Enclosures are connected from B port to A port, using the top Enclosure Management Module (EMM). The B side of an enclosure chain connects enclosure ports B to A on the bottom EMM. The enclosure chain is completed by connecting port A on the bottom EMM to port 3 (target) of the SAS IO Card.

Cabling Best Practices


To isolate errors, cable one enclosure chain and then set up Storage Center (as described in the Storage Center System Setup Guide) before you cable the second chain. After cabling each enclosure chain, check the number of targets in the System Manager Configure Local Ports window, as described in Configure Local Ports on page 131. Make sure that each enclosure chain contains no more that 14 enclosures. Enclosure chains that exceed 14 enclosures will generate a Critical warning in the System Manager and to Dell Technical Support. Make sure that each enclosure chain contains no more than 168 drives. Make sure that cables are labeled at each end. If not, apply labels as directed in the SC8000 Cable Labeling Guide included in the cable package.

Dell Compellent

37

Chapter 4 Back End Cabling

Direct-Connect IPC for Dual-Controller, Single Chain Configurations


Direct-connect IPC provides redundancy for dual-controller Storage Centers that have only one SAS back-end enclosure chain. It is not intended to improve system performance. Extra IO cards are not needed to support a Direct-connect IPC connection. If the Storage Center is configured correctly and IPC is required, add cabling between the initiator and target ports on the controllers. In dual-controller Storage Centers, extra cables are provided for this path.

For Dual-Controller, Single Enclosure Chain


IPC Direct Connect is required. Connect two SAS cables between initiator and target ports on the controllers, and set the port Purpose: 1 Controller A: IO Card port 2 (initiator) Controller B: IO Card port 4 (target). 2 Controller B: IO Card port 2 (initiator) Controller A: IO Card port 4 (target). 3 In the Configure Local Ports wizard, set each port Purpose to Unknown.

For Dual-Controller, Multiple Enclosure Chain


If two or more enclosure chains exist, IPC Direct Connect is optional. Note: It is acceptable to have open ports on SAS IO cards. For additional redundancy, you may connect a SAS cable between initiator and target ports on the two controllers, but this is not necessary.

SC8000 Controller Cabling


This section shows common cabling between the SC8000 controller and SC200/220 SAS enclosures. Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager and visible in the LED display. The System Manager assigns an Index number only after the system is powered up and at least one drive is assigned to a Disk Folder. For more information about assigning disks to a disk folder, see the Storage Center System Setup Guide.

38

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Single SC8000 Controller, Single Enclosure


Figure 29 illustrates an SC8000 controller cabled to a 6 Gb SAS enclosure. A side Controller: slot 6, port 1 Enclosure: top, port A. B side Controller: slot 6, port 3 Enclosure: bottom, port A.
4 3 2 1

A A

B B

Figure 29. Single SC8000 Controller, Single SAS Enclosure

Dell Compellent

39

Chapter 4 Back End Cabling

Single SC8000 Controller, Four Enclosures, Single Chain


Figure 30 illustrates a single SC8000 controller cabled to four SAS enclosures. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. A side: 1 Controller: slot 6, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Enclosure 3: top, port A. 4 Enclosure 3: top, port B Enclosure 4: top, port A. B side: 1 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 2 Enclosure 2: bottom, port B Enclosure 3: bottom, port A. 3 Enclosure 3: bottom, port B Enclosure 4: bottom, port A. 4 Enclosure 4: bottom, port B Controller: slot 6, port 3.
Controller
4 3 2 1

Enclosure 1

A A

B B

Enclosure 2

A A
Enclosure 3

B B

A A

B B

Enclosure 4

A A

B B

Figure 30. Single SC8000 Controller, Single SAS Chain

40

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Single SC8000 Controller, Four Enclosures, Two IO Cards, Two Chains


Figure 31 illustrates a single SC8000 controller cabled to four SAS enclosures in two chains. When cabling a second chain of enclosures, use a second IO card to improve redundancy. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. A side, Chain 1 1 Controller: slot 6, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. B side, Chain 1 1 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 2 Enclosure 2: bottom, port B Controller: slot 5, port 3. A side, Chain 2 1 Controller: slot 6, port 3 Enclosure 3: top, port A. 2 Enclosure 3: top, port B Enclosure 4: top, port A. B side, Chain 2 1 Enclosure 3: bottom, port B Enclosure 4: bottom, port A. 2 Enclosure 4: bottom, port B Controller slot 5, port 1.
Controller
4 3 2 1 4 3 2 1

Enclosure 1 A A B B

Enclosure 2 A A Enclosure 3 A A B B B B

Enclosure 4 A A B B

Figure 31. Single SC8000 Controller, Four SAS Enclosures, Two IO Cards, Two Chains

Dell Compellent

41

Chapter 4 Back End Cabling

Dual SC8000 Controllers, One Enclosure, Single Chain


Figure 32 illustrates two SC8000 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. Note: In a single-chain configuration, use SAS ports 2 (initiator) and 4 (target) to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown. IPC Connection 1 Controller A: slot 6, port 2 Controller B: slot 6, port 4. 2 Controller B: slot 6, port 2 Controller A: slot 6, port 4. A side 1 Controller A: slot 6, port 1 Enclosure: top, port A. 2 Enclosure: top, port B Controller B: slot 6, port 3. B side 1 Controller B: slot 6, port 1 Enclosure: bottom, port A. 2 Enclosure: bottom, port B Controller A: slot 6, port 3.
Controller A
4 3 2 1

Controller B

Enclosure A A B B

Figure 32. Dual SC8000 Controllers, One Enclosure, One Chain

42

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Dual SC8000 Controllers, Two Enclosures, Single Chain


Figure 33 illustrates two SC8000 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. Note: In a single-chain configuration, use SAS ports 2 (initiator) and 4 (target) to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown. IPC Connection 1 Controller A: slot 6, port 2 Controller B: slot 6, port 4. 2 Controller B: slot 6, port 2 Controller A: slot 6, port 4. A side 1 Controller A: slot 6, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Controller B: slot 6, port 3. B side 1 Controller B: slot 6, port 1 Enclosure 1: bottom, port A. 2 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 3 Enclosure 2: bottom, port B Controller A: slot 6, port 3.
Controller A

Controller B

Enclosure 1 A A B B

Enclosure 2 A A B B

Figure 33. Dual SC8000 Controllers, Two Enclosures, One Chain

Dell Compellent

43

Chapter 4 Back End Cabling

Dual SC8000 Controllers, Four Enclosures, Two Chains


Figure 34 illustrates two SC8000 controllers cabled to two 6 Gb enclosures. Each enclosure is on a separate chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. When two chains are used, IPC is optional. A side, Chain 1 1 Controller A: slot 6, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Controller B: slot 6, port 3. B side, Chain 1 1 Controller B: slot 5, port 1 Enclosure 1: bottom, port A. 2 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 3 Enclosure 2: bottom, port B Controller A: slot 5, port 3. A side, Chain 2 1 Controller A: slot 6, port 3 Enclosure 3: top, port A. 2 Enclosure 3: top, port B Enclosure 4: top, port A. 3 Enclosure 4: top, port B Controller B: slot 6, port 1. B side, Chain 2 1 Controller B: slot 5, port 3 Enclosure 3: bottom, port A. 2 Enclosure 3: bottom, port B Enclosure 4: bottom, port A. 3 Enclosure 4: bottom, port B Controller A: slot 5, port 1.
Enclosure 4
A A B B

Controller A

3 2 1

4 3 2 1

Controller B

4 3 2 1

4 3 2 1

Enclosure 1
A A B B

Enclosure 2
A A B B

Enclosure 3
A A B B

Figure 34. Dual SC8000 Controllers, Four Enclosures, Two Chains

44

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Dual SC8000 Controllers, Eight Enclosures, Two Chains


To add redundancy with multiple IO cards, add a second SAS IO card. Create the A-side chain on the IO card in slot 6 and create the B-side chain on the IO card in slot 5. If an IO card, cable, enclosure, or controller fails, at least one side of a loop continues operating. IPC is optional in this configuration. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. Refer to Figure 35 on page 46 for cable connections. 1 (Optional) Create IPC connections between both controllers on ports 2 and 4 of each IO card. 2 A side, Chain 1: Controller A: slot 6, port 1 Enclosure 1: top, port A. a Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B next enclosure down: top, port A. b Finish with Enclosure 4: top, port B Controller B: slot 6, port 3. 3 B side, Chain 1: Controller A: slot 5, port 3 Enclosure 4: bottom, port B. a Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port A next enclosure up: bottom, port B. b Finish with Enclosure 1: bottom, port A Controller B: slot 5, port 1. 4 A side, Chain 2: Controller A: slot 6, port 3 Enclosure 5: top, port A. a Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B next enclosure down: top, port A. b Finish with Enclosure 8: top, port B Controller B: slot 6, port 1. 5 B side, Chain 2: Controller A: slot 5, port 1 Enclosure 8: bottom, port B. a Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port A next enclosure up: bottom, port B. b Finish with Enclosure 5: bottom, port A Controller B: slot 5, port 3.

Dell Compellent

45

Chapter 4 Back End Cabling

Controller A

4 3 2 1

3 2 1

Controller B

4 3 2 1

4 3 2 1

Enclosure 1 A A B B

Enclosure 5 A A B B

Enclosure 2 A A Enclosure 3 A A B B B B

Enclosure 6 A A Enclosure 7 A A B B B B

Enclosure 4 A A B B

Enclosure 8 A A B B

Figure 35. Dual SC8000 Controllers, Eight Enclosures, Two Chains

46

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

CT-SC040 Controller Cabling


This section shows common cabling between the CT-SC040 controller and SC200/220 SAS enclosures. Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager.

Single CT-SC040 Controller, Single Enclosure


Figure 36 illustrates an CT-SC040 controller cabled to a 6 Gb SAS enclosure. A side Controller: slot 1, port 1 Enclosure: top, port A. B side Controller: slot 1, port 3 Enclosure: bottom, port A.
1 2 3 4

A A

B B

Figure 36. Single CT-SC040 Controller, Single SAS Enclosure

Dell Compellent

47

Chapter 4 Back End Cabling

Single CT-SC040 Controller, Four Enclosures, Single Chain


Figure 37 illustrates a single CT-SC040 controller cabled to four SAS enclosures. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. A side: 1 Controller: slot 1, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Enclosure 3: top, port A. 4 Enclosure 3: top, port B Enclosure 4: top, port A. B side: 1 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 2 Enclosure 2: bottom, port B Enclosure 3: bottom, port A. 3 Enclosure 3: bottom, port B Enclosure 4: bottom, port A. 4 Enclosure 4: bottom, port B Controller: slot 1, port 3.
Controller
1 2 3 4

Enclosure 1

A A

B B

Enclosure 2

A A
Enclosure 3

B B

A A

B B

Enclosure 4

A A

B B

Figure 37. Single CT-SC040 Controller, Single SAS Chain

48

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Single CT-SC040 Controller, Four Enclosures, Two IO Cards, Two Chains


Figure 38 illustrates a single CT-SC040 controller cabled to four SAS enclosures in two chains. When cabling a second chain of enclosures, use a second IO card to improve redundancy. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. A side, Chain 1 1 Controller: slot 1, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. B side, Chain 1 1 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 2 Enclosure 2: bottom, port B Controller: slot 2, port 3. A side, Chain 2 1 Controller: slot 1, port 3 Enclosure 3: top, port A. 2 Enclosure 3: top, port B Enclosure 4: top, port A. B side, Chain 2 1 Enclosure 3: bottom, port B Enclosure 4: bottom, port A. 2 Enclosure 4: bottom, port B Controller slot 2, port 1.
Controller
1 2 3 4

Enclosure 1 A A B B

Enclosure 2 A A Enclosure 3 A A B B B B

Enclosure 4 A A B B

Figure 38. Single CT-SC040 Controller, Four SAS Enclosures, Two IO Cards, Two Chains

Dell Compellent

49

Chapter 4 Back End Cabling

Dual CT-SC040 Controllers, Two Enclosures, Single Chain


Figure 39 illustrates two CT-SC040 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. Note: In a single-chain configuration, use SAS ports 2 (initiator) and 4 (target) to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown. IPC Connection 1 Controller A: slot 1, port 2 Controller B: slot 1, port 4. 2 Controller B: slot 1, port 2 Controller A: slot 1, port 4. A side 1 Controller A: slot 1, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Controller B: port 3. B side 1 Controller B: slot 1, port 1 Enclosure 1: bottom, port A. 2 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 3 Enclosure 2: bottom, port B Controller A: slot 1, port 3.
Controller A
1 2 3 4

Controller B
1 2 3 4

Enclosure 1 A A B B

Enclosure 2 A A B B

Figure 39. Dual CT-SC040 Controllers, Two Enclosures, One Chain

50

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Dual CT-SC040 Controllers, Four Enclosures, Two Chains


Figure 40 illustrates two CT-SC040 controllers cabled to two 6 Gb enclosures. Each enclosure is on a separate chain. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. When two chains are used, IPC is optional. A side, Chain 1 1 Controller A: slot 1, port 1 Enclosure 1: top, port A. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Controller B: slot 1, port 3. B side, Chain 1 1 Controller B: slot 2, port 1 Enclosure 1: bottom, port A. 2 Enclosure 1: bottom, port B Enclosure 2: bottom, port A. 3 Enclosure 2: bottom, port B Controller A: slot 2, port 3. A side, Chain 2 1 Controller A: slot 1, port 3 Enclosure 3: top, port A. 2 Enclosure 3: top, port B Enclosure 4: top, port A. 3 Enclosure 4: top, port B Controller B: slot 1, port 1. B side, Chain 2 1 Controller B: slot 2, port 3 Enclosure 3: bottom, port A. 2 Enclosure 3: bottom, port B Enclosure 4: bottom, port A. 3 Enclosure 4: bottom, port B Controller A: slot 2, port 1.
Enclosure 4
A A B B

Controller A
1 2 3 4

Controller B
1 2 3 4

Enclosure 1
A A B B

Enclosure 2
A A B B

Enclosure 3
A A B B

Figure 40. Dual CT-SC040 Controllers, Four Enclosures, Two Chains

Dell Compellent

51

Chapter 4 Back End Cabling

Dual CT-SC040 Controllers, Eight Enclosures, Two Chains


To add redundancy with multiple IO cards, add a second SAS IO card. Create the A-side chain on the IO card in slot 1 and create the B-side chain on the IO card in slot 2. If an IO card, cable, enclosure, or controller fails, at least one side of a loop continues operating. IPC is optional in this configuration. Follow the rules specified in Cabling Best Practices on page 37 when connecting to SAS enclosures. Refer to Figure 41 on page 53 for cable connections. 1 (Optional) Create IPC connections between both controllers on ports 2 and 4 of each IO card. 2 A side, Chain 1: Controller A: slot 1, port 1 Enclosure 1: top, port A. a Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B next Enclosure down: top, port A. b Finish with Enclosure 4: top, port B Controller B: slot 1, port 3. 3 B side, Chain 1: Controller A: slot 2, port 3 Enclosure 4: bottom, port B. a Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port A next Enclosure up: bottom, port B. b Finish with Enclosure 1: bottom, port A Controller B: slot 2, port 1. 4 A side, Chain 2: Controller A: slot 1, port 3 Enclosure 5: top, port A. a Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B next Enclosure down: top, port A. b Finish with Enclosure 8: top, port B Controller B: slot 1, port 1. 5 B side, Chain 2: Controller A: slot 2, port 1 Enclosure 8: bottom, port B. a Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port A next Enclosure up: bottom, port B. b Finish with Enclosure 5: bottom, port A Controller B: slot 2, port 3.

52

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC200/220 SAS Enclosures

Controller A
1 2 3 4

1 2 3 4

Controller B

Enclosure 1 A A B B

Enclosure 5 A A B B

Enclosure 2 A A B B

Enclosure 6 A A Enclosure 7 A A B B A A B B B B

Enclosure 3

Enclosure 4 A A B B

Enclosure 8 A A B B

Figure 41. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains

Dell Compellent

53

Chapter 4 Back End Cabling

EN-SASx6x12/24 Enclosures
Redundant cabling in Storage Center ensures that in the event one controller, IO card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). Each enclosure chain begins with an initiator port on the IO Card and ends with a target port on the IO Card to provide a complete communications path. Controller ports 1 and 2 on SAS IO Cards function as initiator ports, ports 3 and 4 are considered target ports. The A side of a chain starts at port 1 (initiator) and lands on the C port of the SAS enclosure (target). Enclosures are connected from B port to A port, using the top Storage Bridge Bay (SBB). The B side of an enclosure chain connects enclosure ports B to A on the bottom SBB. The enclosure chain is completed by connecting port C on the bottom SBB to port 3 (target) of the SAS IO Card.

This section provides cabling information for SASx6x12 and SASx6x24 enclosures to the following controllers: SC8000 Controller Cabling begins on page 55 CT-SC040 Controller Cabling begins on page 63

Cabling Best Practices


To isolate errors, cable one enclosure chain and then set up Storage Center (as described in the Storage Center System Setup Guide) before you cable the second chain. After cabling each enclosure chain, check the number of targets in the System Manager Configure Local Ports wizard, as described in Configure Local Ports on page 131. 3 Gb versus 6 Gb enclosures: Storage Centers sold with SC8000 controllers contain 6 Gb SAS enclosures. 3 Gb SAS enclosures are only used when a CT-SC040 controller with 3 Gb SAS enclosures is migrated to an SC8000 controller. In this case the 3 Gb enclosure is supported by a 6 Gb IO card. Make sure that 3 Gb and 6 Gb enclosures are connected on separate enclosure chains. Make sure that 3 Gb and 6 Gb enclosures are connected to separate IO cards. Make sure that each 6 Gb enclosure chain contains no more than 168 drives. Make sure that each 3 Gb enclosure chain contains no more than 48 drives.

Make sure that each enclosure chain contains no more that 14 enclosures. Enclosure chains that exceed 14 enclosures will generate a critical warning in the System Manager and to Dell Technical Support Services.

Direct-Connect IPC for Dual-Controller, Single-Chain Configurations


Direct-Connect IPC provides redundancy for dual-controller Storage Center that have only one SAS back-end enclosure chain. It is not intended to improve system performance. Extra IO cards are not needed to support a Direct-Connect IPC connection. If the Storage Center is configured correctly and IPC is required, add cabling between the initiator and target ports on the controllers. In dual-controller Storage Centers, extra 0.5 meter cables are provided for this path.

54

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

For Dual-Controller, Single-Enclosure Chain


IPC Direct Connect is required. Connect two SAS cables between initiator and target ports on the controllers, and set the port Purpose: 1 Controller A: IO Card port 2 (initiator) Controller B: IO Card port 4 (target). 2 Controller B: IO Card port 2 (initiator) Controller A: IO Card port 4 (target). 3 In the Configure Local Ports wizard, set each port Purpose to Unknown.

For Dual-Controller, Multiple-Enclosure Chain


If two or more enclosure chains exist, IPC Direct Connect is optional. Note: It is acceptable to have open ports on SAS IO cards. For additional redundancy, you may connect a SAS cable between initiator and target ports on the two controllers, but this is optional.

SC8000 Controller Cabling


This section describes cabling for the SC8000 controller and SAS enclosures. Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager and visible in the LED display. The System Manager assigns an Index number only after the system is powered up and at least one drive is assigned to a Disk Folder. For more information about assigning disks to a disk folder, see the Storage Center System Setup Guide.

Single SC8000 Controller, Single Enclosure


Figure 42 illustrates an SC8000 controller cabled to a 6 Gb SAS enclosure. A side Controller: slot 6, port 1 Enclosure: top, port C. B side Controller: slot 6, port 3 Enclosure: bottom, port C.

Figure 42. Single SC8000 Controller, Single SAS Enclosure

Dell Compellent

55

Chapter 4 Back End Cabling

Single SC8000 Controller, Four Enclosures, Single Chain


Figure 43 illustrates a single SC8000 controller cabled to four 6 Gb enclosures. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. A side: 1 Controller: slot 6, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Enclosure 3: top, port A. 4 Enclosure 3: top, port B Enclosure 4: top, port A. B side: 1 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 2 Enclosure 2: bottom, port A Enclosure 3: bottom, port B. 3 Enclosure 3: bottom, port A Enclosure 4: bottom, port B. 4 Enclosure 4: bottom, port C Controller: slot 6, port 3.
Controller

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Figure 43. Single SC8000 Controller, Single 6 Gb Chain

56

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Single SC8000 Controller, Four Enclosures, Two IO Cards, Two Chains


Figure 44 illustrates a single SC8000 controller cabled to four SAS enclosures in two chains. When you add a second chain, you should also have a second IO card in the controller. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. A side, Chain 1 1 Controller: slot 6, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. B side, Chain 1 1 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 2 Enclosure 2: bottom, port C Controller: slot 5, port 3. A side, Chain 2 1 Controller: slot 6, port 3 Enclosure 3: top, port C. 2 Enclosure 3: top, port B Enclosure 4: top, port A. B side, Chain 2 1 Enclosure 3: bottom, port A Enclosure 4: bottom, port B. 2 Enclosure 4: bottom, port C Controller slot 5, port 1.
Controller
4 3 2 1 4 3 2 1

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Figure 44. Single SC8000 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains

Dell Compellent

57

Chapter 4 Back End Cabling

Dual SC8000 Controllers, Two Enclosures, Single Chain


Figure 45 illustrates two SC8000 controllers cabled to two 6 Gb enclosures forming a single chain. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. Note: In a single-chain configuration, use SAS ports 2 and 4 to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown. IPC Connection 1 Controller A: slot 6, port 2 Controller B: slot 6, port 4. 2 Controller B: slot 6, port 2 Controller A: slot 6, port 4. A side 1 Controller A: slot 6, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port C Controller B: slot 6, port 3. B side 1 Controller B: slot 6, port 1 Enclosure 1: bottom, port C. 2 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 3 Enclosure 2: bottom, port C Controller A: slot 6, port 3.
Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 45. Dual SC8000 Controllers, Two Enclosures, One Chain

58

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Dual SC8000 Controllers, Four Enclosures, Two Chains


Figure 46 illustrates two SC8000 controllers cabled to two 6 Gb enclosures. Each enclosure is on a separate chain. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. When two chains are used, IPC is optional. A side, Chain 1 1 Controller A: slot 6, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port C Controller B: slot 6, port 3. B side, Chain 1 1 Controller A: slot 5, port 3 Enclosure 2: bottom, port C. 2 Enclosure 2: bottom, port B Enclosure 1: bottom, port A. 3 Enclosure 1: bottom, port C Controller B: slot 5, port 1. A side, Chain 2 1 Controller A: slot 6 port 3 Enclosure 3: top, port C. 2 Enclosure 3: top, port B Enclosure 4: top, port A. 3 Enclosure 4: top, port C Controller B: slot 6, port 1. B side, Chain 2 1 Controller A: slot 5 port 1 Enclosure 4: bottom, port C. 2 Enclosure 4: bottom, port B. Enclosure 3: bottom, port A. 3 Enclosure 3: bottom, port C Controller B: slot 5, port 3.
Enclosure 4 Enclosure 3 Enclosure 2 Enclosure 1 Controller B

Controller A

4 3 2 1

4 3 2 1

Figure 46. Dual SC8000 Controllers, Two Enclosures, Two Chains

Dell Compellent

59

Chapter 4 Back End Cabling

Dual SC8000 Controllers, Four Enclosures, One IO Card, Single Chain


Figure 47 illustrates two SC8000 controllers with one SAS IO Card cabled to four 6 Gb enclosures. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. Note: In a single-chain configuration, use SAS ports 2 and 4 to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown. IPC Connection 1 Controller A: slot 6, port 2 Controller B: slot 6, port 4. 2 Controller B: slot 6, port 2 Controller A: slot 6, port 4. A side 1 Controller A: slot 6, port 1 Enclosure 1: top, port C. 2 Enclosure 1, top, port B Enclosure 2, top, port A. 3 Continue to daisy-chain enclosures: top, port B next enclosure down: top, port A. 4 Enclosure 4: top, port C Controller B: slot 6, port 3. B side 1 Controller B: slot 6, port 1 Enclosure 1: bottom, port C. 2 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 3 Continue to daisy-chain enclosures: bottom, port A next enclosure down: bottom, port B. 4 Enclosure 4: bottom, port C Controller A: slot 6, port 3.
Enclosure 2 Enclosure 1 Controller B Controller A
4 3 2 1

Enclosure 3

Enclosure 4

Figure 47. Dual SC8000 Controllers, Four Enclosures, One IO Card, One Chain

60

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Dual SC8000 Controllers, Eight Enclosures, Two Chains


To add redundancy with multiple IO cards, add a second SAS IO card. Create the A-side chain on the IO card in slot 6 and create the B-side chain on the IO card in slot 5. If an IO card, cable, enclosure, or controller fails, at least one side of a chain continues operating. IPC is optional in this configuration. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. Refer to Figure 48 on page 62 for cable connections. 1 Create IPC connections between both controllers on ports 2 and 4 of each IO card. 2 A side, Chain 1: Controller A: slot 6, port 1 Enclosure 1: top, port C. a Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B next enclosure down: top, port A. b Finish with Enclosure 4: top, port C Controller B: slot 6, port 3. 3 B side, Chain 1: Controller A: slot 5, port 3 Enclosure 4: bottom, port C. a Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port B next enclosure up: bottom, port A. b Finish with Enclosure 1: bottom, port C Controller B: slot 5, port 1. 4 A side, Chain 2: Controller A: slot 6, port 3 Enclosure 5: top, port C. a Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B next enclosure down: top, port A. b Finish with Enclosure 8: top, port C Controller B: slot 6, port 1. 5 B side, Chain 2: Controller A: slot 5, port 1 Enclosure 8: bottom, port C. a Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port B next enclosure up: bottom, port A. b Finish with Enclosure 5: bottom, port C Controller B: slot 5, port 3.

Dell Compellent

61

Chapter 4 Back End Cabling

Controller A

4 3 2 1

Controller B

4 3 2 1

Enclosure 1

Enclosure 5

Enclosure 2

Enclosure 6

Enclosure 3

Enclosure 7

Enclosure 4

Enclosure 8

Figure 48. Dual SC8000 Controllers, Eight Enclosures, Two Chains

62

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

CT-SC040 Controller Cabling


This section describes cabling for the CT-SC040 controller and SAS enclosures. Note: The cabling illustrations in this book refer to enclosures as Enclosure 1, Enclosure 2, and so on. The numbers shown in the illustrations may not match the Index number assigned by the System Manager and visible in the LED display. The System Manager assigns an Index number only after the system is powered up and at least one drive is assigned to a Disk Folder. For more information about assigning disks to a disk folder, see the Storage Center System Setup Guide.

Single CT-SC040 Controller, Single Enclosure


Figure 49 illustrates a CT-SC040 cabled to a 6 Gb enclosure. Cabling is similar for a 3 Gb enclosure. A side Controller: slot 1, port 1 Enclosure: top, port C. B side Controller: slot 1, port 3 Enclosure: bottom, port C.
Controller

Enclosure

Figure 49. Single CT-SC040 Controller, Single 6 Gb Enclosure

Dell Compellent

63

Chapter 4 Back End Cabling

Single CT-SC040 Controller, Four Enclosures, Single Chain


Figure 50 illustrates a single CT-SC040 controller cabled to four 6 Gb enclosures. Cabling is similar for a 3 Gb enclosure. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. A side 1 Controller: slot 1, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port B Enclosure 3: top, port A. 4 Enclosure 3: top, port B Enclosure 4: top, port A. B side 1 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 2 Enclosure 2: bottom, port A Enclosure 3: bottom, port B. 3 Enclosure 3: bottom, port A Enclosure 4: bottom, port B. 4 Enclosure 4: bottom, port C Controller: slot 1, port 3.
Enclosure 3 Enclosure 2 Controller

Enclosure 1

Enclosure 4

Figure 50. Single CT-SC040 Controller, Single 6 Gb Chain

64

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Single CT-SC040 Controller, Four Enclosures, Two IO Cards, Two Chains


Figure 51 illustrates a single CT-SC040 controller cabled to four SAS enclosures in two chains. When you add a second chain, you should also have a second IO card in the controller. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. A side, Chain 1 1 Controller: slot 1, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. B side, Chain 1 1 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 2 Enclosure 2: bottom, port C Controller: slot 2, port 3. A side, Chain 2 1 Controller: slot 1, port 3 Enclosure 3: top, port C. 2 Enclosure 3: top, port B Enclosure 4: top, port A. B side, Chain 2 1 Enclosure 3: bottom, port A Enclosure 4: bottom, port B. 2 Enclosure 4: bottom, port C Controller slot 2, port 1.
Enclosure 3 Enclosure 2 Enclosure 1 Controller

Enclosure 4

Figure 51. Single CT-SC040 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains

Dell Compellent

65

Chapter 4 Back End Cabling

Dual CT-SC040 Controllers, Two Enclosures, Single Chain


Figure 52 illustrates two CT-SC040 controllers cabled to two 6 Gb enclosures forming a single chain. Cabling is similar for a 3 Gb enclosure. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. Note: In a single-chain configuration, use SAS ports 2 and 4 to create a redundant IPC connection. When you configure these ports using the IO port wizard, set the port Purpose to Unknown. IPC Connection 1 Controller A: port 2 Controller B: port 4. 2 Controller B: port 2 Controller A: port 4. A side 1 Controller A: port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top, port C Controller B: port 3. B side 1 Controller B: port 1 Enclosure 1: bottom, port C. 2 Enclosure 1: bottom, port A Enclosure 2: bottom, port B. 3 Enclosure 2: bottom, port C Controller A: port 3.
Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 52. Dual CT-SC040 Controllers, Two Enclosures, One Chain

66

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Dual CT-SC040 Controllers, Four Enclosures, Two Chains


Figure 53 illustrates dual CT-SC040 controllers cabled to 6 Gb enclosures. Cabling is similar for a 3 Gb enclosure. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. In this dual-chain configuration, IPC cabling is optional. A side, Chain 1 1 Controller A: slot 1, port 1 Enclosure 1: top, port C. 2 Enclosure 1: top, port B Enclosure 2: top, port A. 3 Enclosure 2: top port C Controller B: slot 1, port 3. B side, Chain 1 1 Controller A: slot 2, port 3 Enclosure 2: bottom, port C. 2 Enclosure 2: bottom, port B Enclosure 1: bottom, port A. 3 Enclosure 1: bottom, port C Controller B: slot 2, port 1. A side, Chain 2 1 Controller A: slot 1 port 3 Enclosure 3: top, port C. 2 Enclosure 3: top, port B Enclosure 4: top, port A. 3 Enclosure 4: top, port C Controller B: slot 1, port 1. B side, Chain 2 1 Controller A: slot 2, port 1 Enclosure 4: bottom, port C. 2 Enclosure 4: bottom, port B Enclosure 3: bottom, port A. 3 Enclosure 3: bottom, port C Controller B: slot 2, port 3.
Enclosure 4 Enclosure 3 Enclosure 2 Enclosure 1 Controller B Controller A

Figure 53. Dual CT-SC040 Controllers, Two Enclosures, Two Chains

Dell Compellent

67

Chapter 4 Back End Cabling

Dual CT-SC040 Controllers, Eight Enclosures, Two Chains


To add redundancy with multiple IO cards, create the A-side chain on the IO card in slot 1. Create the B-side chain on the IO card in slot 2. If an IO card, cable, enclosure, or controller fails, at least one side of a chain continues operating. Follow the rules specified in CT-SC040 Controller Cabling on page 47 when connecting to SAS enclosures. Refer to Figure 54 on page 69 for cable connections. A side, Chain 1 Controller A: slot 1, port 1 Enclosure 1: top, port C. 2 Starting with Enclosure 1, daisy-chain the A side of Chain 1 by cabling: top, port B next enclosure down: top, port A. 3 Finish with Enclosure 4: top, port C Controller B: slot 1, port 3. B side, Chain 1 Controller A: slot 2, port 3 Enclosure 4: bottom, port C. 2 Starting with Enclosure 4, daisy-chain the B side of Chain 1 by cabling: bottom, port B next enclosure up: bottom, port A. 3 Finish with Enclosure 1: bottom, port C Controller B: slot 2, port 1. A side, Chain 2 1 Controller A: slot 1, port 3 Enclosure 5: top, port C. 2 Starting with Enclosure 5, daisy-chain the A side of Chain 2 by cabling: top, port B next enclosure down: top, port A. 3 Finish with Enclosure 8: top, port C Controller B: slot 1, port 1. B side, Chain 2 1 Controller A: slot 2, port 1 Enclosure 8: bottom, port C. 2 Starting with Enclosure 8, daisy-chain the B side of Chain 2 by cabling: bottom, port B next enclosure up: bottom, port A. 3 Finish with Enclosure 5: bottom, port C Controller B: slot 2, port 3.

68

Storage Center CT-SC040 and SC8000 Connectivity Guide

EN-SASx6x12/24 Enclosures

Controller A

Controller B

Enclosure 1

Enclosure 5

Enclosure 2

Enclosure 6

Enclosure 3

Enclosure 7

Enclosure 4

Enclosure 8

Figure 54. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains

Dell Compellent

69

Chapter 4 Back End Cabling

SBOD Enclosures
Redundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant loop includes an A side (shown in these diagrams in red) and B side (shown in blue). In a dual-controller Storage Center, each side of the loop begins on one controller and ends on the second controller. This section provides cabling information for SBOD enclosures to the following controllers: SC8000 Controller Cabling begins on page 71 CT-SC040 Controller Cabling begins on page 76 Note: SBOD enclosures are supported by the SC8000 controller only when migrated from existing Storage Centers.

Cabling Best Practices


The following rules apply to SBOD cabling: SBOD supports a maximum of seven enclosures per loop. An SBOD loop must contain only SBOD enclosures; do not mix SBOD, SATA, or SAS in the same loop. Each loop must contain enclosures of the same transport speed. The transport speed of the enclosure must match the transport speed of the IO card. Each SBOD enclosure requires a separate Enclosure ID Switch number (1 through 7). See SBOD Port ID on page 27. Connect adjacent ports on a Fibre Channel IO card to different enclosures to ensure port-level redundancy. For example, connect ports 1 and 2 to different enclosures. This is typically accomplished using A-side and B-side loops.

70

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

SC8000 Controller Cabling


This section describes cabling for the SC8000 controller and SBOD enclosures.

Single SC8000 Controller, Single Enclosure


In a single-controller, single-enclosure configuration, the controller is connected to the enclosure using two FC paths. For redundancy, the two FC paths connect to separate hardware components in both the controller and the enclosure. A side Controller: slot 4, port 1 Enclosure: right, Host 0. B side Enclosure: left, Host 0 Controller: slot 5, port 1.
Controller

Enclosure

Figure 55. Single SC8000 Controller, Single SBOD Enclosure

Dell Compellent

71

Chapter 4 Back End Cabling

Using Low-Profile Fibre Channel Ports


The SC8000 Controller includes three slots for low-profile IO cards. When using these ports, make sure that port 1 and port 2 connect to different enclosures, or use port 1 for front-end and port 2 for back-end connections. A side Controller: slot 1, port 2 Enclosure: right, Host 0. B side Enclosure: left, Host 0 Controller: slot 2, port 2. Note: Port numbering on the low profile IO cards in slots 13 begins with port 1 on the left. Port numbering on the standard profile IO cards in slots 46 begins with port 1 on the right.
Controller

1 2

Enclosure

Figure 56. Single SC8000 Controller, Single SBOD Enclosure

72

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

Single SC8000 Controller, Multiple Enclosures


In a single-controller, multiple-enclosure configuration, the back-end cabling is a basic daisy chain. The controller is connected to the enclosures using two pairs of FC cables. For redundancy, the two FC paths connect to separate hardware components in both the controller and the enclosure. Note: The SC8000 Controller includes three slots for low-profile IO cards (slots 13), which may be used for back-end connections. Keep in mind that port 1 on the low-profile cards is to the left. (See page 72 for an example with low profile card connections.) A side 1 Controller: slot 4, port 1 Enclosure 2: right, Host 0. 2 Enclosure 2: right, Host 1 Enclosure 1 right, Host 0. B side 1 Controller: slot 5, port 1 Enclosure 1: left, Host 0. 2 Enclosure 1: left, Host 1 Enclosure 2: left, Host 0.
Controller

Enclosure 1

Enclosure 2

Figure 57. Single SC8000 Controller, Multiple SBOD Enclosures

Dell Compellent

73

Chapter 4 Back End Cabling

Dual SC8000 Controllers, Multiple Enclosures


In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain fashion. Typically, each controller is connected to the enclosure using two FC paths, one connected to the top of the chain and the other connected to the end of the FC path from the other controller. The cabling in Figure 58 shows typical dualcontroller, multiple-enclosure cabling: A side 1 Controller B: slot 5, port 1 Enclosure 1: right, Host 0. 2 Enclosure 1: right, Host 1 Enclosure 2 right, Host 0. 3 Enclosure 2: right, Host 1 Enclosure 3 right, Host 0. 4 Enclosure 3: right, Host 1 Controller A: slot 5, port 1. B side 1 Controller A: slot 4, port 1 Enclosure 1: left, Host 0. 2 Enclosure 1: left, Host 1 Enclosure 2: left, Host 0. 3 Enclosure 2: left, Host 1 Enclosure 3: left, Host 0. 4 Enclosure 3: left, Host 1 Controller B: slot 4, port 1.
Enclosure 2 Enclosure 1 Controller B Controller A

Enclosure 3

Figure 58. Dual SC8000 Controllers, Multiple SBOD Enclosures

74

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

Dual SC8000 Controllers, Multiple Enclosures, Multiple Loops


In a dual-controller, multiple-enclosure configuration with more than one loop, the cabling is a modified daisy chain with multiple loops. The cabling in Figure 59 shows typical dual-controller, multiple-enclosure cabling. A side, Loop 1 1 Controller B: slot 5, port 1 Enclosure 1: right, Host 0. 2 Enclosure 1: right, Host 1 Enclosure 2: right, Host 0. 3 Enclosure 2: right, Host 1 Enclosure 3: right, Host 0. 4 Enclosure 3: right, Host 1 Controller A: slot 5, port 1. B side, Loop 1 1 Controller A: slot 4, port 1 Enclosure 1: left, Host 0. 2 Enclosure 1: left, Host 1 Enclosure 2: left, Host 0. 3 Enclosure 2: left, Host 1 Enclosure 3: left, Host 0. 4 Enclosure 3: left, Host 1 Controller B: slot 4 port 1. A side, Loop 2 1 Controller B: slot 5, port 2 Enclosure 4: right, Host 0. 2 Enclosure 4: right, Host 1, Enclosure 5: right, Host 0. 3 Enclosure 5: right, Host 1, Enclosure 6: right, Host 0. 4 Enclosure 6: right, Host 1, Controller A: slot 5, port 2. B side, Loop 2 1 Controller A: slot 4, port 2 Enclosure 4: left, Host 0. 2 Enclosure 4: left, Host 1, Enclosure 5: left, Host 0. 3 Enclosure 5: left, Host 1, Enclosure 6: left, Host 0. 4 Enclosure 6: left, Host 1, Controller B: slot 4, port 2.
Enclosure 6 Enclosure 5 Enclosure 4 Enclosure 3 Enclosure 2 Enclosure 1 Controller B Controller A

Figure 59. Dual SC8000 Controllers, Multiple Loops

Dell Compellent

75

Chapter 4 Back End Cabling

CT-SC040 Controller Cabling


This section shows typical cabling for CT-SC040 controllers with SBOD enclosures. See Cabling Best Practices on page 70 for general cabling guidelines. Note: Connect A sides of all enclosures together with one loop; connect B sides together with a second loop.

Single CT-SC040 Controller, Single SBOD Enclosure


In a single controller, single enclosure configuration, the controller is connected to the enclosure using two FC paths. For redundancy, the two FC paths connect to separate hardware components in both the controller and the enclosure. A side Controller: slot 1, port 4 Enclosure: right, Host 0. B side Enclosure: left, Host 0 the Controller: slot 2, port 4.
Controller

Enclosure

Figure 60. Single CT-SC040 Controller, Single SBOD Enclosure

76

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

Single CT-SC040 Controller, Multiple Enclosures


In a single controller, multiple enclosure configuration, the back-end cabling is a basic daisy chain. The controller is connected to the enclosure using two pairs of FC cables.The two FC paths connect to additional enclosures. A side 1 Controller: slot 1, port 4 Enclosure 2: right, Host 0. 2 Enclosure 2: right, Host 1 Enclosure 1: right, Host 0. B side 1 Controller: slot 2, port 4 Enclosure 1: left, Host 0. 2 Enclosure 1: left, Host 1 Enclosure 2: left, Host 0.
Controller

Enclosure 1

Enclosure 2

Figure 61. Single CT-SC040 Controller, Multiple SBOD Enclosures

Dell Compellent

77

Chapter 4 Back End Cabling

Dual CT-SC040 Controllers, Single Enclosure, Dual IO Cards


In a dual-controller, single-enclosure configuration, the back-end cabling follows the same basic principles as a single-controller, single-enclosure configuration for each controller. Each controller is connected to the enclosure using two FC paths. Both paths connect from one controller to the enclosure to the other controller. A side 1 Controller A: slot 1, port 4 Enclosure 1, right, Host 1. 2 Enclosure: right, Host 0 Controller B, slot 1, port 4. B side 1 Controller B: slot 2, port 4 Enclosure: left, Host 1. 2 Enclosure: left, Host 0 Controller A: slot 2, port 4.
Controller A

Controller B

Enclosure

Figure 62. Dual CT-SC040 Controllers, Single SBOD Enclosure

78

Storage Center CT-SC040 and SC8000 Connectivity Guide

SBOD Enclosures

Dual CT-SC040 Controllers, Multiple Enclosures


In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain. Typically, each controller is connected to the enclosure using two FC paths: one connected to the top of the chain, and the other connected to the end of the FC path from the other controller. The cabling in Figure 63 depicts normal dualcontroller, multiple-enclosure cabling: A side 1 Controller B: slot 1, port 4 Enclosure 1: right, Host 0. 2 Enclosure 1: right, Host 1 Enclosure 2 right, Host 0. 3 Enclosure 2: right, Host 1 Enclosure 3 right, Host 0. 4 Enclosure 3: right, Host 1 Controller A: slot 1, port 4. B side 1 Controller A: slot 2, port 4 Enclosure 1: left, Host 0. 2 Enclosure 1: left, Host 1 Enclosure 2: left, Host 0. 3 Enclosure 2: left, Host 1 Enclosure 3: left, Host 0. 4 Enclosure 3: left, Host 1 Controller B: slot 2, port 4.
Enclosure 2 Enclosure 1 Controller B Controller A

Enclosure 3

Figure 63. Dual CT-SC040 Controllers, Multiple SBOD Enclosures

Dell Compellent

79

Chapter 4 Back End Cabling

Dual CT-SC040 Controllers, Multiple Enclosures, Multiple Loops


In a dual-controller, multiple-enclosure configuration with more than one loop, the cabling is a modified daisy chain with multiple loops. The cabling in Figure 64 depicts normal dual-controller, multiple-enclosure cabling. A side, Loop 1 1 Controller B: slot 1, port 4 Enclosure 1, right, Host 0. 2 Enclosure 1: right, Host 1 Enclosure 2 right, Host 0. 3 Enclosure 2: right, Host 1 Enclosure 3 right, Host 0. 4 Enclosure 3: right, Host 1 Controller A: slot 1, port 4. B side, Loop 1 1 Controller A: slot 2, port 4 Enclosure 1, left, Host 0. 2 Enclosure 1: left, Host 1 Enclosure 2, left, Host 0. 3 Enclosure 2: left, Host 1 Enclosure 3, left, Host 0. 4 Enclosure 3: left, Host 1 Controller B: slot 2 port 4. A side, Loop 2 1 Controller B: slot 1, port 3 Enclosure 4: right, Host 0. 2 Enclosure 4: right, Host 1 Enclosure 5: right, Host 0. 3 Enclosure 5: right, Host 1 Enclosure 6: right, Host 0. 4 Enclosure 6: right, Host 1 Controller A: slot 1, port 3. B side, Loop 2 1 Controller A: slot 2, port 3 Enclosure 4: left, Host 0. 2 Enclosure 4: left, Host 1 Enclosure 5, left, Host 0. 3 Enclosure 5: left, Host 1 Enclosure 6, left, Host 0. 4 Enclosure 6: left, Host 1 Controller B: slot 2, port 3.
Figure 64. Dual CT-SC040 Controllers, Multiple Loops
Enclosure 6 Enclosure 5 Enclosure 4 Enclosure 3 Enclosure 2 Enclosure 1 Controller B Controller A

80

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

SATA Enclosures
Redundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). For connections to SATA enclosures, connect A sides of all enclosures together with one loop, then connect B sides together with a second loop. The A-side loop starts at the top of the first enclosure, and the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure.

Cabling Best Practices


Make sure that each SATA enclosure has a unique Enclosure ID Switch number (1 through 7). Refer to SATA Enclosures on page 81. One loop can support up to five SATA enclosures. For redundancy, make sure that ports 1 and 2 connect to different enclosures, and that ports 3 and 4 connect to different enclosures. This is typically accomplished using A-side and B-side loops. Adjacent ports on a fibre channel IO card are controlled by a single source. For example, ports 1 and 2 are paired, and ports 3 and 4 are paired.

SC8000 Controller Cabling


This section describes cabling for the SC8000 controller and SATA enclosures. Note: SATA enclosures are supported by the SC8000 controller only when migrated from existing Storage Centers.

Single Controller, Single SATA Enclosure


A side Controller: slot 5, port 1 Enclosure: right, port 3. B side Enclosure: left, port 2 Controller: slot 4, port 1.
Controller

Enclosure

Figure 65. Single SC8000 Controller, Single SATA Enclosure

Dell Compellent

81

Chapter 4 Back End Cabling

Using Low-Profile Fibre Channel Ports


The SC8000 Controller includes three slots for low profile IO cards, which may be used for back-end connections. For redundancy, make sure that port 1 and port 2 connect to different enclosures, or use port 1 for front-end and port 2 for back-end connections. Note: Port numbering on the low profile IO cards in slots 13 begins with port 1 on the left. Port numbering on the standard profile IO cards in slots 46 begins with port 1 on the right. A side Controller: slot 5, port 1 Enclosure: right, port 3. B side Enclosure: left, port 2 Controller: slot 3, port 2.
Controller
1 2 4 3 2 1

Enclosure

Figure 66. Single SC8000 Controller, Single SATA Enclosure

82

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

Single Controller, Two SATA Enclosures


Figure 67 illustrates a single SC8000 Controller cabled to two SATA Enclosures. Typically, the controller is connected to the enclosure using two Fibre Channel paths. A side 1 Controller: slot 5, port 1 Enclosure 2: right, port 3. 2 Enclosure 2: right, port 4 Enclosure 1: right, port 3. B side 1 Controller: slot 4, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2.
Controller
1 2 4 3 2 1

Enclosure 1

Enclosure 2

Figure 67. Single SC8000 Controller, Two SATA Enclosures

Dell Compellent

83

Chapter 4 Back End Cabling

Single Controller, Five SATA Enclosures


In a single controller, multiple enclosure configuration, the back-end cabling is a basic daisy chain. A single loop can contain a maximum of five enclosures. A side 1 Controller: slot 5, port 1 Enclosure 5: right, port 3. 2 Enclosure 5: right, port 4 Enclosure 4: right, port 3. 3 Enclosure 4: right, port 4 Enclosure 3: right, port 3. 4 Enclosure 3: right, port 4 Enclosure 2: right, port 3. Enclosure 1 5 Enclosure 2: right, port 4 Enclosure 1: right, port 3. B side 1 Controller: slot 4, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2. 3 Enclosure 2: left, port 1 Enclosure 3: left, port 2. 4 Enclosure 3: left, port 1 Enclosure 4: left, port 2. 5 Enclosure 4: left, port 1 Enclosure 5: left, port 2.
Enclosure 2 Controller
4 3 21

Enclosure 3

Enclosure 4

Enclosure 5

Figure 68. Single SC8000 Controller, Five SATA Enclosures

84

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

Two Controllers, Four SATA Enclosures, Single Loop


In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain. This configuration connects to the A side and B side of each enclosure. The A-side loop starts at the top of the first enclosure; the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure. A side 1 Controller B: slot 4, port 1 Enclosure 1: right, port 3. 2 Enclosure 1: right, port 4 Enclosure 2: right, port 3. 3 Enclosure 2: right, port 4 Enclosure 3: right, port 3. 4 Enclosure 3: right, port 4 Enclosure 4: right, port 3. 5 Enclosure 4: right, port 4 Controller A: slot 4, port 1. B side 1 Controller A: slot 5, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2. 3 Enclosure 2: left, port 1 Enclosure 3: left, port 2. 4 Enclosure 3: left, port 1 Enclosure 4: left, port 2. 5 Enclosure 4: left, port 1 Controller B: slot 5, port 1.
Enclosure 3 Enclosure 2 Enclosure 1 Controller B Controller A

Enclosure 4

Figure 69. Two SC8000 Controllers, Four SATA Enclosures, Single Loop

Dell Compellent

85

Chapter 4 Back End Cabling

Two Controllers, Seven SATA Enclosures, Two Loops


A single loop can contain a maximum of five enclosures. If a single Storage Center will have more than five enclosures, then multiple loops will have to be used. When you have multiple loops, each controller should have two IO cards as shown in Figure 70 on page 87. A Side, Loop 1 1 Controller B: slot 5, port 1 Enclosure 1: right, port 3. 2 Enclosure 1: right, port 4 Enclosure 2: right, port 3. 3 Enclosure 2: right, port 4 Enclosure 3: right, port 3. 4 Enclosure 3: right, port 4 Enclosure 4: right, port 3. 5 Enclosure 4: right, port 4 Controller A: slot 5, port 1. B side, Loop 1 1 Controller A: slot 4, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2. 3 Enclosure 2: left, port 1 Enclosure 3: left, port 2. 4 Enclosure 3: left, port 1 Enclosure 4: left, port 2. 5 Enclosure 4: left, port 1 Controller B: slot 4, port 1. A Side, Loop 2 1 Controller B: slot 5, port 2 Enclosure 5: right, port 3. 2 Enclosure 5: right, port 4 Enclosure 6: right, port 3. 3 Enclosure 6: right, port 4 Enclosure 7: right, port 3. 4 Enclosure 7: right, port 4 Controller A: slot 5, port 2. B side, Loop 2 1 Controller A: slot 4, port 2 Enclosure 5: left, port 2. 2 Enclosure 5: left, port 1 Enclosure 6: left, port 2. 3 Enclosure 6: left, port 1 Enclosure 7: left, port 2. 4 Enclosure 7: left, port 1 Controller B: slot 4, port 2.

86

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

Controller A

Controller B

Enclosure 1

Enclosure 5

Enclosure 2

Enclosure 6

Enclosure 3

Enclosure 7

Enclosure 4

Figure 70. Two SC8000 Controllers, Seven SATA Enclosures, Two Loops

Dell Compellent

87

Chapter 4 Back End Cabling

CT-SC040 Controller Cabling


This section shows typical cabling for CT-SC040 controllers with SATA enclosures. See Cabling Best Practices on page 81 for general cabling guidelines.

Single Controller, Single SATA Enclosure


A side Controller: slot 2, port 1 Enclosure: right, port 3. B side Enclosure: left, port 2 Controller: slot 1, port 1.
Controller

Enclosure

Figure 71. Single CT-SC040 Controller, Single SATA Enclosure

88

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

Single Controller, Two SATA Enclosures


Figure 72 illustrates a single CT-SC040 Controller cabled to two SATA Enclosures. Typically, the controller is connected to the enclosures using two Fibre Channel paths. A side 1 Controller: slot 2, port 1 Enclosure 2: right, port 3. 2 Enclosure 2: right, port 4 Enclosure 1: right, port 3. B side 1 Controller: slot 1, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2.
Controller

Enclosure 1

Enclosure 2

Figure 72. Single CT-SC040 Controller, Two SATA Enclosures

Dell Compellent

89

Chapter 4 Back End Cabling

Single Controller, Five SATA Enclosures


In a single-controller, multiple-enclosure configuration, the back-end cabling is a basic daisy chain. A single loop can contain a maximum of five enclosures. A side 1 Controller: slot 2, port 1 Enclosure 5: right, port 3. 2 Enclosure 5: right, port 4 Enclosure 4: right, port 3. 3 Enclosure 4: right, port 4 Enclosure 3: right, port 3. 4 Enclosure 3: right, port 4 Enclosure 2: right, port 3. 5 Enclosure 2: right, port 4 Enclosure 1: right, port 3. B side 1 Controller: slot 1, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2. 3 Enclosure 2: left, port 1 Enclosure 3: left, port 2. 4 Enclosure 3: left, port 1 Enclosure 4: left, port 2. 5 Enclosure 4: left, port 1 Enclosure 5: left, port 2.
Enclosure 2 Enclosure 1 Controller

Enclosure 3

Enclosure 4

Enclosure 5

Figure 73. Single CT-SC040 Controller, Five SATA Enclosures

90

Storage Center CT-SC040 and SC8000 Connectivity Guide

SATA Enclosures

Two Controllers, Four SATA Enclosures, Single Loop


In a dual-controller, multiple-enclosure configuration, the cabling is a modified daisy chain. This configuration connects to the A side and B side of each enclosure. The A-side loop starts at the top of the first enclosure, and the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure. A side 1 Controller B: slot 1, port 1 Enclosure 1: right, port 3. 2 Enclosure 1: right, port 4 Enclosure 2: right, port 3. 3 Enclosure 2: right, port 4 Enclosure 3: right, port 3. 4 Enclosure 3: right, port 4 Enclosure 4: right, port 3. 5 Enclosure 4: right, port 4 Controller A: slot 1, port 2. B side 1 Controller A: slot 1, port 1 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2. 3 Enclosure 2: left, port 1 Enclosure 3: left, port 2. 4 Enclosure 3: left, port 1 Enclosure 4: left, port 2. 5 Enclosure 4: left, port 1 Controller B: slot 1, port 2.
Enclosure 2 Enclosure 1 Controller B Controller A

Enclosure 3

Enclosure 4

Figure 74. Two CT-SC040 Controllers, Four SATA Enclosures, Single Loop

Dell Compellent

91

Chapter 4 Back End Cabling

Two Controllers, Seven SATA Enclosures, Two Loops


A single loop can contain a maximum of five enclosures. If a single Storage Center will have more than five enclosures, then multiple loops will have to be used. When you have multiple loops, each controller should have two IO cards as shown in Figure 70 on page 87. A Side, Loop 1 1 Controller B: slot 2, port 3 Enclosure 1: right, port 3. 2 Enclosure 1: right, port 4 Enclosure 2: right, port 3. 3 Enclosure 2: right, port 4 Enclosure 3: right, port 3. 4 Enclosure 3: right, port 4 Enclosure 4: right, port 3. 5 Enclosure 4: right, port 4 Controller A: slot 2, port 3. B side, Loop 1 1 Controller A: slot 1, port 3 Enclosure 1: left, port 2. 2 Enclosure 1: left, port 1 Enclosure 2: left, port 2. 3 Enclosure 2: left, port 1 Enclosure 3: left, port 2. 4 Enclosure 3: left, port 1 Enclosure 4: left, port 2. 5 Enclosure 4: left, port 1 Controller B: slot 1, port 3. A Side, Loop 2 1 Controller B: slot 2, port 4 Enclosure 5: right, port 3. 2 Enclosure 5: right, port 4 Enclosure 6: right, port 3. 3 Enclosure 6: right, port 4 Enclosure 7: right, port 3. 4 Enclosure 7: right, port 4 Controller A: slot 2, port 4. B side, Loop 2: 1 Controller A: slot 1, port 4 Enclosure 5: left, port 2. 2 Enclosure 5: left, port 1 Enclosure 6: left, port 2. 3 Enclosure 6: left, port 1 Enclosure 7: left, port 2. 4 Enclosure 7: left, port 1 Controller B: slot 1, port 4.

Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Enclosure 5

Enclosure 6

Enclosure 7

Figure 75. Two CT-SC040 Controllers, Seven SATA Enclosures, Two Loops

92

Storage Center CT-SC040 and SC8000 Connectivity Guide

Front-End Cabling

This chapter how to connect Dell Compellent controllers to servers, network appliances, and discusses redundancy.

Contents
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Server HBA Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95 Best Practices for Fibre Channel Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96 System Manager WWN Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 Multipath IO (MPIO) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 SC8000 Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 CT-SC040 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113

Dell Compellent

93

Chapter 5 Front-End Cabling

Overview
Front-end cabling refers to connections between the controller and the server. Servers should be connected to the controller through a network switch, which, when combined with cabling techniques provides redundancy through multipathing. Front-end connections can be can be made using iSCSI, Fibre Channel, or Fibre Channel over Ethernet (FCoE).

Legacy Mode vs. Virtual Ports


Storage Center uses either Legacy mode or Virtual Port mode to transport data to the storage disks. Figure 76 on page 95 compares a single switch Fibre Channel configuration in Legacy mode with Virtual Port mode.

Legacy Mode
In legacy mode, front-end IO ports are broken into primary and reserve ports based on a fault domain. Fault domains identify port usage when a controller or port fails. During normal operation, IO is transported on primary ports only. Reserve ports remain in a standby mode until a controller failure, at which point the primary port fails over to the reserve port on the running controller.

Virtual Ports
When licensed, Storage Center can use Virtual Ports, which treats all ports as primary ports for transporting data. Virtual ports expand the number of possible server connections on the front end. In virtual port mode, all ports are active, and if one port fails, the load is distributed between the remaining ports within the same domain. A domain in Virtual Port mode is determined by the number of fabrics. A fabric is determined by the number of independent switches or VLANS, so the number of domains is based on whether separate VLANS or subnets will be used. To configure Virtual Ports, use the Storage Center System Manager Configure Local Ports wizard. See the Storage Center System Manager Administrators Guide for detailed instructions.

Server HBA Settings


See Appendix B in the Storage Center System Manager Administrators Guide for information about server HBA settings for connecting to the SC8000 controller.

94

Storage Center CT-SC040 and SC8000 Connectivity Guide

Switch Settings

Switch Settings
See Appendix C in the Storage Center System Manager Administrators Guide for information about switch settings.
Server

FC Switch

Primary Port P1 Reserved Port R2 Controller A

Reserved Port R1 Primary Port P2 Controller B

iDRAC ETH 0 to switch

Legacy Mode

Server

FC Switch

Controller A

Controller B

iDRAC ETH 0 to switch

Virtual Ports
Figure 76. Dual-Controller FC Legacy Mode vs. Virtual Ports

Dell Compellent

95

Chapter 5 Front-End Cabling

Best Practices for Fibre Channel Zoning


When using Fibre Channel for front-end connectivity, zones must be established to ensure that disk storage is visible to the servers. Zoning can be applied to either the ports on switches or to the World Wide Names (WWNs) of the end devices. Zones should be created using a single initiator (using physical WWNs) and multiple targets (using virtual WWNs). Physical and virtual WWNs are identified in System Manager as shown in Figure 77 on page 97. In a dual-controller configuration, the virtual WWNs from each controller need to be included in the zone with each hosts WWN. Follow the rules below for Fibre Channel zoning.

WWN Zoning
In WWN zoning, since the switch is seeking a WWN, a device may reside on any port or change physical ports and still be visible.

Legacy Mode
Include all Storage Center front-end WWNs or ports in a single zone. Create server zones that contain a single initiator and multiple targets, and which include the server HBA WWN.

Virtual Port Mode


Include all Storage Center virtual WWNs in a single zone. Include all Storage Center physical WWNs in a single zone. Create server zones that contain a single initiator and multiple targets (Storage Center virtual WWNs), and which include the server HBA WWN.

FC Replication Zoning
Include all Storage Center physical WWNs from System A and B in a single zone. Include all Storage Center physical WWNs of System A and the virtual WWNs of System B on the particular Fabric. Include all Storage Center physical WWNs of System B and the virtual WWNs of System A on the particular Fabric. Note: Some ports may not be used or dedicated for replication, however ports that are used must be in these zones.

Port Zoning
In port zoning, only specific switch ports are visible, so if a storage device is moved to a different port, it is no longer visible to the switch. Note: Best practice for Virtual Ports mode is to zone with WWNs.

Legacy Mode or Virtual Port Mode


Include all Storage Center front-end ports. Create server zones which contain all Storage Center front-end ports and a single server port.

FC Replication Zoning
Include all Storage Center front-end ports from System A and System B in a single zone.

96

Storage Center CT-SC040 and SC8000 Connectivity Guide

System Manager WWN Identification

System Manager WWN Identification


In Virtual Port mode, two WWNs are created for each front-end port. The Storage Center System Manager indicates physical WWNs using a green IO Card icon and virtual WWNs using a blue icon, as shown in Figure 77 below. Note: If you are using WWN zoning, virtual WWNs and physical WWNs must be in separate zones. Virtual WWNs are used in server connection zones.

Physical WWN Virtual WWN

Figure 77. Port WWNs in Storage Center System Manager

Dell Compellent

97

Chapter 5 Front-End Cabling

Multipath IO (MPIO)
MPIO software offers redundancy at the path level. MPIO loads as a driver on the server, and typically operates in a round-robin manner by sending packets first down one path and then the other. If a path fails, MPIO software continues to send packets down the functioning path. MPIO is operating-system specific. Windows Server 2003 uses Dell Compellent Multipath Manager. To install and configure the Dell Compellent Multipath Manager, see the Storage Center Multipath IO (MPIO) Manager for Microsoft Servers User Guide. Windows Server 2012, 2008, and 2008 R2 use the Microsoft Device-Specific Module (DSM) to manage all aspects of failover and load balancing. To install and configure the Microsoft DSM, see the Storage Center Microsoft Multipath IO (MPIO) Best Practices.

SC8000 Controller Front-End Cabling


This section provides examples for connecting front-end cables to the SC8000 controller.

Ethernet Management and iDRAC Cabling


All front-end cabling must include the iDRAC and Ethernet connections to the Ethernet switch as described below and on page 98. The ETH 0 port supports system login and access to the management software. It is also used to send email, alerts, SNMP traps, and system data using Phone Home. The iDRAC connection provides access to the controller for system information and diagnostics.

Single Controller Ethernet Management and iDRAC Cabling


1 During installation and setup, assign a static IP address to ETH 0. See Storage Center System Setup Guide for more detailed information. 2 Connect the 1 Gb ETH 0 (port 0) to an Ethernet switch. 3 Connect the iDRAC port to the Ethernet switch using a 1 Gb Ethernet cable.

Corporate/Public Network

Switch

Controller

iDRAC

1 3 IPC

0 2 MGMT

1 Gb ETH 0

Figure 78. Single Controller Ethernet Connection

98

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

Dual-Controller Ethernet Management and iDRAC Cabling


To connect Ethernet management for two controllers: 1 Connect the 10 Gb ETH 1 (port 1) on one controller to the same port on the second controller. Use a Category (Cat.) 6 cable for this connection. Note: Storage Center currently runs the 10 Gb ports at 1 Gb speed. Use a Cat. 6 cable to ensure that a hardware change is unnecessary when 10 Gb rates are implemented. 2 Connect the 1 Gb ETH 0 (port 0) on each controller to an Ethernet switch or VLAN. 3 Connect the iDRAC port to the same Ethernet switch using a 1 Gb Ethernet cable.

Corporate/Public Network

iDRAC iDRAC

Switch

Controller A

ETH 0 Port

1 3 0 2 IPC MGMT

ETH 1 Port

Controller B

ETH 1 Port

1 3 0 2 IPC MGMT

1 Gb ETH 0 Port

Figure 79. Dual-Controller Ethernet Connection

Dell Compellent

99

Chapter 5 Front-End Cabling

Single-Controller Front-End Cabling


Make sure that the front-end cables are labeled at each end. If not, apply identification labels as directed in the SC8000 Cable Labeling Guide included in the cable package.

Single Controller, Single Server


Connect a single server to the controller using a switch as shown below. The drawing shows a Fibre Channel connection. iSCSI cabling follows the same pattern, connecting from the iSCSI port on the controller, to the switch, and then to the server. Add Ethernet and iDRAC cabling as shown on page 98. Note: For low-profile cards (slots 13), ports are numbered beginning with port 1 on the left.

Corporate/Public Network

Switch

Controller
1 2

Figure 80. Single Controller, Single Server, FC

100

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

Single Controller, Multiple Servers


Connect multiple servers to the controller through a switch. Figure 81 shows the cabling for a Fibre Channel connection. iSCSI cabling follows the same pattern, connecting each server through the switch to the iSCSI port on the controller. Add Ethernet and iDRAC cabling as shown on page 98.

Corporate/Public Network

FC Switch

Controller
1 2

Figure 81. Single Controller, Multiple Servers, Fibre Channel

Dell Compellent

101

Chapter 5 Front-End Cabling

Single Controller, Multiple Servers


Connect multiple server types through switches to the controller as shown below. Add Ethernet and iDRAC cabling as shown on page 99.

Corporate/Public Network

FC Switch

Ethernet Switch

Controller
1 2

Figure 82. Single Controller, Multiple Servers

102

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

Fault Domains
Storage Center cabling supports fault domains to increase redundancy. Fault domains can be implemented in either Legacy mode or in Virtual Port mode.

Legacy Mode (Fibre Channel)


In legacy mode, front-end IO ports are divided into primary and reserve ports based on a fault domain. Fault domains identify allowed port movement when a controller or port fails. During normal operation, IO is transported on primary ports only. The reserve port remains in a standby mode until a controller failure, at which point the primary port fails over to the reserve port on the running controller. Ethernet and iDRAC cabling are added as shown on page 99. Each fault domain consists of sets of primary and reserve paths (P1-R1, P2-R2, and so on). To provide redundancy, a primary port and its reserve port in that fault domain must connect to the same switch. Connecting ports in this way, the primary paths provide redundancy for a single server path or fabric failure. Reserve paths provide redundancy for single controller failure. For example, in Figure 83, Fabric A includes Switch 1 and primary data paths for fault domains 1 and 2. Fabric B includes Switch 2 and primary data paths for fault domains 3 and 4. Ethernet and iDRAC cabling would be added as shown on page 99. This is a highly robust failover solution, but it requires four primary data paths and four reserve data paths for proper failover. In addition, the reserve ports remain unused unless a primary path fails.
Server 1 Server 2

Switch 1

Switch 2

R1 R2 P2 P1
1 2

R4 P3 P4 R3
Controller B

Controller A
1 2

Figure 83. Front-End Legacy Mode FC Fault Domains

Dell Compellent

103

Chapter 5 Front-End Cabling

Virtual Ports (Fibre Channel)


Fault domains are determined by the number of independent fabrics. In the figure below, each switch carries a separate fault domain. Virtual port mode eliminates the need for reserve ports, since all ports are primary and can read and write IO. If a port fails, any port within the same fault domain takes over for the failed port. Using multipathing, volumes are mapped to ports in more than one fault domain. To connect independent fabrics to support separate fault domains: 1 Connect each server to both switches. 2 Connect one port on each IO card of each controller to both switches. 3 Connect Ethernet and iDRAC ports as shown on page 99.

Server 1

Server 2 Switch 2

Switch 1

Controller A

Controller B

Figure 84. Front-End Virtual Ports FC Fault Domains

104

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

Fibre Channel Failover


For proper failover, associate Fibre Channel connections with a fault domain. The fault domain you use depends on how the switches are connected in the fabric.

Non-MPIO
A dual-controller, dual-fabric FC configuration contains two independent FC switches. By mapping each volume into a separate fault domain, the IO load is spread over all the available primary ports and switches. Use Storage Center System Manager to map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 2 Fault Domain 2 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 4 (Switch 2)

MPIO
MPIO software allows the servers to support multiple FC connections to the same targets. This gives each server two routes to access each volume, which provides fault tolerance because each route is on a separate switch. You can connect MPIO in either Legacy Mode (Figure 85 on page 106) or using Virtual Ports (Figure 86 on page 107). Use Storage Center System Manager to map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 1 Fault Domain 3 (Switch 2) Volume 2 Fault Domain 2 (Switch 1) Volume 2 Fault Domain 4 (Switch 2) Volume 3 Fault Domain 1 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 2 (Switch 1) Volume 4 Fault Domain 4 (Switch 2)

Dell Compellent

105

Chapter 5 Front-End Cabling

Server 1

Server 2

Switch 1

Switch 2

1 2

4 3 2 1

Controller A

1 2

4 3 2 1

Controller B

Enclosure 1

Enclosure 2

Figure 85. FC Failover, Legacy Mode

106

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

Server 1

Server 2

Switch 1

Switch 2

4 3 2 1

Controller A

4 3 2 1

Controller B

Enclosure 1

Enclosure 2

Figure 86. FC Failover, Virtual Ports

Dell Compellent

107

Chapter 5 Front-End Cabling

iSCSI Failover
In virtual port mode, iSCSI follows the same cabling and port setup as Fibre Channel with the exception of the control port. iSCSI uses a control port configured for each fault domain. Servers connect to the control port, which redirects traffic to an appropriate virtual port. Each iSCSI network is isolated by either a Virtual LAN (VLAN) switch configuration or physical separation. When configuring MPIO, assign only the control port in the iSCSI Initiator software. Create separate and unique subnets for each individual iSCSI network. Separate iSCSI networks with the same subnet can confuse a server trying to determine the proper connection path. In addition, it is difficult to troubleshoot two separate networks in the same IP address range. In most circumstances, iSCSI networks do not need to be routed to a general use LAN or other local iSCSI networks. The exception is in routing to another iSCSI network at a disaster recovery site for volume replication. By multipathing over isolated iSCSI networks, you can reduce the risk of a network storm or normal LAN traffic affecting a Storage Center. In a Fibre Channel network, there is an almost immediate connection initiated between all ports that are zoned together. Once a connection is initiated, you can map volumes through that connection. Conversely, iSCSI is used over an IP based network which is not zoned, and you must initiate all connections from the servers. A Storage Center detects only iSCSI connections that are initiated by the server. Therefore, the server must initiate a connection to the controller before a volume can be presented to the server. The method of initiating a connection depends on whether legacy mode or Virtual ports are used: Legacy mode: The server initiates connections from each iSCSI port to the primary connections of the fault domains within the network associated with that server connection. Virtual port mode: The initiator connects to the control port. The control port sees all members with the same VLAN or subnet.

108

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

iSCSI Failover Example (Legacy Mode)


In Legacy Mode, proper failover requires a minimum of four primary and four reserve data paths as shown in Figure 87 on page 110. The redundant primary paths protect against a single server path or fabric failure. The reserve paths protect against a single controller failure. Each fault domain consists of a primary and reserve path (for example P1-R1, P2-R2). The diagram assumes two iSCSI Networks: Network 1, which includes Switch 1 and Primary data paths for fault domains 1 and 3. The IP address range is within subnet 10.10.1.x. Network 2, which includes Switch 2 and Primary data paths for fault domains 2 and 4. The IP address range is within subnet 10.10.2.x. Port 1 with IP address 10.10.1.50 Port 2 with IP address 10.10.2.50 Controller A primary fault domain connections are IP addresses 10.10.1.10 and 10.10.2.10 Controller B reserve fault domain connections are IP addresses 10.10.1.11 and 10.10.2.11 Controller B primary fault domain connections are IP addresses 10.10.1.12 and 10.10.2.12 Controller A reserve fault domain connections are IP addresses 10.10.1.13 and 10.10.2.13 Port 1 (10.10.1.50) to primaries 10.10.1.10 and 10.10.1.12 Port 2 (10.10.2.50) to primaries 10.10.2.10 and 10.10.2.12 The reserve IPs are not used to host volumes, so connections are not initiated 10.10.1.10 to 10.10.1.50 (fault domain 1) 10.10.2.10 to 10.10.2.50 (fault domain 3) A specific volume can be mapped only through primary ports on one controller. 10.10.1.12 to 10.10.1.50 (fault domain 2) 10.10.2.12 to 10.10.2.50 (fault domain 4) A specific volume can be mapped only through primary ports on one controller.

The Server is connected using a dual-port iSCSI IO card to the two networks:

Two Storage Center controllers connect to the two networks:

The server is configured to initiate connections from:

All volumes presented from Controller A are mapped as follows:

All volumes presented from Controller B are mapped as follows:

Dell Compellent

109

Chapter 5 Front-End Cabling

Server Server Port 1 10.10.1.50 Ethernet Switch 1 iSCSI Network 1 10.10.1.x Server Port 2 10.10.2.50

Ethernet Switch 2 iSCSI Network 2 10.10.2.x

R4 P3 R3 P4 P1 R1 P2 R2

Controller A

4 3 2 1

Controller B
4 3 2 1

Enclosure 1

Enclosure 2

Figure 87. iSCSI Failover in Legacy Mode

110

Storage Center CT-SC040 and SC8000 Connectivity Guide

SC8000 Controller Front-End Cabling

iSCSI Failover Example (Virtual Port Mode)


In Virtual Port mode, fault domains are determined by the number of fabrics/subnets. Connecting four primary paths on each controller provides port failover capability within an individual controller. The connections shown in Figure 88 on page 112 are divided into two different subnets, making the failover function as separate fabrics. This example provides protection for single-server path or fabric failure and for single-controller failure. Switch 1 contains members of one fault domain, and Switch 2 contains members of a separate domain.

Dell Compellent

111

Chapter 5 Front-End Cabling

Server Port 1 10.10.1.50 Server Port 2 10.10.2.50 Ethernet Switch 1 iSCSI Network 1 10.10.1.x

Ethernet Switch 2 iSCSI Network 2 10.10.2.x

Controller A
4 3 2 1

Controller B
4 3 2 1

Enclosure 1

Enclosure 2

Figure 88. iSCSI Failover with Virtual Ports

112

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

CT-SC040 Front-End Cabling


This section provides examples for connecting front-end cables to the CT-SC040 controller.

Ethernet Management Cabling


The ETH 0 port supports system login and access to the management software. It is also used to send email, alerts, SNMP traps, and phone home data. All front-end cabling must include Ethernet connections to the Ethernet switch as described below and on page 114.

Single Controller Ethernet Management Cabling


During Installation and Setup: 1 Assign a static IP address to ETH 0. See Storage Center System Setup Guide for more detailed information. 2 Connect the server Ethernet port through a switch to the controller ETH 0 port.

Corporate/Public Network

Controller

1 2 3 4 6
ETH 0 Port

Figure 89. Single Controller Ethernet Connection

Dell Compellent

113

Chapter 5 Front-End Cabling

Dual Controller Ethernet Management Cabling


To connect Ethernet management for two controllers: 1 Connect the controller ETH 1 ports together. 2 Connect the ETH 0 port on each controller to an Ethernet switch or VLAN.

Corporate/Public Network

Switch

Controller A

1 2 3 4
2 1

ETH 0 Port Controller B

ETH 1 Port

1 2 3 4
2 1

ETH 0 Port

ETH 1 Port

Figure 90. Dual Controller Ethernet Connection

114

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Single Controller Front-End Cabling


Single Controller, Single Server, FC
Connect Fibre Channel servers to the controller through a switch as shown below. Be sure to include Ethernet cabling as shown on page 113.

Corporate/Public Network

Switch

Controller

1 2 3 4 6 5 4 3 2 1 Figure 91. Single Controller, Single Server, FC

Single Controller, Single Server, iSCSI


Connect iSCSI servers to the controller using a switch as shown below. Be sure to include Ethernet cabling as shown on page 113.

Corporate/Public Network

iSCSI Switch

Controller

1 2 3 4 6 5 4 3 2 1 Figure 92. Single Controller, Single iSCSI Server

Dell Compellent

115

Chapter 5 Front-End Cabling

Single Controller, Multiple Servers, iSCSI


Connect iSCSI servers to the controller through an Ethernet switch. Be sure to include Ethernet cabling as shown on page 113.

Corporate/Public Network

Ethernet Switch

Controller

1 2 3 4 6 5 4 3 2 1 Figure 93. Single Controller, Multiple Servers, iSCSI

116

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Single Controller, Multiple Servers, FC


Connect Fibre Channel servers to the controller through a Fibre Channel switch. Be sure to include Ethernet cabling as shown on page 113.

Corporate/Public Network

FC Switch

Controller

1 2 3 4 6 5 4 3 2 1 Figure 94. Single Controller, Multiple Servers, Fibre Channel

Dell Compellent

117

Chapter 5 Front-End Cabling

Single Controller, Multiple Servers


Connect multiple server types through switches to the controller as shown below. Be sure to include Ethernet cabling as shown on page 113.

Corporate/Public Network

Ethernet Switch

FC Switch

Controller

1 2 3 4 6 5 4 3 2 1 Figure 95. Single Controller, Multiple Servers

118

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Fault Domains
Storage Center cabling supports fault domains to increase redundancy. Fault domains can be implemented in either Legacy mode or in Virtual Port mode.

Legacy Mode (Fibre Channel)


Each fault domain consists of sets of primary and reserve paths (P1-R1, P2-R2, and so on). To provide redundancy, a primary port and its reserved port in that fault domain must connect to the same switch. Connecting ports in this way, the primary paths provide redundancy for a single server path or fabric failure. Reserve paths provide redundancy for single controller failure. Ethernet cabling is as shown on page 98. For example, in Figure 96, Fabric A includes Switch 1 and primary data paths for fault domains 1 and 2. Fabric B includes Switch 2 and primary data paths for fault domains 3 and 4. This is a highly robust failover solution, but it requires four primary data paths and four reserve data paths for proper failover. In addition, the reserve ports remain unused unless a primary path fails.
Server 1 Server 2

Switch 1

Switch 2

R1
Controller B

R2 P1

P3

R3

R4

P2

1 2 3 4 4 3 2 1

P4
Controller A
1 2 3 4 4 3 2 1

Figure 96. Front-End Legacy FC Fault Domains

Dell Compellent

119

Chapter 5 Front-End Cabling

Fibre Channel (Virtual Ports)


When Virtual Ports are enabled on the system, all ports are considered primary ports. Fault domains are determined by the number of independent fabrics. In the figure below, each switch carries a separate fault domain. Ethernet cabling is as shown on page 114. Virtual port mode eliminates the need for reserve ports, since all ports are primary and can read and write IO. If a port fails, any port within the same fault domain takes over for the failed port. Using multipathing, volumes are mapped to ports in more than one fault domain.
Server 1 Server 2

Switch 1

Switch 2

Controller A
1 2 3 4 2 1

Controller B
1 2 3 4 2 1

Figure 97. Front-End FC with Virtual Ports

120

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Fibre Channel Failover


For proper failover, associate Fibre Channel connections with a fault domain. The fault domain you use depends on how the switches are connected in the fabric.

Non-MPIO
A dual-controller, dual-fabric FC configuration contains two independent FC switches. By mapping each volume into a separate fault domain, the IO load is spread over all the available primary ports and switches. Map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 2 Fault Domain 2 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 4 (Switch 2)

MPIO
MPIO software allows the servers to support multiple FC connections to the same targets. This gives each server two routes to access each volume and each route is on a separate switch. You can connect MPIO in either Legacy Mode (Figure 85 on page 106) or using Virtual Ports (Figure 86 on page 107). Map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 1 Fault Domain 3 (Switch 2) Volume 2 Fault Domain 2 (Switch 1) Volume 2 Fault Domain 4 (Switch 2) Volume 3 Fault Domain 1 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 2 (Switch 1) Volume 4 Fault Domain 4 (Switch 2)

Dell Compellent

121

Chapter 5 Front-End Cabling

Server 1

Server 2

Switch 1

Switch 2

Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 98. FC Failover, Legacy Mode

122

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Server 1

Server 2

Switch 1

Switch 2

Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 99. FC Failover, Virtual Ports

Dell Compellent

123

Chapter 5 Front-End Cabling

iSCSI Failover
iSCSI follows the same cabling and port setup as Fibre Channel with the exception of the control port. iSCSI uses a control port configured for each of the fault domains. Servers connect to the control port, which then redirects traffic to the appropriate virtual port. When configuring MPIO, assign only the control port in the iSCSI Initiator software. iSCSI Failover on page 108 describes this in more detail. This section provides cabling examples for the CT-SC040 controller.

iSCSI Failover Example (Legacy Mode)


In Legacy Mode, proper failover requires a minimum of four primary and four reserve data paths as shown in Figure 87 on page 110. The redundant primary paths protect against a single server path or fabric failure. The reserve paths protect against a single controller failure. Each fault domain consists of a primary and reserve path (for example P1-R1, P2-R2). The diagram assumes two iSCSI Networks: Network 1, which includes Switch 1 and Primary data paths for fault domains 1 and 3. The IP address range is within subnet 10.10.1.x. Network 2, which includes Switch 2 and Primary data paths for fault domains 2 and 4. The IP address range is within subnet 10.10.2.x. Port 1 with IP address 10.10.1.50 Port 2 with IP address 10.10.2.50 Controller A primary fault domain connections are IP addresses 10.10.1.10 and 10.10.2.10 Controller B reserve fault domain connections are IP addresses 10.10.1.11 and 10.10.2.11 Controller B primary fault domain connections are IP addresses 10.10.1.12 and 10.10.2.12 Controller A reserve fault domain connections are IP addresses 10.10.1.13 and 10.10.2.13 Port 1 (10.10.1.50) to primaries 10.10.1.10 and 10.10.1.12 Port 2 (10.10.2.50) to primaries 10.10.2.10 and 10.10.2.12 The reserve IPs are not used to host volumes, so connections are not initiated 10.10.1.10 to 10.10.1.50 (fault domain 1) 10.10.2.10 to 10.10.2.50 (fault domain 3) A specific volume can be mapped only through primary ports on one controller 10.10.1.12 to 10.10.1.50 (fault domain 2) 10.10.2.12 to 10.10.2.50 (fault domain 4) A specific volume can be mapped only through primary ports on one controller

The Server is connected using a dual-port iSCSI IO card to the two networks:

Two Storage Center controllers connect to the two networks:

The server is configured to initiate connections from:

All volumes presented from Controller A are mapped as follows:

All volumes presented from Controller B are mapped as follows:

124

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Server Server Port 1 10.10.1.50 Ethernet Switch 1 iSCSI Network 1 10.10.1.x Server Port 2 10.10.2.50 Ethernet Switch 2 iSCSI Network 2 10.10.2.x

P2 P1 R1 R2
Controller A

R4

P4

P3

R3

Controller B

Enclosure 1

Enclosure 2

Figure 100. iSCSI MPIO in Legacy Mode

Dell Compellent

125

Chapter 5 Front-End Cabling

iSCSI Failover Example (Virtual Port Mode)


In Virtual Port mode, fault domains are determined by the number of fabrics/subnets. Connecting four primary paths on each controller provides port failover capability within an individual controller. The connections shown in Figure 88 on page 112 are divided into two different subnets, making the failover function as separate fabrics. This example provides protection for single-server path or fabric failure and for single-controller failure. Switch 1 contains members of one fault domain, and Switch 2 contains members of a separate domain.

126

Storage Center CT-SC040 and SC8000 Connectivity Guide

CT-SC040 Front-End Cabling

Server Port 1 10.10.1.50

Ethernet Switch 1 iSCSI Network 1 10.10.1.x

Server Port 2 10.10.2.50

Ethernet Switch 2 iSCSI Network 2 10.10.2.x

Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 101. iSCSI Failover with Virtual Ports

Dell Compellent

127

Chapter 5 Front-End Cabling

128

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding or Removing an Enclosure

This chapter describes how to add or remove Dell Compellent enclosures from a Storage Center.

Contents
Using Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129 Adding SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131 Removing SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 Adding EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146 Removing EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155 Adding SBOD or SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160

Using Storage Center System Manager


Adding or removing an enclosure requires access and use of the Storage Center System Manager. This section provides basic information about the System Manager that can help identify and configure enclosures and ports. See the Storage Center System Manager Administrators Guide for more detailed information about the Storage Center System Manager.

Dell Compellent

129

Chapter 6 Adding or Removing an Enclosure

View Enclosures
Display a list of enclosures (and their attributes) attached to this Storage Center. In the System Explorer Tree, select Enclosures. The right pane displays a list of enclosures.

Figure 102. List of Enclosures

130

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SC200/220 Enclosures

Configure Local Ports


The Configure Local Ports wizard shows important information about the current configuration: Slot/Port column displays the status of each port on an IO card. Target Count displays the number of drives recognized by this controller. Note: After adding a chain in a system, make sure that the number of drives in the Target Count column equals the number of drives that were added. 1 From the Storage Management menu, select System Setup Configure Local Ports. 2 The Configure Local Ports wizard starts, displaying information about every card in each controller. Local ports are displayed separated by transport type (FC, iSCSI, or SAS). Columns and options displayed may differ depending upon the transport type selected and the operational mode for that transport type.
Slot/Port Target Count

Figure 103. Configure Local Ports Wizard

Adding SC200/220 Enclosures


Use caution when adding an enclosure to a live Storage Center system to preserve the integrity of the existing data. This section describes two methods of adding enclosures: Create a new chain by adding enclosures to available ports on the controllers IO cards. The current configuration is undisturbed. Creating a new chain is the safest way to increase storage capacity. When you have multiple chains, you should have at least two IO cards in each controller. Add an enclosure to an existing chain by failing over to one side of the chain and then connecting into the other side of the chain.

Dell Compellent

131

Chapter 6 Adding or Removing an Enclosure

Creating a New Chain of SC200/220 Enclosures


This method is safe and non-intrusive to the existing disks and chains. Figure 104 on page 133 shows an example of adding a new chain using the steps below. 1 If there is more than one enclosure in the new chain, cable the enclosures together first. Do not connect the chain to the controller yet. Connect the enclosures: a New Enclosure (3): top, port B Next Enclosure (4): top, port A. b New Enclosure (3): bottom port B Next Enclosure (4): bottom, port A. 2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation. 3 Connect the Controller: slot 6, port 2 Enclosure 3: top, port A. 4 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 5 Make sure that: Slot and slot port (in this case, slot 6, port 2) are Up and the Purpose is set to back-end. Target Count equals the number of added drives, demonstrating that the controller recognizes the new enclosures.

6 In the Storage Manager System Tree, confirm the number of enclosures. 7 Connect last Enclosure (4): bottom, port B Controller: slot 6, port 4. 8 Verify that the last enclosure has been added as described in steps 4 through 6 above. 9 If there are no managed disks in this system, the System Manager does not assign an Index number. If the system contains a managed disk in any enclosure, the System Manager assigns an index number to the new enclosures. 10 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. 11 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.

132

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SC200/220 Enclosures

Controller

Enclosure 1

Enclosure 2

Enclosure 3

Two new enclosures added Enclosure 4

Figure 104. Connecting a New SC200/220 SAS Chain

Dell Compellent

133

Chapter 6 Adding or Removing an Enclosure

Adding to an Existing SAS Enclosure Chain


The following example shows how to insert an enclosure into an existing enclosure chain by connecting the enclosure to one side of the enclosure chain at a time. During this process, one side of the enclosure chain is disconnected, and the Storage Center fails over to the side that remains connected. Caution: Before adding an enclosure to an existing chain, make sure your data is backed up. For maximum protection, add enclosures during a service outage.

Check Current Disk Count


Displays the number of drives accessible by the Storage Center. 1 From a workstation connected to the network, open the Storage Center System Manager. 2 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 3 Maximize the Configure Local Port wizard so that you can see the Target Count column, and note the number of drives currently viewed by the controllers. This number increases when new enclosures are added. When adding enclosures to an existing configuration, add enclosures to the end of the chain.

Add an Enclosure to an Existing Chain Currently in Service


Disconnect the chain one side at a time to maintain drive availability while adding an enclosure. 1 Disconnect the A-side cables from the controllers as shown in Figure 105 on page 135: Controller A, slot 6 port 1. Controller B, slot 6 port 3.

IO continues through the B-side cables. 2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation. 3 Move the cable from Enclosure 2: top, port B Enclosure 4: top, port B. 4 Use new cables to connect the new enclosures to the A-side cabling (Figure 105 on page 135): Enclosure 2: top, port B Enclosure 3: top, port A. Enclosure 3: top, port B Enclosure 4, top, port A.

Enclosures 3 and 4 are now part of the A side chain and can now be connected to Controllers A and B.

134

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SC200/220 Enclosures

Controller A Disconnect A side

Controller B

Enclosure 1 Move Cable from Enclosure 2

Enclosure 2

Add cable Enclosure 3 Connect Enclosures (A side) Add cable New Enclosures Enclosure 4

Figure 105. Connect SC200/220 Enclosures to A side

5 Reconnect the A-side Controller cables: a Enclosure 4: top, port B Controller B: slot 6, port 3. b Enclosure 1: top, port A Controller A, slot 6, port 1.

Dell Compellent

135

Chapter 6 Adding or Removing an Enclosure

Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Figure 106. Reconnect SC200/220 A-side Cables to Controllers

6 Check the port configurations: a In the Configure Local Ports wizard (See Figure 103 on page 131), make sure that both controller ports show their status as Up. b Make sure that all drives in the new enclosures are recognized. c Make sure the Target Count equals the number of drives. 7 Disconnect the B-side cables from the controllers as shown in Figure 118: Controller A: slot 6 port 3. Controller B, slot 6 port 1.

136

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SC200/220 Enclosures

IO continues through the A-side cables. 8 Move the cable from Enclosure 2: bottom, port B Enclosure 4: bottom, port B. 9 Use new cables to connect the new enclosures to the existing enclosures (B side): Enclosure 2: bottom, port B Enclosure 3: bottom, port A. Enclosure 3: bottom port B to Enclosure 4: bottom port A.

Enclosures 3 and 4 are now part of the B-side chain and can now be connected to Controllers A and B.
Controller A

Disconnect B side Controller B

Enclosure 1

Enclosure 2 Move Cable from Enclosure 2

Add cable Enclosure 3 Connect Enclosures (B side) Add cable Enclosure 4

Figure 107. Connect SC200/220 Enclosures to B Side

10 Connect Enclosure 4: bottom, port B Controller A: slot 6, port 3. 11 Reconnect Enclosure 1: bottom, port A Controller B: slot 6, port 1.

Dell Compellent

137

Chapter 6 Adding or Removing an Enclosure

Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Figure 108. Reconnect SC200/220 B-side Cables to Controllers

12 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. For more information, see the Storage Center System Manager Administrators Guide. 13 In the Storage Manager System Tree, view the list of enclosures. See Figure 102 on page 130. The System Manager assigns an index number to all managed drives. 14 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.

138

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SC200/220 Enclosures

Adding a Second SAS Enclosure, Second Chain


In a dual-controller, single SAS enclosure configuration, controller redundancy is created using cross-over cables (IPC) from controller ports 2 to controller ports 4. A second chain performs the same redundancy as the IPC cross-over cables.

Add an Enclosure
Add an additional enclosure while maintaining redundancy. 1 Power on the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation. 2 Remove the two IPC cables from the Controllers, ports 2 and 4. 3 Connect: Controller A, port 2 new Enclosure 3: top, port A. 4 Connect Enclosure 3: top, port B Controller B, port 4. 5 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of port 2 of Controller A is Up Status of port 4 of Controller B is Up. The Target Count of Controller A, port 2 and Controller B, port 4 recognizes the drives in Enclosure 2. Purpose for Controller A, port 2 and Controller B, port 4 are set to back-end.
Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 3

Figure 109. Adding an SC200/220 SAS Enclosure, Step 1

6 Connect Controller A: port 4 new Enclosure 3: bottom, port B.

Dell Compellent

139

Chapter 6 Adding or Removing an Enclosure

7 Connect Enclosure 3: bottom, port A Controller B: port 2. 8 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of port 4 of Controller A is Up Status of port 2 of Controller B is Up. The Target Count of Controller A, port 4 and Controller B, port 2 recognizes the drives in Enclosure 2. Purpose for Controller A, port 4 and Controller B, port 2 are set to back-end.

Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 2

Figure 110. Adding an SC200/220 SAS Enclosure, B side

140

Storage Center CT-SC040 and SC8000 Connectivity Guide

Removing SC200/220 Enclosures

Removing SC200/220 Enclosures


The following procedure describes how to use Storage Center System Manager to move data off the disks in the enclosure to be removed. For more detailed instructions, see the Storage Center System Manager Administrators Guide. Caution: Before you remove an enclosure, make sure your data is backed up and that all disks to be removed are empty of data.

Release Disks
Release disks to remove them from the pool in preparation of removing the enclosure. 1 In the Storage Center tree, expand the Disks folder to view the disks in the enclosure. 2 Select all the disks in the enclosure you are removing. 3 From the shortcut menu, select Release Disk. The Release Disk wizard starts. 4 Note the warning and click Yes to continue. The disk is immediately released and a dialog box opens asking if you wish to rebalance RAID devices now, later, or skip balancing. 5 Click Yes. Wait for the rebalance operation to finish. Enclosures with all drives in the unassigned disk folder are now safe to remove.

Removing a SAS Enclosure


These instructions describe how to remove the top enclosure from a SAS enclosure chain. If the configuration has two enclosure chains (as shown in red and blue below), you do not need to take a system outage; however, the controller must be able to see all drives through one chain while the other side is down. Caution: To disconnect the A-side chain without a system outage, it is crucial that you first disconnect the A-side cable from the controller.

Dell Compellent

141

Chapter 6 Adding or Removing an Enclosure

Disconnect the A-side Chain


Disconnect the enclosure to be removed from the A-side chain. 1 Disconnect the A-side cable from Controller A: slot 6, port 1. The B side continues to carry IO while the A side is disconnected. 2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that port 3 of the controller is Up and the Target Count recognizes the drives through the B side. 3 Remove the cable between: Enclosure 1: top, port B Enclosure 2: top, port A.

Controller A

Disconnect A side

Controller B

Enclosure 1

Remove the A-side cable between enclosures Enclosure 2

Enclosure 3

Enclosure 4

Figure 111. Disconnecting the SC200/220 Enclosure from the A side

4 Move the cable from Enclosure 1: top, port A Enclosure 2: top, port A. 5 Reconnect the top cable to Controller A: slot 6, port 1.

142

Storage Center CT-SC040 and SC8000 Connectivity Guide

Removing SC200/220 Enclosures

Controller A

Reconnect A side, after moving the cable below.

Controller B

Enclosure 1 Move the A-side cable to next enclosure.

Enclosure 2

Enclosure 3

Enclosure 4

Figure 112. Reconnecting the SC200/220 A side

Caution: To disconnect the B-side chain without a system outage, it is crucial that you first disconnect the B-side cable from the controller.

Dell Compellent

143

Chapter 6 Adding or Removing an Enclosure

Disconnect the B-side Chain


Disconnect the enclosure to be removed from the B-side chain. 1 Disconnect the B-side cable from Controller B: slot 5, port 3. The A side continues to carry IO while the B side is disconnected. 2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that Port 1 of the controller is Up and the Target Count recognizes the drives through the A side. 3 Remove the cable between Enclosure 1: bottom, port B Enclosure 2: bottom, port A.

Controller A Disconnect B side

Controller B

Enclosure 1

Remove the B-side cable between enclosures Enclosure 2 Move to Enclosure 2, bottom, port A

Enclosure 3

Enclosure 4

Figure 113. Disconnecting the SC200/220 Enclosure from the B-side Chain

4 Reconnect the B-side cable to Controller B: slot 5, port 1. 5 The top enclosure is now disconnected and can be removed.

144

Storage Center CT-SC040 and SC8000 Connectivity Guide

Removing SC200/220 Enclosures

Reconnect B side

Controller A

Controller B

Figure 114. Top SC200/220 Enclosure Disconnected

Dell Compellent

145

Chapter 6 Adding or Removing an Enclosure

Adding EN-SASx6x12/24 Enclosures


Use caution when adding an enclosure to a live Storage Center to preserve the integrity of the existing data. This section describes two methods of adding enclosures: Create a new chain by adding enclosures to available ports on the controllers IO cards. The current configuration is undisturbed. Creating a new chain is the safest way to increase storage capacity. When cabling multiple chains, each controller should have at least two IO cards installed. Add an enclosure to an existing chain by failing over to one side of the chain while connecting into the other side of the chain.

Creating a New Chain for SAS 12- or 24-Drive Enclosures


This method is safe and non-intrusive to the existing disks and chains. Figure 115 on page 147 shows the final cabling diagram after adding the new chain. 1 If there is more than one enclosure in the new chain, cable the enclosures together first. Do not connect the chain to the controller yet. Connect the enclosures: New Enclosure (3): top 6, port B Next Enclosure (4): top, port A. New Enclosure (3): bottom port A Next Enclosure (4): bottom, B.

2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel LED and all drive LEDs are green. 3 Connect the Controller: slot 6, port 4 Enclosure 3: top, port C. 4 From the Storage Management window, select System Setup Configure Local Ports. 5 Verify that Storage Center recognizes the new drives: a Verify that slot and slot port (in this case, slot 6, port 3) are Up and the Purpose is set to back-end. b Verify that Target Count equals the number of added drives, demonstrating that the controller recognizes the new enclosures. c Confirm the number of enclosures in the Storage Manager System Tree. 6 Connect last Enclosure (4): bottom, port C Controller: slot 6, port 2. 7 Verify that the last enclosure has been added as described in Step 4 through 5c above. 8 If there are no managed disks in this system, the System Manager does not assign an Index number. If the system contains a managed disk in any enclosure, the System Manager assigns an index number to the new enclosures. Make sure that the Index number matches the number on the front panel. 9 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. 10 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.

146

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding EN-SASx6x12/24 Enclosures

Controller

Enclosure 1

Enclosure 2

Enclosure 3

Two new enclosures added Enclosure 4

Figure 115. Connecting a New SAS Chain

Dell Compellent

147

Chapter 6 Adding or Removing an Enclosure

Adding to an Existing SAS Enclosure Chain


Caution: Before adding an enclosure to an existing chain, make sure your data is backed up. For maximum protection, add enclosures during a service outage.

Check Current Disk Count


Verify the number of disks currently available to the controller(s). 1 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 2 Maximize the Configure Local Port wizard so that you can see the Target Count column, and note the number of drives currently viewed by the controllers. This number increases when new enclosures are added. When adding enclosures to an existing configuration, add enclosures to the end of the chain.

Add an Enclosure to an Existing Chain That is in Service


Connect a new enclosure to a Storage Center in service. 1 Disconnect the A-side cables from the controllers as shown in Figure 116 on page 149: Controller A: slot 6 port 1. Controller B: slot 6 port 3.

IO continues through the B-side cables. 2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the Ops Panel LED (SAS Enclosure Rear View on page 22) and all drive LEDs are green. 3 Use new cables to connect the new enclosures to the existing A-side enclosure connections (Figure 116 on page 149): Enclosure 2: top, port B Enclosure 3: top, port A. Enclosure 3: top, port B Enclosure 4: top, port A.

Enclosures 3 and 4 are now part of the A side chain and can be connected to Controllers A and B. 4 Move the cable from Enclosure 2: top, port C Enclosure 4: top, port C.

148

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding EN-SASx6x12/24 Enclosures

Controller A

Disconnect A side Controller B

Enclosure 1

Enclosure 2 Move Cable from Enclosure 2 Connect Enclosures (A side)

Enclosure 3

New Enclosures Enclosure 4

Figure 116. Connect Enclosures to A side

5 Reconnect the A-side Controller cables: Enclosure 4: top, port C Controller B: slot 6, port 3. Enclosure 1: top, port C Controller A: slot 6, port 1.

Dell Compellent

149

Chapter 6 Adding or Removing an Enclosure

Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Figure 117. Reconnect A-side Cables to Controllers A and B

6 Check the port configurations: a In the Configure Local Ports wizard (See Figure 103 on page 131), make sure that both controller ports show their status as Up. b Make sure that all drives in the new controllers are recognized. c Make sure the Target Count equals the number of drives. 7 Disconnect the B-side cables from the controllers as shown in Figure 118: Controller A: slot 5, port 3. Controller B: slot 5, port 1.

IO continues through the A-side cables. 8 Use new cables to connect the new enclosures to the existing enclosures (B side): Enclosure 2: bottom, port A Enclosure 3: bottom, port B. Enclosure 3: bottom, port A to Enclosure 4: bottom, port B.

Enclosures 3 and 4 are now part of the B-side chain and can be connected to Controllers A and B.

150

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding EN-SASx6x12/24 Enclosures

9 Move the cable from Enclosure 2: bottom, port C Enclosure 4: bottom, port C.
Controller A

Disconnect B side Controller B

Enclosure 1

Enclosure 2 Move Cable from Enclosure 2

Enclosure 3

Connect Enclosures (B side)

Enclosure 4

Figure 118. Connect Enclosures to B Side

10 Connect Enclosure 4: bottom, port C Controller B: slot 5, port 1. 11 Reconnect Enclosure 1: bottom, port C Controller A: slot 5, port 3.

Dell Compellent

151

Chapter 6 Adding or Removing an Enclosure

Controller A

Controller B

Enclosure 1

Enclosure 2

Enclosure 3

Enclosure 4

Figure 119. Reconnect B-side Cables to Controllers A and B

12 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. For more information, see the Storage Center System Manager Administrators Guide. 13 In the Storage Manager System Tree, view the list of enclosures. See Figure 102 on page 130. The System Manager assigns an index number to all managed drives. Make sure the index number shown in the Enclosures window matches the Index number on the enclosure front panel. 14 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.

152

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding EN-SASx6x12/24 Enclosures

Adding a Second SAS Enclosure, Second Chain


In a dual-controller, single SAS enclosure configuration, controller redundancy is created using cross-over cables from controller ports 2 to controller ports 4. A second chain performs the same function as the IPC cross-over cables. 1 Turn on the enclosures being added. When the enclosure spins up, make sure that the Front Panel LED and all drive LEDs are green. 2 Remove the two IPC cables from the Controllers, ports 2 and 4. 3 Connect Controller A: slot 6, port 2 new Enclosure 2: top, port C. 4 Connect Enclosure 2: top, port B Controller B: slot 6, port 4. 5 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of slot 6, port 2 of Controller A is Up Status of slot 6, port 4 of Controller B is Up. The Target Count of Controller A: slot 6, port 2 and Controller B: slot 6, port 4 recognizes the drives in Enclosure 2. Purpose for Controller A: slot 6, port 2 and Controller B: slot 6, port 4 are set to back-end.
Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 120. Adding a SAS Enclosure, Step 1

6 Connect Controller A: slot 6, port 4 new Enclosure 2: bottom, port B. 7 Connect Enclosure 2: bottom, port C Controller B: slot 6, port 2. 8 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of slot 6, port 4 of Controller A is Up

Dell Compellent

153

Chapter 6 Adding or Removing an Enclosure

Status of slot 6, port 2 of Controller B is Up. The Target Count of Controller A: slot 6, port 4 and Controller B: slot 6, port 2 recognizes the drives in Enclosure 2. Purpose for Controller A: slot 6, port 4 and Controller B: slot 6, port 2 are set to back-end.
Controller A

Controller B

Enclosure 1

Enclosure 2

Figure 121. Adding a SAS Enclosure, B side

154

Storage Center CT-SC040 and SC8000 Connectivity Guide

Removing EN-SASx6x12/24 Enclosures

Removing EN-SASx6x12/24 Enclosures


The following procedure describes how to use the Storage Center System Manager to move data off the disks in the enclosure to be removed. For more detailed instructions, see the Storage Center System Manager Administrators Guide. Caution: Before you remove an enclosure, make sure your data is backed up and that all disks to be removed are empty of data.

Release Disks
Release disks to remove them from the pool in preparation of removing the enclosure. 1 In the Storage Center tree, expand the Disks folder to view the disks in the enclosure. 2 Select all the disks in the enclosure you are removing. 3 From the shortcut menu, select Release Disk. The Release Disk wizard starts. 4 Note the warning and click Yes to continue. The disk is immediately released and a dialog box opens asking if you wish to rebalance RAID devices now, later, or skip balancing. 5 Click Yes. Wait for rebalance operation to finish. Enclosures with all drives in the unassigned disk folder are now safe to remove.

Dell Compellent

155

Chapter 6 Adding or Removing an Enclosure

Removing a SAS Enclosure


These instructions describe how to use the top enclosure from a multiple SAS enclosure configuration. If the configuration has two chains A (red) and B (blue), you do not need to take a system outage; however, the controller must be able to see all drives through one chain while the other side is down. Caution: To disconnect the A-side chain without a system outage, it is crucial that you first disconnect the A-side cable from the controller.

Disconnect the A-side Chain


Disconnect the enclosure to be removed from the A-side chain. 1 Disconnect the A-side cable from controller: slot 6, port 1. The B side continues to carry IO while the A side is disconnected. 2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that slot 6, port 3 of the controller is Up and the Target Count recognizes the drives through the B side. 3 Disconnect the cable between: Enclosure 1: top, port B Enclosure 2: top, port A.
Disconnect A side Controller

Enclosure 1

Remove the A-side cable between enclosures Enclosure 2

Enclosure 3

Enclosure 4

Figure 122. Disconnecting the Enclosure from the A side

156

Storage Center CT-SC040 and SC8000 Connectivity Guide

Removing EN-SASx6x12/24 Enclosures

4 Move the cable from Enclosure 1: top, port C Enclosure 2: top, port C. 5 Reconnect the top cable to Controller: slot 6, port 1.
Controller

Reconnect A side, after moving the cable below.

Enclosure 1

Move the A-side cable to next enclosure.

Enclosure 2

Enclosure 3

Enclosure 4

Figure 123. Reconnecting the A side

Dell Compellent

157

Chapter 6 Adding or Removing an Enclosure

Disconnect the B-side Chain


Disconnect the enclosure to be removed from the B-side chain. Caution: To disconnect the B-side chain without a system outage, it is crucial that you first disconnect the B-side cable from the controller. 1 Disconnect the B-side cable from controller port 3. The A side continues to carry IO while the B side is disconnected. 2 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that slot 6, Port 1 of the controller is Up and the Target Count recognizes the drives through the A side. 3 Remove the cable between: Enclosure 1: bottom, port A Enclosure 2: bottom, port B.
Controller

Disconnect B side Enclosure 1

Remove the B-side cable between enclosures Enclosure 2

Enclosure 3

Enclosure 4

Figure 124. Disconnecting the Enclosure from the B-side Chain

4 Reconnect the B-side cable to slot 6, port 3 of the controller. 5 The top enclosure is now disconnected and can be removed.

158

Storage Center CT-SC040 and SC8000 Connectivity Guide

Removing EN-SASx6x12/24 Enclosures

Reconnect B side

Controller

Figure 125. Top Enclosure Disconnected

Dell Compellent

159

Chapter 6 Adding or Removing an Enclosure

Adding SBOD or SATA Enclosures


You can add SBOD or SATA enclosures to a Storage Center using one of the following methods. Add a new loop: When adding enclosures on a new loop with a new set of ports, follow Adding an SBOD or SATA Enclosure to a New Loop. Add to an existing loop: When adding the new enclosures onto an existing loop, follow Adding an SBOD or SATA Enclosure to an Existing Loop on page 160. Note: When shutting down a connected enclosure, power down the controllers first. Otherwise, the Storage Center detects missing disks and takes actions to protect the data.

Before you Begin


Make sure that the new enclosure speed is set correctly prior to powering on the enclosure. If adding to an existing loop, make sure the Shelf ID is unique. Make sure that each IO Module is fully locked in position by pushing on the center post and ensuring that both locking handles close and click into the locked position. If not, pull back and reinsert. Tip: Hold on to the power supply lip to get leverage. Make sure that each enclosure has the correct DIP switch settings.

Adding an SBOD or SATA Enclosure to a New Loop


If the Storage Center has spare ports, they can be used to add a new enclosure. This method is safe and non-intrusive to the existing disks and loops. 1 Verify the existing configuration as described in Before you Begin. 2 With new enclosure(s) shut down, connect the cabling on both the A side and B side. Refer to cabling diagrams in SBOD Enclosures on page 70 or SATA Enclosures on page 81. 3 Verify cabling along the entire loop. Check that the connectors have clicked in and verify that all other requirements are met. 4 Verify the IO modules in the new enclosures are fully seated by pushing on the center post and making sure that both locking handles close and click into the locked position. If not, pull back and reinsert. 5 After turning on the enclosure, wait 30 seconds for the IO module to initialize. Verify that lights at each connector are green and there are no alarms. If there is a problem: a Shut down the enclosure. b Unseat all IO modules on the side being altered. c Correct cabling and connections. d Turn on the enclosure. 6 Verify paths. a In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. b Maximize the Configure Local Port wizard so that you can see the Network, Usage, and Target Count columns. Verify that the Target Count increased equal to the number of drives added. c Change the Network setting to back-end and Usage setting to In Use on any ports that were previously spares but are now connected to the new enclosure.

Adding an SBOD or SATA Enclosure to an Existing Loop


If there are no spare ports on the Storage Center to add new enclosures, you can use one of the existing loops. First review the current configuration to identify where an enclosure can be added, then make sure you have a license for additional disks, and lastly, add the enclosure.

160

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SBOD or SATA Enclosures

Verify Paths
Identify if and where an enclosure can be added. 1 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 2 Maximize the Configure Local Port wizard so that you can see the Target Count column. The Target Count column displays the number of drives per loop. In a dual-controller configuration, each loop has four system connections, two connections per controller. In a single-controller configuration, each loop has two system connections. Before disconnecting any cables, verify that all involved back-end ports can see all disks. Caution: If all involved back-end ports cannot see all disks, do not proceed any further. Contact Dell Technical Support Services.

Phone Home
Send the Storage Center information to Dell Technical Support Services using Phone Home. 1 In the Storage Management menu, select System Phone Home Phone Home. 2 Click Phone Home Now. 3 Wait for confirmation that the Phone Home completed successfully.

Check Your Disk License


Verify that your license supports the number of disks to add. In the Storage Management menu, select Help Licensed Features. If the number of disks you want to add exceeds the number of licensed disks, contact your Dell Compellent Business Partner for an additional license.

Figure 126. Licensed Features Window

Dell Compellent

161

Chapter 6 Adding or Removing an Enclosure

Enclosure IO Ports
The following example illustrates the procedure to add a third SBOD enclosure to a dual-controller system without taking an outage. SBOD enclosures are used as illustration, but the procedure is the same for SATA. SBOD and SATA rules apply.

Add an Enclosure
Physically prepare the enclosure. 1 Rack the enclosure. 2 Install the disk drives into the enclosure. If you are adding fewer than 16 drives, make sure that drives are installed in slot 1 and slot 16, and that unused slots are filled with empty drive carriers to maintain airflow. 3 Assign a shelf ID to the enclosure that is unique within the loop. 4 Verify DIP switch settings, making sure that you do not have a 4 Gb enclosure and a 2 Gb enclosure in the same loop.
4 Gb Switch
1 2 3 4 5 6 7 8 9 10 11 12

2 Gb Switch
1 2 3 4 5 6 7 8 9 10 11 12

Figure 127. 4 Gb and 2 Gb Switch Settings

5 Turn on the enclosures. 6 Verify that the green LED is illuminated on each drive, indicating that the drives are working. 7 In the Storage Management menu, select System Setup Configure Local Ports. 8 Verify that the number of back-end ports correlates to the number of Target Count ports, and that the count equals the current number of disks in the system.

162

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SBOD or SATA Enclosures

Connect Back-end Cabling


Complete the necessary cable connections between the controller, the new enclosure, and the existing enclosure(s). The following figure shows the IO ports for both SBOD and SATA enclosures. Note which ports are for input cabling and which are used for output cables.
IN

Host 0

Host 3

Host 2

Host 0

IN

Host 1

OUT

Figure 128. SBOD and SATA IO Ports

Dell Compellent

RS232

OUT

RS232

Host 1 Host 2 Host 3

OUT

IN

IN

OUT

SBOD IO Ports (4 Gb Card shown)

SATA IO Ports

163

Chapter 6 Adding or Removing an Enclosure

1 Move the B-side cable from Enclosure 1: left module, Host 1 Enclosure 2: left module, Host 1.
Controller A

Controller B

Enclosure 1

Move Controller connection

Enclosure 2

Figure 129. Connect Controller A to New Enclosure

164

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SBOD or SATA Enclosures

2 Connect Enclosure 1: left module, Host 1 Enclosure 2: left module, Host 0.


Controller A

Controller B

Enclosure 1

Enclosure 2
Add Enclosure connection

Figure 130. Connect Enclosure 1 to Enclosure 2 (B side)

3 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 4 Maximize the Configure Local Port wizard so that you can see the Network, Usage, and Target Count columns. Verify that the Target Count increased equal to the number of drives added.

Dell Compellent

165

Chapter 6 Adding or Removing an Enclosure

5 Move the A-side cable from Enclosure 1: right module, Host 1 Enclosure 2: right module, Host 1.
Controller A

Controller B

Enclosure 1

Move Controller connection

Enclosure 2

Figure 131. Connect Controller A to Enclosure 2 (A side)

166

Storage Center CT-SC040 and SC8000 Connectivity Guide

Adding SBOD or SATA Enclosures

6 Connect Enclosure 1: right module, Host 1 Enclosure 2: right module, Host 0.


Controller A

Controller B

Enclosure 1
Add Enclosure connection

Enclosure 2

Figure 132. Connect Enclosure 1 to Enclosure 2 (A side)

7 In System manager, refresh the Configure Local Ports wizard by clicking the Refresh button. 8 Verify the that the Target Count increased on the back end that was added. 9 From the Storage Management menu, select Disk Manage Unassigned Disks. The Add Disk wizard takes you through the disk management process and prompts you to rebalance data on the drives. See the Storage Center System Manager Administrators Guide for more information on RAID Rebalance.

Dell Compellent

167

Chapter 6 Adding or Removing an Enclosure

168

Storage Center CT-SC040 and SC8000 Connectivity Guide

680-027-013 A

Anda mungkin juga menyukai