Description
Initial release of software-version-independent publication.
Caution: Indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. Warning: Indicates that failure to follow directions could result in property damage, personal injury, or death.
Contents
1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Safety Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Electrostatic Discharge (ESD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Weight . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Electrical . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Environmental . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Storage Center Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Controller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Front End . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Back End . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . System Administration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1
2 2 2 2 2 3 3 4 5 5 6 6 6
2 Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SC8000 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . LCD Panel Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . NIC Indicator Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IO Card Slot Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Seating IO Cards Properly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CT-SC040 Communication Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . IO Card Slot Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
7
7 9 9 10 11 12 13 14 15 16
3 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC200/220 Enclosure Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC200/220 Enclosure Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enclosure Management Module (EMM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS Enclosure Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS Enclosure Rear View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Storage Bridge Bay (SBB) Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS 6 Gb and 3 Gb IO Module Comparison . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD IO Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
17
18 18 19 20 21 21 22 23 24 25 26
Dell Compellent
iii
Contents
SBOD Port ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enclosure Speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Service Control Modules (SCMs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SATA Enclosure ID . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disk Drive Speeds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SAS Disk Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SBOD and SATA Disk Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Enterprise Plus Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Standard SAS Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Removing Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Installing Disks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
27 27 28 29 29 30 30 31 32 33 34 35 36
37
37 37 38 38 47 54 54 55 63 70 70 71 76 81 81 81 88
5 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Server HBA Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Best Practices for Fibre Channel Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . WWN Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Port Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . System Manager WWN Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Multipath IO (MPIO) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SC8000 Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ethernet Management and iDRAC Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single-Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fibre Channel Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iSCSI Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iSCSI Failover Example (Legacy Mode) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
93
94 94 94 95 96 96 96 97 98 98 98 100 101 102 103 105 108 109
iv
Contents
CT-SC040 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ethernet Management Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Dual Controller Ethernet Management Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fibre Channel (Virtual Ports) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fibre Channel Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iSCSI Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
113 113 114 115 117 118 119 120 121 124
Dell Compellent
Contents
vi
List of Figures
Figure 1. Dell Compellent Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 2. SC8000 Controller Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 3. SC8000 Front View Features and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 4. LCD Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 5. SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 6. NIC Indicator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 7. IO Card Guide Slots . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 8. CT-SC040 Front View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 9. CT-SC040 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 10. CT-SC040 Communication Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 11. SC200/220 Enclosures Front View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . Figure 12. SC200/220 Enclosure Back View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . Figure 13. IO Module Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 14. SAS Enclosures Front View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 15. SAS Enclosure Rear View Controls and Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 16. IO Module Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 17. Rear View of an SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 18. SBOD Ports (4 Gb IO Card) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 19. Enclosure ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 20. Rear View of a SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 21. SATA SCM Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 22. Enclosure ID Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 23. SAS Disk Numbering, 12-Disk Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 24. SATA/SBOD Disk Numbering (Front View) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 25. Enterprise Plus Drive Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 26. Standard SAS Drive Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 27. Removing a Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 28. Installing a Disk . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 29. Single SC8000 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 30. Single SC8000 Controller, Single SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 31. Single SC8000 Controller, Four SAS Enclosures, Two IO Cards, Two Chains . . . . . . . . . . Figure 32. Dual SC8000 Controllers, One Enclosure, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 33. Dual SC8000 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 34. Dual SC8000 Controllers, Four Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 35. Dual SC8000 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 36. Single CT-SC040 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 37. Single CT-SC040 Controller, Single SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 38. Single CT-SC040 Controller, Four SAS Enclosures, Two IO Cards, Two Chains . . . . . . . . Figure 39. Dual CT-SC040 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 40. Dual CT-SC040 Controllers, Four Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . Figure 41. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . 4 5 7 9 9 10 12 13 14 15 18 19 20 21 22 23 25 26 27 28 29 29 31 32 33 34 35 36 39 40 41 42 43 44 46 47 48 49 50 51 53
Dell Compellent
vii
List of Figures
Figure 42. Single SC8000 Controller, Single SAS Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 43. Single SC8000 Controller, Single 6 Gb Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 44. Single SC8000 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains . . . . . . . . . . Figure 45. Dual SC8000 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 46. Dual SC8000 Controllers, Two Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 47. Dual SC8000 Controllers, Four Enclosures, One IO Card, One Chain . . . . . . . . . . . . . . . . . Figure 48. Dual SC8000 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 49. Single CT-SC040 Controller, Single 6 Gb Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 50. Single CT-SC040 Controller, Single 6 Gb Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 51. Single CT-SC040 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains . . . . . . . . Figure 52. Dual CT-SC040 Controllers, Two Enclosures, One Chain . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 53. Dual CT-SC040 Controllers, Two Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . Figure 54. Dual CT-SC040 Controllers, Eight Enclosures, Two Chains . . . . . . . . . . . . . . . . . . . . . . . . . Figure 55. Single SC8000 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 56. Single SC8000 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 57. Single SC8000 Controller, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 58. Dual SC8000 Controllers, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 59. Dual SC8000 Controllers, Multiple Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 60. Single CT-SC040 Controller, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 61. Single CT-SC040 Controller, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 62. Dual CT-SC040 Controllers, Single SBOD Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 63. Dual CT-SC040 Controllers, Multiple SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 64. Dual CT-SC040 Controllers, Multiple Loops . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 65. Single SC8000 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 66. Single SC8000 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 67. Single SC8000 Controller, Two SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 68. Single SC8000 Controller, Five SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 69. Two SC8000 Controllers, Four SATA Enclosures, Single Loop . . . . . . . . . . . . . . . . . . . . . . Figure 70. Two SC8000 Controllers, Seven SATA Enclosures, Two Loops . . . . . . . . . . . . . . . . . . . . . Figure 71. Single CT-SC040 Controller, Single SATA Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 72. Single CT-SC040 Controller, Two SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 73. Single CT-SC040 Controller, Five SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 74. Two CT-SC040 Controllers, Four SATA Enclosures, Single Loop . . . . . . . . . . . . . . . . . . . . Figure 75. Two CT-SC040 Controllers, Seven SATA Enclosures, Two Loops . . . . . . . . . . . . . . . . . . . Figure 76. Dual-Controller FC Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 77. Port WWNs in Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 78. Single Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 79. Dual-Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 80. Single Controller, Single Server, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 81. Single Controller, Multiple Servers, Fibre Channel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 82. Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 83. Front-End Legacy Mode FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 84. Front-End Virtual Ports FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 85. FC Failover, Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 86. FC Failover, Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 87. iSCSI Failover in Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 88. iSCSI Failover with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 89. Single Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 90. Dual Controller Ethernet Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 91. Single Controller, Single Server, FC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 92. Single Controller, Single iSCSI Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 93. Single Controller, Multiple Servers, iSCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 94. Single Controller, Multiple Servers, Fibre Channel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 95. Single Controller, Multiple Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
55 56 57 58 59 60 62 63 64 65 66 67 69 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 87 88 89 90 91 92 95 97 98 99 100 101 102 103 104 106 107 110 112 113 114 115 115 116 117 118
viii
List of Figures
Figure 96. Front-End Legacy FC Fault Domains . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 97. Front-End FC with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 98. FC Failover, Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 99. FC Failover, Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 100. iSCSI MPIO in Legacy Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 101. iSCSI Failover with Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 102. List of Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 103. Configure Local Ports Wizard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 104. Connecting a New SC200/220 SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 105. Connect SC200/220 Enclosures to A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 106. Reconnect SC200/220 A-side Cables to Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 107. Connect SC200/220 Enclosures to B Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 108. Reconnect SC200/220 B-side Cables to Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 109. Adding an SC200/220 SAS Enclosure, Step 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 110. Adding an SC200/220 SAS Enclosure, B side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 111. Disconnecting the SC200/220 Enclosure from the A side . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 112. Reconnecting the SC200/220 A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 113. Disconnecting the SC200/220 Enclosure from the B-side Chain . . . . . . . . . . . . . . . . . . . . Figure 114. Top SC200/220 Enclosure Disconnected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 115. Connecting a New SAS Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 116. Connect Enclosures to A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 117. Reconnect A-side Cables to Controllers A and B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 118. Connect Enclosures to B Side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 119. Reconnect B-side Cables to Controllers A and B . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 120. Adding a SAS Enclosure, Step 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 121. Adding a SAS Enclosure, B side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 122. Disconnecting the Enclosure from the A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 123. Reconnecting the A side . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 124. Disconnecting the Enclosure from the B-side Chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 125. Top Enclosure Disconnected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 126. Licensed Features Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 127. 4 Gb and 2 Gb Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 128. SBOD and SATA IO Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 129. Connect Controller A to New Enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 130. Connect Enclosure 1 to Enclosure 2 (B side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 131. Connect Controller A to Enclosure 2 (A side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Figure 132. Connect Enclosure 1 to Enclosure 2 (A side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
119 120 122 123 125 127 130 131 133 135 136 137 138 139 140 142 143 144 145 147 149 150 151 152 153 154 156 157 158 159 161 162 163 164 165 166 167
Dell Compellent
ix
List of Figures
Introduction
This chapter includes general hardware safety information to protect the installation and basic system information to help understand concepts throughout the manual.
Contents
Safety Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 Storage Center Hardware Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Communication Links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Dell Compellent
Chapter 1 Introduction
Safety Considerations
Note: See the safety and regulatory information that shipped with each Storage Center component. Warranty information may be included within this document or as a separate document. If equipment described in the document is used in a manner not specified by Dell Compellent, the protection provided by the equipment may be impaired. For your safety and protection, observe the following rules:
Weight
An enclosure can weigh up to 26 kg (57 lb). Do not lift it without assistance. Do not lift an enclosure by the handles of the Power Cooling Modules (PCMs). They are not designed to hold the weight of the entire enclosure, and the enclosure cover may become bent. Before moving an enclosure, remove the PCMs to minimize weight.
Electrical
Provide a suitable power source with electrical overload protection. All components in the Storage Center must be grounded before applying power. Make sure there is a safe electrical earth connection to power supply cords. Check the grounding before applying power. The plugs on the power supply cords are used as the main disconnect device. Make sure that the socket outlets are located near the equipment and are easily accessible. Do not remove covers from the Power Control Module (PCM). Disconnect the power connection before removing a PCM from the enclosure. Do not remove a faulty PCM unless you have a replacement model of the correct type ready for insertion. A faulty PCM must be replaced with a fully operational module within 24 hours. Permanently unplug the enclosure before you move it or if you think it has become damaged in any way. When powered by multiple AC sources, disconnect all supply power for complete isolation.
Environmental
In order to comply with applicable safety, emission, and thermal requirements, do not remove bay covers from enclosures. Make sure that all bays are populated with plug-in modules. Do not remove bay covers or drives until ready to replace them.
Controller
The Storage Center controller provides the central processing capability for the Storage Center. A Storage Center can be configured with a single controller (single-controller Storage Center) or a pair of controllers (dual-controller Storage Center). Figure 1 on page 4 shows the Storage Center controllers supported by this manual. The supported controllers are: CT-SC040 SC8000
The controller functional specifications are given below. Controllers are described in more detail in Chapter 2 on page 7. IO cards are located inside the controller and provide communication between the server and the storage enclosures. IO cards are described in more detail in Chapter 2 on page 7. In a dual-controller Storage Center configuration, the pair of controllers must be the same controller model. For example, a pair of SC8000 controllers. A dual-controller Storage Center does not support mixed controller models. SC8000
Processor Bus Speed System Cache Cache Card Expansion Slots 2.56 GHz Dual 6 core 1333 MHz 16 GB (expandable to 64 GB) 512 MB, PCIe (Slot 7) Gen 3 PCIe: Three full height, Three low profile 8 Gb 10 Gb 3 Gba, 6 Gb 1 Gb, 10 Gb 14 (Using two 4-port IO cards plus three 2-port IO cards) 12 (Using three 4-port IO cards) 6 168 drives/chain = 1008 48 drives/chain = 288 2U 2 6
CT-SC040
2.53 GHz Quad-Core 1333 MHz 6 GB (expandable to 12 GB) 512 MB, PCIe (Slot 7) Six PCIe, 2.5 GHz
Transport Speeds Fibre Channel FCoE SAS iSCSI Maximum Front-End (FC) Ports
4 Gb, 8 Gb 10 Gb 3 Gb, 6 Gb 1 Gb, 10 Gb 20 (Using five 4-port IO cards) 20 (Using five 4-port IO cards) 10 168 drives/chain = 1680 48 drives/chain = 480 3U 2 5
Maximum Back-End Ports Maximum Back-End SAS Chains Supported Maximum 6 Gb SAS Drives Maximum 3 Gba. SAS Drives Form Factor Power Supplies Fans
a. For SC8000 migrations only: 3 Gb SAS enclosures are supported using a 6 Gb IO Card.
Dell Compellent
Chapter 1 Introduction
CT-SC040 Controller
SC8000 Controller
Switches
Dell Compellent offers Fibre Channel (FC) switches and IO cards as part of the total Storage Center product package. Switches provide robust connectivity to servers, allowing for the use of multiple controllers and redundant transport paths. Cabling between the controller IO cards and switches (and servers) is referred to as front-end connectivity.
Communication Links
Enclosures
Enclosures house and control disks that provide storage. The enclosures are connected directly to controller IO cards, and is referred to as back-end connectivity. New Storage Centers contain 2U-size Serial Attached SCSI (SAS) enclosures. Fibre Channel Switched Bunch of Disks (SBOD) and Serial Advanced Technology Attachment (SATA) enclosures are supported for existing Storage Centers and for controller migrations only (for example, upgrading an existing Storage Center by migrating from a CT-SC040 controller to an SC8000 controller).
Enclosures and connectivity requirements are described in more detail in Chapter 3: Enclosures, on page 17.
Communication Links
A Storage Center controller uses multiple types of communication links for both data transfer and administrative functions.
Fibre Channel Server, 8 Gb Fibre Channel over Ethernet (FCoE) Server, 10 Gb iSCSI, or iSCSI Server, 1 Gb Ethernet
Ethernet Switches
Controller
* FC Enclosures are supported in CT-SC040 controllers and for SC8000 controller migrations. New systems contain 6 Gb SAS Enclosures.
Dell Compellent
Chapter 1 Introduction
Front End
Front-End connectivity provides connections from servers to controllers using either Ethernet (iSCSI) or Fibre Channel switches. Front-End connectivity also supports all replication traffic. See page 3 for specific transport speeds. iSCSI connections provide reads and writes from a server to a controller through an Ethernet switch. Fibre Channel Over Ethernet (FCoE) uses the FCoE protocol for data on the front end for lossless transmission of data. Fibre Channel (FC) connections on the front end are used to provide reads and writes from a server to a controller.
Back End
Back-end connectivity is strictly between the controllers and enclosures. The following protocols are supported to communicate with the enclosures. See page 3 for specific transport speeds. Fibre Channel connections on the back end provide reads and writes to the enclosures for CT-SC040 controllers. Fibre Channel IO cards can be migrated from CT-SC040 controllers to SC8000 controllers. SAS uses a point-to-point switched topology on four lanes. Each lane can perform concurrent IO transactions at 6 Gb/sec. (Transfer speeds for earlier versions are 3 Gb/sec.)
System Administration
The following connections are used for communicating with computers outside of Storage Center: Serial: Used for initial configuration and other service-related tasks. Ethernet: The Ethernet ports on the back of the controller can operate at 10 Mb or 1 Gb (the SC8000 has four ports and the CT-SC040 has two ports). These ports are not used for server or enclosure connectivity, but instead are used internally for: ETH 0 port: configuration, administration, and management of a Storage Center. ETH 1 port: Inter-Process Communications (IPC) between controllers.
iDRAC: For SC8000 controllers, a dedicated 1 Gb Ethernet port provides access to the Integrated Dell Remote Access Controller (iDRAC) for integrated peer controller management.
Controllers
This chapter describes Dell Compellent Controllers including ports, card slots, and buttons and indicators.
Contents
SC8000 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 SC8000 Controller Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 CT-SC040 Controller Front View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 CT-SC040 Back View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Warning: Turning off system power with the power switch removes the main power but keeps standby power supplied to the Storage Center.
Dell Compellent
Chapter 2 Controllers
Item Name
1 2 Power indicator, power button NMI button
Icon Description
The power indicator is illuminated when the system power is on. The power button controls the power supply output to the controller. The non-maskable interrupt button is used to troubleshoot software and device driver errors. For the SC8000, this button is disabled in the BIOS. Used to locate a particular system within a rack. When a System ID button on the front or back panel is pressed, the front LCD panel and the back system status indicator flash until one of the buttons is pressed again. Press to toggle the system ID on and off. If the system stops responding during POST, press and hold the system ID button for more than five seconds to enter BIOS progress mode.
4 5 6
Allows you to connect a VGA display to the system. Allows you to navigate the control panel LCD menu (see page 9 for more information). Displays system ID, status information, and system error messages. The LCD lights blue during normal system operation. The LCD lights amber when the system needs attention, and displays an error code followed by descriptive text.
Note: If the system is connected to a power source and an error is detected, the LCD lights amber regardless of whether the system is turned on or off. 7 8 9 vFlash media card slot USB connectors (2) EST panel Not used for the SC8000. Allows you to connect USB devices to the system. The ports are USB 2.0 compliant. A slide-out panel for system information including the Express Service tag, embedded NIC MAC address, and iDRAC7 Enterprise card MAC address.
Button
Left Select Right
Description
Moves the cursor back in one-step increments. Selects the menu item highlighted by the cursor. Moves the cursor forward in one-step increments. During message scrolling: Press once to increase scrolling speed. Press again to stop. Press again to return to default scrolling speed. Press again to repeat the cycle.
1 1 2 3 4 5 6 7
3 IPC
0 2 MGMT 8 9
Item
Control/Feature
Description
Ports are numbered beginning with port 1 on the left. Ports are numbered beginning with port 1 on the right. Cache card (CHA3) is always located in this slot.
Slots 13 Low profile IO card slots Slots 46 Standard profile IO card slots Slot 7 Standard profile cart slot
Dell Compellent
Chapter 2 Controllers
Item
1
Control/Feature
System identification button
Description
Used to locate a particular controller within a rack. When a System ID button on the front or back panel is pressed, the front LCD panel and the back system status indicator flash until one of the buttons is pressed again. Press to toggle the system ID on and off. If the controller stops responding during POST, press and hold the system ID button for more than five seconds to enter BIOS progress mode.
2 3 4 5 6 7
System identification connector iDRAC Serial port Video connector USB connectors Internal Ethernet connectors
Connects the optional system status indicator assembly through the optional cable management arm. Connects to the Ethernet switch in the rack. Connects to the Comtrol Ethernet server by means of serial interface. Connects a monitor to the controller. Connect USB devices to the controller. The ports are USB 2.0 compliant. Connect the controller to the Ethernet switch and to the other controller in the rack. The ports function as follows: Port 1: ETH 110GbE capable, configured for 1GbE. Used for interprocessor communication (IPC) between controllers in a dualcontroller system. Port 0: ETH 01GbE. Management port connects to Ethernet switch for system login, email, alerts, SNMP traps, phone home data, and access for software.
Note: Ports 2 and 3 are not used. 8 9 Power Supply 1 Power Supply 2 Hot-swappable, 750 W AC 100-240 V AC, auto-ranging, 50/60 Hz
Feature
Link indicator
Indicator Code
Off: The NIC is not connected to the network. Green: The NIC is connected to a valid network at its maximum port speed (1 Gbps or 10 Gbps). Amber: The NIC is connected to a valid network at less than its maximum port speed. Blinking: Indicates transmit/receive activity Steady: Indicates valid network connection
Activity indicator
10
Card
Chelsio S320E-LP-CR Chelsio S320E-CR* QLogic QLE4062 LSI SAS9201-16E Emulex LPe12004-M8* Emulex LPe12002-M8* QLogic QLE2662 QLogic QLE2562 QLogic QLE2564 Qlogic QLE8152 (with or without an SFP+ transceiver) Dell CHA3
Height
Low profile 10
Cache card
Full height
n/a
n/a
* These IO cards cannot be ordered for SC8000 controllers. An SC8000 controller can contain these IO cards only if they were transferred to the SC8000 controller during an upgrade from a CT-SC030 or CT-SC040 controller.
Dell Compellent
11
Chapter 2 Controllers
12
Warning: Turning off system power with the power switch removes the main power but keeps standby power supplied to the Storage Center.
Item
1 2 3 4 5 6 7 8
Control/Feature
Power supply failure Overheat and/or fan failure ETH 0 ETH 1 Disk activity AC power Reset button Power button
Description
Illuminated: One of the redundant power supplies has failed. Flashing light: Fan failure Steady light: Overheated condition
Flashing light: Network activity on Ethernet Port 0 (Management port) Flashing light: Network activity on Ethernet Port 1 (IPC) Illuminated: Activity on the bootable Flash Card IO channel Illuminated: AC power is being supplied to the power supplies Resets the controller Applies or turns off controller power.
Dell Compellent
13
Chapter 2 Controllers
Cache
2 3 4
Item
Control/Feature
Description
Front-end IO cards starting in slot 6, back-end IO cards starting in slot 1 Cache card (CHA3) Two hot-swappable AC power supplies. Two of five shown. See Figure 10 on page 15
Slots 16 Standard profile card slots Slot 7 1 2 3 Standard profile cart slot Power Supplies Fans System/internal communication ports
14
10
Item
1 2 3
Control/Feature
Mouse connector IPMI connector Link activity LED
Description
Connects to mouse or other pointing device Not Used Flickering light: Indicates transmit/receive activity Steady light: Indicated valid network connection
IO speed LED
5 6 7 8 9 10
Disk keyboard connector USB connector COM 1 connector Video connector ETH 0 ETH 1
Connects to external keyboard Connect USB devices to the controller Serial connection to external devices Connects a VGA monitor to the controller. Management port. IPC.
Note: Ethernet ports marked ETH 0 and ETH 1 do not support iSCSI communication; iSCSI connections are supported by PCI-based IO ports on the IO card.
Dell Compellent
15
Chapter 2 Controllers
Use
Front end Front end Front end Front end/ Back end Front end/ Back end Front end/ Back end Front end/ Back end Back end Back end
Slot Priority
6, 5, 4 6, 5, 4 6, 5, 4 6, 5, 4/ 1, 2, 3 6, 5, 4/ 1, 2, 3 6, 5, 4/ 1, 2, 3 6, 5, 4/ 1, 2, 3 1, 2, 3 1, 2, 3
16
Enclosures
This chapter describes Dell Compellent disk enclosures including disk types, ports, and buttons and indicators.
Contents
SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Dell Compellent
17
Chapter 3 Enclosures
SC220 Enclosure
Item
1
Control/Feature
Enclosure status
Icon
Description
Illuminates when the enclosure power is on: Steady blue: Normal operation Flashing blue: Indicates that Storage Center is identifying the enclosure. Steady amber: Enclosure is turning on or reset. Flashing amber: Enclosure is in fault state.
Power status
Illuminates when at least one power supply is supplying power to the enclosure
18
Compellent SC2
Compellent SC2
Figure 12. SC200/220 Enclosure Back View Controls and Indicators Table 1.
Item
1
Control/Feature
PCM status indicator
Icon
Description
Green: Normal operation Amber: Power supply failure Green: Normal operation Amber: Fan failure Green: Normal operation Amber: No AC power
Fan indicator
AC power indicator
4 5 6
Power switch Power Cooling Module (PCM)one of two Enclosure Management Module (EMM)one of two
Controls power for the enclosure Contains fans that provide cooling for the enclosure See Enclosure Management Module (EMM) on page 20
Dell Compellent
19
Chapter 3 Enclosures
Compellent SC2
Item
1
Control/Feature
System status indicator
Icon
Description
Not used on SC200/220 enclosures
Debug port
Green: All the links to the port are connected Amber: One or more links are not connected Off: Enclosure is not connected
Green: All the links to the port are connected Amber: One or more links are not connected Off: Enclosure is not connected Steady Green: Normal operation Amber: Enclosure did not boot or is not properly configured Flashing Green: Automatic update in process Flashing Amber Twice: Enclosure is unable to communicate with other enclosures Flashing Amber Four Times: Firmware update failed Flashing Amber Five Times: Firmware versions are different between the two EMMs
20
EN-SASx6x12/24 Enclosures
EN-SASx6x12/24 Enclosures
SAS enclosures hold disks for data storage and connect to the controllers through back-end ports. SAS enclosures are configured to hold either 12-3.5" drives or 24-2.5" drives.
EN-SASX6X24 Enclosure
Item
1
Control/Feature
Mute button
Icon
Description
Mutes the alarm
Amber: Enclosure module failure (PCM fault, Fan fault, SSB module fault. Check indicators on individual modules) Amber: Disk drive failure Flashing Amber: Unexpected enclosure ID (Module Fault will also be flashing amber)
LED display
Indicates the enclosure ID numberthis number is set by the software during installation, and matches the Disk ID displayed in the Storage Center System Manager
Dell Compellent
21
Chapter 3 Enclosures
1 2
5 6
Item
1
Control/Feature
AC power indicator
Icon
Description
Green: Normal operation Amber: No AC power Green: Normal operation Amber: Fan failure Green: Normal operation Amber: Power supply failure Green: Normal operation Amber: No DC power
Fan indicator
DC power indicator
5 6 7
Power switch Power Cooling Module (PCM)one of two Storage Bridge Bay (SBB)one of two
Controls power for the enclosure Contains fans that provide cooling for the enclosure See Storage Bridge Bay (SBB) Module on page 23
22
EN-SASx6x12/24 Enclosures
6 Gb Module 1 2
Item
1
Control/Feature
IO Module indicator
Icon
Description
On Steady: Normal operation
3 4 5
The port with the in/out arrow connects to the controller. The 6 Gb C-port always connects to the controller.
Dell Compellent
23
Chapter 3 Enclosures
3 Gb IO Module Enclosure
3 Gb controller IO card Other 3 Gb enclosures
3 Gb or 6 Gb drives Note: A 3 Gb drive in a 6 Gb enclosure can transfer data at no more than 3 Gigabits per second.
Port C
Double arrow
Each cabling side can contain up to 14 IO Each cabling side can contain up to four IO Modules in the chain, which creates a maximum Modules in the chain, which creates a limit of 14 enclosures. maximum limit of four enclosures If all 14 enclosures are fully populated the maximum number of drives is 168 per chain. If all four enclosures are fully populated with 2.5 drives, the maximum number of drives is 96 per chain
24
SBOD Enclosures
SBOD Enclosures
Switched Bunch of Disk (SBOD) enclosures connect using two SBD modules. The SBOD enclosures are internally connected using a Switched Fabric architecture, in which data can be distributed directly to each disk. This architecture supports up to seven SBOD enclosures on a loop. SBOD can NOT coexist on a loop with a SATA enclosure One loop can contain a maximum of seven SATA enclosures An SBOD enclosure can contain only Fibre Channel drives
On/Off Switch SBD Modules Enclosure ID Switch
DIP Switches
On/Off Switch
Dell Compellent
25
Chapter 3 Enclosures
SBOD IO Modules
An SBOD IO module has four ports. Ports on the right IO Modules are numbered Host 0, Host 1, Host 2, and Host 3 from top to bottom. Ports on the left are numbered Host 3, Host 2, Host 1, and Host 0 from top to bottom. Host 0 is the input port, Host 1 is the output port.
Host 0
Host 3
Host 2
Host 0
Host 1
26
RS232
RS232
Speed Indicator
SBOD Enclosures
SBOD Port ID
Each enclosure on a fibre channel loop must have a unique ID number. Set the enclosure ID to a unique number from 17 using the Enclosure ID switch. New/changed ID settings are read only at power up, so cycle power on the enclosure to implement the changed setting. Note: Duplicate enclosure ID numbers are one of the most common configuration errors.
Enclosure Speed
SBOD enclosures are shipped set to 4 Gb, so by default only 4 Gb drives can be used. In addition: If a 2 Gb drive is installed in a 4 Gb enclosure, the drive goes into bypass mode and is not recognized by the system. A 2 Gb enclosure can be changed to 4 Gb by changing the DIP switches. If the disks on a loop are configured at 2 Gb, change the enclosure DIP switches to the 2 Gb setting as shown in Figure 19. 4 Gb enclosures can only exist in their own loop. Small form plugable transceivers (SFPs) can only be used in 4 Gb enclosures. The controller IO cards must be 4 Gb type.
4 Gb Switch Mode 2 Gb Switch Mode
DIP Switches
1 2 3 4 5 6 7 8 9 10 11 12
1 2 3 4 5 6 7 8 9 10 11 12
Key:
Dell Compellent
27
Chapter 3 Enclosures
SATA Enclosures
SATA disk enclosures support Fibre Channel connectivity to the controller and other enclosures. SATA disks are internally connected by an Arbitrated Loop, and all disks share resources on the Fibre Loop. This means that to write to the target disk, the communication path must go through all preceding disks, which limits the maximum number of SATA enclosures on a loop to five. SATA can not coexist on a loop with an SBOD enclosure SATA can coexist on a loop with a JBOD enclosure One loop can contain a maximum of five (5) SATA enclosures
On/Off Switch Service Control Modules (SCMs) Enclosure ID Switch
DIP Switches
On/Off Switch
Note: When installing an enclosure into the rack, make sure that it is oriented so that the DIP switches are located at the bottom.
28
SATA Enclosures
Output Port: Arrow points away from port Input Port: Arrow points toward port
Note: SATA uses arrows to indicate data transmission direction. Always use the blue ports.
SATA Enclosure ID
Each enclosure on a FC loop must have a unique ID number. Set the enclosure ID to a unique number from 1 to 7 using the Enclosure ID switch. New/changed ID settings are read only at system power up, so if changes are made, the entire system needs to be restarted. Note: Incorrectly numbered enclosures are one of the most common configuration errors.
Power On LED
Alarm Mute Switch System Fault LED Hub Mode (not used)
1
1
2 3 4 5 6 7 8 9 10 11 12
Dell Compellent
29
Chapter 3 Enclosures
Disk Drives
Consolidate drives into as few enclosures as possible. Because drives are massed into a virtual pool of storage, the exact location of a drive is not important. Caution: Always fill every slot in the enclosure, either with a disk or with an empty carrier. Operating a Storage Center with any modules missing disrupts airflow, which prevents the drives from being cooled sufficiently. Observe the following guidelines for handling drives: Insert an empty drive carrier in each unused drive bay to maintain a balanced airflow. Protect the drive from static discharge. Keep each drive in its protective packing container until ready to install. Always wear a grounded wrist or ankle strap. Install one drive at a time. Handle the drives by the edges of the frames. Handle drives with care, being careful not to drop or jar the drive.
7.2K
10K
15K
ESSD
Caution: Populating drives of different spindle rates (7.2K, 10K, or 15K) in the same column creates vibration that can slow IO and possibly produce errors. Make sure that each column contains drives of the same spindle rate.
30
Disk Drives
In a 12-disk enclosure, disk drives are installed horizontally, and are numbered as shown in Figure 23.
SC200 Enclosure Disk 0 Disk 4 Disk 8 Disk 1 Disk 5 Disk 9 Disk 2 Disk 6 Disk 10 Disk 3 Disk 7 Disk 11
EN-SASx6x12 Enclosure Disk 1 Disk 5 Disk 9 Disk 2 Disk 6 Disk 10 Disk 3 Disk 7 Disk 11 Disk 4 Disk 8 Disk 12
When installing drives into the 12-disk enclosure, make sure that all drives in a column are of the same spindle rate as shown in the example below. Column 1 Row 1 Row 2 Row 3
7.2K 7.2K 7.2K
Column 2
15K 15K 15K
Column 3
10K 10K 10K
Column 4
15K 15K 15K
Dell Compellent
31
Chapter 3 Enclosures
32
Disk Drives
2 1
Item
1 2
Control/Feature
Hard drive activity indicator
Description
Flashing green: Indicates drive activity Steady green: Indicates no drive activity Steady green: Normal operation Off: No power to the drive Flashes amber four times per second: Drive failed
Dell Compellent
33
Chapter 3 Enclosures
Item
1 2
Control/Feature
Amber LED Green LED
Description
Off: No drive, or drive is operating On: Drive fault Green: Connected, No activity Flashing: Activity Red: Locked Black: Unlocked
3 4
34
Disk Drives
Removing Disks
Failed disks may be removed without system downtime. The following instructions show removal of a Dell Enterprise Plus drive from a 24-disk enclosure. Other drive and carrier models are removed in a similar manner.
1 Press the release button. 2 Open the hard drive carrier. 3 Slide the drive out until it is free of the hard drive bay.
Dell Compellent
35
Chapter 3 Enclosures
Installing Disks
The following instructions show installation of the Dell Enterprise Plus drive into a 24-disk enclosure. Dell Enterprise Plus drives can only be installed in SC200/220 enclosures, however other drive and carrier models are installed in a similar manner.
1 Insert the hard drive carrier into the hard drive bay. 2 Slide the drive into the bay until the carrier contacts the backplane. 3 Close the hard drive carrier handle to lock the hard drive in place. 4 Continue to push firmly until you hear a click and the handle fully engages.
36
This chapter describes how to connect Dell Compellent controllers to Dell Compellent enclosures.
Contents
SC200/220 SAS Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 CT-SC040 Controller Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 SBOD Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
Dell Compellent
37
38
A A
B B
Dell Compellent
39
Enclosure 1
A A
B B
Enclosure 2
A A
Enclosure 3
B B
A A
B B
Enclosure 4
A A
B B
40
Enclosure 1 A A B B
Enclosure 2 A A Enclosure 3 A A B B B B
Enclosure 4 A A B B
Figure 31. Single SC8000 Controller, Four SAS Enclosures, Two IO Cards, Two Chains
Dell Compellent
41
Controller B
Enclosure A A B B
42
Controller B
Enclosure 1 A A B B
Enclosure 2 A A B B
Dell Compellent
43
Controller A
3 2 1
4 3 2 1
Controller B
4 3 2 1
4 3 2 1
Enclosure 1
A A B B
Enclosure 2
A A B B
Enclosure 3
A A B B
44
Dell Compellent
45
Controller A
4 3 2 1
3 2 1
Controller B
4 3 2 1
4 3 2 1
Enclosure 1 A A B B
Enclosure 5 A A B B
Enclosure 2 A A Enclosure 3 A A B B B B
Enclosure 6 A A Enclosure 7 A A B B B B
Enclosure 4 A A B B
Enclosure 8 A A B B
46
A A
B B
Dell Compellent
47
Enclosure 1
A A
B B
Enclosure 2
A A
Enclosure 3
B B
A A
B B
Enclosure 4
A A
B B
48
Enclosure 1 A A B B
Enclosure 2 A A Enclosure 3 A A B B B B
Enclosure 4 A A B B
Figure 38. Single CT-SC040 Controller, Four SAS Enclosures, Two IO Cards, Two Chains
Dell Compellent
49
Controller B
1 2 3 4
Enclosure 1 A A B B
Enclosure 2 A A B B
50
Controller A
1 2 3 4
Controller B
1 2 3 4
Enclosure 1
A A B B
Enclosure 2
A A B B
Enclosure 3
A A B B
Dell Compellent
51
52
Controller A
1 2 3 4
1 2 3 4
Controller B
Enclosure 1 A A B B
Enclosure 5 A A B B
Enclosure 2 A A B B
Enclosure 6 A A Enclosure 7 A A B B A A B B B B
Enclosure 3
Enclosure 4 A A B B
Enclosure 8 A A B B
Dell Compellent
53
EN-SASx6x12/24 Enclosures
Redundant cabling in Storage Center ensures that in the event one controller, IO card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). Each enclosure chain begins with an initiator port on the IO Card and ends with a target port on the IO Card to provide a complete communications path. Controller ports 1 and 2 on SAS IO Cards function as initiator ports, ports 3 and 4 are considered target ports. The A side of a chain starts at port 1 (initiator) and lands on the C port of the SAS enclosure (target). Enclosures are connected from B port to A port, using the top Storage Bridge Bay (SBB). The B side of an enclosure chain connects enclosure ports B to A on the bottom SBB. The enclosure chain is completed by connecting port C on the bottom SBB to port 3 (target) of the SAS IO Card.
This section provides cabling information for SASx6x12 and SASx6x24 enclosures to the following controllers: SC8000 Controller Cabling begins on page 55 CT-SC040 Controller Cabling begins on page 63
Make sure that each enclosure chain contains no more that 14 enclosures. Enclosure chains that exceed 14 enclosures will generate a critical warning in the System Manager and to Dell Technical Support Services.
54
EN-SASx6x12/24 Enclosures
Dell Compellent
55
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
56
EN-SASx6x12/24 Enclosures
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Figure 44. Single SC8000 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains
Dell Compellent
57
Controller B
Enclosure 1
Enclosure 2
58
EN-SASx6x12/24 Enclosures
Controller A
4 3 2 1
4 3 2 1
Dell Compellent
59
Enclosure 3
Enclosure 4
Figure 47. Dual SC8000 Controllers, Four Enclosures, One IO Card, One Chain
60
EN-SASx6x12/24 Enclosures
Dell Compellent
61
Controller A
4 3 2 1
Controller B
4 3 2 1
Enclosure 1
Enclosure 5
Enclosure 2
Enclosure 6
Enclosure 3
Enclosure 7
Enclosure 4
Enclosure 8
62
EN-SASx6x12/24 Enclosures
Enclosure
Dell Compellent
63
Enclosure 1
Enclosure 4
64
EN-SASx6x12/24 Enclosures
Enclosure 4
Figure 51. Single CT-SC040 Controller, Four 6 Gb Enclosures, Two IO Cards, Two Chains
Dell Compellent
65
Controller B
Enclosure 1
Enclosure 2
66
EN-SASx6x12/24 Enclosures
Dell Compellent
67
68
EN-SASx6x12/24 Enclosures
Controller A
Controller B
Enclosure 1
Enclosure 5
Enclosure 2
Enclosure 6
Enclosure 3
Enclosure 7
Enclosure 4
Enclosure 8
Dell Compellent
69
SBOD Enclosures
Redundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant loop includes an A side (shown in these diagrams in red) and B side (shown in blue). In a dual-controller Storage Center, each side of the loop begins on one controller and ends on the second controller. This section provides cabling information for SBOD enclosures to the following controllers: SC8000 Controller Cabling begins on page 71 CT-SC040 Controller Cabling begins on page 76 Note: SBOD enclosures are supported by the SC8000 controller only when migrated from existing Storage Centers.
70
SBOD Enclosures
Enclosure
Dell Compellent
71
1 2
Enclosure
72
SBOD Enclosures
Enclosure 1
Enclosure 2
Dell Compellent
73
Enclosure 3
74
SBOD Enclosures
Dell Compellent
75
Enclosure
76
SBOD Enclosures
Enclosure 1
Enclosure 2
Dell Compellent
77
Controller B
Enclosure
78
SBOD Enclosures
Enclosure 3
Dell Compellent
79
80
SATA Enclosures
SATA Enclosures
Redundant cabling in Storage Center ensures that in the event one controller, IO Card, or port fails, the running controller continues to send IO through functioning paths. A redundant enclosure chain includes an A side (shown in these diagrams in red) and B side (shown in blue). For connections to SATA enclosures, connect A sides of all enclosures together with one loop, then connect B sides together with a second loop. The A-side loop starts at the top of the first enclosure, and the B-side loop starts at the bottom of the last enclosure. This provides alternate paths to all drives in each enclosure.
Enclosure
Dell Compellent
81
Enclosure
82
SATA Enclosures
Enclosure 1
Enclosure 2
Dell Compellent
83
Enclosure 3
Enclosure 4
Enclosure 5
84
SATA Enclosures
Enclosure 4
Figure 69. Two SC8000 Controllers, Four SATA Enclosures, Single Loop
Dell Compellent
85
86
SATA Enclosures
Controller A
Controller B
Enclosure 1
Enclosure 5
Enclosure 2
Enclosure 6
Enclosure 3
Enclosure 7
Enclosure 4
Figure 70. Two SC8000 Controllers, Seven SATA Enclosures, Two Loops
Dell Compellent
87
Enclosure
88
SATA Enclosures
Enclosure 1
Enclosure 2
Dell Compellent
89
Enclosure 3
Enclosure 4
Enclosure 5
90
SATA Enclosures
Enclosure 3
Enclosure 4
Figure 74. Two CT-SC040 Controllers, Four SATA Enclosures, Single Loop
Dell Compellent
91
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Enclosure 5
Enclosure 6
Enclosure 7
Figure 75. Two CT-SC040 Controllers, Seven SATA Enclosures, Two Loops
92
Front-End Cabling
This chapter how to connect Dell Compellent controllers to servers, network appliances, and discusses redundancy.
Contents
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Legacy Mode vs. Virtual Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Server HBA Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 Switch Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95 Best Practices for Fibre Channel Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96 System Manager WWN Identification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 Multipath IO (MPIO) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 SC8000 Controller Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 CT-SC040 Front-End Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Dell Compellent
93
Overview
Front-end cabling refers to connections between the controller and the server. Servers should be connected to the controller through a network switch, which, when combined with cabling techniques provides redundancy through multipathing. Front-end connections can be can be made using iSCSI, Fibre Channel, or Fibre Channel over Ethernet (FCoE).
Legacy Mode
In legacy mode, front-end IO ports are broken into primary and reserve ports based on a fault domain. Fault domains identify port usage when a controller or port fails. During normal operation, IO is transported on primary ports only. Reserve ports remain in a standby mode until a controller failure, at which point the primary port fails over to the reserve port on the running controller.
Virtual Ports
When licensed, Storage Center can use Virtual Ports, which treats all ports as primary ports for transporting data. Virtual ports expand the number of possible server connections on the front end. In virtual port mode, all ports are active, and if one port fails, the load is distributed between the remaining ports within the same domain. A domain in Virtual Port mode is determined by the number of fabrics. A fabric is determined by the number of independent switches or VLANS, so the number of domains is based on whether separate VLANS or subnets will be used. To configure Virtual Ports, use the Storage Center System Manager Configure Local Ports wizard. See the Storage Center System Manager Administrators Guide for detailed instructions.
94
Switch Settings
Switch Settings
See Appendix C in the Storage Center System Manager Administrators Guide for information about switch settings.
Server
FC Switch
Legacy Mode
Server
FC Switch
Controller A
Controller B
Virtual Ports
Figure 76. Dual-Controller FC Legacy Mode vs. Virtual Ports
Dell Compellent
95
WWN Zoning
In WWN zoning, since the switch is seeking a WWN, a device may reside on any port or change physical ports and still be visible.
Legacy Mode
Include all Storage Center front-end WWNs or ports in a single zone. Create server zones that contain a single initiator and multiple targets, and which include the server HBA WWN.
FC Replication Zoning
Include all Storage Center physical WWNs from System A and B in a single zone. Include all Storage Center physical WWNs of System A and the virtual WWNs of System B on the particular Fabric. Include all Storage Center physical WWNs of System B and the virtual WWNs of System A on the particular Fabric. Note: Some ports may not be used or dedicated for replication, however ports that are used must be in these zones.
Port Zoning
In port zoning, only specific switch ports are visible, so if a storage device is moved to a different port, it is no longer visible to the switch. Note: Best practice for Virtual Ports mode is to zone with WWNs.
FC Replication Zoning
Include all Storage Center front-end ports from System A and System B in a single zone.
96
Dell Compellent
97
Multipath IO (MPIO)
MPIO software offers redundancy at the path level. MPIO loads as a driver on the server, and typically operates in a round-robin manner by sending packets first down one path and then the other. If a path fails, MPIO software continues to send packets down the functioning path. MPIO is operating-system specific. Windows Server 2003 uses Dell Compellent Multipath Manager. To install and configure the Dell Compellent Multipath Manager, see the Storage Center Multipath IO (MPIO) Manager for Microsoft Servers User Guide. Windows Server 2012, 2008, and 2008 R2 use the Microsoft Device-Specific Module (DSM) to manage all aspects of failover and load balancing. To install and configure the Microsoft DSM, see the Storage Center Microsoft Multipath IO (MPIO) Best Practices.
Corporate/Public Network
Switch
Controller
iDRAC
1 3 IPC
0 2 MGMT
1 Gb ETH 0
98
Corporate/Public Network
iDRAC iDRAC
Switch
Controller A
ETH 0 Port
1 3 0 2 IPC MGMT
ETH 1 Port
Controller B
ETH 1 Port
1 3 0 2 IPC MGMT
1 Gb ETH 0 Port
Dell Compellent
99
Corporate/Public Network
Switch
Controller
1 2
100
Corporate/Public Network
FC Switch
Controller
1 2
Dell Compellent
101
Corporate/Public Network
FC Switch
Ethernet Switch
Controller
1 2
102
Fault Domains
Storage Center cabling supports fault domains to increase redundancy. Fault domains can be implemented in either Legacy mode or in Virtual Port mode.
Switch 1
Switch 2
R1 R2 P2 P1
1 2
R4 P3 P4 R3
Controller B
Controller A
1 2
Dell Compellent
103
Server 1
Server 2 Switch 2
Switch 1
Controller A
Controller B
104
Non-MPIO
A dual-controller, dual-fabric FC configuration contains two independent FC switches. By mapping each volume into a separate fault domain, the IO load is spread over all the available primary ports and switches. Use Storage Center System Manager to map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 2 Fault Domain 2 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 4 (Switch 2)
MPIO
MPIO software allows the servers to support multiple FC connections to the same targets. This gives each server two routes to access each volume, which provides fault tolerance because each route is on a separate switch. You can connect MPIO in either Legacy Mode (Figure 85 on page 106) or using Virtual Ports (Figure 86 on page 107). Use Storage Center System Manager to map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 1 Fault Domain 3 (Switch 2) Volume 2 Fault Domain 2 (Switch 1) Volume 2 Fault Domain 4 (Switch 2) Volume 3 Fault Domain 1 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 2 (Switch 1) Volume 4 Fault Domain 4 (Switch 2)
Dell Compellent
105
Server 1
Server 2
Switch 1
Switch 2
1 2
4 3 2 1
Controller A
1 2
4 3 2 1
Controller B
Enclosure 1
Enclosure 2
106
Server 1
Server 2
Switch 1
Switch 2
4 3 2 1
Controller A
4 3 2 1
Controller B
Enclosure 1
Enclosure 2
Dell Compellent
107
iSCSI Failover
In virtual port mode, iSCSI follows the same cabling and port setup as Fibre Channel with the exception of the control port. iSCSI uses a control port configured for each fault domain. Servers connect to the control port, which redirects traffic to an appropriate virtual port. Each iSCSI network is isolated by either a Virtual LAN (VLAN) switch configuration or physical separation. When configuring MPIO, assign only the control port in the iSCSI Initiator software. Create separate and unique subnets for each individual iSCSI network. Separate iSCSI networks with the same subnet can confuse a server trying to determine the proper connection path. In addition, it is difficult to troubleshoot two separate networks in the same IP address range. In most circumstances, iSCSI networks do not need to be routed to a general use LAN or other local iSCSI networks. The exception is in routing to another iSCSI network at a disaster recovery site for volume replication. By multipathing over isolated iSCSI networks, you can reduce the risk of a network storm or normal LAN traffic affecting a Storage Center. In a Fibre Channel network, there is an almost immediate connection initiated between all ports that are zoned together. Once a connection is initiated, you can map volumes through that connection. Conversely, iSCSI is used over an IP based network which is not zoned, and you must initiate all connections from the servers. A Storage Center detects only iSCSI connections that are initiated by the server. Therefore, the server must initiate a connection to the controller before a volume can be presented to the server. The method of initiating a connection depends on whether legacy mode or Virtual ports are used: Legacy mode: The server initiates connections from each iSCSI port to the primary connections of the fault domains within the network associated with that server connection. Virtual port mode: The initiator connects to the control port. The control port sees all members with the same VLAN or subnet.
108
The Server is connected using a dual-port iSCSI IO card to the two networks:
Dell Compellent
109
Server Server Port 1 10.10.1.50 Ethernet Switch 1 iSCSI Network 1 10.10.1.x Server Port 2 10.10.2.50
R4 P3 R3 P4 P1 R1 P2 R2
Controller A
4 3 2 1
Controller B
4 3 2 1
Enclosure 1
Enclosure 2
110
Dell Compellent
111
Server Port 1 10.10.1.50 Server Port 2 10.10.2.50 Ethernet Switch 1 iSCSI Network 1 10.10.1.x
Controller A
4 3 2 1
Controller B
4 3 2 1
Enclosure 1
Enclosure 2
112
Corporate/Public Network
Controller
1 2 3 4 6
ETH 0 Port
Dell Compellent
113
Corporate/Public Network
Switch
Controller A
1 2 3 4
2 1
ETH 1 Port
1 2 3 4
2 1
ETH 0 Port
ETH 1 Port
114
Corporate/Public Network
Switch
Controller
Corporate/Public Network
iSCSI Switch
Controller
Dell Compellent
115
Corporate/Public Network
Ethernet Switch
Controller
116
Corporate/Public Network
FC Switch
Controller
Dell Compellent
117
Corporate/Public Network
Ethernet Switch
FC Switch
Controller
118
Fault Domains
Storage Center cabling supports fault domains to increase redundancy. Fault domains can be implemented in either Legacy mode or in Virtual Port mode.
Switch 1
Switch 2
R1
Controller B
R2 P1
P3
R3
R4
P2
1 2 3 4 4 3 2 1
P4
Controller A
1 2 3 4 4 3 2 1
Dell Compellent
119
Switch 1
Switch 2
Controller A
1 2 3 4 2 1
Controller B
1 2 3 4 2 1
120
Non-MPIO
A dual-controller, dual-fabric FC configuration contains two independent FC switches. By mapping each volume into a separate fault domain, the IO load is spread over all the available primary ports and switches. Map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 2 Fault Domain 2 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 4 (Switch 2)
MPIO
MPIO software allows the servers to support multiple FC connections to the same targets. This gives each server two routes to access each volume and each route is on a separate switch. You can connect MPIO in either Legacy Mode (Figure 85 on page 106) or using Virtual Ports (Figure 86 on page 107). Map volumes to the following fault domains: Volume 1 Fault Domain 1 (Switch 1) Volume 1 Fault Domain 3 (Switch 2) Volume 2 Fault Domain 2 (Switch 1) Volume 2 Fault Domain 4 (Switch 2) Volume 3 Fault Domain 1 (Switch 1) Volume 3 Fault Domain 3 (Switch 2) Volume 4 Fault Domain 2 (Switch 1) Volume 4 Fault Domain 4 (Switch 2)
Dell Compellent
121
Server 1
Server 2
Switch 1
Switch 2
Controller A
Controller B
Enclosure 1
Enclosure 2
122
Server 1
Server 2
Switch 1
Switch 2
Controller A
Controller B
Enclosure 1
Enclosure 2
Dell Compellent
123
iSCSI Failover
iSCSI follows the same cabling and port setup as Fibre Channel with the exception of the control port. iSCSI uses a control port configured for each of the fault domains. Servers connect to the control port, which then redirects traffic to the appropriate virtual port. When configuring MPIO, assign only the control port in the iSCSI Initiator software. iSCSI Failover on page 108 describes this in more detail. This section provides cabling examples for the CT-SC040 controller.
The Server is connected using a dual-port iSCSI IO card to the two networks:
124
Server Server Port 1 10.10.1.50 Ethernet Switch 1 iSCSI Network 1 10.10.1.x Server Port 2 10.10.2.50 Ethernet Switch 2 iSCSI Network 2 10.10.2.x
P2 P1 R1 R2
Controller A
R4
P4
P3
R3
Controller B
Enclosure 1
Enclosure 2
Dell Compellent
125
126
Controller A
Controller B
Enclosure 1
Enclosure 2
Dell Compellent
127
128
This chapter describes how to add or remove Dell Compellent enclosures from a Storage Center.
Contents
Using Storage Center System Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129 Adding SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131 Removing SC200/220 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 Adding EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146 Removing EN-SASx6x12/24 Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155 Adding SBOD or SATA Enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160
Dell Compellent
129
View Enclosures
Display a list of enclosures (and their attributes) attached to this Storage Center. In the System Explorer Tree, select Enclosures. The right pane displays a list of enclosures.
130
Dell Compellent
131
6 In the Storage Manager System Tree, confirm the number of enclosures. 7 Connect last Enclosure (4): bottom, port B Controller: slot 6, port 4. 8 Verify that the last enclosure has been added as described in steps 4 through 6 above. 9 If there are no managed disks in this system, the System Manager does not assign an Index number. If the system contains a managed disk in any enclosure, the System Manager assigns an index number to the new enclosures. 10 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. 11 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.
132
Controller
Enclosure 1
Enclosure 2
Enclosure 3
Dell Compellent
133
IO continues through the B-side cables. 2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation. 3 Move the cable from Enclosure 2: top, port B Enclosure 4: top, port B. 4 Use new cables to connect the new enclosures to the A-side cabling (Figure 105 on page 135): Enclosure 2: top, port B Enclosure 3: top, port A. Enclosure 3: top, port B Enclosure 4, top, port A.
Enclosures 3 and 4 are now part of the A side chain and can now be connected to Controllers A and B.
134
Controller B
Enclosure 2
Add cable Enclosure 3 Connect Enclosures (A side) Add cable New Enclosures Enclosure 4
5 Reconnect the A-side Controller cables: a Enclosure 4: top, port B Controller B: slot 6, port 3. b Enclosure 1: top, port A Controller A, slot 6, port 1.
Dell Compellent
135
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
6 Check the port configurations: a In the Configure Local Ports wizard (See Figure 103 on page 131), make sure that both controller ports show their status as Up. b Make sure that all drives in the new enclosures are recognized. c Make sure the Target Count equals the number of drives. 7 Disconnect the B-side cables from the controllers as shown in Figure 118: Controller A: slot 6 port 3. Controller B, slot 6 port 1.
136
IO continues through the A-side cables. 8 Move the cable from Enclosure 2: bottom, port B Enclosure 4: bottom, port B. 9 Use new cables to connect the new enclosures to the existing enclosures (B side): Enclosure 2: bottom, port B Enclosure 3: bottom, port A. Enclosure 3: bottom port B to Enclosure 4: bottom port A.
Enclosures 3 and 4 are now part of the B-side chain and can now be connected to Controllers A and B.
Controller A
Enclosure 1
10 Connect Enclosure 4: bottom, port B Controller A: slot 6, port 3. 11 Reconnect Enclosure 1: bottom, port A Controller B: slot 6, port 1.
Dell Compellent
137
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
12 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. For more information, see the Storage Center System Manager Administrators Guide. 13 In the Storage Manager System Tree, view the list of enclosures. See Figure 102 on page 130. The System Manager assigns an index number to all managed drives. 14 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.
138
Add an Enclosure
Add an additional enclosure while maintaining redundancy. 1 Power on the enclosures being added. When the enclosures spin up, make sure that the front panel enclosure and power status LEDs show normal operation. 2 Remove the two IPC cables from the Controllers, ports 2 and 4. 3 Connect: Controller A, port 2 new Enclosure 3: top, port A. 4 Connect Enclosure 3: top, port B Controller B, port 4. 5 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of port 2 of Controller A is Up Status of port 4 of Controller B is Up. The Target Count of Controller A, port 2 and Controller B, port 4 recognizes the drives in Enclosure 2. Purpose for Controller A, port 2 and Controller B, port 4 are set to back-end.
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 3
Dell Compellent
139
7 Connect Enclosure 3: bottom, port A Controller B: port 2. 8 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of port 4 of Controller A is Up Status of port 2 of Controller B is Up. The Target Count of Controller A, port 4 and Controller B, port 2 recognizes the drives in Enclosure 2. Purpose for Controller A, port 4 and Controller B, port 2 are set to back-end.
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 2
140
Release Disks
Release disks to remove them from the pool in preparation of removing the enclosure. 1 In the Storage Center tree, expand the Disks folder to view the disks in the enclosure. 2 Select all the disks in the enclosure you are removing. 3 From the shortcut menu, select Release Disk. The Release Disk wizard starts. 4 Note the warning and click Yes to continue. The disk is immediately released and a dialog box opens asking if you wish to rebalance RAID devices now, later, or skip balancing. 5 Click Yes. Wait for the rebalance operation to finish. Enclosures with all drives in the unassigned disk folder are now safe to remove.
Dell Compellent
141
Controller A
Disconnect A side
Controller B
Enclosure 1
Enclosure 3
Enclosure 4
4 Move the cable from Enclosure 1: top, port A Enclosure 2: top, port A. 5 Reconnect the top cable to Controller A: slot 6, port 1.
142
Controller A
Controller B
Enclosure 2
Enclosure 3
Enclosure 4
Caution: To disconnect the B-side chain without a system outage, it is crucial that you first disconnect the B-side cable from the controller.
Dell Compellent
143
Controller B
Enclosure 1
Remove the B-side cable between enclosures Enclosure 2 Move to Enclosure 2, bottom, port A
Enclosure 3
Enclosure 4
Figure 113. Disconnecting the SC200/220 Enclosure from the B-side Chain
4 Reconnect the B-side cable to Controller B: slot 5, port 1. 5 The top enclosure is now disconnected and can be removed.
144
Reconnect B side
Controller A
Controller B
Dell Compellent
145
2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the front panel LED and all drive LEDs are green. 3 Connect the Controller: slot 6, port 4 Enclosure 3: top, port C. 4 From the Storage Management window, select System Setup Configure Local Ports. 5 Verify that Storage Center recognizes the new drives: a Verify that slot and slot port (in this case, slot 6, port 3) are Up and the Purpose is set to back-end. b Verify that Target Count equals the number of added drives, demonstrating that the controller recognizes the new enclosures. c Confirm the number of enclosures in the Storage Manager System Tree. 6 Connect last Enclosure (4): bottom, port C Controller: slot 6, port 2. 7 Verify that the last enclosure has been added as described in Step 4 through 5c above. 8 If there are no managed disks in this system, the System Manager does not assign an Index number. If the system contains a managed disk in any enclosure, the System Manager assigns an index number to the new enclosures. Make sure that the Index number matches the number on the front panel. 9 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. 10 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.
146
Controller
Enclosure 1
Enclosure 2
Enclosure 3
Dell Compellent
147
IO continues through the B-side cables. 2 Turn on each of the enclosures being added. When the enclosures spin up, make sure that the Ops Panel LED (SAS Enclosure Rear View on page 22) and all drive LEDs are green. 3 Use new cables to connect the new enclosures to the existing A-side enclosure connections (Figure 116 on page 149): Enclosure 2: top, port B Enclosure 3: top, port A. Enclosure 3: top, port B Enclosure 4: top, port A.
Enclosures 3 and 4 are now part of the A side chain and can be connected to Controllers A and B. 4 Move the cable from Enclosure 2: top, port C Enclosure 4: top, port C.
148
Controller A
Enclosure 1
Enclosure 3
5 Reconnect the A-side Controller cables: Enclosure 4: top, port C Controller B: slot 6, port 3. Enclosure 1: top, port C Controller A: slot 6, port 1.
Dell Compellent
149
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
6 Check the port configurations: a In the Configure Local Ports wizard (See Figure 103 on page 131), make sure that both controller ports show their status as Up. b Make sure that all drives in the new controllers are recognized. c Make sure the Target Count equals the number of drives. 7 Disconnect the B-side cables from the controllers as shown in Figure 118: Controller A: slot 5, port 3. Controller B: slot 5, port 1.
IO continues through the A-side cables. 8 Use new cables to connect the new enclosures to the existing enclosures (B side): Enclosure 2: bottom, port A Enclosure 3: bottom, port B. Enclosure 3: bottom, port A to Enclosure 4: bottom, port B.
Enclosures 3 and 4 are now part of the B-side chain and can be connected to Controllers A and B.
150
9 Move the cable from Enclosure 2: bottom, port C Enclosure 4: bottom, port C.
Controller A
Enclosure 1
Enclosure 3
Enclosure 4
10 Connect Enclosure 4: bottom, port C Controller B: slot 5, port 1. 11 Reconnect Enclosure 1: bottom, port C Controller A: slot 5, port 3.
Dell Compellent
151
Controller A
Controller B
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
12 The Storage Center System Manager informs you that you have new, unassigned disks. Move the unassigned disks to the managed disk folder. For more information, see the Storage Center System Manager Administrators Guide. 13 In the Storage Manager System Tree, view the list of enclosures. See Figure 102 on page 130. The System Manager assigns an index number to all managed drives. Make sure the index number shown in the Enclosures window matches the Index number on the enclosure front panel. 14 To redistribute data across all drives, from the Storage Management menu, select Disk Rebalance RAID.
152
Controller B
Enclosure 1
Enclosure 2
6 Connect Controller A: slot 6, port 4 new Enclosure 2: bottom, port B. 7 Connect Enclosure 2: bottom, port C Controller B: slot 6, port 2. 8 In the Configure Local Ports wizard (see Figure 103 on page 131), make sure that: Status of slot 6, port 4 of Controller A is Up
Dell Compellent
153
Status of slot 6, port 2 of Controller B is Up. The Target Count of Controller A: slot 6, port 4 and Controller B: slot 6, port 2 recognizes the drives in Enclosure 2. Purpose for Controller A: slot 6, port 4 and Controller B: slot 6, port 2 are set to back-end.
Controller A
Controller B
Enclosure 1
Enclosure 2
154
Release Disks
Release disks to remove them from the pool in preparation of removing the enclosure. 1 In the Storage Center tree, expand the Disks folder to view the disks in the enclosure. 2 Select all the disks in the enclosure you are removing. 3 From the shortcut menu, select Release Disk. The Release Disk wizard starts. 4 Note the warning and click Yes to continue. The disk is immediately released and a dialog box opens asking if you wish to rebalance RAID devices now, later, or skip balancing. 5 Click Yes. Wait for rebalance operation to finish. Enclosures with all drives in the unassigned disk folder are now safe to remove.
Dell Compellent
155
Enclosure 1
Enclosure 3
Enclosure 4
156
4 Move the cable from Enclosure 1: top, port C Enclosure 2: top, port C. 5 Reconnect the top cable to Controller: slot 6, port 1.
Controller
Enclosure 1
Enclosure 2
Enclosure 3
Enclosure 4
Dell Compellent
157
Enclosure 3
Enclosure 4
4 Reconnect the B-side cable to slot 6, port 3 of the controller. 5 The top enclosure is now disconnected and can be removed.
158
Reconnect B side
Controller
Dell Compellent
159
160
Verify Paths
Identify if and where an enclosure can be added. 1 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 2 Maximize the Configure Local Port wizard so that you can see the Target Count column. The Target Count column displays the number of drives per loop. In a dual-controller configuration, each loop has four system connections, two connections per controller. In a single-controller configuration, each loop has two system connections. Before disconnecting any cables, verify that all involved back-end ports can see all disks. Caution: If all involved back-end ports cannot see all disks, do not proceed any further. Contact Dell Technical Support Services.
Phone Home
Send the Storage Center information to Dell Technical Support Services using Phone Home. 1 In the Storage Management menu, select System Phone Home Phone Home. 2 Click Phone Home Now. 3 Wait for confirmation that the Phone Home completed successfully.
Dell Compellent
161
Enclosure IO Ports
The following example illustrates the procedure to add a third SBOD enclosure to a dual-controller system without taking an outage. SBOD enclosures are used as illustration, but the procedure is the same for SATA. SBOD and SATA rules apply.
Add an Enclosure
Physically prepare the enclosure. 1 Rack the enclosure. 2 Install the disk drives into the enclosure. If you are adding fewer than 16 drives, make sure that drives are installed in slot 1 and slot 16, and that unused slots are filled with empty drive carriers to maintain airflow. 3 Assign a shelf ID to the enclosure that is unique within the loop. 4 Verify DIP switch settings, making sure that you do not have a 4 Gb enclosure and a 2 Gb enclosure in the same loop.
4 Gb Switch
1 2 3 4 5 6 7 8 9 10 11 12
2 Gb Switch
1 2 3 4 5 6 7 8 9 10 11 12
5 Turn on the enclosures. 6 Verify that the green LED is illuminated on each drive, indicating that the drives are working. 7 In the Storage Management menu, select System Setup Configure Local Ports. 8 Verify that the number of back-end ports correlates to the number of Target Count ports, and that the count equals the current number of disks in the system.
162
Host 0
Host 3
Host 2
Host 0
IN
Host 1
OUT
Dell Compellent
RS232
OUT
RS232
OUT
IN
IN
OUT
SATA IO Ports
163
1 Move the B-side cable from Enclosure 1: left module, Host 1 Enclosure 2: left module, Host 1.
Controller A
Controller B
Enclosure 1
Enclosure 2
164
Controller B
Enclosure 1
Enclosure 2
Add Enclosure connection
3 In the Storage Center System Manager, select Storage Management System Setup Configure Local Ports. 4 Maximize the Configure Local Port wizard so that you can see the Network, Usage, and Target Count columns. Verify that the Target Count increased equal to the number of drives added.
Dell Compellent
165
5 Move the A-side cable from Enclosure 1: right module, Host 1 Enclosure 2: right module, Host 1.
Controller A
Controller B
Enclosure 1
Enclosure 2
166
Controller B
Enclosure 1
Add Enclosure connection
Enclosure 2
7 In System manager, refresh the Configure Local Ports wizard by clicking the Refresh button. 8 Verify the that the Target Count increased on the back end that was added. 9 From the Storage Management menu, select Disk Manage Unassigned Disks. The Add Disk wizard takes you through the disk management process and prompts you to rebalance data on the drives. See the Storage Center System Manager Administrators Guide for more information on RAID Rebalance.
Dell Compellent
167
168
680-027-013 A