NetApp PhysicalStorare PPT2

Physical Storage
Module 3 Data ONTAP 7-Mode Administration
Module Objectives
By the end of this module, you should be able to: Describe Data ONTAP RAID technology Identify a disk in a disk shelf based on its ID Execute commands to determine a disk ID Identify a hot-spare disk in a FAS system Describe the effects of using multiple disk types Create a 32-bit and a 64-bit aggregate Execute aggregate commands in the Data ONTAP operating system
2011 NetApp, Inc. All rights reserved. 2
Storage
The Data ONTAP operating system provides data storage for clients: A volume (or a smaller increment within vol1 a volume) makes storage available to clients through protocols. Volumes are contained in an aggregate. aggr1 Aggregates are not visible to clients.
2011 NetApp, Inc. All rights reserved.
Storage Architecture
Storage Architecture: Aggregates

Aggregates: Are created by administrators aggr1 Contain one or two plexes Aggregate types: plex0 Traditional: deprecated 32-bit: 16-TB limitation 64-bit: Data ONTAP 8.0.x operating system only
system> aggr status Aggr State aggr_trad online Status Options raid4, trad 32-bit raid_dp, aggr root 32-bit raid_dp, aggr 64-bit
5
aggr0
aggr1
online
online
Storage Architecture: Plexes

A plex: is a physical copy of the WAFL file system When used with SyncMirror software, provides mirror capabilities Contains one or more RAID groups If mirroring is not used, is limited to one per aggregate
aggr1
plex0 rg1
rg0
system> sysconfig -r ... Plex /aggr1/plex0 (online, normal, active, pool0) RAID group /aggr1/plex0/rg0 (normal) ... RAID group /aggr1/plex0/rg1 (normal)
...
Disks belong to pool0 unless part of SyncMirror.

6
Storage Architecture: RAID Protection

RAID group:
Provides data protection Contains two or more disks
aggr1
RAID types:
RAID 4 RAID-DP technology (a RAID 6 implementation)
rg0
plex0 rg1
system> sysconfig -r ... RAID group /aggr1/plex0/rg0 (normal) RAID Disk Device HA SHELF BAY CHAN Pool... --------- ------ ------------- ---- ---parity 0a.24 0a 1 8 FC:A 0... data 0a.25 0a 1 9 FC:A 0...
Storage Architecture: Disks

Disks:
Store data Are contained in shelves
aggr1
Disk types:
Parity
Data
Composed of 4-KB blocks
rg0
plex0 rg1
system> sysconfig -r ... RAID group /aggr1/plex0/rg0 (normal) RAID Disk Device HA SHELF BAY CHAN Pool... --------- ------ ------------- ---- ---parity 0a.24 0a 1 8 FC:A 0... data 0a.25 0a 1 9 FC:A 0...
Disks
Disks
All data is stored on disks. To understand how physical media is managed in your storage system, you need to be familiar with:
Disk types (FC, SATA, SAS, SSD) Disk qualification Disk ownership Spare disks
10
Disk Qualification
NetApp allows only qualified disks to be used with the Data ONTAP operating system. Qualification
Ensures quality and reliability Is enforced by /etc/qual_devices
Caution!
Modifying the disk qualification requirement file can cause your storage system to halt.
11
Supported Disk Connection Architectures
FC-AL
DS14mk4 (ESH2 or ESH4)
SAS
DS4243
DS14mk2AT
DS2246
12
FC-AL Architecture
FC and ATA disks connect through an FC-AL (Fibre Channel Arbitrated Loop) architecture with ESH (electronically switched hub) technology Uses FC and ATA disks types
e0a
e0b e0c e0d e0e e0f

LINK LINK LINK LINK LINK
0a
0b
LINK LINK
0c
0d
LINK
ESH
DS14
FC
Power
MK4
Fault
Loop A
Loop B
System
Shelf ID
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
13
FC-AL Device Names

The system assigns the device ID automatically through the host_adapter and disk_id.
system> sysconfig -r Aggregate aggr0 (online, raid_dp, redirect) (block checksums) Plex /aggr0/plex0 (online, normal, active) RAID group /aggr0/plex0/rg0 (normal)
RAID Disk --------dparity parity data Device -----0a.16 0a.17 0a.18 HA -0a 0a 0a SHELF BAY CHAN Pool Type ----- --- ---- ---- ---1 0 FC:A FCAL 1 1 FC:A FCAL 1 2 FC:A FCAL RPM ---10000 10000 10000 Used (MB/blks)... -------------34000/69632000... 34000/69632000... 34000/69632000...
Device ID = host_adapter.disk_id
14
FC-AL Device Names: host_adapter

The host_adapter designates the slot and port where an adapter is located.
0a
0a
LINK
e0a
e0b e0c e0d e0e e0f
0b
LINK LINK
0c
0d
LINK
LINK
LINK LINK
LINK
13
14
15
10
16
FAS6280 with optional IOXM

FC-AL Device Names: disk_id

DS14
FC
Power
MK4
Fault
Loop A
Loop B
System
Shelf ID
Shelf ID
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
13 12 11 10 Shelf ID 1 2
Bay Number
Bay Number 130 130
Disk ID 2916 4532
3
4 5 6 7
130
130 130 130 130
6148
7764 9380 10996 125112
16
The fcstat device_map Command

Use the fcstat command to troubleshoot disks and shelves. Use the fcstat device_map command to display the relative physical position of the drives on an FC loop and the mapping of devices to shelves.
system> fcstat device_map
Loop Map for channel 0a: Translated Map: Port Count 7 29 Shelf mapping: Shelf 1: 29 Loop Map for channel 0b: Translated Map: Port Count 7 45 Shelf mapping: Shelf 2: 45 15 28 27 25 26 23 22 21 20 16 19 18 17 24 28 BYP 26 25 24 23 22 21 20 19 18 17 XXX 15 44 43 41 42 39 38 37 36 32 35 34 33 40 44 43 42 41 40 39 38 37 36 35 34 33 32
https://kb.netapp.com/support/index?page=content&id=3012395
17
SAS Architecture
Serial Attached SCSI (SAS) provides the affordability of SATA with the reliability of FC SAS uses expanders
Expanders are switches Maintain point-to-point connections with disks
e0a
e0b e0c e0d e0e e0f

LINK LINK LINK LINK LINK
0a
0b
LINK LINK
0c
0d
LINK
Uses SATA, SAS and SSD disk types Expander
Expander
18
SAS Device Names

The system assigns the device ID automatically through the host_adapter, shelf_id and bay_id.
system> sysconfig -r Aggregate aggr0 (online, raid_dp, redirect) (block checksums) Plex /aggr0/plex0 (online, normal, active) RAID group /aggr0/plex0/rg0 (normal)
RAID Disk --------dparity parity data Device -----0a.00.18 0a.00.19 0a.00.20 HA -0a 0a 0a SHELF ----00 00 00 BAY --18 19 20 CHAN Pool Type ---- ---- ---SA:A SAS SA:A SAS SA:A SAS RPM... ---15000... 15000... 15000...
Device ID = host_adapter.shelf_id.bay_id
19
SAS Device Names Example

RAID Disk --------dparity parity data Device -----0a.00.18 0a.00.19 0a.00.20 HA SHELF BAY... -- ----- --0a 00 18... 0a 00 19... 0a 00 20...
3
0a
0a
LINK
e0a
e0b e0c e0d e0e e0f
0b
LINK LINK
0c
0d
LINK
LINK
LINK LINK
LINK
Shelf ID of 00
Bay 0
Bay 1
Bay 2
Bay 3
Bay 20
Bay 23
20
Disk Ownership
Disks are assigned to one system controller. Disk ownership is either:
Hardware-based: determined by the slot position of the host bus adapter (HBA) and shelf module port Software-based: determined by the storage system administrator
Storage Systems FAS6200 series FAS6000 series FAS3200 series FAS3100 series FAS3000 series FAS2000 series Software Disk Ownership X X X X X X Hardware Disk Ownership
21
Determining Disk Ownership

To determine your systems ownership:
system> storage show
Hardware-based output: SANOWN not enabled Software-based output: report on the current ownership
In a stand-alone storage system without SyncMirror synchronous mirroring software:

Disks are owned by one controller Disks are in pool0
22
Hardware-Based Ownership
Determined by two conditions:
1. 2. How a storage system is configured How the disk shelves are attached to the storage system
A standalone system owns all disks that are directly attached to it. If part of a high-availability configuration:
Local node owns the disks connected to the ESH A channel Partner node owns the disk connected to the ESH B channel
4Gb 2Gb 1Gb ELP
X2
1Gb
2Gb
4Gb
SHELF ID
A B
ES H 4
4Gb 2Gb 1Gb ELP
Channel B
X2
ESH4
Channel A
Software-Based Ownership
Ownership is determined by the system administrator: To verify current ownership:
system> disk show -v DISK OWNER --------- --------------0b.43 Not Owned ... 0b.29 system (84165672) ... POOL ----NONE Pool0 SERIAL NUMBER ------------41229013 41229011
To view all disks without an owner:

system> disk show -n DISK OWNER --------- --------------0b.43 Not Owned ...
POOL ----NONE
SERIAL NUMBER ------------41229013

24
Software-Based Ownership: Disk Assign

To assign disk ownership:
system> disk assign {device_list|all| [-T storage_type] -n count|auto}... device_list is the disk IDs of the unassigned disks T is ATA, FCAL, LUN, SAS, or SATA
To assign a specific set of disks:

system> disk assign 0b.43 0b.41 0b.39
To assign all unassigned disks:

system> disk assign all
To unassign disks:
Specify the device IDs that you want to work with.
system> disk assign 0b.39 -s unowned -f

Use -s to specify the sysid to take ownership. Use -f to force assignment of previously assigned disks. NOTE: Unassign only hot-spare disks.
Software-Based Ownership: Auto Assign

Automatic assignment option:
system> options disk.auto_assign
This option specifies whether disks are automatically assigned on systems with software disk ownership. The default is on. The Data ONTAP operating system assigns unassigned disks to the system and pool based upon the disk loop. Automatic assignment is invoked:
10 minutes after boot Every five minutes
system> disk assign auto
26
Disk Selection
When creating an aggregate, the Data ONTAP operating system selects disks:
With the same speed That match the speed of existing disks
The Data ONTAP operating system verifies that adequate spares are available.
If spares are not available, the Data ONTAP operating system warns you. NOTE: NetApp recommends that spares be available.
Using Multiple Disk Types in an Aggregate

Drives in an aggregate can be:
Different speeds (not recommended) On the same shelf or on different shelves
Not all drive types can be mixed within an aggregate:

FC and SAS can be mixed (not recommended) FC and SATA or SAS and SATA cannot be mixed
28
Spare Disks
Spare disks are used to:
Increase aggregate capacity Replace failed disks
Disks must be zeroed before use:

Disks are automatically zeroed when they are brought into use. NetApp recommends zeroing disks before use:
system> disk zero spares
29
NetApp System Manager: Disks
Select Disks to reveal a list of disks.
30
Disk Protection and Validation
31
Disk Protection and Validation

The Data ONTAP operating system protects data through RAID. The Data ONTAP operating system verifies data through disk scrubbing.
32
RAID Groups
RAID groups are a collection of data disks and parity disks. RAID groups provide protection through parity. The Data ONTAP operating system organizes disks into RAID groups. The Data ONTAP operating system supports:
RAID 4 RAID-DP technology
33
RAID 4 Technology
RAID 4 protects against data loss that results from a single-disk failure in a RAID group. A RAID 4 group requires a minimum of two disks:
One parity disk One data disk
Data
Data
Data
Data
Data
Data
Data
Parity
34
RAID-DP Technology
RAID-DP technology protects against data loss that results from double-disk failures in a RAID group. A RAID-DP group requires a minimum of three disks:
One parity disk One double-parity disk One data disk
Data
Data
Data
Data
Data
Data
Parity
DoubleParity
35
RAID Group Size

RAID-DP NetApp Platform All storage systems (with SATA disks) All storage systems (with FC or SAS disks) Minimum Group Size 3 3 Maximum Group Size 16 28 Default Group Size 14 16
RAID 4 NetApp Platform All storage systems (with SATA) All storage systems (with FC or SAS) Minimum Group Size 2 Maximum Group Size 7 Default Group Size 7
14
36
Growing Aggregates
Take care with how you grow your aggregates.
Existing rg0
Data Data Data Data Data Data Data Parity
Existing rg1
Data
Data
Data
Data
Data
Data
Data
Parity
If you grow this configuration by three disks when the existing disks are nearly full, the new data disks can become hot disks.
Data
Parity
37
Disk Failure and Physical Removal

To fail a disk: system> disk fail device_id
To unfail a disk: system> priv set advanced system*> disk unfail device_id To unload a disk so that it can be physically removed: system> disk remove device_id
The disk is now ready to be pulled from the shelf.
41
Degraded Mode
Degraded mode occurs when a disk fails in a RAID group During degraded mode:
Data is still available Performance is less than optimal
Data must be recalculated from parity until the failed disk is replaced. CPU usage increases to calculate from parity.
The failed disk (or disks for RAID-DP) will be rebuilt on a spare drive (if available)
If no spares are available or if the rebuild fails, the system shuts down after a period of time.
To change the time interval, use the options raid.timeout command.
The default value is 24 hours.
44
Hot-Swapping: Replacing Failed Disks

Hot-swapping is the process of removing or installing a disk drive while the system is running. Hot-swapping allows for:
Minimal interruption The addition of new disks
Removing two disks from a RAID 4 group results in:

Double-disk failure Data loss
Removing two disks from a RAID-DP group results in:

Double-degraded mode No data loss
45
Replacing Failed Disks
750 GB
1 TB
750 GB
750 GB
750 GB
750 GB
NOTE: When a larger disk replaces a smaller disk, disk resizing occurs.
46
Disk Replacement
To replace a data disk with a spare disk:
system> disk replace start device_id spare_device_id system> disk replace start 0a.21 0a.23
0a.20 0a.21 0a.22 0a.23
Parity Disk
Data Disk
Target Disk
Data Disk
Spare Disk
To check the status of a replace operation:

system> disk replace status
To stop a disk replace operation:

system> disk replace stop device_id
47
Aggregates
48
Aggregates
Aggregates logically contain flexible volumes (FlexVol volumes). NetApp recommends that aggregates be 32-bit or 64-bit. An aggregate name must:
Begin with a letter or the underscore character (_) Contain only letters, digits, and underscore characters Contain no more than 255 characters A single storage system supports up to 100 aggregates (including traditional volumes)
49
Adding an Aggregate
Use one of two methods:
The CLI: system> aggr create ... NetApp System Manager: the Aggregate Wizard
Know the following information:

Aggregate name (required) Aggregate type (32-bit is default) RAID Type (DP is default) RAID group size Disk selection method Disk size Number of disks including parity (required)
Minimum options shown
50
To create an aggregate:
system> aggr create aggr1 3
Using the CLI to Create an Aggregate

To create a 64-bit aggregate:
system> aggr create aggr -B 64 24
The 64-bit aggregate, which is called aggr, has 24 disks. By default, the aggregate uses RAID-DP technology. The command succeeds only if 24 disks (spares) are available. To create a 32-bit aggregate:
system> aggr create aggr -B 32 24
or
system> aggr create aggr 24
32-Bit or 64-Bit Aggregate

For creating aggregates, NetApp recommends the following:
32-bit
Maximize performance when no more than 16 TB of space is needed.
64-bit
Achieve high performance and the ability to exceed the 16-TB limitation.
52
Common Aggregate Commands

To grow an existing aggregate:
system> aggr add aggr [options] disk_number
system> aggr status aggr [options] system> aggr rename aggr new_aggr system> aggr offline aggr system> aggr online aggr Before you take an aggregate offline, destroy all volumes inside the aggregate. Before you destroy an aggregate, take it offline.
To review the status of an aggregate: To rename an aggregate:
To take an aggregate offline: To put an aggregate back online:
To destroy an aggregate:
system> aggr offline aggr system> aggr destroy aggr
53
NetApp System Manager: Storage View
Select Storage and launch the wizard to configure storage.
54
Storage Configuration Wizard
If NFS and CIFS are licensed, this page appears.
55
Storage Configuration Wizard Summary
56
NetApp System Manager: Aggregate
Select Aggregates to administrate aggregates.
Select Create to create an aggregate.
57
Create Aggregate Wizard
For a 64-bit aggregate, select this option. For a 32bit aggregate, do not select the option.
Create Aggregate Wizard Conclusion
59
Create Aggregate Wizard Results
60
Exercise
Module 3: Physical Storage Estimated Time: 60 minutes
Check Your Understanding: Answers

What is a RAID group?
A collection of disks that is organized to protect data. A RAID group includes: One or more data disks One or two parity disks for protection
Why use double parity?

To protect against a double-disk failure
65
Check Your Understanding: Answers

If the RAID group size is 16, the following command creates how many RAID groups and an aggregate of what type?
system> aggr create newaggr 32
Two RAID groups A 32-bit aggregate
What is the minimum number of disks in a RAID-DP group?

Three disks (one data disk, one parity disk, and one double-parity disk)
66

NetApp PhysicalStorare PPT2

Diunggah oleh

Informasi Dokumen

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

NetApp PhysicalStorare PPT2

Diunggah oleh

Hak Cipta:

Format Tersedia

Physical Storage

Module 3 Data ONTAP 7-Mode Administration

2011 NetApp, Inc. All rights reserved.

2011 NetApp, Inc. All rights reserved.

Storage Architecture: Aggregates

Storage Architecture: Plexes

Disks belong to pool0 unless part of SyncMirror.

2011 NetApp, Inc. All rights reserved.

Storage Architecture: RAID Protection

Storage Architecture: Disks

2011 NetApp, Inc. All rights reserved.

2011 NetApp, Inc. All rights reserved.

2011 NetApp, Inc. All rights reserved.

Supported Disk Connection Architectures

2011 NetApp, Inc. All rights reserved.

e0b e0c e0d e0e e0f

2011 NetApp, Inc. All rights reserved.

FC-AL Device Names

2011 NetApp, Inc. All rights reserved.

FC-AL Device Names: host_adapter

e0b e0c e0d e0e e0f

FAS6280 with optional IOXM

FC-AL Device Names: disk_id

Bay Number 130 130

Disk ID 2916 4532

2011 NetApp, Inc. All rights reserved.

The fcstat device_map Command

2011 NetApp, Inc. All rights reserved.

e0b e0c e0d e0e e0f

Uses SATA, SAS and SSD disk types Expander

2011 NetApp, Inc. All rights reserved.

SAS Device Names

2011 NetApp, Inc. All rights reserved.

SAS Device Names Example

e0b e0c e0d e0e e0f

2011 NetApp, Inc. All rights reserved.

Determining Disk Ownership

In a stand-alone storage system without SyncMirror synchronous mirroring software:

2011 NetApp, Inc. All rights reserved.

To view all disks without an owner:

SERIAL NUMBER ------------41229013

Software-Based Ownership: Disk Assign

To assign a specific set of disks:

To assign all unassigned disks:

Specify the device IDs that you want to work with.

system> disk assign 0b.39 -s unowned -f

Software-Based Ownership: Auto Assign

2011 NetApp, Inc. All rights reserved.

Using Multiple Disk Types in an Aggregate

Not all drive types can be mixed within an aggregate:

2011 NetApp, Inc. All rights reserved.

Disks must be zeroed before use:

2011 NetApp, Inc. All rights reserved.

NetApp System Manager: Disks

Select Disks to reveal a list of disks.

2011 NetApp, Inc. All rights reserved.

Disk Protection and Validation

2011 NetApp, Inc. All rights reserved.

Disk Protection and Validation

2011 NetApp, Inc. All rights reserved.

2011 NetApp, Inc. All rights reserved.

2011 NetApp, Inc. All rights reserved.

2011 NetApp, Inc. All rights reserved.

RAID Group Size