Section 2 : Storage Networking Technologies and Virtualization

IP SAN

Chapter 8

EMC Proven Professional

The #1 Certification Program in the information storage and management industry

2009 EMC Corporation. All rights reserved.

Chapter Objectives
Upon completion of this chapter, you will be able to: o Identify components of IP SAN

o Describe benefits of IP SAN

o Describe IP convergence in the SAN and its implications o Describe basic architecture of
o iSCSI o FCIP o FCoE

2009 EMC Corporation. All rights reserved.

Lesson: IP SAN Protocols

Upon completion of this lesson, you will be able to: o Discuss market drivers for IP SAN technology

o List IP SAN technologies

o List components and connectivity options of iSCSI o Describe iSCSI architecture and topologies o Explain iSNS operation o Describe architecture of FCIP

2009 EMC Corporation. All rights reserved.

Driver for IP SAN Internetworking

o In FC SAN transfer of block level data takes place over Fibre Channel o Emerging technologies provide for the transfer of block-level data over an existing IP network infrastructure o IP is being positioned as a storage transport because:
o Easier management o Existing network infrastructure can be leveraged o Reduced cost compared to new SAN hardware and software o Supports multi-vendor interoperability o Many long-distance disaster recovery solutions already leverage IP-based networks o Many robust and mature security options are available for IP networks

2009 EMC Corporation. All rights reserved.

Block Storage Over IP Protocol Options

o iSCSI
o SCSI over IP
o IP encapsulation
o Ethernet NIC card o iSCSI HBA
Server iSCSI HBA

Storage Array
iSCSI Gateway

IP
FC Port

o Hardware-based gateway to Fibre Channel storage

iSCSI Port

o Used to connect servers

(a) iSCSI Implementation

Storage Array

o FCIP
o Fibre Channel-to-IP bridge / tunnel (point to point)
o Fibre Channel end points
Server FC HBA

IP
FC Port

Storage Array

o Used in DR implementations
2009 EMC Corporation. All rights reserved.

(b) FCIP Implementation

What is iSCSI ?
o IP based protocol used to connect host and storage o Carries block-level data over IP-based network

o Encapsulate SCSI commands and transport as TCP/IP packet

2009 EMC Corporation. All rights reserved.

Components of iSCSI
o iSCSI host initiators
o Host computer using a NIC or iSCSI HBA to connect to storage o iSCSI initiator software may need to be installed if a NIC is used

o iSCSI targets
o Storage array with embedded iSCSI capable network port o FC-iSCSI bridge is required if the storage array only has FC port

o LAN for IP storage network

o Interconnected Ethernet switches and/or routers

2009 EMC Corporation. All rights reserved.

iSCSI - Host Connectivity Options

o Three options for iSCSI configuration:
o Software Initiators
o Code that can be loaded onto a host to provide the translation between the storage I/O calls and the network interface

o TCP Offload Engine (TOE)

o Moves the TCP processing load off the host CPU onto the NIC card, to free up processing cycles for application execution

o iSCSI HBA
o A network interface adapter with an integrated SCSI ASIC (application-specific integrated circuit) o Simplest option if the host needs to boot from SAN

2009 EMC Corporation. All rights reserved.

iSCSI Protocol Stack

OSI Model Layer 7 Application Layer 5 Session Layer 4 Transport Layer 3 Network Layer 2 Data Link iSCSI Initiator SCSI iSCSI TCP IP Ethernet
Commands and Data

iSCSI Target SCSI iSCSI TCP IP Ethernet

Login and Discovery

Windows and Segments

Packets

Frames

Interconnect

Ethernet

IP

TCP

iSCSI

SCSI

Data

2009 EMC Corporation. All rights reserved.

iSCSI Topologies
o Native iSCSI Connectivity o Bridged iSCSI Connectivity

o Combining FCP and Native iSCSI Connectivity

2009 EMC Corporation. All rights reserved.

Native iSCSI Connectivity

Native iSCSI Port

IP
Servers iSCSI HBA Storage Array

o No FC components o Each iSCSI port on the array is configured with an IP address and port number
o iSCSI Initiators Connect directly to the Array

2009 EMC Corporation. All rights reserved.

Bridged iSCSI Connectivity

iSCSI Gateway

Storage Array

IP
Servers

iSCSI HBA

FC SAN

FC Port FC HBA

o Bridge device translates iSCSI/IP to FCP

o Standalone device o Integrated into FC switch (multi-protocol router)

o iSCSI initiator/host configured with bridge as target o Bridge generates virtual FC initiator
2009 EMC Corporation. All rights reserved.

Combining FCP and Native iSCSI Connectivity

Native iSCSI Port

IP
Servers

iSCSI HBA

FC SAN
FC Port FC HBA

Storage Array

o Array provides FC and iSCSI connectivity natively

o No bridge devices needed

2009 EMC Corporation. All rights reserved.

Internet Storage Name Server

o For iSCSI communication, initiator must discover location of the target on a network o iSCSI discovery takes place in two ways:
o SendTargets discovery
o initiator is manually configured with the target

o Internet Storage Name Service (iSNS)

o Initiators and targets automatically register themselves with iSNS server o iSNS is a client/server model

o An iSNS server can be hosted on a target, initiator, or standalone server with a specified IP address

2009 EMC Corporation. All rights reserved.

iSNS Operation

Additional Task Research on iSNS

A
iSNS
Target Z - Device A Initiator A Target Z - Device B Initiator B Target Z - Device C Initiator C

Target Z

B C

IP

Initiator A Initiator B

Initiator C

2009 EMC Corporation. All rights reserved.

iSCSI Names
o All initiators and targets require a unique iSCSI identifier o Two types of iSCSI names
o IQN: iSCSI Qualified Name
o To use IQN, the company must own a registered domain name o iqn.2008-02.com.example:optional_string
o Example: iqn.1992-05.com.emc:apm000339013630000-10

o EUI: Extended Unique Identifier

o Use the WWN (World Wide Name) o eui.0300732A32598D26

2009 EMC Corporation. All rights reserved.

iSCSI Error Handling and Security

o iSCSI protocol addresses errors in IP data delivery o Use Command Sequencing for
o Flow control
o Missing:
o commands, responses and data blocks Sequence numbers

o The error detection and recovery are classified into 3 levels

o Level 0 (session recovery) o Level 1 (digest failure recovery) o Level 2 (connection recovery)

o Security methods to protect data on IP network

o IPSec o Kerberos and CHAP (challenge-handshake authentication protocol)
2009 EMC Corporation. All rights reserved.

What is FCIP (Fibre Channel over IP)

o FCIP is an IP-based storage networking technology o Combines advantages of Fibre Channel and IP

o Creates virtual FC links that connect devices in a different fabric

o FCIP is a distance extension solution
o Used for data sharing over geographically dispersed SAN

FC SAN
Host

IP

FC SAN

2009 EMC Corporation. All rights reserved.

FCIP Frame
Additional Task

o Encapsulates FC frames in IP packets

o FCIP Router is used for encapsulation

Research on FCIP Performance & Security

o FC Router at other end removes IP wrapper and sends FC data to other fabric

o Includes security, data integrity, congestion and performance specifications

FC Frame SOF FC Header SCSI Data CRC EOF

FCIP Encapsulation

FCIP Frame

IP Header

TCP Header

FCIP Header

IP Payload

2009 EMC Corporation. All rights reserved.

Lesson Summary
Key points covered in this lesson: o iSCSI components

o iSCSI frame structure and topologies

o iSNS operation o iSCSI error handling and security o Architecture of FCIP

2009 EMC Corporation. All rights reserved.

Lesson: Fibre Channel over Ethernet (FCoE)

Upon completion of this lesson, you will be able to: o Discuss the FCoE and its benefits

o Describe how FCoE works

o Describe FCoE physical and logical elements o Compare different protocol stack

2009 EMC Corporation. All rights reserved.

Fibre Channel over Ethernet (FCoE)

o A new protocol that maps Fibre Channel protocol natively over Ethernet
o Allows Fibre Channel to use 10 Gigabit Ethernet networks (or higher speeds) while preserving the Fibre Channel protocol

o Based on two standards :

o FCoE standard, developed by T11 Fibre Channel Interfaces Technical Committee o Enhanced Ethernet standard, developed by the Ethernet IEEE Data Center Bridging Task Group

o Enables the consolidation of SAN traffic and Ethernet traffic onto a common 10 Gigabit network infrastructure
2009 EMC Corporation. All rights reserved.

FCoE: Benefits
o Lower capital expenditure
o Dramatic reduction in the number of adapters, switch ports and cables required

o Reduced power and cooling requirement

o Enabler for consolidated network infrastructure

o Potentially lower administration cost, with convergence of LAN and SAN o Effective sharing of high-bandwidth links

o Lower Total Cost of Ownership (TCO)

2009 EMC Corporation. All rights reserved.

I/O Consolidation with FCoE

CNA LAN Ethernet FC HBA SAN (FCoE)

SAN (FC)

LAN (Ethernet)

NIC

CNA Typical Server Connectivity in data center environments Server with CNA supporting both SAN and LAN

2009 EMC Corporation. All rights reserved.

FCoE - Physical Elements

o Host Interface: CNA (Converged Network Adapter)
o PCIe card on host consolidates NICs and HBAs o Provides a 10 Gigabit Ethernet link that carries consolidated traffic
10Gbps Ethernet /FCoE

FC
Menlo ASIC

10 GE CNA

PCIe Bus

o 10 Gbps connectivity options: Host to FCoE switch

o Option1: Copper-based
o Cost effective option

o Option2: Standard optical

Copper Cable
2009 EMC Corporation. All rights reserved.

Infrastructure - Before FCoE

Storage Arrays

LAN

IP Edge Switches FC Switches

Hosts

2009 EMC Corporation. All rights reserved.

Infrastructure With FCoE

Storage Arrays

LAN

FCoE Switch

FCoE links

Hosts

2009 EMC Corporation. All rights reserved.

FCoE Frame Structure

Normal Ethernet Frame: Ether Type = FCoE

Additional Task Research on FCoE

Control Information: Version and Ordered Sets (SOF and EOF) Same as a Physical Fibre Channel Frame

Ethernet Header

FCoE Header

FC Header

EOF

Fibre Channel Payload

24 Bytes

CRC

FCS
4 Bytes

16 Bytes 12 Bytes (MAC Addresses) + 4 Bytes (802.10 TAG)

Up to 2112 Bytes

1 Byte(EOF) + 3 Bytes (Padding)

2009 EMC Corporation. All rights reserved.

Lossless Ethernet
o FCoE cannot afford to have frame drop due to congestion or buffer overflow
o Fibre Channel manages congestion through link level, credit based flow control
o Ethernet uses drop flow control method which is not lossless

o PAUSE capability of Ethernet (based on IEEE 802.3x) is used to achieve lossless fabric
o Busy receive port can send the control frame to the transmit port for pause in transmission
Ethernet traffic Sender Port A
FRAMES PAUSE

Receiver Port B

QUEUE FULL

2009 EMC Corporation. All rights reserved.

Network Stack Comparison

SCSI SCSI iSCSI SCSI FCP FC SCSI FCP FC SCSI FCP FC Less Overhead than FCIP, iSCSI

FCIP
TCP IP Ethernet TCP IP Ethernet PHYSICAL WIRE SCSI
2009 EMC Corporation. All rights reserved.

FCoE Ethernet

iSCSI

FCIP

FCoE

FC

Lesson Summary Key points covered in this lesson: o Basics and benefits of FCoE

o Storage infrastructure with FCoE

o FCoE Architecture and stack comparison

2009 EMC Corporation. All rights reserved.

Chapter Summary
Key topics covered in this chapter: o Benefits of IP SAN

o IP convergence in the SAN and its implications

o Architecture and implementation of iSCSI o Architecture and implementation of FCIP o Convergence of new protocol FCoE

2009 EMC Corporation. All rights reserved.

 Check Your Knowledge

o What is the difference between a native and bridged iSCSI implementation? o Explain the benefits and drawbacks of using: NIC, TOE and iSCSI HBA o Name two iSCSI discovery mechanisms

o What are two types of iSCSI names, and which one is similar to a Fibre Channel name?
o What are the physical elements of FCoE?

o Explain the benefit of using CNA card

2009 EMC Corporation. All rights reserved.

#1 IT company

For more information visit

2009 EMC Corporation. All rights reserved.

http://education.EMC.com