IBM System Networking RackSwitch G8316

IBM Redbooks Product Guide

The IBM System Networking RackSwitch G8316 provides low latency, lossless performance, and a feature-rich design with key virtualization features, such as Converged Enhance Ethernet (CEE)/Data Center Bridging (DCB), high availability, and enterprise class Layer 2 and Layer 3 functions. In addition, the G8316 also delivers excellent cost savings as you consider acquisition costs, energy costs, operational expense, and ease of use and management for a 40 Gb class switch. The IBM System Networking RackSwitch G8316 is suitable for clients using 10 Gb or 40 Gb connectivity (or both). The G8316 Ethernet aggregation switch enables customers to own an end-to-end flat 2-tier network that is based on industry standards using IBM switches and servers. For example, the G8316 is an ideal tier two switch to use when connecting a number of RackSwitch G8264 40Gb uplink ports at the access layer. Other clients like the G8316 as an investment protection switch, as they can use it with their 10Gb Ethernet environments today, but can also leverage it in the future as they move to 40Gb Ethernet. With latency below 1 microsecond, the G8316 is an industry leader. This and the 1.28 Tbps throughput makes the G8316 an ideal offering for latency-sensitive applications, such as high-performance computing, financial applications, hosting environments, and cloud designs. In addition, IBM VMready with Virtual Vision enables the network to be Virtual Machine (VM) aware, and provides the capability to have a virtualization environment that is simpler, less expensive, and provides exceptional performance. Figure 1 shows the IBM System Networking RackSwitch G8316.

Figure 1. IBM System Networking RackSwitch G8316

Did you know?

Here are the key features of the RackSwitch G8316:

Supports several types of configurations: 10 Gb, and 40 Gb, Virtual NIC, Converged Enhanced Ethernet (CEE/DCB), and iSCSI. Supports Data Center Bridging (DCB), which is the IEEEs group of protocols that provide lossless Ethernet and allows for clients to reduce the costs of implementing either NAS or iSCSI convergence and priority-based flow control. Uses VMready on-switch software that helps reduce the complexity of managing virtual machines (VMs) in the network (the license for this capability comes standard with the purchase of the switch and is part of the IBM Networking Operating System). The RackSwitch G8316 is OpenFlow enabled. With OpenFlow, you can easily create user-controlled virtual networks, optimize performance dynamically, and minimize complexity when you use the switch used with IBM Programmable Network Controller.

IBM System Networking RackSwitch G8316

The RackSwitch G8316 includes a standard IBM 1-year hardware warranty, with Next Business Day (NBD), 9x5, Customer Replaceable Unit (CRU) warranty service. IBM also include one year of software upgrades. IBM ServicePac solutions are available (in select countries) for hardware warranty upgrade options. Table 1 lists the part numbers (IBM System x) for ordering modules and additional options for them, including ServicePac solutions. Table 1. IBM System Networking part numbers and feature codes (part 1)
Description IBM System Networking RackSwitch G8316 (Rear-to-Front) IBM System Networking RackSwitch G8316 (Front-to-Rear) 10 Gb options (Break-out using 40Gb port) 1 m IBM QSFP+ DAC Break Out Cable* 3 m IBM QSFP+ DAC Break Out Cable* 5 m IBM QSFP+ DAC Break Out Cable* 40 Gb options IBM QSFP+ SR4 Transceiver IBM QSFP+ LR4 Transceiver 1 m IBM QSFP+-to-QSFP+ Cable* 3 m IBM QSFP+-to-QSFP+ Cable* 5 m IBM QSFP+-to-QSFP+ Cable* 7 m IBM QSFP+-to-QSFP+ Cable* 49Y7884 00D6222 49Y7890 49Y7891 00D5810 00D5813 EB2B EB2H ECBN ECBP EB2J EC2K EB27 49Y7886 49Y7887 49Y7888 EB24 EB25 EB26 System x part numbers 8036-ARX (HVEC) / 8036-HC2 (XCC) 8036-AFX (HVEC) / 8036-HC1 (XCC) IBM Power Systems MTM /FC 1611-16E

10 m IBM QSFP+ MTP Optical Cable 90Y3519 30 m IBM QSPF+ MTP Optical Cable 90Y3521

* QSFP+ DAC Break Out cables and QSFP+ to QSFP+ cables are not supported for Power Systems 10Gb NICs. They are used for switch to switch connectivity only.

IBM System Networking RackSwitch G8316

Table 1. IBM System Networking part numbers and feature codes (part 2)
Miscellaneous options IBM System Networking Adjustable 19" 4 Post Rail Kit IBM System Networking Recessed 19" 4 Post Rail Kit (NeXtScale) Hot-swappable, Rear-to-Front Fan Assembly Spare Hot-swappable, Front-to-Rear Fan Assembly Spare Hot-swappable, Rear-to-Front Power Supply Spare Hot-swappable, Front-to-Rear Power Supply Spare Console Cable Kit Spare ServicePacs (available in select countries) 3-year on-site repair 24x7 two-hour response 3-year on-site repair 24x7 four-hour response 3-year on-site repair 9x5 four-hour response 4-year on-site repair 24x7 two-hour response 4-year on-site repair 24x7 four-hour response 4-year on-site repair 9x5 four-hour response 4-year on-site repair 9x5 next business day 5-year on-site repair 24x7 two-hour response 5-year on-site repair 24x7 four-hour response 5-year on-site repair 9x5 four-hour response 5-year on-site repair 9x5 next business day 00D6185 00CG089 88Y6026 49Y7939 49Y7938 49Y7937 90Y9462 System x part numbers 67567P1 67567P0 67567NZ 67567P5 67567P4 67567P3 67567P2 67567P9 67567P8 67567P7 67567P6 Power Systems MTM /FC EU27

IBM System Networking RackSwitch G8316

With the flexibility of IBM RackSwitch, clients can take advantage of the technologies that they require for multiple environments:

For 10 Gb, they can use DAC break-out cables, which converts 40 Gb ports into four 10 Gb ports and allows connection for distances up to 5 m. For 40 Gb links, they can use QSFP transceivers and MTP cables.

Figure 2 shows the cables.

Figure 2. Cables The module part numbers include the following items:

One IBM System Networking RackSwitch G8316R/ G8316F Generic Rail Mount Kit (2-post) Mini-USB Console port for serial access

Figure 3 shows a 2-post Rack Mount Kit.

Figure 3. 2-post Rack Mount Kit

IBM System Networking RackSwitch G8316

Make sure that you include power cords in your configuration. Table 2 lists the appropriate power cord, depending on country of purchase for System x, and Table 3 lists line cords available through IBM Power Systems and IBM System Storage AAS ordering systems. Table 2. Power cord description and IBM System x part numbers
Description Power Cord Europe AC plug 10A/250 V; OPT Power Cord Europe (Denmark) AC plug 10A/250 V; OPT Power Cord Europe (Switzerland) AC plug 10A/250 V; OPT Power Cord Europe AC (Israel) plug 10A/250 V; OPT Power Cord Europe (South Africa) AC plug 10A/250 V; OPT Power Cord UK AC plug 13A/250 V; OPT Power Cord Australia AC plug 10A/250 V; OPT Power Cord Korea AC plug 10A/250 V; OPT Power Cord Japan AC plug 10A/125 V; OPT Power Cord India AC plug 10A/250 V; OPT Power Cord China AC plug 16A/250 V; OPT Power Cord Brazil AC plug 16A/250 V; OPT Power Cord Uruguay/Argentina AC plug 16A/250 V; OPT Power Cord US/Canada AC plug 10A/125 V; OPT 4.3 m, 10A/100 - 250 V, C13 to IEC 320-C14 Rack Power Cable 1.5 m, 10A/100 - 250 V, C13 to IEC 320-C14 Rack Power Cable 2.8m, 10A/100-250V, C13 to IEC 320-C20 Rack Power Cable IBM part number 39Y7917 39Y7918 39Y7919 39Y7920 39Y7922 39Y7923 39Y7924 39Y7925 46M2593 39Y7927 39Y7928 39Y7929 39Y7930 46M2592 39Y7932 39Y7937 39Y7938

IBM System Networking RackSwitch G8316

Table 3. Power cords description and IBM Power System and IBM System Storage Feature Codes
Description Power Cord 4.3m (14-ft), Drawer to Wall/IBM PDU (250V/10A) Power Cord 4.3m (14-ft), Drawer to Wall/OEM PDU (250V/15A) U. S. Power Cord 1.8m (6-ft), Drawer to Wall (125V/15A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU (125V/15A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU (250V/16A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU (250V/10A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/13A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/16A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/10A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/16A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (125V/15A or 250V/10A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/10A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/10A) Power Cord 4.3m (14-ft), Drawer to Wall/OEM PDU (125V/15A) Power Cord 2.8m (9.2-ft), Drawer to Wall/IBM PDU, (250V/ 10A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/10A) Power Cord 2.7m (9-ft), Drawer to Wall/OEM PDU, (250V/10A) Power Cord 1.5m (5-ft), Drawer to Wall/OEM PDU, (250V/10A) Feature Code 6458 6469 6470 6471 6472

6473 6474 6475 6476 6477 6488 6493 6494 6660 6665 6680 6671 6672

Benefits
The IBM System Networking RackSwitch G8316 offers the following benefits:

High performance : This 10/40Gb Low Latency (880 nanoseconds) Switch with 1.28 Tbps throughput provides the best combination of low latency, non-blocking line-rate switching, and ease of management. The G8316 is also a single ASIC design, which promises consistent lower port-to-port latency compared with other vendors with multiple chip designs, which causes port-to-port latency to be inconsistent and unpredictable. Lower power and better cooling : The RackSwitch G8316 uses as little as 330 W of power, which is a fraction of the power consumption of many competitive offerings. The front-to-rear or rear-to-front cooling design reduces data center air conditioning costs by having airflow match the servers in the rack. In addition, variable speed fans assist in automatically reducing power consumption. High Availability: The G8316 also comes standard with hot-swap redundant power supplies and fans, making the switch highly reliable, ready to use, and easy to service in the unlikely event of a failure.

IBM System Networking RackSwitch G8316

VM-Aware Networking : VMready software on the switch simplifies configuration and improves security in virtualized environments. VMready automatically detects virtual machine movement between physical servers and instantly reconfigures each VMs network policies across VLANs to keep the network up and running without interrupting traffic or impacting performance. VMready works with all leading VM providers, such as VMware, Citrix, Xen, Microsoft Hyper V, Red Hat KVM, and IBM PowerVM. Layer 3 functionality: The IBM switch includes Layer 3 functionality, which provides security and performance benefits, as inter-VLAN traffic stays within the switch. This switch also provides the full range of Layer 3 protocols from static routes for technologies, such as Open Shortest Path First (OSPF) and Border Gateway Protocol (BGP) for enterprise customers. Seamless interoperability : IBM switches interoperate seamlessly with other vendors' upstream switches. Fault tolerance: These IBM switches learn alternate routes automatically and perform faster convergence in the unlikely case of a link, switch, or power failure. The switch uses proven technologies like L2 trunk failover, advanced VLAN-based failover, VRRP, and HotLink. OpenFlow enabled: The RackSwitch G8316 offers benefits of OpenFlow. OpenFlow is the new open application programming interface (API) that enables the network administrator to easily configure and manage virtual networks that control traffic on a per-flow basis. It creates multiple independent virtual networks and related policies without dealing with the complexities of the underlying physical network and protocols. The G8316 can also be used with the IBM Programmable Network Controller, which is the IBM network controller that is compliant with OpenFlow. Multicast: This supports IGMP Snooping v1, v2, and v3 with 2 K IGMP groups, as well as Protocol Independent Multicast, such as PIM Sparse Mode or PIM Dense Mode. Converged fabric : The IBM switch supports CEE and Data Center Bridging, which is ideal for storage connectivity (NAS and iSCSI). CEE enables clients to combine storage, messaging traffic, VoIP, video, and other data on a common data center Ethernet infrastructure. Data Center Bridging helps with iSCSI and FCoE with features such as Priority-based Flow Control, Enhanced Transmission Selection, and Congestion Notifications. FCoE enables highly efficient block storage over Ethernet for consolidating server network connectivity. As a result, clients can deploy a single server interface for multiple data types, which can simplify both deployment and management of server network connectivity, while maintaining the high availability and robustness required for storage transactions.

Features and specifications

This section lists the key features and specifications of the G8316. Performance The performance features are as follows:

Single-switch ASIC design 100% line rate performance 1.28 Tbps non-blocking switching throughput (full duplex) Sub microseconds latency 960 million packets per second (mpps)

IBM System Networking RackSwitch G8316

Hardware features The hardware features are as follows:

Models o o IBM System Networking RackSwitch G8316 Rear-to-Front. For ports in the rear of the rack to match System x and IBM BladeCenter designs. IBM System Networking RackSwitch G8316 Front-to-Rear. For ports in the front of the rack to match airflow of IBM iDataPlex and NeXtScale systems. Sixteen QSFP+ ports (40 GbE), support for optional break-out cable for sixty-four 10 Gb connections. One 10/100/1000 Ethernet RJ45 port for out-of-band management. One USB port for mass storage device connection. One fixed mini-USB Console port for configuration and code changes by thumb drive, or boot from USB drive with new code. Server-like port orientations, enabling short and simple cabling.

Interface options o o o o o

Dimensions: 17.3 wide, 19 deep, 1 RU high Weight: 9.98 kg (22 lb) Rack Installation Kit o o o Generic Rack Mount Kit (2-post). Optional versatile 4-post mounting options for 19-inch server rack or datacom rack. Can be mounted vertically or horizontally System LEDs to indicate link status, fan, and power. Stacking LEDs to indicate master/member (future support). Front-to-rear or rear-to-front cooling. Redundant variable hot-swap speed fans for reduced power draw.

LEDs o o

Airflow o o

IBM System Networking RackSwitch G8316

Figure 4 shows the adjustable 4-post rail kit.

Figure 4. Adjustable 4-post rail kit Figure 5 shows the rear.

Figure 5. Rear

Power o o Dual load-sharing hot-swap internal power modules, 50 - 60 Hz, 100 - 240 V ac auto-switching per module Typical power consumption of 330 watts

IBM System Networking RackSwitch G8316

Environmental specifications o o o o o Temperature: Ambient operating: 0 - 40 C Relative humidity: Non-condensing, operating 10 - 90% Altitude: Operating 3,050 m (10,000 feet) Heat dissipation: 1127 BTU/hour (typical) Mean time between failures (MTBF): 165,990 hours @ 40 C

Software features For the most current updates, see the IBM Networking Operating System data sheet, found at: http://ibm.biz/Bdx4gn Here are the software features:

Security o RADIUS, TACACS+, and LDAP o SCP o Wire Speed Filtering: Allow and Deny o SSH v1, v2 o HTTPS Secure BBI o Secure interface login and password Management o MAC address move notification o SNMP v1, v2c, and v3 o RMON o Dual NTP Support o Accept DHCP IP address assignment o DHCP Snooping, DHCP Option 82 o Dual software images o Netconf (XML Config) o Syslog Configuration tracking o Shift B Boot Menu (Password Recovery/Factory Default) o Management ACLs o IP Loopback o IPv6 Base RFCs o Ipsec o IKE o IPv6 RFC support acceptable for NIST certification o Netboot VLANs o Port-based VLANs o 2048 VLAN IDs supported o 1 K Port-based VLANs (802.1Q) o Private VLAN Edge Lossless Ethernet o 802.1 Data Center Bridging o Priority Based Flow Control (PFC) o Enhanced Transmission Selection (ETS) o Data Center Bridge Exchange protocol (DCBX) o FIP Snooping o Converged Enhanced Ethernet

IBM System Networking RackSwitch G8316

10

Link Aggregation o Static Trunks (EtherChannel) and LACP (802.3ad) o Configurable Trunk Hash algorithm o Enhanced reporting of statistics Spanning Tree o Multiple Spanning Tree (802.1 s) o Rapid Spanning Tree (802.1 w) o PVRST+ o Auto assignment of VLANs to STG o BPDU Guard o Root guard o Loop guard Quality of service o QoS 802.1p (priority queues) o DiffServ IPV4 and IPv6 o ACL, IGMP Profiles o DSCP remarking o Metering o 9 MB shared packet buffer o Weighted random early detection with explicit congestion notification (WRED/ECN) o CPU priority policies (CoPP) o User configurable buffers Routing protocols o RIP /v2 o OSPF v2, v3 o BGP o BGP enhancements for MD5 hash, ECMP, and Passive mode support o Dynamic BGP peers High availability o Layer 2 failover o HotLinks o Virtual Router Redundancy support (VRRP) Multicast o OpenFlow o MLDv2 o IGMP Snooping v2 and v3 o IGMP Querier o Protocol Independent Multicast (PIM Sparse Mode/Dense Mode) Monitoring o Port mirroring o ACL-based mirroring o ACL logging o CPU logging o Version 5 o UDLD Virtualization o VMready Clients o System Networking Switch Center (SNSC) o isCLI (Cisco-like) o Scriptable ASCII Based CLI o Browser-based client or Telnet Standard protocols o DHCP Client o DHCP Relay o LLDP o 128 K MAC Table

IBM System Networking RackSwitch G8316

11

o o

9 K Jumbo Frames 802.3X Flow Control

Popular configurations
This section describes two popular configurations. 40G aggregation switch for east -west traffic As more clients look to flatten their networking to exploit more of an east-west traffic flow that is required by a number of todays applications and especially virtualized environments, the RackSwitch G8316 is an ideal tier-two switch for connecting multiple RackSwitch G8264 switches, which are likely being used at the edge to connect to multiple 10 Gb ports on servers, as shown in Figure 6.

Figure 6. Aggregation switch for east-west traffic

IBM System Networking RackSwitch G8316

12

Using the RackSwitch G 8316 as an edge switch for servers using 40G Ethernet adapters For environments such as HPC and others where I/O performance is important, 40 Gb is increasing in popularity. As more 40 Gb Ethernet adapters appear and costs fall in line, and applications start looking for the next step beyond 10 Gb, the RackSwitch G8316 is the ideal solution for connecting multiple servers per rack, as shown in Figure 7.

Figure 7. Aggregation switch for east-west traffic

Related publications and links

IBM Offering Information page (to search on announcement letters, sales manuals, or both): http://www.ibm.com/common/ssi/index.wss?request_locale=en On this page, enter G8316 for System x and iDataPlex, select the information type, and then click Search. On the next page, narrow your search results by geography and language.

IBM System Networking RackSwitch G8316

13

IBM System Networking RackSwitch G8316 product publications: http://ibm.com/support/entry/portal/documentation o o o o

Application Guide Industry-Standard CLI Reference Browser-Based Interface (BBI) Quick Guide Menu-based CLI Command Reference

IBM VMready: http://www.ibm.com/systems/networking/software/vmready

IBM System Networking RackSwitch G8316

14

Notices
This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to:

IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law : INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment. COPYRIGHT LICENSE: This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. Copyright International Business Machines Corporation 2011. All rights reserved . Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM System Networking RackSwitch G8316

15

This document was created or updated on November 14, 2013. Send us your comments in one of the following ways: Use the online Contact us review form found at: ibm.com/redbooks Send your comments in an e-mail to: redbook@us.ibm.com Mail your comments to: IBM Corporation, International Technical Support Organization Dept. HYTD Mail Station P099 2455 South Road Poughkeepsie, NY 12601-5400 U.S.A.

This document is available online at http://www.ibm.com/redbooks/abstracts/tips0842.html .

Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol ( or ), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml. The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both: BladeCenter IBM iDataPlex Power Systems PowerVM RackSwitch Redbooks (logo) System Storage System x VMready The following terms are trademarks of other companies: Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

IBM System Networking RackSwitch G8316

16