Catalyst 6500 4500/4900: IP Multicast

Catalyst 6500 & 4500/4900 IP Multicast Architecture
Session ID: BRKARC-3322
Cisco Live & Networkers Virtual

Special Offer Save $100
Cisco Live has a well deserved reputation as one the industrys best educational values. With hundreds of sessions spanning four educational programs Networkers, Developer Networker, Service Provider, IT Management, you can build a custom curriculum that can make you a more valuable asset to your workplace and advance your career goals. Cisco Live and Networkers Virtual immerses you in all facets of Cisco Live, from participating in live keynotes and Super Sessions events to accessing session content to networking with your peers. Visit www.ciscolivevirtual.com and register for Cisco Live and Networkers Virtual. To get $100 USD off the Premier pass, which provides access to hundreds of technical sessions, enter slideshareFY11.
Presentation_ID
2010 Cisco and/or its affiliates. All rights reserved.
Cisco Public
Session Goals
To provide you with a thorough understanding of the Catalyst 6500 IP Multicast architecture and packet flow To provide you with a thorough understanding of the Catalyst 4500 & 4900 IP Multicast architecture and packet flow
Presentation_ID
Cisco Public
Session Assumptions
Working understanding of General (platform-independent) IPv4 & IPv6 Multicast Working understanding of Catalyst 6500 & 4500/4900 (platform-dependent) architecture and operation
General IP Multicast architecture covered in: IPM-1261: Introduction to IP Multicast
Advanced IP Multicast architecture covered in: IPM-2008: Advanced Topics in IP Multicast Deployment
Presentation_ID
General Catalyst 6500 architecture covered in: RST-3465: Cisco Catalyst 6500 Switch Architecture
General Catalyst 4500/4900 architecture covered in: RST-3445: Cisco Catalyst 4500 Switch Architecture
Cisco Public
IP Multicast - Agenda 1/3

PIM Distribution Modes (~5m)
Multicast Overview (15-20m)
IP Multicast on Catalyst 4500/4900 (~2m)
IP Multicast on Catalyst 6500 (~2m)
Multicast Management (~2m)
Multicast High-Availability (~2m)
Multicast VPN & Extranet (~2m)
IGMP/MLD & Snooping (~2m)
Presentation_ID
Cisco Public
Catalyst 6500 - Agenda 2/3

Multicast Hardware Architecture (~15m)
Catalyst 6500 (60-70m)
Multicast Forwarding on VSS (~10m)
IGMP / MLD & PIM Snooping (~5m)
Multicast Packet Flows (~15m)
Multicast Hardware Replication (~5m)
Multicast Hardware Forwarding (~10m)
Presentation_ID
Cisco Public
Catalyst 4500/4900 - Agenda 3/3

Multicast Hardware Architecture (~10m) Multicast Hardware Forwarding (~10m) Multicast Hardware Replication (~5m) Multicast Packet Flows (~15m)
Catalyst 4500/4900 (30-40m)
Presentation_ID
Cisco Public
Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping
Multicast VPN & Extranet Multicast Management
Multicast High-Availability IP Multicast on Catalyst 6500
IP Multicast on Catalyst 4500/4900
IP Multicast Overview PIM Distribution Modes
Presentation_ID
Cisco Public
PIM Dense Mode (PIM-DM)

1st Gen. Flood & Prune (S,G based) multicast distribution protocol
Designed with the assumption that receivers are Densely populated in the network... Uses only Source-based Trees
Distribution trees are unidirectional (RPF-based) Source Tree
Rooted at Source1 1
Source Tree
Rooted at Source2 2
Source1
Source2
Does NOT use Rendezvous Points (RPs), which makes it simpler to implement & deploy Data-driven Multicast state
Requires Periodic Flooding & Pruning on all PIM routers, and DR Election / Asserts on each subnet
Group membership tracked via IGMP v1 or v2 Catalyst Switches provide support for:
IPv4 PIM-DM (S,G) forwarding IGMPv1 & v2 and Snooping
Presentation_ID
Receivers
Cisco Public
PIM Sparse Mode (PIM-SM)

2nd Gen. All-Purpose (S,G and / or *,G) multicast distribution protocol
Designed with the assumption that receivers are Sparsely populated in the network...
Distribution trees are unidirectional (RPF-based) Source Tree Source
SPT: Rooted at the Source RPT: Rooted at the Rendezvous Point
Shared Tree
RP
Uses both Shared (RP) & Source based Trees Data-driven Multicast state
Group membership tracked via IGMP v1, v2, or v3 (IPv4) or MLD v1 or v2 (IPv6) Catalyst Switches provide support for:
IPv4 and IPv6 (*,G) forwarding IPv4 and IPv6 (S,G) forwarding
Presentation_ID
Automatic Source discovery (via Registers)
Requires Source Registration, RP group-mapping, DR Election & Asserts, and SPT switch-over
Receivers
IGMP v1/2/3 & MLDv1/2 and Snooping

2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
10
PIM Source-Specific Multicast (PIM-SSM)

3rd Gen. Shortest Path (S,G based) multicast distribution protocol
Low-Latency variation of PIM-SM, which assumes the one-to-many model Data-driven Multicast state
Source Tree
Rooted at Source1 1
Source Tree
Rooted at Source2 2
Source1
Source2
Internet, Inter-Domain and Voice / Video distribution Requires only SSM Range, and DR Election / Asserts
Hosts are responsible for source discovery

Eliminates need for RP (Shared trees) & MSDP
Typically via some out-of-band mechanism (web page,etc.)
Group membership tracked via IGMP v3 (IPv4) or MLD v2 (IPv6) Catalyst Switches provide support for:
IPv4 and IPv6 (S,G) forwarding IGMPv3 & MLDv2 and Snooping
Presentation_ID
SSM mapping (for IGMPv2 & MLDv1)

S1,G1 S2,G1
S1,G1
Receivers
S1,G1
S2,G1
11
Bidirectional PIM (PIM-BiDir)

3rd Gen. Shared Path (*,G based) multicast distribution protocol
Intra-Domain multicast & Database distribution
Source
Bidirectional tree rooted at the Rendezvous Point
Shared Tree
Highly Scalable variation of PIM-SM, which assumes LOTS of Sources & Receivers Data-Flow Independent
RP
Drastically reduces network mroute state

Permits virtually UNLIMITED Sources
Pre-built (RP/DF-based) distribution trees = NO source registers, DR Asserts, or non-RPF issues Eliminates ALL (S,G) mroute state in the PIM network Multicast traffic can flow Up & Down (Bidirectional) on the Shared (RP-based) tree
Group membership tracked via IGMP v1 or v2 Catalyst Switches provide support for:
IPv4 PIM-Bidir (*,G) forwarding IGMP v1/2 & Snooping
Presentation_ID
Sources/Receivers
Cisco Public
12
The Evolution of PIM...

(S,G) One to Many
SSM
Sparse Mode
(S,G) & (*,G)
Lookup Lookup arrives arrives
(*,G) Many to Many
BiDir
Lookup Lookup
arrives arrives
Accept Accept
arrives arrives
(S,G)? (S,G)? (S,G)? (S,G)? Discard Discard
(*,G)? (*,G)?
Direct Direct Connect? Connect?
RPF RPF or or DF DF
RPF? RPF? RPF? RPF? OIF OIF List? List? PIM PIM Process Process OIF OIF !NULL? !NULL? Forward/ Forward/ Replicate Replicate
OIF OIF List? List?
PIM PIM Process Process DF DF Forwarding Forwarding // Replication Replication Discard Discard
Discard Discard
rewrite rewrite
Presentation_ID
sent sent
Forward Forward // Replicate Replicate
S w S P T itc h o v e r
rewrite rewrite
Cisco Public
sent sent
rewrite rewrite
sent sent
13
IP Multicast Overview IGMP/MLD & Snooping
Presentation_ID
Cisco Public
14
IGMP / MLD & Snooping

Internet Group Management Protocol (IGMP) Multicast Listener Discovery (MLD) IGMP / MLD operates on L3 PIM Interfaces
IGMP v1/v2/v3 MLD v1/v2 SSM mapping
Source Source
Host membership reporting for IPv4 Host membership reporting for IPv6
IGMP / MLD Snooping constrains multicast flooding on L2 switchports Snooping process uses both L2 & L3 Hardware & Software information
Based on received Join / Leave reports
Host Join Reports Receivers
Snooping support for IGMPv1/2/3 and MLDv1/v2
PFC/DFC performs hardware protocol redirection of IGMP & MLD packets to SP CPU for processing
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
15
Multicast VPN & Extranet Multicast High-Availability Multicast Management
IP Multicast on Catalyst 6500
IP Multicast Overview Multicast VPN & Extranet
Presentation_ID
Cisco Public
16
Multicast Over MPLS VPN
MVPN
CE
Join
CE
Used for high-bandwidth data stream
Data MDT
Receiver
PE Default MDT
Receiver
Enterprise MPLS Core
Join
Traffic
Default MDT
Used for low-bandwidth & control-traffic only
Receiver
High-Rate Source
Presentation_ID
Rooted at Source PE: controls multicast distribution within MPLS VPN core
MVPN Source Tree
Rooted at CE RP or Source: controls multicast distribution within individual VPN/VRF

Cisco Public
Shared / Source Tree
17
MVPN Extranet
Join
Receiver
MPLS Core
Join
Source
Traffic
Receiver
Allows IP Multicast content which originated in one MVPN, to be distributed to other MVPNs Two configuration requirements:
On Source PE or Receiver PE (or both) configure all relevant MVRFs Configure fallback static mroute (for Source VRF IP subnets: Source and / or RP address) to allow RPF check between MVRFs.
Presentation_ID
18
IP Multicast Overview Multicast High-Availability
Presentation_ID
Cisco Public
19
Multicast HA - MMLS NSF/SSO

Multicast MLS Non-Stop Forwarding (NSF) & Stateful Switch-Over (SSO) Offers single-node Multicast HA on Catalyst 6500 with Supervisor 720 Synchronizes critical Multicast forwarding entries from the Active supervisor to Standby
Multicast (MLS/CEF) Forwarding Entries Multicast Expansion Table (MET) IGMP / MLD Snooping state Multicast Data Structures
Active
Standby
Global Global Sync Sync
Periodic Syncs
Benefit: Minimizes multicast traffic disruption during supervisor switchover Works with PIM Triggered Joins
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Public
20
Multicast HA -Triggered PIM Joins

Designed for SSO/NSF-capable Highly Available IP Multicast deployment
RP
Benefit: Rebuilds the PIM multicast state very quickly after switchover
GenID 1
GenID 2
Standby Active
Failure
On switchover, new Active supervisor changes Generation ID field in PIM Hellos PIM neighbors use the new GenID as an indication that the neighbor on that Interface has no / old multicast state
GenID 1
Neighbor then sends triggered PIM Join messages for all (*,G) & (S,G) mroutes, which have that Interface as the RPF Interface Assumption is that PIM neighbors know how to interpret GenID field in PIM hello
GenID 2
Periodic PIM Joins
Periodic PIM Hellos
Hello with new GenID Triggered PIM Joins

21
IP Multicast Overview Multicast Management
Presentation_ID
Cisco Public
22
Multicast Management NDE with NetFlow v9

Provides wire-rate statistics collection for IP Multicast data flows
NetFlow Collector
Ingress NetFlow tracks multicast traffic received (input) on an Interface Egress NetFlow tracks multicast traffic replicated (output) on an Interface
Support for Ingress & Egress multicast statistics

S1,G1 S2,G1 S1,G2
NetFlow v9 Export Egress

vlan100 vlan200
Netflow Sampling support, to reduce export load
Voice Video Data
S3,G1
Ingress
Important for PIM-BiDir networks, where (S,G) entries NOT in mroute table
g1/1
Catalyst 6500 vlan300

23
Cisco Public
Multicast Management SNMP MIBs & Traps

Several Multicast-specific SNMP MIBs Several Multicast-specific SNMP Traps
pimNeighborLoss ciscoPimRPMappingChange ciscoPimInvalidReFaster ciscoPimInvalidJoinPrune ciscoPimInterfaceUp ciscoPimInterfaceDown msdpEstablished1 msdpBackwardTransition ciscoMvpnMvrfChange
SNMP Server
PIM, MROUTE, MSDP, MVPN & IGMP/MLD
SNMP MIBs
S1,G1 S2,G1 S1,G2
SNMP Traps
Voice Video Data
S3,G1
Egress
vlan100 vlan200
Special Trap called Multicast Heartbeat can be used to track availability of a Multicast group
ciscoIpMRouteMissingHeartBeats
Ingress
g1/1
Catalyst 6500
vlan300
24
Cisco Public
IP Multicast Overview Multicast on Catalyst 6500
Presentation_ID
Cisco Public
25
Catalyst 6500 - Ciscos Premiere Multicast Hardware-Switching Platform

Leverages Cisco IOSs 10+ years of IPv4 & IPv6 Multicast expertise & innovation
Delivers Un-Matched Price & Performance
200+Mpps IPv4 multicast forwarding demonstrated in EANTC tests Up to 80G multicast replication per-slot with WS-6708-10GE module 720Gbps throughput & 1.44Tbps throughput with VSS
Already widely deployed in many of the Worlds most business-critical networks

Global Financials - Exchanges, Brokerages and FSPs Video Providers - Domestic / Foreign IPTV and Triple-Play ISPs Retail Enterprise - Inventory & Data-Base Distribution Government and Department of Defense
26
IP Multicast on Catalyst 6500

Centralized & Distributed IPv4 & IPv6 Multicast hardware-switching
IPv4 & IPv6 PIM-SM & PIM-SSM (S,G) mroute forwarding in hardware
Off-loads the majority of multicast forwarding load (data-plane) from the switch control-plane
IPv4 & IPv6 PIM-SM & PIM-Bidir (*,G) mroute forwarding in hardware
IPv4 MVPN forwarding in hardware IPv4 IGMP v1/v2/v3 Snooping in hardware IPv4 PIM Snooping in hardware IPv6 MLD v1/v2 Snooping in hardware
WS-SUP720-3B/XL WS-SUP720-3B/XL
Switch Fabric provides greater throughput over traditional Bus-based designs

VS-S720-10GE-3C/XL VS-S720-10GE-3C/XL
27
IP Multicast Overview Multicast on Catalyst 4500/4900
Presentation_ID
Cisco Public
28
Classic and E-Series Platforms
Classic
E-Series
Presentation_ID
Cisco Public
29
Catalyst 4500/4900 IP Multicast

Implements Centralized & Distributed IPv4 and IPv6 Multicast hardware-switching Supports IPv4 & IPv6 PIM-SM and PIM-SSM (S,G) mroute forwarding in hardware Supports IPv4 PIM-SM and PIM-Bidir (*,G) mroute forwarding in hardware Supports IPv4 MVPN forwarding in hardware Supports MLDv1/v2 snooping in hardware Supports PIM snooping in hardware Supports IGMPv1/v2/v3 snooping in hardware
Off-loads the majority of (data-plane) forwarding tasks from the switch control-plane
Supervisor720 supports Centralized & Distributed multicast packet-replication

30
Multicast Features (Hardware)

Features Classic
Yes Yes No No Yes Yes Yes No
IGMP (Internet Group Management Protocol) v1, v2, v3 IGMP Snooping (v1, v2, v3) MLD (Multicast Listener Discovery) v1, v2 MLD snooping (v1, v2) PIM (Protocol Independent Multicast) SM (Sparse Mode) PIM DM (Dense Mode) PIM SSM (Source Specific Mode) PIM Bi-Dir (Bi-Directional)
E-Series
Yes Yes Yes Yes Yes Yes Yes Yes
Presentation_ID
Cisco Public
31
Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS
Catalyst 6500
IP Multicast Hardware Architecture
Presentation_ID
Cisco Public
32
Supervisor Engine Multicast Components

Switch Fabric & Multicast Replication Engine Route Processor (RP) Switch Processor (SP) PFC Daughter Card
Presentation_ID
Cisco Public
33
Supervisor 720 Multicast Architecture

PFC provides L2 - L3/L4 Hardware data-plane, using TCAMs & ASICs
FIB contains (S,G) & (*,G) entries and RPF VLAN ADJ contains rewrite info & MET index Bidir RP table for DF Interface check
RP & SP CPUs control Software control-plane and user-interface

SP CPU programs hardware & performs IGMP/MLD & PIM snooping RP CPU maintains mroutes & state, and downloads tables
Supervisor 720 Baseboard

Counter FPGA ACL TCAM Protocol Redirection Logic QoS FIB ADJ TCAM TCAM
1GE Uplinks
L3/4 Engine L2 Engine

L2 CAM
Bidir RP NetFlow
Port ASIC MET
1 Gbps 1 Gbps
RP (MSFC3) CPU SP (NMP) CPU
DRAM DRAM
CPU Daughter Card Integrated 720 Gbps Switch Fabric
Daughter Card
PFC3
20 Gbps Fabric Interface & Replication Engine
Protocol Redirection captures IGMP / MLD & PIM packets
18 x 20Gbps Fabric Channels
Presentation_ID
32 Gbps Bus L2 CAM 16contains Gbps multicast MAC entries Bus
MET contains OILs for replication

Cisco Public
DBUS RBUS
Central replication-engine for Bus-based modules and uplink ports
34
Supervisor 720-10GE Multicast Architecture

PFC3C serves same basic functions as PFC3A/B Supervisor 720-10GE Baseboard
Counter FPGA ACL TCAM Protocol Redirection Logic QoS FIB ADJ TCAM TCAM
RP & SP CPUs perform all CLI and control-plane functions

1GE & 10GE Uplinks Port ASIC Port ASIC 1 Gbps 1 Gbps
RP (MSFC3C) CPU SP (NMP) CPU
DRAM DRAM
Bidir RP NetFlow
MET Fabric 20 Gbps Interface & Replication Engine DBUS RBUS

Cisco Public
CPU Daughter Card Integrated 720 Gbps Switch Fabric
L2 CAM
Daughter Card
PFC3C
20 x 20Gbps Fabric Channels
32 Gbps Bus
Central Replication engine for Bus-based cards and uplink ports
35
Supervisor 32 Multicast Architecture

PFC3B is the same as used on Supervisor 720 Supervisor Engine 32 Baseboard
Counter FPGA ACL TCAM Protocol Redirection Logic QoS FIB ADJ TCAM TCAM 10GE Uplinks Port ASIC Port ASIC 1 Gbps 1 Gbps
RP & SP CPUs perform all CLI and control-plane functions
SP CPU RP CPU
DRAM DRAM

L2 CAM
Bidir RP NetFlow
Daughter Card
PFC3B
FPGA MUX Bus Interface & Replication Engine
MSFC2a Daughter Card
MET 32 Gbps Bus

WS-SUP32-10GE-3B DBUS RBUS Central replication engine performs replication for ENTIRE system
36
Classic Module Architecture

DBUS RBUS Example: WS-X6416-GBIC
Classic Module
Port ASIC Port ASIC Port ASIC Port ASIC
4xGE
4xGE
4xGE
4xGE
Port ASIC for Physical Connectivity, Buffering, and Queuing
DBUS RBUS
Example: WS-X6148A-RJ-45
Classic Module
Port ASIC
Presentation_ID
No multicast-specific components on these modules...

48x10/100
37
CEF256 Module Architecture

Example: WS-X6516-GBIC DBUS RBUS Fabric / Bus Interface Fabric Interface Connects to Fabric and Bus
LC-DBUS LC-RBUS
8 Gbps Fabric Channel
CEF256 Module
MET MET Contains OILs for Replication
Replication Engine
Multicast Replication EngineReplicates Packets to OILs

4xGE
Port ASIC
Port ASIC
4xGE
4xGE
Port ASIC
4xGE Port ASIC for Physical Connectivity, Buffering, and Queuing

38
Port ASIC
Presentation_ID
CEF256 Module Architecture + DFC

Layer 2 Engine for MAC learning, Security / QoS ACL Lookups, and Protocol Redirection Fabric / Bus Interface
LC-DBUS LC-RBUS
Example: WS-X6516-GBIC with WS-F6K-DFC
8 Gbps Fabric Channel Layer 2 Engine L3/L4 Engine
DFC
CEF256 Module with DFC
Layer 3 Engine for FIB/ADJ and NetFlow Lookups
MET
Replication Engine
4xGE
Port ASIC
Port ASIC
4xGE
4xGE
Port ASIC
4xGE
Port ASIC
Presentation_ID
Cisco Public
39
CEF720 Module Architecture

Example: WS-X6748-SFP
DBUS RBUS
Complex A Complex B
MET
Fabric Interface & Replication Engine Port ASIC
Bus Interface
Bus Interface
CEF720 Module
MET
12xGE 12xGE MET Contains OILs for Replication

Bus Interface for Control Data Only!!
Port ASIC
CFC
12xGE 12xGE Fabric Interface & Replication Engine Connects to Fabric & Bus (CFC), and Replicates Packets to OILs
Cisco Public
Port ASIC
Port ASIC for Physical Connectivity, Buffering, and Queuing

40
CEF720 Module Architecture + DFC3

Example: WS-X6748-SFP with WS-F6700-DFC3B Layer 2 Engine for L2 Lookups and Protocol Redirection 20 Gbps Fabric Channel
Layer3/4 Engine for FIB/ADJ, ACL, QoS, and NetFlow Lookups 20 Gbps Fabric Channel
MET
Complex A
Complex B
Layer 2 Engine
Layer 2 Engine
12xGE 12xGE
Port ASIC
DFC3
L3/4 Engine
MET
CEF720 Module w/DFC3
12xGE 12xGE
Port ASIC
Presentation_ID
Cisco Public
41
Multicast Hardware Architecture Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping Multicast Forwarding on VSS
Multicast Hardware Forwarding
Catalyst 6500
IP Multicast Hardware Forwarding
Presentation_ID
Cisco Public
42
Multicast Control Plane

RP CPU (L3) IP Multicast control-plane functions: SP CPU (L2) IP Multicast controlplane functions:
Managing PFC / DFC hardware tables IGMP / MLD Snooping packet processing PIM Snooping / RGMP packet processing IGMP / MLD Querier functions Statistics Collection & Reporting
IP Mroute Table Group Membership MSDP
Multicast protocols: PIM, IGMP / MLD, AutoRP / BSR, MSDP, MVPN, etc. Calculating RPF interfaces Managing software IP mroute table Downloading IP mroute table entries to SP (for installation in the PFC / DFC hardware)
1 Gbps
Inband Channels
1 Gbps
RP (MSFC3) CPU SP (NMP) CPU

Cisco Public
IGMP / MLD Snooping PIM Snooping
Presentation_ID
43
Hardware Multicast Switching

RP (MSFC)
MMLS-RP MDSS SCP / ICC PIM, IGMP, MLD & IP Mrouting
RP CPU derives 3 important data structures from the IP Multicast routing table...
Multicast FIB: Contains (S,G) & (*,G) entries, RPF VLAN, and BiDir RP index Adjacency Table: Contains L2 rewrite MAC information and MET index Multicast Expansion Table (MET): Contains Output Interface Lists (OILs)
SP (Supervisor)
MMLS-SP
MET Manager, IGMP & PIM Snooping SCP
RP CPU downloads tables to SP... SP CPU installs the tables into the appropriate hardware...
MET installed in replication engines Multicast FIB and Adjacency tables installed in PFC/DFC hardware
LC (Linecard)
MET
LC (Linecard)
FIB/ADJ
MET
MMLS-LC
Presentation_ID
MMLS-LC
Cisco Public
SP CPU also maintains L2 tables for IGMP/MLD & PIM snooping
44
Multicast FIB TCAM Lookup

Generate Lookup Key Compare
10.1.1.10, 239.1.1.1
Lookup Key 2 FFFFFFFF FFFFFFFF
3 1 2 3 4 5 4 6 7 8 Result RPF VLAN Adj Index
10.1.1.10, 239.1.1.1 10.1.1.10, 239.1.1.1 10.1.1.10, 239.1.1.1 10.1.1.10, 239.1.1.1 10.1.1.10, 239.1.1.1 10.1.1.10, 239.1.1.1 10.1.1.10, 239.1.1.1
Patterns
Multicast Packet
(S,G) 10.1.1.10, 239.1.1.1
HIT! 10.1.1.10, 239.1.1.1
S,G compares all bits in Source IP and Group IP
Masks
FIB TCAM
Replication Engine(s)
OIL #1 6 OIL #2 OIL #3 OIL #4 MET

MAC, MET Index 5 MAC, MET Index MAC, MET Index MAC, MET Index Adjacency Table
45
BiDir FIB TCAM Lookup

Generate Lookup Key Compare
10.1.1.10, XXXXXX, 239.1.1.1

Lookup Key 2 00000000 FFFFFFFF
5 1 2 3
xxxxxxxx, 239.1.1.99 xxxxxxxx, 239.1.16.1 xxxxxxxx, 239.2.1.1
Bidir RP Table RP #1 DF Set RP #2 RP #3 RP #4 DF Set DF Set DF Set
Multicast Packet
S,G 10.1.1.10, 239.1.1.1
xxxxxxxx, 239.44.12.1 5 4 HIT! xxxxxxxx, 239.1.1.1 6 xxxxxxxx, 239.1.11.1 xxxxxxxx, 239.50.1.1

Patterns
xxxxxxxx, 239.14.14.1 4
7 8
*,G compares all bits in Group IP
Result
Bidir RP Index Adj Index
Masks
FIB TCAM
Replication Engine(s)
OIL #1 7 OIL #2 OIL #3 OIL #4 MET

MAC, MET Index 6 MAC, MET Index MAC, MET Index MAC, MET Index Adjacency Table
46
BiDir RP-to-DF Mapping Table

RP Index 0 1 2 3
1 2 3 4 5 6 1 2 3 4 5 6
1 2 3 4 5 6
DF Interface Set
4093 4094
1 2 3 4 5 6
4093 4094
4093 4094
4093 4094
4K VLAN IDs RP Index 0 1 2 3 RP IP Address 10.1.1.1 10.2.2.2 10.3.3.3 10.4.4.4 DF Interfaces
RP #1 RP #2 RP #3 RP #4
DF Set DF Set DF Set DF Set
VLAN 3 4 5 6
VLAN 1 2 3
Bidir RP Table (PFC/DFC)

Mapping Table (Software Data Structure)
VLAN 200 201

47
VLAN 3 4093
Multicast Expansion Table (MET)
Index Index A from ADJ A
OIF VLAN 100 101 102
Port List
Gi4/12,Gi4/19 Gi9/1 Gi9/25,Gi9/29 Gi4/12,Gi4/22,Gi4/30 Te1/1 Gi4/1,Gi4/2,Gi4/3 Te8/1 Te8/3 Te2/1,Te2/2,Te2/9
MET Block
Index B from ADJ
1019 700
100
Index C from ADJ Replication Engine MET
4030 4031 4032
Presentation_ID
Cisco Public
48
Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Packet Flows Multicast Hardware Replication IGMP / MLD & PIM Snooping Multicast Forwarding on VSS
Catalyst 6500
IP Multicast Hardware Replication
Presentation_ID
Cisco Public
49
Multicast Replication
Process of creating copies of multicast packets on each Layer 3 OIF
Catalyst 6500 supports 3 types of replication
Example: A PIM-SM (S,G) with 3 OIFs - multicast replication creates three copies of every packet received from source (S) & destined to group (G)
For Layer 3 Forwarding between (1 or many) interfaces Replication Engine does the replication
Layer 3 multicast replication Layer 2 multicast replication Fabric multicast replication

For Layer 2 Forwarding between ports in same LC Port ASIC does the replication
Fabric ASIC does the replication
For Egress Forwarding between ports on different Modules

Cisco Public
50
Multicast Replication Modes

Replication Mode refers to exactly where in the system that multicast replication occurs Replication occurs in one or more replication engine ASICs
In a Classic (bus) system, replication occurs centrally on the Supervisor replication engine In a Fabric-enabled system, there are two possible replication modes:
Ingress replication Egress replication
Presentation_ID
Cisco Public
51
Centralized Replication - Classic Systems

The Supervisor replication-engine MUST perform multicast packet replication for all modules All input packets must pass on the shared Data switching Bus (DBUS)
Supervisor
FIB/ADJ
Linecard Linecard
MET
All replicated copies must also pass on the switching bus PFC performs forwarding lookups, and then replicates all packets Only one MET within the system (i.e. the MET on the Supervisor replication-engine)
DBUS DBUS -- Data Data Bus: Bus:
Path Path over over which which actual actual frame Data (and / frame Data (and / or or Header) Header) is is transferred transferred between between Modules Modules and and the the Supervisor Supervisor
RBUS RBUS -- Result Result Bus: Path Bus: Path over over which which
Results Results of of L2-L3/L4 L2-L3/L4 forwarding-engine forwarding-engine lookups lookups by by the the Supervisor Supervisor (PFC) (PFC) are are passed passed back back to to Modules Modules
Cisco Public
52
Ingress Replication-Mode
Supported on Supervisor 720s & Supervisor 2 + SFM
Three Packets Cross Switch Fabric B RE A RE Switch Fabric D RE
Requires Switch Fabric, and multiple Fabric & Replication-capable modules
Replication load is Distributed: Supervisor and / or Switching modules can perform replication Replication engine on the ingress module performs replication for all OIFs Input and replicated packets get lookup on PFC or ingress DFC
C RE
All replicated copies pass over Fabric to egress modules
Multiple MET tables, but MET on all replication-engines synchronized

RE = Replication Engine
53
Egress Replication-Mode
Supported on Supervisor 720s with certain modules
Requires ALL egress-capable modules Input packets get one lookup on ingress PFC/DFC, replicated packets get lookup on egress PFC/DFC
A RE Switch Fabric D RE
e.g. CEF720, 6516A, 6548A-GETX, SIPs
One Packet Crosses Switch Fabric
RE
For OIFs on other (egress) modules, the ingress RE only sends a single copy of packet over Switch Fabric The replication-engine on the egress module then replicate for local OIFs MET on different egress-capable modules can be different / asymmetric
For OIFs on ingress module, the local RE performs the replication
RE
= Replication Engine RE = Replication Engine

Cisco Public
54
Egress Replication - Same Module

With Egress Replication OIF entries are symmetrical among replication-engines on the same module... Hence replication bandwidth usage is not optimized
Entry
MET Contents
OIF 2/1 2/2 Dest Index 2/1 2/2
Index
Module B
1 2
RE 2/1 2/2
Module A
Receiver Green
DROP
Switch Fabric
RE
Source
RE 2/3 2/4
Entry
OIF 2/1 2/3
Dest Index 2/1 2/3 55
MET entry for Non-Local port RE = Replication Engine = Replication Engine

1 2
MET Contents
Egress Local Replication

Egress local replication optimizes the replication bandwidth within the same module, by including only the local ports of each replication engine Cat6500(config)# mls ip multicast egress local
Entry
MET Contents
OIF 2/1 2/2 Dest Index 2/1 2/2
Index
Module B
1 2
RE 2/1 2/2
Module A
Receiver Green
Switch Fabric
RE
Source
RE
2/3 2/4
Entry 1
OIF 2/3
Dest Index 2/3
RE = Replication Engine = Replication Engine

MET Contents
56
Catalyst 6500
IP Multicast Packet Flows
Presentation_ID
Cisco Public
57
Centralized Replication (1)

Supervisor Engine 32 MET L2 Engine
2 3
NOTE: Packet-Flow Steps are kept in the Slide Notes
L3/4 Engine
Orange Green Red Purple R R R R Classic Module B

Port ASIC A Port ASIC B
PFC3
Replication Engine
DBUS RBUS Classic Module A Source Receiver Blue VLAN Orange VLAN Green VLAN Red VLAN Purple VLAN Entire Packet Packet Header S R
Port ASIC A
Blue S
Port ASIC B4
Blue R
Presentation_ID
Cisco Public
58
Centralized Replication (2)

Supervisor Engine 32 MET L2 Engine
6 7
L3/4 Engine
Orange Green Red Purple R R R R

8
PFC3
Replication Engine
5
Classic Module B
Port ASIC A
Port ASIC B
DBUS RBUS Classic Module A Source Receiver Blue VLAN Orange VLAN Green VLAN Red VLAN Purple VLAN Entire Packet Packet Header S R
Port ASIC A
Port ASIC B
Blue S
Blue R
Presentation_ID
Cisco Public
59
Ingress Replication (1)

Supervisor Engine 720
Port ASIC A

Port ASIC B
LC-RBUS LC-DBUS
L3/4 Engine L2 Engine PFC3

3
720 Gbps Switch Fabric
8 Gbps
Fabric Interface
MET DBUS RBUS
Replication Engine
CEF256 Module B
Fabric Interface 4
LC-DBUS LC-RBUS
8 Gbps
CEF256 Module A
MET
Replication Engine
Port ASIC Port ASIC A B

1
Source Receiver Blue VLAN Orange VLAN Green VLAN Red VLAN Purple VLAN Entire Packet Packet Header
S R
Blue S
Presentation_ID
Blue R
Cisco Public
60
Ingress Replication (2)

Supervisor Engine 720
Port ASIC A

Port ASIC B
LC-RBUS LC-DBUS

7
PFC3
720 Gbps Switch Fabric
8 Gbps
9 Fabric Interface
MET DBUS RBUS
Replication Engine
CEF256 Module B
Fabric Interface
LC-DBUS LC-RBUS
8 Gbps
CEF256 Module A
MET
5 Replication Engine
Port ASIC Port ASIC A B
Source Receiver Blue VLAN Orange VLAN Green VLAN Red VLAN Purple VLAN Entire Packet Packet Header
S R
Blue S
Presentation_ID
Blue R
Cisco Public
61
Egress Replication (1)

Port ASIC Port ASIC
Supervisor Engine 720 PFC3 720 Gbps Switch Fabric 20 Gbps
MET 20 Gbps
CEF720 DFC3 Module B L3/4 Engine w/DFC3 L2 Engine
Fabric Interface & Replication Engine
MET

4
L2 Engine L3/4 Engine
CEF720 Module A w/DFC3
Port ASIC
Port ASIC DFC3
Source S Receiver R Blue VLAN Orange VLAN Green VLAN Red VLAN Purple VLAN Internal VLAN Entire Packet Packet Header
Blue S
Presentation_ID
R Blue
62

Port ASIC Port ASIC
MET 20 Gbps
CEF720 DFC3 Module B L3/4 Engine w/DFC3

9

8
L2 Engine
MET
L2 Engine 6 L3/4 Engine
Port ASIC
Port ASIC DFC3
Blue S
Presentation_ID
R Blue
63

Port ASIC Port ASIC
MET 20 Gbps
12
12
CEF720 DFC3 Module B L3/4 Engine w/DFC3

11 10
L2 Engine
MET
L2 Engine L3/4 Engine
Port ASIC
Port ASIC DFC3
Blue S
Presentation_ID
R Blue
64
Catalyst 6500
IP Multicast IGMP/MLD & PIM Snooping
Presentation_ID
Cisco Public
65
IGMP / MLD
Purpose: Signal & Refresh group membership on receiver subnets IGMP (IPv4) & MLD (IPv6) supported IGMP v1, v2 & v3 protocol support for PIM-SM & PIM-BiDir IGMP v3 protocol support for PIM-SSM
MLD v1 & v2 protocol support for PIM-SM MLD v2 protocol support for PIM-SSM Operates on Layer 3 PIM interfaces
Option for SSM Mapping to translate IGMPv2 (*,G) joins into PIM-SSM (S,G) joins
Option for SSM Mapping to translate MLDv1 (*,G) joins into PIM-SSM (S,G) join
66
IGMP / MLD Snooping

Purpose: Constrain unnecessary multicast flooding on Layer 2 host ports
IGMP/MLD Snooping code leverages both Hardware and Software:

PFC/DFC ASICs recognize IGMP / MLD packets and redirects them to SP CPU (protocol redirection logic)
Switch snoops Layer 3 contents of IGMP / MLD packets Switch installs static Layer 2 forwarding entries for each multicast group MAC address
Multicast data traffic forwarded to appropriate Interfaces according to MAC address table entries (per VLAN)
Snooping does NOT affect the performance of multicast data traffic
Redirection logic ONLY redirects IGMP/MLD packets, not UDP (multicast data) packets
67
PIM Snooping
Purpose: Constrain unnecessary multicast flooding on Layer 2 mrouter ports PIM Snooping code also leverages both Hardware and Software:
Switch snoops Layer 3 contents of PIM packets
Mainly used in PIM-connected Layer 2 Core
Switch installs / removes Layer 2 forwarding entries for interfaces which send PIM Joins / Prunes
PFC/DFC ASICs recognize PIM packets and redirects them to SP CPU (protocol redirection logic)
Multicast data traffic only forwarded to appropriate Interfaces according to PIM Snooping mroute table entries (per VLAN)
Protocol redirection ONLY redirects PIM packets, not UDP (multicast data) packets
68
L2 Snooping Packet Flow

CPU Daughter Card RP (MSFC3) CPU 5 SNOOPING SP (NMP) 4 PROCESS CPU
Supervisor Engine 720 Baseboard
Port ASIC MET Fabric Interface & Replication Engine
Integrated 720 Gbps Switch Fabric
DFC3
L2 Engine
Protocol Redirection Logic
3 Fabric Interface & 2 Replication Engine
CEF720 Module w/DFC3
L3/4 Engine
Presentation_ID
Port ASIC
Port ASIC
69
Cisco Public
Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows IGMP / MLD & PIM Snooping
Multicast Forwarding on VSS
Catalyst 6500
IP Multicast Forwarding on VSS
Presentation_ID
Cisco Public
70
Virtual Switching System - Overview
Presentation_ID
Cisco Public
71
Benefits of Multicast with VSS

DR
Stand-Alone
STP/HSRP
Non-DR
Switch-1: Active
Virtual Switch
DR
VSL
Switch-2:-Standby
Inter chassis SSO (*,G) & (S,G) and L2 snooping entries synced across chassis, faster convergence
Benefits of VSS Better multicast traffic load-distribution using MEC
Simplified multicast topology eliminates PIM DR election process & Non-RPF traffic across inter-switch links
72
Multicast with VSS - Load-Sharing

VSS provides Multicast Load-sharing across multiple links with MEC RP
Stand-Alone
RP
VSS
ECMP
L3 MEC
DR
STP/HSRP L2 STP
Non-DR
DR
VSL L2 MEC
Receivers
Presentation_ID
Receivers
Cisco Public
Receivers
Receivers
73
Multicast with VSS - Inter-chassis SSO

VSS Supervisor failure re-convergence is faster with MMLS SSO Multicast forwarding entries (State) is synchronized, so that the new Active Supervisor can forward traffic immediately after Switch-Over RP
SSO
Presentation_ID
Cisco Public
74
Multicast with VSS - Simplified Topology

VSS Simplifies Multicast Topologies
DR
Stand-Alone
Non-DR Non-RPF flows
VSS Logical View

DR
In Stand-Alone (multi-home) topologies, inter-switch link bandwidth is wasted due to non-RPF traffic between DR & non-DR VSS is a single DR, so there is no non-RPF traffic
75
Multicast Re-convergence Scenarios

1. Uplinks Failure 3. Switch Interlink Failure
RP
1
L3 L2/L3
DR
3 4
L3 L2/L3
2. Supervisor Failure
4. Downlinks Failure
Receivers
Receivers
Multicast State: 500 PIM groups @ 10 sources per-group = 5000 mroute entries With MMLS Egress Replication-Mode = 10,000 shortcuts in hardware Time is in Seconds
76
Multicast with VSS - Deployment Guidelines

Connected devices should ALWAYS be dual-homed (MEC or ECMP), for optimal replication performance MEC is recommended in BOTH L2 & L3 environments, to provide deterministic data-plane convergence MEC eliminates RPF re-calculation & DR re-election during Link Failures
L2 MEC
VSS Multicast Guidelines:
L3 MEC
VSS
L3 MEC
PIM DR
L2 MEC
Use Egress replication-mode (and egress-local) for higher multicast replication throughput
Traffic flow #1 Traffic flow #2

Egress replication-mode requires DFCs for optimized replication performance Size the total number of VSL member links to meet traffic requirements
Cisco Public
77
Multicast Control Plane Details

Control Plane operates ONLY on the VSS Active Supervisor
Multicast Control Plane traffic ( IGMP / MLD, PIM hellos, PIM Joins / Prunes, etc... ) received by VSS Standby are redirected to VSS Active via VSL
Catalyst 6500-A (VS Active)
Supervisor
Control traffic is redirected to Active VSS SP/RP

VSL Catalyst 6500-B (VS Standby) RP SP
Supervisor
SP
RP
PIM Hellos MEC MEC
Presentation_ID
Cisco Public
78
VSS Multicast: FIB Programming

The VS Standby SP is treated as a DFC module from a FIB / ADJ forwarding perspective.
VS ACTIVE
MET 67XX DFC FIB/ADJ DFC FIB/ADJ MET
VS STANDBY
The VS Active SP installs forwarding shortcuts onto the Active PFC, Standby PFC and all other DFCs in the VS System.
MET
MET
C2+
C2+
MET
MET
FIB/ADJ
Active SP
Standby
FIB/ADJ
HA FIB-CAPABLE ICC MCAST GROUP
VSL
SP
MET
Presentation_ID
Cisco Public
79
VSS Multicast: MET programming

The VS Standby SP is treated as a Supervisor module from a MET programming perspective
VS ACTIVE
C2+ MET DFC DFC C2+ MET MET C2+ MET MET
VS STANDBY
The SP on each Chassis manages & programs its own MET, and the METs of all local C2+ modules
DFC modules manage and program their own METs
Active SP
MET
Standby SP
MET
ACTIVE SCP MET MCAST GROUP
VSL
STANDBY SCP MET MCAST GROUP
Presentation_ID
Cisco Public
80
Multicast Ingress Forwarding Model

All forwarding-lookups & replication occur on the Ingress modules Subsequent modules only perform L2 egress lookup. Multiple replications cross the Ingress Cores Switch Fabric and / or VSL
Ingress Core
M0 1 S R1 E
MET2
Egress Core
R R M0 E
LC2
R3
M1 3 M0 E M1
R R
R
LC 1
M1 M0 E
2 MET3 E
LC1 (Ingress)
LC 3
R 6 4
VSL
7 R
LC2
R4 8 R5
Switch 1
LC3
M1
Switch 2
LC 4
MEC
Access Switch

Presentation_ID
5 R2
Cisco Public
I-E-E-E (Ingress-VSL-VSL-Egress)
Multicast packets may cross up to 4 DFCs Ingress DFC performs L2-L4 forwarding lookup Up to 3 DFCs (VSL) perform L2 egress lookup
81
Multicast Egress Forwarding Model

Egress modules (on Ingress Core) then replicate locally, and also for all receivers on the Egress Core. Multiple replications cross the VSL
Ingress Core
M0 E 1 S R1
MET3 MET2
Ingress modules replicate locally & one copy to Egress modules
Egress Core
R R M0 E R R 6 R 4 7 R
LC 1
R3
M1 2 M0 E 3 M1
M1 M0 8 E M1
LC2
LC2 (Egress)
LC 3
E
LC1 (Ingress)
VSL
R
R4 9 R5
LC 4
Switch 1
MET2
LC3 (Egress)
Switch 2
10
MET3
MEC

Presentation_ID
Access Switch
5 R2
Cisco Public
I-E-E-E (Ingress-VSL-VSL-Egress)
Multicast packets may cross up to 4 DFCs Ingress DFC performs L2-L4 forwarding lookup Up to 3 DFCs (VSL) perform L2 egress lookup
82
Catalyst 4500/4900 (30-40m)
Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows
Catalyst 4500/4900
IP Multicast Hardware Architecture
Presentation_ID
Cisco Public
83
Cat4K Architecture
Packet Processor: receive, extract, reconstruct, and send. Forwarding Engine: lookup, rewire, replication, and Qos
Packet Packet Memory Memory
Packet Lookup Descriptor (PLD)
Layer2 module
Input Services FWD module
Packet Packet Processor Processor
Replication Replication Forwarding Forwarding Engine Engine Queue Queue

Packet Transmit Descriptor(PTD)
Output Services
Replication Replication Module Module
CPU CPU
84
Single copy of multicast packet in Packet Memory => Excellent buffer capability Same path as unicast => deterministic and low latency/jitter
Packet Lookup Descriptor (PLD)
Cat4K Multicast Architecture
Layer2 module
Replication Forwarding Forwarding Engine Engine Queue

Packet Transmit Descriptor(PTD)
Output Services
Replication Module Replication Table
CPU CPU
85
Catalyst 4500/4900 (30-40m)
Multicast Hardware Architecture Multicast Hardware Replication Multicast Packet Flows
Multicast Hardware Forwarding
Catalyst 4500/4900
IP Multicast Hardware Forwarding
Presentation_ID
Cisco Public
86
Multicast Forwarding Overview

Forwarding TCAM
S,G S1, G1 S2, G2 *, G4 RPF interface Vlan3 Vlan7
RET table
RP ID 0 0 2 RET index 1219 1279 1356 index 0 ..
Set of {vlan switchport}
1279 1356
{vlan3, Fa3/1} {vlan5, Fa3/2}
{vlan101, te1/1} {vlan1007, te1/8}
Hardware FIB Table Install mroute table except OIL (Outgoing Interface List)
Hardware RET Table Install OIL information of mroute
These two tables constitute the MFIB entry

87
Multicast PIM BiDir Forwarding Overview

Forwarding TCAM
S,G S1, G1 S2, G2 *, G4 RPF interface Vlan3 Vlan7
RET table
RP ID 0 0 2 RET index 1219 1279 1356 index 0 ..
Set of {vlan switchport}
1279 1356
{vlan3, Fa3/1} {vlan5, Fa3/2}
{vlan101, te1/1} {vlan1007, te1/8}
VLAN 1
1 0 0 0 0
2 0 0 1 0
VLAN DF Table
7 0 0 0 0
88
101 4094
Cisco Public
Catalyst 4500/4900 (30-40m)
Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Packet Flows Multicast Hardware Replication
Catalyst 4500/4900
IP Multicast Hardware Replication
Presentation_ID
Cisco Public
89
Replication Module
PLD
Layer2 module

PTD
Output Services
Replication Module Replication Replication Table Table
CPU CPU
Presentation_ID
Cisco Public
90
Replication Module
Replicated packetspackets that need to go to two or more ports and/or VLANs Packet which require replication are
CPU copy for Unicast packet SPAN Unknown Unicast Flooding IP multicast packet Broadcast packets
With Classic Supervisors, this module is called Multicast Replication Module (MRM)
Replication Module
With E-Series Supervisors, this module is called Replication Management Module (RMM)
91
Replication Table
PLD
Layer2 module

PTD
Output Services
Replication Replication Module Module Replication Table
CPU CPU
Presentation_ID
Cisco Public
92
Replication Table
Stores replication vlan/portsets information for L2 multicast/broadcast/flooding and IP multicast forwarding
With Classic Supervisors, this module is called Multicast Expansion Table (MET). The MET size is 64K [it is 32K for SupII+, SupII+TS Replication and SupII+10GE] Table With E-Series Supervisors, this module is called Replication Expansion Table (RET). The RET size is 102K
Presentation_ID
93
Replication Queues
PLD
Layer2 module
Replication Forwarding Forwarding Engine Engine Queue Replication Replication Module Module Replication Replication Table Table
Output Services
PTD
CPU CPU
Presentation_ID
Cisco Public
94
Replication Queues
Replication queues prevents the congestion in Forwarding Engines pipeline
With Classic Supervisors, this module is called Multicast Replication Queue (MRQ). Queue depth is 2048. It stores [pkt id, header, MET index] With E-Series Supervisors, this module is called Replica Request Queue (RRQ). Queue depth is 4096. It stores [pkt id, header, RET index]
Replication Queue
Presentation_ID
Cisco Public
95
Catalyst 4500/4900 (30-40m)
Multicast Hardware Architecture Multicast Hardware Forwarding Multicast Hardware Replication Multicast Packet Flows
Catalyst 4500/4900
IP Multicast Packet Flows
Presentation_ID
Cisco Public
96
IP Multicast Forwarding
Host AVLAN 1 Multicast Source PLD
Layer2 module
Host BVLAN 2 Multicast Receiver Modules Modules

PTD
Output Services
Host CVLAN 3 Multicast Receiver
CPU CPU
Presentation_ID
Cisco Public
97
1
2
Layer2 module

PTD
Output Services
CPU CPU
Presentation_ID
Cisco Public
98
8
Layer2 module
Replication Forwarding Forwarding Engine Engine Queue Replication Module Replication Table
Output Services
9
CPU CPU
PTD
Presentation_ID
Cisco Public
99
Session Take-Aways
Catalyst Switches leverage proven IP Multicast IOS code Hardware Switching provides Higher Throughput
Software-based Multicast forwarding is limited by CPU & Memory (vs. bandwidth) MLS & CEF offloads a significant portion of Multicast routing (packet rewrite) to hardware WS-SUP720-3B & VS-S720-10G provide 720Gbps Fabric-based throughput (VSS @ 1.44Tbps) WS-SUP32-3B provides 32Gbps Bus-based throughput DFCs + Egress Replication capable of 30/48Mpps of throughput Supervisor 6L-E capable of 225Mpps of replication.
Supervisor 6E & Catalyst 4900M capable of 250Mpps of replication.
Hardware Switching provides Less Latency / Jitter

Hardware-based forwarding is only limited by ASIC replication times
Software-based forwarding incurs high latency / jitter during routing & replication
High-Availability (SSO/NSF) Minimizes Traffic Loss

Loss of an adjacency will cause RPF re-calculation, DR/DF election, before convergence
Forwarding entries are synchronized & adjacencies will not drop, resulting in near-zero loss
100
Recommended Reading
Continue your Networkers @ Cisco Live learning experience with further reading from Cisco Press Check the Recommended Reading flyer for suggested books
Available Onsite @ the Cisco Company Store

101
Presentation_ID
Cisco Public
102
APPENDIX:
IP Multicast Troubleshooting
Presentation_ID
Cisco Public
103
Some Definitions...
ACL: Access Control List
BIDIR: Bi-Directional (PIM) DR: Designated Router (DM,SM & SSM) DF: Designated Forwarder (BIDIR) DM: Dense-Mode (PIM) IGMP: Internet Group Management Protocol MET: Multicast Expansion Table MLD: Multicast Listener Discovery MVPN: Multicast VPN OIF: Out-going InterFace OIL: Out-going Interface List PIM: Protocol Independent Multicast RP: Rendez-vous Point (SM & BIDIR) SM: Sparse-Mode (PIM) SSM: Source-Specific Multicast (PIM)
Cisco Public
ACE: Access Control Entry
ADJ: Adjacency Table / Rewrite Info CEF: Cisco Express Forwarding HA: High Availability FIB: Forwarding Information Base MLS: Multi-Layer Switching NSF: Non-Stop Forwarding SSO: Stateful Switch-Over RPF: Reverse-Path Forwarding VPN: Virtual Private Network
VRF: Virtual Routing & Forwarding VSS: Virtual Switching System

Presentation_ID
104
Catalyst 6500
Presentation_ID
Cisco Public
105
Multicast Troubleshooting Overview

Key Problem Areas Configuration Software and hardware multicast forwarding state Software and hardware scalability limits
Most of the troubleshooting is applicable to Catalyst 4500/4900 as well.
There is note on the slide if that is specific to Catalyst 6500.
Presentation_ID
Cisco Public
106
Verify the Multicast Configuration

Verify that ip multicast-routing is enabled! If MVPN, verify ip multicast-routing is enabled per-VRF PIM enabled on all of the Interfaces (including Loopbacks) If PIM-SM and / or PIM-BiDir, verify the RP configuration (AutoRP, BSR, Anycast, Phantom RP, Static) Hardware MMLS/CEF and IGMP Snooping enabled (enabled by Default, but can be disabled) Watch out for TTL thresholds, multicast boundary, security ACLs, VACLs, policers, etc. Watch for proper SSM or BiDir address-range configuration (SSM & Bidir require coordination between Network and Application groups) Unicast Routing is enabled & RPF information is correct
107
Troubleshooting Forwarding State

Verify RP and DR/DF state
Verify software IP mroute state
Verify hardware multicast forwarding tables
Presentation_ID
Cisco Public
108
Verifying RP and DR/DF State

Check RP IP addresses and group-to-RP mappings Verify RP RPF/upstream information Verify DR or DF Interface state
Presentation_ID
Cisco Public
109
Verifying Group-to-RP Mappings

Catalyst-6506E#show ip pim rp mapping PIM Group-to-RP Mappings Group(s): 224.0.0.0/4, Static RP: 10.255.255.3 (tstevens-6509.cisco.com) Catalyst-6506E#show ip pim rp Group: 239.1.1.10, RP: 10.255.255.3, v2, uptime 00:01:10, expires never Group: 239.1.1.11, RP: 10.255.255.3, v2, uptime 00:01:10, expires never Group: 239.1.1.12, RP: 10.255.255.3, v2, uptime 00:01:10, expires never Group: 239.1.1.13, RP: 10.255.255.3, v2, uptime 00:01:10, expires never Group: 224.0.1.40, RP: 10.255.255.3, v2, uptime 00:01:10, expires never Catalyst-6506E#
Presentation_ID
Cisco Public
110
Verifying IP RPF Information

Catalyst-6506E#show ip rpf 10.255.255.3 RPF information for tstevens-6509.cisco.com (10.255.255.3) RPF Interface: GigabitEthernet1/5 RPF neighbor: tstevens-6513 (10.20.1.2) RPF route/mask: 10.255.255.3/32 RPF type: unicast (ospf 10) RPF recursion count: 0 Doing distance-preferred lookups across tables Catalyst-6506E#
Presentation_ID
Cisco Public
111
Identifying the DR for a Segment

show ip pim Interface identifies DR for each Interface
Catalyst-6506E#show ip pim Interface Address 10.255.255.2 10.255.254.1 10.10.1.2 10.30.1.1 Interface Loopback0 Loopback1 GigabitEthernet4/3 Vlan100 Vlan101 Vlan200 Vlan201 Ver/ Nbr 0 0 1 1 1 1 1 1 Query 30 30 30 30 30 30 30 30 DR 1 1 1 1 1 1 1 1 DR 10.255.255.2 10.255.254.1 10.10.1.2 10.30.1.2
v2/S v2/S v2/S v2/S v2/S v2/S v2/S v2/S
Mode
Count
Intvl
Prior
10.100.1.1 10.101.1.1 10.200.1.1 10.201.1.1 Catalyst-6506E#

Presentation_ID
GigabitEthernet4/16
10.100.1.2 10.101.1.2 10.200.1.2 10.201.1.2
This routers Interface addresses
Compare with DR address
Cisco Public
112
Identifying Bidir DF Interfaces

Catalyst-6506E#show ip pim Interface df Interface Loopback0 GigabitEthernet1/5 GigabitEthernet1/13 GigabitEthernet2/13 GigabitEthernet2/14 GigabitEthernet2/24 Vlan100 Vlan101 Vlan200 Vlan201 Catalyst-6506E# RP 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 DF Winner 10.255.255.1 10.20.1.2 10.13.1.1 10.13.2.1 10.14.2.1 10.2.24.1 10.100.1.2 10.101.1.2 10.200.1.2 10.201.1.2 Metric 2 0 2 2 2 2 2 2 2 2 Uptime 02:21:07 02:21:08 02:21:07 02:21:07 02:21:07 00:35:15 00:03:39 00:01:13 00:01:10 00:01:07
PIM enabled Interfaces Bidir RP address

Winners routing metric to RP
IP address of current DF winner

113
Bidir RP-to-DF Interface Mapping Table

Catalyst-6506E#show mls ip multicast rp-mapping df-cache State: H - Hardware Switched, I - Install Pending, D - Delete Pending, Z - Zombie RP Address 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 10.255.255.3 Catalyst-6506E#
* Catalyst 6500 Only
All DF Interfaces should be in H state
State H H H H H H H H
DF Gi2/13 Gi1/13 Gi2/14 Gi2/24 Vl100 Vl101 Vl200 Vl201
State H H H H H H H H
DF Interfaces for specified Bidir RP
114
Verifying Software IP Mroute State

Ensure IP mroute exists in software... show ip mroute
Ensure RPF Interface is known and correct
Does Hardware state information in show ip mroute output appear correct?
Does (*,G) and/or (S,G) exist in software mroute table?
Make sure show ip mroute and show ip rpf show correct RPF Interface for (*,G) or (S,G) PIM reliance on unicast routing means multicast issues often caused by unicast routing issues
Presentation_ID
Cisco Public
115
Verifying Software IP Mroute State (2)
OIFs are Known and Correct OIF Inclusion driven by PIM or IGMP Ensure PIM neighbors active and stable (show ip pim neighbor)
IGMP dictates connected receiver membership ensure joins/leaves sent by receivers and received by RP CPU
Might need to verify PIM and IGMP packet exchange using SPAN/sniffer and/or debugs
116
Displaying Hardware Forwarding Entries

show mls ip multicast

Catalyst-6506E#show mls ip multicast group 239.1.1.1 source 10.1.1.100 Multicast hardware switched flows: (10.1.1.100, 239.1.1.1) Incoming Interface: Gi1/5, Packets switched: 293919 Hardware switched outgoing Interfaces: Vlan100 Vlan101 Gi1/13 Gi2/13 Gi2/14 Vlan200 RPF-MFD installed
Total hardware switched flows : 1 Catalyst-6506E#
Applies to PIM-SM, PIM-SSM, and Bidir (*,G) hardware entries

117
Bidir-PIM (*,G/m) Entries

Source-only traffic must reach RP (could be receivers on other branches) For efficiency, system installs (*,G/m) hardware forwarding entry/entries to transport this traffic
Entries based on Bidir-PIM RP ACL configuration
At RP, assuming no receivers on other branches, packets dropped in hardware
NOTE: (*,G/m) entries not shown in software mroute table today
Presentation_ID
Cisco Public
118
Viewing Bidir (*,G/m) Forwarding Entries

Catalyst-6506E#show mls ip multicast rp-mapping gm-cache State: H - Hardware Switched, I - Install Pending, D - Delete Pending, Z - Zombie
RP Address 10.255.255.3 Catalyst-6506E#
State H
Group 224.0.0.0
Mask 240.0.0.0
State H
Packet/Byte-count 1183799/1754389822
Statistics
Bidir RP IP Address
Group IP and Mask (224/4)
Presentation_ID
Cisco Public
119
Troubleshooting Group Membership

Verify IGMP / MLD & IGMP / MLD Snooping configuration status
Make sure IGMP snooping requirements are met
Make sure the Layer 3 and Layer 2 entries exist and Interface/port membership is correct
Presentation_ID
Cisco Public
120
Verifying IGMP / MLD & Snooping Configuration Status

Catalyst-6506E#show ip igmp Interface vlan 100 Vlan100 is up, line protocol is up IGMP is enabled on Interface Internet address is 10.100.1.2/24 Current IGMP host version is 2
Current IGMP router version is 2
IGMP query interval is 60 seconds
IGMP querier timeout is 120 seconds Last member query count is 2
IGMP max query response time is 10 seconds Last member query response interval is 1000 ms Inbound IGMP access group is not set IGMP activity: 3 joins, 2 leaves
IGMP Configuration State
IGMP Packet Statistics

121
Cisco Public
Verifying IGMP / MLD & Snooping Configuration Status (2)

Multicast routing is enabled on Interface Multicast TTL threshold is 0 Multicast designated router (DR) is 10.100.1.3 No multicast groups joined by this system IGMP snooping is globally enabled
DR & Querier Information
IGMP querying router is 10.100.1.2 (this system)
IGMP snooping is enabled on this Interface IGMP snooping explicit-tracking is enabled
IGMP snooping Gist-leave is disabled and querier is disabled IGMP snooping last member query response interval is 1000 ms Catalyst-6506E# IGMP snooping report-suppression is disabled
IGMP Snooping Configuration State

122
Verifying IGMP Snooping Requirements

IGMP querier must be present in the VLAN Make sure all multicast router ports known
Could be multicast router or switch configured as querier
Switch tracks location of all multicast routers on per-VLAN basis Detection based on IGMP queries and PIM hellos Snooping switch uses list of mrouter ports to flood certain traffice.g., proxied joins/leaves Loss of multicast router port will impact traffic flow
Presentation_ID
Cisco Public
123
Viewing Multicast Routers

Catalyst-6506E#show ip igmp snooping mrouter vlan ports
-----+---------------------------------------100 101 200 201 Gi3/7,Gi3/16 Gi3/7,Gi3/16 Gi3/7,Gi3/16 Gi3/7,Gi3/16

VLAN for Which Specified Ports Are Multicast Router Ports
List of Multicast Router Ports for VLAN
Catalyst-6506E#
124
Verifying IGMP Membership

IGMP enabled when PIM configured on an Interface For receiver segments, IGMP drives OIF presence in mroute table
Use show ip igmp groups to see IGMP join status on mrouter
Verify IGMP querier consistency and group membership for routers on shared segments Watch for IGMP access groups, multicast boundary Verify IGMP snooping entries
Make sure entry exists and port membership correct
Be aware of effect of IGMP snooping on Layer 3 IGMP behavior (e.g. not all joins/leaves seen by router)
Use debug ip igmp <group> to monitor IGMP packet reception at router
Presentation_ID
Cisco Public
125
Verifying IGMP Entries
Catalyst-6506E#show ip igmp groups IGMP Connected Group Membership Group Address 239.1.2.0 239.1.2.1 239.1.2.2 239.1.2.3 239.1.1.10 224.0.1.40 Catalyst-6506E# Interface Vlan200 Vlan200 Vlan200 Vlan200 Vlan201 Loopback0
Uptime
00:00:12 00:00:12 00:00:12 Interface with 00:00:13 Connected Receiver 1w4d 00:00:12
Expires
00:00:00 00:00:00 00:00:00 00:00:00 00:00:00 00:02:18
Last Reporter 10.200.1.101 10.200.1.101 10.200.1.101 10.200.1.101 10.201.1.101 10.255.255.1
Multicast Group Joined
IP Address of Last Receiver to Report for the Group on the Interface

Cisco Public
Presentation_ID
126
Verifying IGMP Snooping Entries

Catalyst-6506E#show mac-address-table multicast igmp vlan mac address type learn qos ports -----+---------------+--------+-----+---+-------------------------------200 0100.5e01.0101 static Yes Gi3/1,Gi3/7,Gi3/16 100 0100.5e01.0101 static Yes Gi3/5,Gi3/7,Gi3/16 101 0100.5e01.0101 static Yes Gi3/6,Gi3/7,Gi3/16 Catalyst-6506E# List of Receiver Ports (Also Includes Any Multicast Router Ports in VLAN) Group Destination MAC VLAN Where Group MAC Is Learned
127
Scalability Limits
Ensure Layer 3 and Layer 2 entry capacity not exceeded Monitor MET utilization Monitor RP and SP CPU utilization Monitor Fabric and bus utilization
Presentation_ID
Cisco Public
128
Checking Layer 3 Entry Capacity
Multicast entries share FIB TCAM entries and hardware adjacency entries with other protocols (unicast, IPv6, MPLS) Syslogs printed when hardware capacity exceeded (total FIB exhaustion, or exceeded max-routes configuration) Check current entry status:
show mls ip multicast summary
Maximum capacity by forwarding engine documented earlier in your handouts

show mls cef maximum-routes (PFC3)
129

Catalyst-6506E#show mls ip multicast summary 21210 MMLS entries using 3394656 bytes of memory Number of partial hardware-switched flows: 0 Number of complete hardware-switched flows: 21210 Directly connected subnet entry install is enabled Hardware shortcuts for mvpn mroutes supported Current mode of replication is Ingress Auto-detection of replication mode is enabled Consistency checker is enabled Bidir gm-scan-interval: 10 Catalyst-6506E#
130
Monitoring MET Utilization

Recall that MET in replication engines contains OIFs for mroutes MET is limited hardware resource (64K entries total)
Allocated in fixed size blocks CatOS always allocates in four-entry blocks
Monitor current MET utilization
Cisco IOS allocates in variable block sizes based on need (one, two, four, eight, or 16 entries) Inexact sciencesome internal overhead (pointers, etc.) and wasted space
Syslog generated if MET capacity reached
%MMLS-SP-6-MET_LIMIT_EXCEEDED: Failed to allocate MET entry, exceeded system limit of (65536) entries. Number of times MET limit is exceeded in the last 1 min : 7
Presentation_ID
Cisco Public
131
Monitoring MET Utilization

Catalyst-6506E-sp#show mmls met
met free entries: 61462 met total entries: 65526 <>
Total Free Entries
Catalyst-6506E-sp#
64K Total MET Entries
Presentation_ID
Cisco Public
132
Layer 2 Entry Capacity

Limit is 15,488 Layer 2 multicast groups
Limit is configurable using ip igmp snooping l2-entry-limit command
Syslog posted when limit exceeded or hash collision occurred

%MCAST-SP-6-L2_HASH_BUCKET_COLLISION: Failure installing (G,C)>index: (0100.5e01.1465,1017)->0x82C
%MCAST-SP-6-GC_LIMIT_EXCEEDED: IGMP snooping was trying to allocate more Layer 2 entries than what allowed (15488)
When limit exceeded, flooding occurs for additional group MACs
Presentation_ID
Cisco Public
133
Monitoring Layer 2 Entry Capacity

show mac-address-table multicast igmp count
Catalyst-6506E#show mac-address-table multicast igmp count Multicast MAC Entries for all vlans: Catalyst-6506E# 455
Presentation_ID
Cisco Public
134
Catalyst 4500/4900
Presentation_ID
Cisco Public
135
Multicast Related Entries

Protocols EIGRP/OSPF PIM/IGMP IGMP snooping
Unicast Routing Software Tables Table
Multicast Routing Table
Layer 2 Forwarding Table
CEF
MFIB
CEF MFIB Subsystem
S/W adjacency Table
S/W FIB Table
Hardware Tables
Presentation_ID
H/W adjacency Table

H/W FIB Table

Cisco Public
Replication Table
136
Multicast Related Entries

Protocols EIGRP/OSPF show ip mroute PIM/IGMP IGMP snooping show ip igmp snooping group show ip igmp group Multicast Routing Table Layer 2 Forwarding Table
Unicast Routing Software Tables
Table show ip mfib CEF
MFIB
show platform software ip route multicast S/W adjacency S/W FIB
CEF MFIB Subsystem
Table Table show platform hardware ip route multicast Hardware Tables

Presentation_ID
H/W adjacency Table
Table Table show platform hardware met entry < > 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public Show platform hardware ret chain index <>
H/W FIB
Replication
137
IGMP Troubleshooting Check List

Make sure igmp entry is correctly programmed to mroute table
show ip igmp snooping group show ip igmp snooing mrouter show platform hardware mac-address-table address < > show platform hardware met entry < > [Classic] show ip igmp group show platform hardware ret chain index < > [E-Series] show ip igmp Interface < > show ip pim neighbor show ip mroute
Presentation_ID
Cisco Public
138
PIM troubleshooting check list

PIM and mroute debugging
show ip mroute show platform hardware ip route multicast show platform hardware met entry < > show platform hardware ret chain < > show ip rpf < > show ip pim neighbor show platform hardware met chain < > [Classic]
[E-Series]
[Classic]
show ip mroute < > count show ip mroute active Show ip pim rp mapping in-use
Presentation_ID
Cisco Public
139

Catalyst 6500 4500/4900: IP Multicast

Diunggah oleh

Informasi Dokumen

Deskripsi Asli:

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Catalyst 6500 4500/4900: IP Multicast

Diunggah oleh

Hak Cipta:

Format Tersedia

Catalyst 6500 & 4500/4900 IP Multicast Architecture

Session ID: BRKARC-3322

Cisco Live & Networkers Virtual

2010 Cisco and/or its affiliates. All rights reserved.

2010 Cisco and/or its affiliates. All rights reserved.

General IP Multicast architecture covered in: IPM-1261: Introduction to IP Multicast

2010 Cisco and/or its affiliates. All rights reserved.

IP Multicast - Agenda 1/3

Multicast Overview (15-20m)

IP Multicast on Catalyst 4500/4900 (~2m)

IP Multicast on Catalyst 6500 (~2m)

Multicast Management (~2m)

Multicast High-Availability (~2m)

Multicast VPN & Extranet (~2m)

IGMP/MLD & Snooping (~2m)

2010 Cisco and/or its affiliates. All rights reserved.

Catalyst 6500 - Agenda 2/3

Catalyst 6500 (60-70m)

Multicast Forwarding on VSS (~10m)

IGMP / MLD & PIM Snooping (~5m)

Multicast Packet Flows (~15m)

Multicast Hardware Replication (~5m)

Multicast Hardware Forwarding (~10m)

2010 Cisco and/or its affiliates. All rights reserved.

Catalyst 4500/4900 - Agenda 3/3

Catalyst 4500/4900 (30-40m)

2010 Cisco and/or its affiliates. All rights reserved.

Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping

Multicast VPN & Extranet Multicast Management

Multicast High-Availability IP Multicast on Catalyst 6500

IP Multicast on Catalyst 4500/4900

IP Multicast Overview PIM Distribution Modes

2010 Cisco and/or its affiliates. All rights reserved.

PIM Dense Mode (PIM-DM)

2010 Cisco and/or its affiliates. All rights reserved.

PIM Sparse Mode (PIM-SM)

Automatic Source discovery (via Registers)

IGMP v1/2/3 & MLDv1/2 and Snooping

PIM Source-Specific Multicast (PIM-SSM)

Hosts are responsible for source discovery

Typically via some out-of-band mechanism (web page,etc.)

SSM mapping (for IGMPv2 & MLDv1)

Bidirectional PIM (PIM-BiDir)

Drastically reduces network mroute state

2010 Cisco and/or its affiliates. All rights reserved.

The Evolution of PIM...

(*,G) Many to Many

(S,G)? (S,G)? (S,G)? (S,G)? Discard Discard

Direct Direct Connect? Connect?

OIF OIF List? List?

Forward Forward // Replicate Replicate

2010 Cisco and/or its affiliates. All rights reserved.

Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping

Multicast VPN & Extranet Multicast Management

Multicast High-Availability IP Multicast on Catalyst 6500

IP Multicast on Catalyst 4500/4900

IP Multicast Overview IGMP/MLD & Snooping

2010 Cisco and/or its affiliates. All rights reserved.

IGMP / MLD & Snooping

Snooping support for IGMPv1/2/3 and MLDv1/v2

Multicast Overview (15-20m) PIM Distribution Modes IGMP/MLD & Snooping

Multicast VPN & Extranet Multicast High-Availability Multicast Management