Advanced Traffic
Management and QoS
Concepts
Session 319
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 2
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 1
Introduction
• Traffic Management
• Applications and Transports
• So what Are the Issues for
TCP
Voice on IP
Video (Broadcast and Teleconferencing)
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 3
• Why it is a concern
• What the guiding principles are
• What tools are available
• What can be accomplished using
those tools
• What cannot be accomplished
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 4
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 2
Why Traffic Management
Is a Concern
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 5
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 3
What Tools Are Available for
Traffic Management
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 7
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 8
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 4
Primarily a WAN IP Talk
WAN Protocol
• IP is the dominant
Breakdown
internet protocol
• TCP is the dominant 80%
IP SNA IPX
• Heterogeneous Others RFC 1490
link layers
Source: Gartner Group Study, March 1997
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 9
Making Networks
Predictable
The Grail
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 10
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 5
This Is what You Need
to Understand:
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 11
• INFOCOMM ’93
• One must have at most a predictable
amount of traffic in the network
• One must have predictable traffic
delay in each network element
• Given these, end-to-end delay of a
host to host message is predictable
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 12
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 6
Definition of “Predictable”
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 7
Examples of Source Predictability
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 8
Examples of Unpredictability
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 17
Examples of Predictability
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 18
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 9
Quality of Service Issues in
Traffic Management
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 19
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 10
Backbone Traffic Mix
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 22
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 11
Behavior of a TCP Sender
• Sends as much as N
credit allows N+
N+ 1
2
N+
3
• Starts credit small
Avoid overloading
network queues
• Increases credit
exponentially
To gauge network capability
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 23
N
N+
• When in receipt of “next N+ 1
2
message,” schedules N+
3
+1
kN
an ACK Ac 1
+
kN
Ac
+1
• When in receipt of ckN
A
something else,
acknowledges all it
can immediately
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 24
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 12
Sender Response to ACK
• If ACK acknowledges N
N+
something N+ 1
2
N+
Update credit and send 3
+1
kN
Ac 1
• If not, presume it indicates kN
+
Ac
a lost packet Ac
kN
+1
N+
Send first unacknowledged 1
+1
within the same session: N+
4 ck N
A
+1
kN
Ac
Current TCPs wait for time-out kN
+1
Ac
N+
1
Selective acknowledge may
work around (but see +4
INFOCOM ’98) ckN
A
World
N+
4 Wide
New Reno “fast retransmit
phase” takes several RTTs Wait!
+5
kN
to recover Ac
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 26
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 13
Remember Parekh and Gallagher
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 27
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 14
Fundamental FIFO Queue
Management Technologies
• Tail drop
Network standard behavior
Causes session synchronization when
waves of traffic experience
correlated drops
• Random Early Detection (RED)
Random drops used to desynchronize
TCP sessions and control rates
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 29
Session Synchronization
• Session
synchronization
results from
synchronized
losses
• Tail drop from
waves of traffic
synchronizes
losses
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 30
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 15
Effect of
Random Early Detection
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 32
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 16
FIFO Traffic Timings
400
350
300
Mean
250
Latency
Correlates
Ns RTT
200
with
150
Maximum
Queue
100 Depth
50
0
Elapsed Time
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 33
400
350
Additional
300 Capacity
to Absorb
250
Bursts
Ms RTT
200
Mean
150
Latency
Correlates
100 with
Minimum
50 Drop
Threshold
0
Elapsed Time
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 34
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 17
Therefore—TCP QoS Definition:
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 35
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 18
An Interesting Common
Fallacy about RED:
• Applications
Often have site-specific policy
associated with them
Traffic often identifiable by port numbers
• Sites
Generally identifiable by address prefix
or interface traffic is received on
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 38
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 19
TCP Bandwidth Policy
Questions to Answer
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 39
Limiting to a rate
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 40
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 20
Some Class of Traffic Wants at
Least a Certain Bandwidth
ICU
Left Right
UC Me
Managed Link
U Betcha
• Example:
Several organizations share cost of link
Distribute bandwidth proportional to
fiscal responsibility
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 41
• Traffic shaping
• Similar queuing technology to class-
based weighted fair queuing
• Rate assigned to
Interface or sub-interface
Frame Relay circuit
ATM virtual channel (in hardware)
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 42
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 21
Examples of Rate Control
64
KBPS
T-1
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 43
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 44
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 22
Marking TCP Traffic at Edge
• A useful technique:
• Mark traffic at a network edge with
simple classifier
• This allows network to
Do the right thing without having to fully
classify everywhere
Use more effective markings
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 45
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 23
Structure of Presumed Service
Level Agreement
Usage
gets some guarantees 40%
30%
20
10
30
40
50
60
70
80
90
Potentially dropped by
WRED at bottleneck Time
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 47
Line Congested?
Drop at Some Rate!
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 48
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 24
Assured Service in Simple
IP Networks
Line Congested
and Packet Out of
Profile? Drop at
Profile
Some Rate!
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 49
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 50
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 25
Assured Service in an
ATM-Based Network
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 51
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 52
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 26
Convergence with Voice
Networks
“It’s about Internet Telephony!”
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 53
• TCP-based applications,
voice,
voice and video can be
managed well with a little
planning
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 54
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 27
Changing Corporate Network
Application Predominance
Numbers
in Percent
2%
100 2% Multimedia
7% 13% Dynamic WWW
7%
80 27% Static WWW
28% FTP and Telnet
27%
60 Email and News
15% Other
39% 39%
40 12%
20 17% 17%
17%
8% 14%
8%
0
1996 1998 2000
Source: The Yankee Group, 1996
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 55
Growth of IP Traffic
• Email
Rel. Bit
• Information Volume
Traffic Projections
search/access 250
for Voice and Data
• Subscription 200 Data
services/“Push” (IP)
150
• Conferencing/ Circuit Switched Voice
multimedia 100
• Video/imaging
50
“From 2000 on, 80% of Service
Provider Profits Will Be Derived
from IP-Based Services.”
Source: CIMI Corp. 1997 1998 1999 2000 2001
Source: Multiple IXC Projections
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 56
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 28
High End IP Transport Alternatives
IP or
ATM IP Voice
Voice
H.323 Voice/Video
• Voice
Constant bit rate when sending
Relatively small messages (44-170 bytes)
• Video
Generally high variable bit rate
Controlled by codec efficiency on picture
Message size is generally the MTU
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 58
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 29
Video: Traffic Pattern
Key Key
Frame Frame
Delta Frames
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 59
Key Key
Frame Frame
Delta Frames
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 60
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 30
Video: Playback Point
Typical
Transmission Time
Delivery
Playback
Point
Preferred Delivery
Interval Unless it’s
Application Buffers Data Too Late…
to Ensure Consistency
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 61
Synchronization of
Voice and Video
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 62
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 31
QoS Definition for Voice:
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 64
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 32
QoS Definition for Video:
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 65
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 33
How Can We Make Internet Voice
Act Predictably?
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 67
Voice/Video Traffic
Management Issues
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 68
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 34
Predictable Amount of
Traffic in the Network
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 70
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 35
Planning for a Predictable Network
• Premise:
Reducing voice packet size reduces
session requirements on network
So compress out IP, UDP, and RTP
headers as much as possible
• Limits jitter on lower bandwidth links
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 72
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 36
Resource Reservation
• Current deployment
• Current extensions
• Extensions being developed
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 73
Current Deployment
• RSVP version 1
Call control for individual sessions
Deployed
Cisco 11.2
Microsoft Windows ’98 (service pack)
Microsoft Windows NT 2000
• Appropriate to edge networks
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 74
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 37
Current Extensions
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 75
• Local or central
policy server can
authorize decisions
• Local policy:
Simple policies
• Central policy
server:
Certificates,
Complex policies
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 76
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 38
LAN Management Via Subnet
Bandwidth Manager
• Subnet bandwidth
manager is RSVP
in a switch
• Controls aggregate
reservations on
a LAN
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 77
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 78
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 39
Rapid Deployment of Calls
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 79
Aggregate Classification in
Edge Networks
PSTN
• Use differentiated
services code
points to identify
traffic
Rather than
specific flows PSTN
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 80
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 40
Aggregate Classification in
Edge Networks
• Reservation requested
by host in the usual
way (RFC 2205)
• Flow classification
and policing at first
hop router
• Flow admission along
end to end path
• Aggregate classification
and policing at
subsequent routers
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 81
• Voice/video calls
Placed across aggregation
domain boundary
• Aggregate reservations
Placed from ingress
to egress for DSCP used
Use expedited • Why?
forwarding service
Otherwise, you don’t
Limited rate of change know that bandwidth
exists on a path
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 82
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 41
Solving Voice/Video Issues Using
the Expedited Forwarding Service
• Rate control
Application at source
Reservation in network
• Jitter control
WFQ’s priority queue (low speed)
Statistically empty queue (CB-WFQ)
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 83
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 42
Traffic Path Control
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 85
Traffic Engineering
• Historical approaches
Load sharing
Routing metrics
• A new one
Label switching
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 86
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 43
Load Sharing
• Multipath routing
Equal and unequal cost
• Multilink PPP
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 87
Routing
• Administrative metrics
Designed to move traffic to statistically
low volume links
• Load sensitive metrics
Designed to move data away from
congested links
Tendency towards oscillation
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 88
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 44
Utility of These:
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 89
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 90
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 45
Principles of Label Switching
• Labeled paths:
Multiple enumerated point to point
relationships between pairs of routers
Sets of pair-wise relationships create a
labeled tunnel
• Conceptually similar to ATM VCs or
Frame Relay DLCs, but
Interface independent
Used to model network layer constructs
Variable length packets
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 91
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 46
Using Labeled Tunnels to Create
Virtual Private Networks
• Imagine edge
network with private
address space
• Stretch labeled
tunnels across the
network
• Now, do it again
• Disjoint networks
Same address space
Separate routing
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 93
• Initially seen as
off-line engineering
• Can use either
LDP or RSVP to install routes
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 94
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 47
CoS in MPLS Networks
• Class of Service
Roughly similar to diff-serv code point
Eight values, not sixty-four
• Implements similar drop/delay
management within labeled tunnels
• Therefore, MPLS networks have
fundamental TCP QoS support
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 95
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 96
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 48
MPLS Routing for Resource
Reservation
Automated Reinstallation of
Labeled Tunnels
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 49
Q.E.D. MPLS
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 99
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 100
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 50
Plan Your Network for
Predictability
• Network engineering
• Assured forwarding service
TCP
• Expedited forwarding service
Voice, implies some form of admission
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 101
Network Engineering
• Capacity engineering
Engineered IP routes?
• May involve traffic engineering
Labeled tunnels?
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 102
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 51
Assured Forwarding Service
319
Class-based weighted fair queuing
1056_05F9_c2 © 1999, Cisco Systems, Inc. 103
• Appropriate to voice/video
• Requires
Under-subscribed traffic classes
Reservation of bandwidth
Policing
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 104
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 52
Guiding Principles
for Predictability
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 105
In Your Network…
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 106
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 53
Please Complete Your
Evaluation Form
Session 319
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 107
319
1056_05F9_c2 © 1999, Cisco Systems, Inc. 108
Copyright © 1998, Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr 54