Finite Queue Examples for Dynamic Programming

Paul A. Jensen

All the models in this workbook are created with the DP Data add-in.
Modeling takes place in the DP Models add-in
Problems are solved with either the Markov Analysis add-in or the DP Solver add-in.
Use the Start command to add or replace buttons on a worksheet.
Use the Finish command to remove buttons from the worksheet.

Problems
The first three problems are about a birth-death process with purging. Each state has the sam
FQ_1: Continous Time Markov Chain
FQ_2: Discrete Time Markov Chain
FQ_3: Finds the optimum solution for the adding or deleting servers in a queue.
FQ_4: Continous Time Markov Chain for a problem with different servers
FQ_5: Discrete Time Markov Chain for a problem with different servers

mic Programming

n or the DP Solver add-in.

with purging. Each state has the same birth and death rates

ng servers in a queue.
fferent servers
erent servers

Markov Process Data

Type
Title
Problem Type
Model Type

CTMC Data
FQ_1
Finite Queue
CTMC

Build Model
Maximum number in system
Number of Channels
Economic Measure
Time Measure
Cost per Arrival
Cost per Departure
Cost per Balk
Holding Cost Rate for Items in the System
Discount Rate
Cost cost rate for open channels
Arrival Rate
Service Rate for each channel

Build Data Table

10
2
Cost
Hour
5
-20
50
6
0.1
10
10
6

/Hour
/Hour
/Hour
/Hour
/Hour

Markov Process Model

Type
Title
Model Type
State Variables
Action Variables
Event Variables
State Blocks
Decision Blocks
Transition Blocks
Economic Measure
Time Measure
Discount Rate
Goal
Step Interval
Channels

CTMC Model
FQ_1
Finite Queue
1
0
1
0
0
2
Cost
Hour
10.000%
None
1
2

Change Model
List States
List Elements

State Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost

0
1
11
1

S
20

State
System
0
11
1
1
0
10
_0
6

S_0
20

Definitions
s1: Number in System

Transitions
State/Event Transition Equations, Rates and Costs
System
State
0 S_0
Transition Transition caused by balk
State System
Feasible
1
0
0
Min
10
Max
10
Change State

0
System Index
Next State
0
1

Transition Transitions caused by arrivals and departure

State System
Feasible
1
1
1
Min
0
Max
10
Change State

1
System Index
Next State
1
2

Transfer to Markov Analysis

Event Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost
Rates

Summary

5
1
3
1

5
0

Event
Event
1
3
1
1
1
-1
1
Arrive Arrive
0
5
10
10

Name: S_0/Arrive

Feasible:
Subset:

State
1
0

Transition
Feasible:
1
Subset:
2

Definitions
e1: Departure if event = -1. Arrival if event =1. Neither if 0.

Transition Summary
Name: S_0/Arrive
Feasible:
1
Subset:
2

Equations, Rates and Costs

Event

Event
1 Arrive

Event
1
Min
Max

Event
1
1
1

Event
1
Min
Max

Event
1
-1
1

sed by balk
Feasible

Transition 1 Summary
Feasible:
0
Cost:
50
Rate:
10
Next State:
1
Exit Model:
0
Index:
9999

Feasible
Name
1 S_0

used by arrivals and departures

Feasible

Feasible
Name
1 S_1

Transition 2 Summary
Feasible:
1
Cost:
5
Rate:
10
Next State:
2
Exit Model:
0
Index:
2

Summary

Summary

Event
-1
0
1

Name Cost
Rate
Depart
-20
0
Null
0
0
Arrive
5
10

Markov Process Rate Matrix

Type:
Title:

CTMC
FQ_1

Step
Calculate
Measure
Change
Hour
Analyze
State
Index Names
Economics
0
S_0
1
S_1
Transient
2
S_2
3
S_3
Steady State
4
S_4
5
S_5
n-step Probabilities
6
S_6
7
S_7
First Pass
8
S_8
9
S_9
Simulate
10
S_10
Absorbing States

11
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10
Sum

Matrix Analyzed.
11 Recurrent States
1 Recurrent State Class
0 Transient States
0
1
2
S_0
S_1
S_2
0
10
0
6
0
10
0
12
0
0
0
12
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
6
22
22

3
S_3
0
0
10
0
12
0
0
0
0
0
0
22

4
S_4
0
0
0
10
0
12
0
0
0
0
0
22

5
S_5
0
0
0
0
10
0
12
0
0
0
0
22

6
S_6
0
0
0
0
0
10
0
12
0
0
0
22

7
S_7
0
0
0
0
0
0
10
0
12
0
0
22

8
S_8
0
0
0
0
0
0
0
10
0
12
0
22

9
S_9
0
0
0
0
0
0
0
0
10
0
12
22

10
S_10
0
0
0
0
0
0
0
0
0
10
10
20

Sum
10
16
22
22
22
22
22
22
22
22
22

Status
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1

0
1
2
3
4
5
6
7
8
9
10

S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

Embedded Markov Matrix

Expected
0
1
2
3
4
Time
S_0
S_1
S_2
S_3
S_4
0.1
0
1
0
0
0
0.0625
0.375
0
0.625
0
0
0.045455
0 0.545455
0 0.454545
0
0.045455
0
0 0.545455
0 0.454545
0.045455
0
0
0 0.545455
0
0.045455
0
0
0
0 0.545455
0.045455
0
0
0
0
0
0.045455
0
0
0
0
0
0.045455
0
0
0
0
0
0.045455
0
0
0
0
0
0.045455
0
0
0
0
0

5
S_5

6
S_6

7
S_7

8
S_8

9
S_9

10
S_10

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0.454545
0
0
0
0
0
0 0.454545
0
0
0
0
0.545455
0 0.454545
0
0
0
0 0.545455
0 0.454545
0
0
0
0 0.545455
0 0.454545
0
0
0
0 0.545455
0 0.454545
0
0
0
0 0.545455 0.454545

Economic Data
Type:
Title:

CTMC
FQ_1

Calculate
Matrix

conomic Measure
Discount Rate

Cost
0.1

0
1
2
3
4
5
6
7
8
9
10

State
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

State
Combine Combine
Cost
d Cost
d Cost
Rate
Rate
per Step
20
70
7
26
-44
-2.75
32
-158 -7.18182
38
-152 -6.90909
44
-146 -6.63636
50
-140 -6.36364
56
-134 -6.09091
62
-128 -5.81818
68
-122 -5.54545
74
-116 -5.27273
80
340 15.45455

S_0
0
-20
0
0
0
0
0
0
0
0
0

Transition Cost Matrix

1
2
3
4

S_1
5
0
-20
0
0
0
0
0
0
0
0

S_2
0
5
0
-20
0
0
0
0
0
0
0

S_3
0
0
5
0
-20
0
0
0
0
0
0

S_4
0
0
0
5
0
-20
0
0
0
0
0

S_5
0
0
0
0
5
0
-20
0
0
0
0

S_6
0
0
0
0
0
5
0
-20
0
0
0

S_7
0
0
0
0
0
0
5
0
-20
0
0

S_8
0
0
0
0
0
0
0
5
0
-20
0

10

S_9

S_10
0
0
0
0
0
0
0
0
0
5
50

0
0
0
0
0
0
0
0
5
0
-20

Steady State Analysis

Type:
Title:
Solve by:

CTMC
FQ_1
Inverse

0
1
S_0
S_1
Steady State (Time) 0.1066 0.1776
Transition Time

Matrix

2
3
4
5
S_2
S_3
S_4
S_5
0.148 0.1233 0.1028 0.0856

0.1 0.0625 0.0455 0.0455 0.0455 0.0455

Steady State (Steps) 0.0542 0.1446 0.1656

Expected NPW -837.3 -852.6

0.138

0.115 0.0959

-866 -874.9 -879.1 -878.3

Expected
6
7
8
9
10
Transition
S_6
S_7
S_8
S_9
S_10
Time
0.0714 0.0595 0.0496 0.0413 0.0344 0.05087552
0.0455 0.0455 0.0455 0.0455 0.0455
0.0799 0.0666 0.0555 0.0462 0.0385
-872.2 -860.1 -841.5 -815.3 -780.5

Average
Cost
rate
-85.7896253

FQ_1 Model Lists

State List
Index
1
2
3
4
5
6
7
8
9
10
11

Count
0
1
2
3
4
5
6
7
8
9
10

Name
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

System
0
1
2
3
4
5
6
7
8
9
10

Trans.
Range

Cost
20
26
32
38
44
50
56
62
68
74
80

1
3
5
7
9
11
13
15
17
19
21

Event List
Index
1
2
3

Count
0
1
2

Name
Depart
Null
Arrive

Event
-1
0
1

Cost
-20
0
5

Transitions
State Event
Index Index Index
1
1
3
2
2
1
3
2
3
4
3
1
5
3
3
6
4
1
7
4
3
8
5
1
9
5
3
10
6
1
11
6
3
12
7
1
13
7
3
14
8
1
15
8
3
16
9
1
17
9
3
18
10
1
19
10
3
20
11
1
21
11
3

Name
S_0/Arrive
S_1/Depart
S_1/Arrive
S_2/Depart
S_2/Arrive
S_3/Depart
S_3/Arrive
S_4/Depart
S_4/Arrive
S_5/Depart
S_5/Arrive
S_6/Depart
S_6/Arrive
S_7/Depart
S_7/Arrive
S_8/Depart
S_8/Arrive
S_9/Depart
S_9/Arrive
S_10/Depart
S_10/Arrive

Cost
5
-20
5
-20
5
-20
5
-20
5
-20
5
-20
5
-20
5
-20
5
-20
5
-20
50

Next
Next
Rate State Name
10
2 S_1
6
1 S_0
10
3 S_2
12
2 S_1
10
4 S_3
12
3 S_2
10
5 S_4
12
4 S_3
10
6 S_5
12
5 S_4
10
7 S_6
12
6 S_5
10
8 S_7
12
7 S_6
10
9 S_8
12
8 S_7
10
10 S_9
12
9 S_8
10
11 S_10
12
10 S_9
10
11 S_10

Markov Chain Data

Type
Title
Problem Type
Model Type

DTMC Data
FQ_2
Finite Queue
DTMC

Build Model
Maximum number in system
Number of Channels
Economic Measure
Time Measure
Cost per Arrival
Cost per Departure
Cost per Balk
Holding Cost Rate for Items in the System
Discount Rate
Cost cost rate for open channels
Arrival Rate
Service Rate for each channel
Time Interval
Holding Cost for Items in the System
Cost for open channels
Discount Rate
Arrival Probability
Service Probability for each channel

Build Data Table

10
2
Cost
Hour
5
-20
50
6
0.1
10
10
6
0.01
0.06
0.02
0.001
0.1
0.06

/Hour
/Hour
/Hour
/Hour
/Hour
Hour
/Period
/Period
/Period
/Period
/Period

Markov Chain Model

Type
Title
Model Type
State Variables
Action Variables
Event Variables
State Blocks
Decision Blocks
Transition Blocks
Economic Measure
Time Measure
Discount Rate
Goal
Step Interval
Channels

DTMC Model
FQ_2
Finite Queue
1
0
1
0
0
2
Cost
Hour
0.100%
None
0.01
2

Change Model

Transfer to Markov

List States

Transfer to DP Solv

List Elements

State Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost

10
1
11
1

S
0.04

State
System
10
11
1
1
0
10
_10
0.06

S_10
0.64

Definitions
s1: Number in System

Transitions
State/Event Transition Equations, Probabilities and C
System
State
10 S_10
Transition Transition caused by balk
State System
Feasible
1
1
1
Min
10
Max
10
Change State

0
System Index Feasible
Next State
10
11
1

Transition Transitions caused by arrivals and departures

State System
Feasible
1
1
1
Min
0
Max
10
Change State

1
System Index Feasible
Next State
11
###
0

Transfer to Markov Analysis

Transfer to DP Solver

Event Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost
Probability

Summary

2
1
3
1

5
0

Event
Event
1
3
1
1
1
-1
1
Arrive Arrive
0
5
0.1
0.1

Name: S_10/Arrive
State
Feasible:
1
Subset:
0
Transition
Feasible:
1
Subset:
1

Definitions
e1: Departure if event = -1. Arrival if event =1. Neither if 0.

Transition Summary
Name: S_10/Arrive
Feasible:
1
Subset:
1

ns, Probabilities and Costs

Event

Feasible

Event
1 Arrive

Event
1
Min
Max

Event
1
1
1

Event
1
Min
Max

Event
1
-1
1

Transition 1 Summary
Feasible:
1
Cost:
50
Probability:
0.1
Next State:
11
Exit Model:
0
Index:
1

Name
S_10

arrivals and departures

Feasible

Name
Err:502

Transition 2 Summary
Feasible:
0
Cost:
5
Probability:
0.1
Next State:
###
Exit Model:
0
Index:
9999

Event
-1
0
1

Name Cost
Probability
Depart
-20
0.12
Null
0
0.78
Arrive
5
0.1

DP Solver
Type
Title
Model Name
Goal
States
Actions
Actions/State
Events
Events/Action
Iteration Type

DTMC
FQ_2
FQ_2_Model
None
11
0
0
3
3
Value

Iteration Steps

200

Max. Val. Difference 0.84262519

Sum Prob. Difference 0.00100461
Time Measure
Hour
Economic Measure
Cost
Discount Rate
0.100%
Step Interval
0.01

Solve

Make Markov Chain

Change DP

Make LP Model

Equations

State List
Index
1
2
3
4
5
6
7
8
9
10
11

Name
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

System
0
1
2
3
4
5
6
7
8
9
10

Cost
0.04
0.1
0.16
0.22
0.28
0.34
0.4
0.46
0.52
0.58
0.64

kov Chain

Gain

Expected
Transitio Transitio
n Range n Value
2
0.5
2
-0.7
2
-1.9
2
-1.9
2
-1.9
2
-1.9
2
-1.9
2
-1.9
2
-1.9
2
-1.9
2
2.6

Step
Value
0.54
-0.6
-1.74
-1.68
-1.62
-1.56
-1.5
-1.44
-1.38
-1.32
3.24

Expected
Next
Value
-164.698
-179.043
-191.403
-200.573
-205.142
-204.803
-199.13
-187.553
-169.324
-143.485
-113.321

State
Value
-163.994
-179.465
-192.952
-202.053
-206.557
-206.158
-200.431
-188.805
-170.535
-144.661
-109.968

Exp. Value
0 -1.02908

Next
Value
-163.151
-178.623
-192.112
-201.215
-205.722
-205.328
-199.605
-187.985
-169.719
-143.849
-109.158

State
Prob.
0.117911
0.194497
0.15957
0.129443
0.103807
0.082364
0.064797
0.050745
0.039807
0.031547
0.025515

Last
Prob.
0.118034
0.194679
0.159694
0.129508
0.103816
0.082328
0.064726
0.050652
0.039703
0.031444
0.025421

Event List
Index
1
2
3
4
5

Name
Depart
Null
Arrive
Null
NA

Transition List
Event
-1
0
1
0
0

Event
Cost
0
0
0
0
999999

Prob.
1
0
0
0
0

Index
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32

State
Index
1
1
2
2
2
3
3
3
4
4
4
5
5
5
6
6
6
7
7
7
8
8
8
9
9
9
10
10
10
11
11
11

tion List
Event
Index
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3

Transition Transitio Transitio

Name
n Cost
n Prob.
S_0/Null
0
0.9
S_0/Arrive
5
0.1
S_1/Depart
-20
0.06
S_1/Null
0
0.84
S_1/Arrive
5
0.1
S_2/Depart
-20
0.12
S_2/Null
0
0.78
S_2/Arrive
5
0.1
S_3/Depart
-20
0.12
S_3/Null
0
0.78
S_3/Arrive
5
0.1
S_4/Depart
-20
0.12
S_4/Null
0
0.78
S_4/Arrive
5
0.1
S_5/Depart
-20
0.12
S_5/Null
0
0.78
S_5/Arrive
5
0.1
S_6/Depart
-20
0.12
S_6/Null
0
0.78
S_6/Arrive
5
0.1
S_7/Depart
-20
0.12
S_7/Null
0
0.78
S_7/Arrive
5
0.1
S_8/Depart
-20
0.12
S_8/Null
0
0.78
S_8/Arrive
5
0.1
S_9/Depart
-20
0.12
S_9/Null
0
0.78
S_9/Arrive
5
0.1
S_10/Depart
-20
0.12
S_10/Null
0
0.78
S_10/Arrive
50
0.1

Next
State
1
2
1
2
3
2
3
4
3
4
5
4
5
6
5
6
7
6
7
8
7
8
9
8
9
10
9
10
11
10
11
11

Next
Name
S_0
S_1
S_0
S_1
S_2
S_1
S_2
S_3
S_2
S_3
S_4
S_3
S_4
S_5
S_4
S_5
S_6
S_5
S_6
S_7
S_6
S_7
S_8
S_7
S_8
S_9
S_8
S_9
S_10
S_9
S_10
S_10

Next
Cost
-163.151
-178.623
-163.151
-178.623
-192.112
-178.623
-192.112
-201.215
-192.112
-201.215
-205.722
-201.215
-205.722
-205.328
-205.722
-205.328
-199.605
-205.328
-199.605
-187.985
-199.605
-187.985
-169.719
-187.985
-169.719
-143.849
-169.719
-143.849
-109.158
-143.849
-109.158
-109.158

Next
Prob.
0.106231
0.011803
0.011681
0.16353
0.019468
0.019163
0.124561
0.015969
0.015541
0.101016
0.012951
0.012458
0.080977
0.010382
0.009879
0.064215
0.008233
0.007767
0.050486
0.006473
0.006078
0.039508
0.005065
0.004764
0.030969
0.00397
0.003773
0.024526
0.003144
0.00305
0.019828
0.002542

Rows with zero probabilities are deleted.

Sum
Prob.
0.11791
0.1945
0.15957
0.12944
0.10381
0.08236
0.0648
0.05075
0.03981
0.03155
0.02551

Index
1
2
3
4
5
6
7
8
9
10
11

Name
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

System
0
1
2
3
4
5
6
7
8
9
10

Markov Chain
Final Step 200
State
State
Value
Prob.
-163.99 0.11791
-179.46 0.1945
-192.95 0.15957
-202.05 0.12944
-206.56 0.10381
-206.16 0.08236
-200.43 0.0648
-188.81 0.05075
-170.53 0.03981
-144.66 0.03155
-109.97 0.02551

Markov Chain

Markov Chain Transition Matrix

Type:
Title:

DTMC
FQ_2

Step
Calculate
Measure
Change
Hour
Analyze
State
Index Names
Economics
0
S_0
1
S_1
Transient
2
S_2
3
S_3
Steady State
4
S_4
5
S_5
n-step Probabilities
6
S_6
7
S_7
First Pass
8
S_8
9
S_9
Simulate
10
S_10
Absorbing States

11
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10
Sum

Matrix Analyzed.
11 Recurrent States
1 Recurrent State Class
0 Transient States
0
1
2
S_0
S_1
S_2
0.9
0.1
0
0.06
0.84
0.1
0
0.12
0.78
0
0
0.12
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0.96
1.06
1

3
S_3
0
0
0.1
0.78
0.12
0
0
0
0
0
0
1

4
S_4
0
0
0
0.1
0.78
0.12
0
0
0
0
0
1

5
S_5
0
0
0
0
0.1
0.78
0.12
0
0
0
0
1

6
S_6
0
0
0
0
0
0.1
0.78
0.12
0
0
0
1

7
S_7
0
0
0
0
0
0
0.1
0.78
0.12
0
0
1

8
S_8
0
0
0
0
0
0
0
0.1
0.78
0.12
0
1

9
S_9
0
0
0
0
0
0
0
0
0.1
0.78
0.12
1

10
S_10
0
0
0
0
0
0
0
0
0
0.1
0.88
0.98

Sum
1
1
1
1
1
1
1
1
1
1
1

Status
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1

Economic Data
Type:
Title:

DTMC
FQ_2

Calculate
Matrix

conomic Measure
Discount Rate

Cost
0.001

0
1
2
3
4
5
6
7
8
9
10

State
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

State
Combine
Cost
d Cost
0.04
0.54
0.1
-0.6
0.16
-1.74
0.22
-1.68
0.28
-1.62
0.34
-1.56
0.4
-1.5
0.46
-1.44
0.52
-1.38
0.58
-1.32
0.64
3.24

S_0
0
-20
0
0
0
0
0
0
0
0
0

Transition Cost Matrix

1
2
3
S_1
5
0
-20
0
0
0
0
0
0
0
0

S_2
0
5
0
-20
0
0
0
0
0
0
0

S_3
0
0
5
0
-20
0
0
0
0
0
0

S_4
0
0
0
5
0
-20
0
0
0
0
0

S_5
0
0
0
0
5
0
-20
0
0
0
0

S_6
0
0
0
0
0
5
0
-20
0
0
0

S_7
0
0
0
0
0
0
5
0
-20
0
0

S_8
0
0
0
0
0
0
0
5
0
-20
0

10

S_9

S_10
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
5
0
0
5
-20 5.681818

Steady State Analysis

Type:
Title:
Solve by:

DTMC
FQ_2
Inverse

0
1
S_0
S_1
Steady State Dist. 0.1066 0.1776
Expected NPW -998.3

Matrix

-1014

2
3
4
5
S_2
S_3
S_4
S_5
0.148 0.1233 0.1028 0.0856
-1027

-1036

-1040

-1039

Average
6
7
8
9
10
Cost
S_6
S_7
S_8
S_9
S_10
per period
0.0714 0.0595 0.0496 0.0413 0.0344 -1.01789678
-1033

-1021

-1003 -976.4 -941.5

FQ_2 Model Lists

State List
Index
1
2
3
4
5
6
7
8
9
10
11

Count
0
1
2
3
4
5
6
7
8
9
10

Name
S_0
S_1
S_2
S_3
S_4
S_5
S_6
S_7
S_8
S_9
S_10

System
0
1
2
3
4
5
6
7
8
9
10

Cost
0.04
0.1
0.16
0.22
0.28
0.34
0.4
0.46
0.52
0.58
0.64

Trans.
Range
2
5
8
11
14
17
20
23
26
29
32

Event List
Index
1
2
3

Count
0
1
2

Name
Depart
Null
Arrive

Event
-1
0
1

Cost
-20
0
5

Transitions
State Event
Index Index Index
1
1
2
2
1
3
3
2
1
4
2
2
5
2
3
6
3
1
7
3
2
8
3
3
9
4
1
10
4
2
11
4
3
12
5
1
13
5
2
14
5
3
15
6
1
16
6
2
17
6
3
18
7
1
19
7
2
20
7
3
21
8
1
22
8
2
23
8
3
24
9
1
25
9
2
26
9
3
27
10
1
28
10
2
29
10
3
30
11
1
31
11
2
32
11
3

Name
S_0/Null
S_0/Arrive
S_1/Depart
S_1/Null
S_1/Arrive
S_2/Depart
S_2/Null
S_2/Arrive
S_3/Depart
S_3/Null
S_3/Arrive
S_4/Depart
S_4/Null
S_4/Arrive
S_5/Depart
S_5/Null
S_5/Arrive
S_6/Depart
S_6/Null
S_6/Arrive
S_7/Depart
S_7/Null
S_7/Arrive
S_8/Depart
S_8/Null
S_8/Arrive
S_9/Depart
S_9/Null
S_9/Arrive
S_10/Depart
S_10/Null
S_10/Arrive

Cost
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
50

Next
Next
Prob. State Name
0.9
1 S_0
0.1
2 S_1
0.06
1 S_0
0.84
2 S_1
0.1
3 S_2
0.12
2 S_1
0.78
3 S_2
0.1
4 S_3
0.12
3 S_2
0.78
4 S_3
0.1
5 S_4
0.12
4 S_3
0.78
5 S_4
0.1
6 S_5
0.12
5 S_4
0.78
6 S_5
0.1
7 S_6
0.12
6 S_5
0.78
7 S_6
0.1
8 S_7
0.12
7 S_6
0.78
8 S_7
0.1
9 S_8
0.12
8 S_7
0.78
9 S_8
0.1
10 S_9
0.12
9 S_8
0.78
10 S_9
0.1
11 S_10
0.12
10 S_9
0.78
11 S_10
0.1
11 S_10

Markov Decision Process Data

Type
Title
Problem Type
Model Type

MDP Data
FQ_3
Finite Queue
MDP

Build Model
Maximum number in system
10
Economic Measure Cost
Goal for Optimization Min
Time Measure Hour
Cost per Arrival
5
Cost per Departure
-20
Cost per Balk
50
Holding Cost Rate for Items in the System
6 /Hour
Discount Rate
0 /Hour
Min number of channels
2
Max number of channels
6
Cost to Increase the number of channels by 1
5
Cost to decrease the number of channels by 1
0
Cost cost rate for open channels
10 /Hour
Arrival Rate
10 /Hour
Service Rate for each channel
6 /Hour
Time Interval
0.01 Hour
Holding Cost for Items in the System
0.06 /Period
Cost for open channels
0.1 /Period
Discount Rate
0 /Period
Arrival Probability
0.1 /Period
Service Probability for each channel
0.06 /Period

Build Data Table

Markov Decision Model

Type
Title
Model Type
State Variables
Action Variables
Event Variables
State Blocks
Decision Blocks
Transition Blocks
Economic Measure
Time Measure
Discount Rate
Goal
Step Interval
Channels

MDP Model
FQ_3
Finite Queue
2
1
1
0
2
2
Cost
Hour
0.000%
Min
0.01
***

Change Model
List States
List Elements

State Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost

54
1
55
1

S
0

State
SystemChannels
10
6
11
5
5
1
1
1
0
2
10
6
_10
_6
0.06
0.1

Definitions
s1: Number in System
s2: Number of Channels

Decisions
State/Action Interaction: Feasibility and Cost
SystemChannels
State
10
6
Decision 1 Increase channels or stay the same
State SystemChannels
Feasible
1
1
0
Min
0
2
Max
10
5
Decision 2 Decrease channels or stay the same
State SystemChannels
Feasible
1
1
1
Min
0
3
Max
10
6

Transitions
State/Action/Event Transition Equations, Probabi
SystemChannels
State
10
6
Transition Transition caused by balk

Feasible

State SystemChannels
1
1
1
Min
10
2
Max
10
6

Change State

0
1
SystemChannels
Next State
10
7

Transition Transitions caused by arrivals and departure

State SystemChannels
Feasible
1
1
1
Min
0
2
Max
10
6
Change State

1
1
SystemChannels
Next State
11
7

Transfer to DP Solver

Action Vector

Event Vector

Channels

S_10_6
1.2

Index
Step
Count
Feasible
Min
Max
Name
Cost

2
1
3
1

Action
Action
1
3
1
1
-1
1
Add
0

Add

2
1
3
1

5
0

Definitions
a1: Change(1 if increase,-1 if decrease
Definitions
e1: Departure if event = -1. Arrival

n: Feasibility and Cost

Channels
S_10_6

Action

nels or stay the same

Channels
0

Feasible

nnels or stay the same

Channels
1

Feasible

Action
1 Add

Action Action
1
1
Min
0
Max
1

Action Action
1
0
Min
-1
Max
0

nsition Equations, Probabilities and Costs

Channels
Action
S_10_6
Action
1 Add

sed by balk

Index
Step
Count
Feasible
Min
Max
Name
Cost
Probability

Event
Event
1
3
1
1
-1
1
Arrive
0
0.1

Event

Event
1

Channels
1

Index Feasible
###
0

Feasible

Feasible

Event
1
Min
Max

Event
1
1
1

Event
1
Min
Max

Event
1
-1
1

Name
#VALUE!

used by arrivals and departures

Channels
1
Feasible

Index Feasible
###
0

Action Action
1
1
Min
-1
Max
1

Name
#VALUE!

Action Action
1
1
Min
-1
Max
1

Feasible

Summary
Name: S_10_6/Add/Arrive
State
Feasible:
1
Subset:
0
1

Arrive
5
0.1

Decision
Feasible:
0
Subset:
9999

Transition
Feasible:
0
Subset:
9999
rture if event = -1. Arrival if event =1. Neither if 0.

Decision Summary
Name: S_10_6/Add
Feasible:
0
Subset:
9999
Decision 1 Summary
Feasible:
0
Cost:
5
Exit Model:
0
Index:
9999
Decision 2 Summary
Feasible:
0
Cost:
5
Exit Model:
0
Index:
9999

Arrive

Transition Summary
Name: S_10_6/Add/Arrive
Feasible:
0
Subset:
9999
Transition 1 Summary

Action
-1
0
1

Name
Delete
Same
Add

Cost

Event
-1
0
1

Name Cost
Probability
Depart
-20
0.36
Null
0
0.54
Arrive
5
0.1

0
0
5

Feasible:
Cost:
Probability:
Next State:
Exit Model:
Index:

0
50
0.1
###
0
9999

Transition 2 Summary
Feasible:
0
Cost:
5
Probability:
0.1
Next State:
###
Exit Model:
0
Index:
9999

Probability

DP Solver
Type
Title
Model Name
Goal
States
Actions
Actions/State
Events
Events/Action
Iteration Type

MDP
FQ_3
FQ_3_Model
Min
55
3
3
3
3
Value

Iteration Steps

200

Max. Val. Difference 1.1066325

Sum Prob. Difference 0.00042261
Time Measure
Hour
Economic Measure
Cost
Discount Rate
0.000%
Step Interval
0.01

Solve

Make Markov Chain

Change DP

Make LP Model

Equations

State List
Index
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

Name
S_0_2
S_0_3
S_0_4
S_0_5
S_0_6
S_1_2
S_1_3
S_1_4
S_1_5
S_1_6
S_2_2
S_2_3
S_2_4
S_2_5
S_2_6
S_3_2
S_3_3
S_3_4
S_3_5
S_3_6
S_4_2
S_4_3
S_4_4
S_4_5
S_4_6
S_5_2
S_5_3
S_5_4
S_5_5
S_5_6
S_6_2
S_6_3
S_6_4
S_6_5
S_6_6
S_7_2
S_7_3
S_7_4

System Channels
0
2
0
3
0
4
0
5
0
6
1
2
1
3
1
4
1
5
1
6
2
2
2
3
2
4
2
5
2
6
3
2
3
3
3
4
3
5
3
6
4
2
4
3
4
4
4
5
4
6
5
2
5
3
5
4
5
5
5
6
6
2
6
3
6
4
6
5
6
6
7
2
7
3
7
4

39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55

S_7_5
S_7_6
S_8_2
S_8_3
S_8_4
S_8_5
S_8_6
S_9_2
S_9_3
S_9_4
S_9_5
S_9_6
S_10_2
S_10_3
S_10_4
S_10_5
S_10_6

7
7
8
8
8
8
8
9
9
9
9
9
10
10
10
10
10

5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6

kov Chain

Cost
0.2
0.3
0.4
0.5
0.6
0.26
0.36
0.46
0.56
0.66
0.32
0.42
0.52
0.62
0.72
0.38
0.48
0.58
0.68
0.78
0.44
0.54
0.64
0.74
0.84
0.5
0.6
0.7
0.8
0.9
0.56
0.66
0.76
0.86
0.96
0.62
0.72
0.82

Decision Decision
Index
Range
1
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
4
2
3
2
3
2
3
2
3
2
4
2
3
2
3
2
3
2
3
2
4
2
4
2
3
2
3
2
3
2
4
2
4
2
4
2
3
2
4
2
4
2
4
2
4
2
4
2
4
2
4
2
4
2

Action
Index
2
1
1
1
1
1
1
1
1
1
1
2
1
1
1
1
2
1
1
1
1
2
2
1
1
1
2
2
2
1
2
2
2
2
2
2
2
2

Action
Name
Same
Delete
Delete
Delete
Delete
Delete
Delete
Delete
Delete
Delete
Delete
Same
Delete
Delete
Delete
Delete
Same
Delete
Delete
Delete
Delete
Same
Same
Delete
Delete
Delete
Same
Same
Same
Delete
Same
Same
Same
Same
Same
Same
Same
Same

Decision
Value
-187.765
-187.765
-187.665
-187.47
-187.18
-205.891
-205.891
-205.843
-205.696
-205.45
-223.457
-223.973
-223.973
-223.867
-223.665
-239.788
-241.924
-241.924
-241.902
-241.766
-255.239
-259.052
-259.829
-259.829
-259.768
-270.229
-275.298
-277.18
-277.63
-277.63
-285.266
-290.554
-293.801
-294.976
-295.321
-299.268
-304.627
-309.271

Step
Value
0.7
0.8
0.9
1
1.1
0.76
0.86
0.96
1.06
1.16
0.82
0.92
1.02
1.12
1.22
0.88
0.98
1.08
1.18
1.28
0.94
1.04
1.14
1.24
1.34
1
1.1
1.2
1.3
1.4
1.06
1.16
1.26
1.36
1.46
1.12
1.22
1.32

State
Value
-187.565
-187.465
-187.265
-186.97
-186.58
-205.631
-205.531
-205.383
-205.136
-204.79
-223.137
-223.553
-223.453
-223.247
-222.945
-239.408
-241.444
-241.344
-241.222
-240.986
-254.799
-258.512
-259.189
-259.089
-258.928
-269.729
-274.698
-276.48
-276.83
-276.73
-284.706
-289.894
-293.041
-294.116
-294.361
-298.648
-303.907
-308.451

0.92
1.02
0.68
0.78
0.88
0.98
1.08
0.74
0.84
0.94
1.04
1.14
0.8
0.9
1
1.1
1.2

4
4
4
5
4
4
4
4
5
5
4
4
4
5
5
5
4

2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2

2
2
2
3
2
2
2
2
3
3
2
2
2
3
3
3
2

Same
Same
Same
Add
Same
Same
Same
Same
Add
Add
Same
Same
Same
Add
Add
Add
Same

-311.559
-312.517
-311.503
-317.169
-322.574
-326.449
-328.53
-318.81
-325.405
-331.279
-336.858
-340.88
-310.859
-319.783
-327.619
-334.428
-340.645

1.42
1.52
1.18
6.28
1.38
1.48
1.58
1.24
6.34
6.44
1.54
1.64
1.3
6.4
6.5
6.6
1.7

-310.639
-311.497
-310.823
-316.389
-321.694
-325.469
-327.45
-318.07
-324.565
-330.339
-335.818
-339.74
-310.059
-318.883
-326.619
-333.328
-339.445

Gain

Exp. Value
0 0.871677

Action List
Next
State
Last
Value
Prob.
Prob.
-186.458 0.134544 0.149494
-186.358
0
0
-186.158
0
0
-185.863
0
0
-185.473
0
0
-204.524 0.014949 0.245229
-204.424
0 0.003163
-204.276
0
0
-204.029
0
0
-203.684
0
0
-222.03
0 0.179847
-222.446
0 0.026406
-222.346
0
0
-222.14
0
0
-221.838
0
0
-238.302
0 0.12234
-240.337
0 0.031495
-240.237
0 0.001032
-240.115
0
0
-239.88
0
0
-253.692
0 0.074113
-257.406
0 0.030463
-258.082
0 0.003862
-257.982
0 0.000447
-257.822
0
0
-268.623
0 0.033734
-273.592
0 0.029507
-275.374
0 0.004275
-275.724
0 0.001337
-275.624
0 0.000155
-283.6
0 0.003374
-288.788
0 0.026837
-291.935
0 0.004292
-293.01
0 0.001482
-293.255
0 0.000432
-297.542
0
0
-302.801
0 0.010777
-307.345
0 0.004324

Index
1
2
3
4
5

Name
Delete
Same
Add
Null
NA

Action
-1
0
1
0
0

Event List
Action
Cost
0
0
0
0
999999

Index
1
2
3
4
5

-309.533
-310.391
-309.717
-315.283
-320.589
-324.362
-326.344
-316.964
-323.459
-329.233
-334.712
-338.634
-308.953
-317.777
-325.513
-332.222
-338.339

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0.001487
0.000554
0
0.001077
0.003546
0.001495
0.00059
0
0
0.000462
0.001134
0.000603
0
0
0
0.000159
0.000476

Event List
Name
Depart
Null
Arrive
Null
NA

Decision List
Event
-1
0
1
0
0

Event
Cost
0
0
0
0
999999

Prob.
1
0
0
0
0

Decision
Index
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

State
Index
1
1
2
2
2
3
3
3
4
4
4
5
5
6
6
7
7
7
8
8
8
9
9
9
10
10
11
11
12
12
12
13
13
13
14
14
14
15

Action
Index
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1

Decision
Name
S_0_2/Same
S_0_2/Add
S_0_3/Delete
S_0_3/Same
S_0_3/Add
S_0_4/Delete
S_0_4/Same
S_0_4/Add
S_0_5/Delete
S_0_5/Same
S_0_5/Add
S_0_6/Delete
S_0_6/Same
S_1_2/Same
S_1_2/Add
S_1_3/Delete
S_1_3/Same
S_1_3/Add
S_1_4/Delete
S_1_4/Same
S_1_4/Add
S_1_5/Delete
S_1_5/Same
S_1_5/Add
S_1_6/Delete
S_1_6/Same
S_2_2/Same
S_2_2/Add
S_2_3/Delete
S_2_3/Same
S_2_3/Add
S_2_4/Delete
S_2_4/Same
S_2_4/Add
S_2_5/Delete
S_2_5/Same
S_2_5/Add
S_2_6/Delete

39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91

15
16
16
17
17
17
18
18
18
19
19
19
20
20
21
21
22
22
22
23
23
23
24
24
24
25
25
26
26
27
27
27
28
28
28
29
29
29
30
30
31
31
32
32
32
33
33
33
34
34
34
35
35

2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2

S_2_6/Same
S_3_2/Same
S_3_2/Add
S_3_3/Delete
S_3_3/Same
S_3_3/Add
S_3_4/Delete
S_3_4/Same
S_3_4/Add
S_3_5/Delete
S_3_5/Same
S_3_5/Add
S_3_6/Delete
S_3_6/Same
S_4_2/Same
S_4_2/Add
S_4_3/Delete
S_4_3/Same
S_4_3/Add
S_4_4/Delete
S_4_4/Same
S_4_4/Add
S_4_5/Delete
S_4_5/Same
S_4_5/Add
S_4_6/Delete
S_4_6/Same
S_5_2/Same
S_5_2/Add
S_5_3/Delete
S_5_3/Same
S_5_3/Add
S_5_4/Delete
S_5_4/Same
S_5_4/Add
S_5_5/Delete
S_5_5/Same
S_5_5/Add
S_5_6/Delete
S_5_6/Same
S_6_2/Same
S_6_2/Add
S_6_3/Delete
S_6_3/Same
S_6_3/Add
S_6_4/Delete
S_6_4/Same
S_6_4/Add
S_6_5/Delete
S_6_5/Same
S_6_5/Add
S_6_6/Delete
S_6_6/Same

92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143

36
36
37
37
37
38
38
38
39
39
39
40
40
41
41
42
42
42
43
43
43
44
44
44
45
45
46
46
47
47
47
48
48
48
49
49
49
50
50
51
51
52
52
52
53
53
53
54
54
54
55
55

2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2

S_7_2/Same
S_7_2/Add
S_7_3/Delete
S_7_3/Same
S_7_3/Add
S_7_4/Delete
S_7_4/Same
S_7_4/Add
S_7_5/Delete
S_7_5/Same
S_7_5/Add
S_7_6/Delete
S_7_6/Same
S_8_2/Same
S_8_2/Add
S_8_3/Delete
S_8_3/Same
S_8_3/Add
S_8_4/Delete
S_8_4/Same
S_8_4/Add
S_8_5/Delete
S_8_5/Same
S_8_5/Add
S_8_6/Delete
S_8_6/Same
S_9_2/Same
S_9_2/Add
S_9_3/Delete
S_9_3/Same
S_9_3/Add
S_9_4/Delete
S_9_4/Same
S_9_4/Add
S_9_5/Delete
S_9_5/Same
S_9_5/Add
S_9_6/Delete
S_9_6/Same
S_10_2/Same
S_10_2/Add
S_10_3/Delete
S_10_3/Same
S_10_3/Add
S_10_4/Delete
S_10_4/Same
S_10_4/Add
S_10_5/Delete
S_10_5/Same
S_10_5/Add
S_10_6/Delete
S_10_6/Same

Transition List
Expected Expected
Decision Transitio Transitio
Next
Decision
Last
Cost
n Range n Cost
Value
Prob.
Cost
0
2
0.5 -188.265 -187.765 0.149494
5
2
0.5 -188.165 -182.665
0
0
2
0.5 -188.265 -187.765
0
0
2
0.5 -188.165 -187.665
0
5
2
0.5
-187.97
-182.47
0
0
2
0.5 -188.165 -187.665
0
0
2
0.5
-187.97
-187.47
0
5
2
0.5
-187.68
-182.18
0
0
2
0.5
-187.97
-187.47
0
0
2
0.5
-187.68
-187.18
0
5
2
0.5 -187.294 -181.794
0
0
2
0.5
-187.68
-187.18
0
0
2
0.5 -187.294 -186.794
0
0
2
-0.7 -205.191 -205.891
0
5
2
-0.7 -205.143 -200.843
0
0
2
-0.7 -205.191 -205.891
0
0
2
-0.7 -205.143 -205.843
0
5
2
-0.7 -204.996 -200.696
0
0
2
-0.7 -205.143 -205.843
0
0
2
-0.7 -204.996 -205.696
0
5
2
-0.7
-204.75
-200.45
0
0
2
-0.7 -204.996 -205.696
0
0
2
-0.7
-204.75
-205.45
0
5
2
-0.7 -204.407 -200.107
0
0
2
-0.7
-204.75
-205.45
0
0
2
-0.7 -204.407 -205.107
0
0
2
-1.9 -221.557 -223.457
0
5
2
-1.9 -222.073 -218.973
0
0
2
-1.9 -221.557 -223.457
0
0
2
-1.9 -222.073 -223.973
0
5
2
-1.9 -221.967 -218.867
0
0
2
-1.9 -222.073 -223.973
0
0
2
-1.9 -221.967 -223.867
0
5
2
-1.9 -221.765 -218.665
0
0
2
-1.9 -221.967 -223.867
0
0
2
-1.9 -221.765 -223.665
0
5
2
-1.9 -221.464 -218.364
0
0
2
-1.9 -221.765 -223.665
0

Index
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38

Decision
Index
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
12
12
13
13
14
14
14
15
15
15
16
16
16
17
17
17

0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0

2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2

-1.9
-1.9
-1.9
-3.1
-3.1
-3.1
-3.1
-3.1
-3.1
-3.1
-3.1
-3.1
-3.1
-3.1
-1.9
-1.9
-3.1
-3.1
-3.1
-4.3
-4.3
-4.3
-4.3
-4.3
-4.3
-4.3
-4.3
-1.9
-1.9
-3.1
-3.1
-3.1
-4.3
-4.3
-4.3
-5.5
-5.5
-5.5
-5.5
-5.5
-1.9
-1.9
-3.1
-3.1
-3.1
-4.3
-4.3
-4.3
-5.5
-5.5
-5.5
-6.7
-6.7

-221.464
-237.888
-239.897
-236.912
-238.824
-238.802
-238.824
-238.802
-238.666
-238.802
-238.666
-238.427
-238.666
-238.427
-253.339
-256.976
-252.415
-255.952
-256.599
-254.928
-255.529
-255.468
-255.529
-255.468
-255.296
-255.468
-255.296
-268.329
-273.169
-267.433
-272.198
-273.917
-271.227
-272.88
-273.194
-271.842
-272.13
-272.046
-272.13
-272.046
-283.197
-288.366
-282.298
-287.454
-290.495
-286.542
-289.501
-290.514
-288.508
-289.476
-289.679
-288.439
-288.621

-223.364
-239.788
-236.797
-240.012
-241.924
-236.902
-241.924
-241.902
-236.766
-241.902
-241.766
-236.527
-241.766
-241.527
-255.239
-253.876
-255.515
-259.052
-254.699
-259.228
-259.829
-254.768
-259.829
-259.768
-254.596
-259.768
-259.596
-270.229
-270.069
-270.533
-275.298
-272.017
-275.527
-277.18
-272.494
-277.342
-277.63
-272.546
-277.63
-277.546
-285.097
-285.266
-285.398
-290.554
-288.595
-290.842
-293.801
-289.814
-294.008
-294.976
-290.179
-295.139
-295.321

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91

18
18
18
19
19
19
20
20
20
21
21
21
22
22
22
23
23
23
24
24
24
25
25
25
26
26
26
27
27
27
28
28
28
29
29
29
30
30
30
31
31
31
32
32
32
33
33
33
34
34
34
35
35

0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0

2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2

-1.9
-1.9
-3.1
-3.1
-3.1
-4.3
-4.3
-4.3
-5.5
-5.5
-5.5
-6.7
-6.7
-1.9
-1.9
-3.1
-3.1
-3.1
-4.3
-4.3
-4.3
-5.5
-5.5
-5.5
-6.7
-6.7
-1.9
-1.9
-3.1
-3.1
-3.1
-4.3
-4.3
-4.3
-5.5
-5.5
-5.5
-6.7
-6.7
2.6
2.6
1.4
1.4
1.4
0.2
0.2
0.2
-1
-1
-1
-2.2
-2.2

-297.086
-302.368
-296.25
-301.527
-305.895
-300.686
-304.971
-307.05
-304.046
-306.059
-306.846
-305.068
-305.817
-308.981
-314.603
-308.25
-313.854
-319.069
-313.105
-318.274
-321.838
-317.48
-320.949
-322.787
-320.059
-321.83
-315.293
-321.91
-314.858
-321.419
-327.305
-320.929
-326.786
-331.979
-326.268
-331.358
-334.917
-330.737
-334.18
-309.914
-318.459
-310.395
-318.8
-326.183
-319.141
-326.406
-332.819
-326.629
-332.969
-338.428
-333.118
-338.445

-298.986
-299.268
-299.35
-304.627
-303.995
-304.986
-309.271
-306.35
-309.546
-311.559
-307.346
-311.768
-312.517
-310.881
-311.503
-311.35
-316.954
-317.169
-317.405
-322.574
-321.138
-322.98
-326.449
-323.287
-326.759
-328.53
-317.193
-318.81
-317.958
-324.519
-325.405
-325.229
-331.086
-331.279
-331.768
-336.858
-335.417
-337.437
-340.88
-307.314
-310.859
-308.995
-317.4
-319.783
-318.941
-326.206
-327.619
-327.629
-333.969
-334.428
-335.318
-340.645

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0.149494

92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144

35
36
36
36
37
37
37
38
38
38
39
39
39
40
40
40
41
41
41
42
42
42
43
43
43
44
44
44
45
45
45
46
46
46
47
47
47
48
48
48
49
49
49
50
50
50
51
51
51
52
52
52
53

145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197

53
53
54
54
54
55
55
55
56
56
56
57
57
57
58
58
58
59
59
59
60
60
60
61
61
61
62
62
62
63
63
63
64
64
64
65
65
65
66
66
66
67
67
67
68
68
68
69
69
69
70
70
70

198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250

71
71
71
72
72
72
73
73
73
74
74
74
75
75
75
76
76
76
77
77
77
78
78
78
79
79
79
80
80
80
81
81
81
82
82
82
83
83
83
84
84
84
85
85
85
86
86
86
87
87
87
88
88

251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303

88
89
89
89
90
90
90
91
91
91
92
92
92
93
93
93
94
94
94
95
95
95
96
96
96
97
97
97
98
98
98
99
99
99
100
100
100
101
101
101
102
102
102
103
103
103
104
104
104
105
105
105
106

304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356

106
106
107
107
107
108
108
108
109
109
109
110
110
110
111
111
111
112
112
112
113
113
113
114
114
114
115
115
115
116
116
116
117
117
117
118
118
118
119
119
119
120
120
120
121
121
121
122
122
122
123
123
123

357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409

124
124
124
125
125
125
126
126
126
127
127
127
128
128
128
129
129
129
130
130
130
131
131
131
132
132
132
133
133
133
134
134
134
135
135
135
136
136
136
137
137
137
138
138
138
139
139
139
140
140
140
141
141

410
411
412
413
414
415
416

141
142
142
142
143
143
143

tion List
Event
Index
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
2
3
1
2
3
1
2
3
1
2
3
1
2
3

Transition Name
S_0_2/Same/Null
S_0_2/Same/Arrive
S_0_2/Add/Null
S_0_2/Add/Arrive
S_0_3/Delete/Null
S_0_3/Delete/Arrive
S_0_3/Same/Null
S_0_3/Same/Arrive
S_0_3/Add/Null
S_0_3/Add/Arrive
S_0_4/Delete/Null
S_0_4/Delete/Arrive
S_0_4/Same/Null
S_0_4/Same/Arrive
S_0_4/Add/Null
S_0_4/Add/Arrive
S_0_5/Delete/Null
S_0_5/Delete/Arrive
S_0_5/Same/Null
S_0_5/Same/Arrive
S_0_5/Add/Null
S_0_5/Add/Arrive
S_0_6/Delete/Null
S_0_6/Delete/Arrive
S_0_6/Same/Null
S_0_6/Same/Arrive
S_1_2/Same/Depart
S_1_2/Same/Null
S_1_2/Same/Arrive
S_1_2/Add/Depart
S_1_2/Add/Null
S_1_2/Add/Arrive
S_1_3/Delete/Depart
S_1_3/Delete/Null
S_1_3/Delete/Arrive
S_1_3/Same/Depart
S_1_3/Same/Null
S_1_3/Same/Arrive

Transitio Transitio
n Cost
n Prob.
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
0
0.9
5
0.1
-20
0.06
0
0.84
5
0.1
-20
0.06
0
0.84
5
0.1
-20
0.06
0
0.84
5
0.1
-20
0.06
0
0.84
5
0.1

Next
State
1
6
2
7
1
6
2
7
3
8
2
7
3
8
4
9
3
8
4
9
5
10
4
9
5
10
1
6
11
2
7
12
1
6
11
2
7
12

Next
Name
S_0_2
S_1_2
S_0_3
S_1_3
S_0_2
S_1_2
S_0_3
S_1_3
S_0_4
S_1_4
S_0_3
S_1_3
S_0_4
S_1_4
S_0_5
S_1_5
S_0_4
S_1_4
S_0_5
S_1_5
S_0_6
S_1_6
S_0_5
S_1_5
S_0_6
S_1_6
S_0_2
S_1_2
S_2_2
S_0_3
S_1_3
S_2_3
S_0_2
S_1_2
S_2_2
S_0_3
S_1_3
S_2_3

Next
Cost
-186.458
-204.524
-186.358
-204.424
-186.458
-204.524
-186.358
-204.424
-186.158
-204.276
-186.358
-204.424
-186.158
-204.276
-185.863
-204.029
-186.158
-204.276
-185.863
-204.029
-185.473
-203.684
-185.863
-204.029
-185.473
-203.684
-186.458
-204.524
-222.03
-186.358
-204.424
-222.446
-186.458
-204.524
-222.03
-186.358
-204.424
-222.446

1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2

S_1_3/Add/Depart
S_1_3/Add/Null
S_1_3/Add/Arrive
S_1_4/Delete/Depart
S_1_4/Delete/Null
S_1_4/Delete/Arrive
S_1_4/Same/Depart
S_1_4/Same/Null
S_1_4/Same/Arrive
S_1_4/Add/Depart
S_1_4/Add/Null
S_1_4/Add/Arrive
S_1_5/Delete/Depart
S_1_5/Delete/Null
S_1_5/Delete/Arrive
S_1_5/Same/Depart
S_1_5/Same/Null
S_1_5/Same/Arrive
S_1_5/Add/Depart
S_1_5/Add/Null
S_1_5/Add/Arrive
S_1_6/Delete/Depart
S_1_6/Delete/Null
S_1_6/Delete/Arrive
S_1_6/Same/Depart
S_1_6/Same/Null
S_1_6/Same/Arrive
S_2_2/Same/Depart
S_2_2/Same/Null
S_2_2/Same/Arrive
S_2_2/Add/Depart
S_2_2/Add/Null
S_2_2/Add/Arrive
S_2_3/Delete/Depart
S_2_3/Delete/Null
S_2_3/Delete/Arrive
S_2_3/Same/Depart
S_2_3/Same/Null
S_2_3/Same/Arrive
S_2_3/Add/Depart
S_2_3/Add/Null
S_2_3/Add/Arrive
S_2_4/Delete/Depart
S_2_4/Delete/Null
S_2_4/Delete/Arrive
S_2_4/Same/Depart
S_2_4/Same/Null
S_2_4/Same/Arrive
S_2_4/Add/Depart
S_2_4/Add/Null
S_2_4/Add/Arrive
S_2_5/Delete/Depart
S_2_5/Delete/Null

-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0

0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78

3
8
13
2
7
12
3
8
13
4
9
14
3
8
13
4
9
14
5
10
15
4
9
14
5
10
15
6
11
16
7
12
17
6
11
16
7
12
17
8
13
18
7
12
17
8
13
18
9
14
19
8
13

S_0_4
S_1_4
S_2_4
S_0_3
S_1_3
S_2_3
S_0_4
S_1_4
S_2_4
S_0_5
S_1_5
S_2_5
S_0_4
S_1_4
S_2_4
S_0_5
S_1_5
S_2_5
S_0_6
S_1_6
S_2_6
S_0_5
S_1_5
S_2_5
S_0_6
S_1_6
S_2_6
S_1_2
S_2_2
S_3_2
S_1_3
S_2_3
S_3_3
S_1_2
S_2_2
S_3_2
S_1_3
S_2_3
S_3_3
S_1_4
S_2_4
S_3_4
S_1_3
S_2_3
S_3_3
S_1_4
S_2_4
S_3_4
S_1_5
S_2_5
S_3_5
S_1_4
S_2_4

-186.158
-204.276
-222.346
-186.358
-204.424
-222.446
-186.158
-204.276
-222.346
-185.863
-204.029
-222.14
-186.158
-204.276
-222.346
-185.863
-204.029
-222.14
-185.473
-203.684
-221.838
-185.863
-204.029
-222.14
-185.473
-203.684
-221.838
-204.524
-222.03
-238.302
-204.424
-222.446
-240.337
-204.524
-222.03
-238.302
-204.424
-222.446
-240.337
-204.276
-222.346
-240.237
-204.424
-222.446
-240.337
-204.276
-222.346
-240.237
-204.029
-222.14
-240.115
-204.276
-222.346

3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1

S_2_5/Delete/Arrive
S_2_5/Same/Depart
S_2_5/Same/Null
S_2_5/Same/Arrive
S_2_5/Add/Depart
S_2_5/Add/Null
S_2_5/Add/Arrive
S_2_6/Delete/Depart
S_2_6/Delete/Null
S_2_6/Delete/Arrive
S_2_6/Same/Depart
S_2_6/Same/Null
S_2_6/Same/Arrive
S_3_2/Same/Depart
S_3_2/Same/Null
S_3_2/Same/Arrive
S_3_2/Add/Depart
S_3_2/Add/Null
S_3_2/Add/Arrive
S_3_3/Delete/Depart
S_3_3/Delete/Null
S_3_3/Delete/Arrive
S_3_3/Same/Depart
S_3_3/Same/Null
S_3_3/Same/Arrive
S_3_3/Add/Depart
S_3_3/Add/Null
S_3_3/Add/Arrive
S_3_4/Delete/Depart
S_3_4/Delete/Null
S_3_4/Delete/Arrive
S_3_4/Same/Depart
S_3_4/Same/Null
S_3_4/Same/Arrive
S_3_4/Add/Depart
S_3_4/Add/Null
S_3_4/Add/Arrive
S_3_5/Delete/Depart
S_3_5/Delete/Null
S_3_5/Delete/Arrive
S_3_5/Same/Depart
S_3_5/Same/Null
S_3_5/Same/Arrive
S_3_5/Add/Depart
S_3_5/Add/Null
S_3_5/Add/Arrive
S_3_6/Delete/Depart
S_3_6/Delete/Null
S_3_6/Delete/Arrive
S_3_6/Same/Depart
S_3_6/Same/Null
S_3_6/Same/Arrive
S_4_2/Same/Depart

5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20

0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.12

18
9
14
19
10
15
20
9
14
19
10
15
20
11
16
21
12
17
22
11
16
21
12
17
22
13
18
23
12
17
22
13
18
23
14
19
24
13
18
23
14
19
24
15
20
25
14
19
24
15
20
25
16

S_3_4
S_1_5
S_2_5
S_3_5
S_1_6
S_2_6
S_3_6
S_1_5
S_2_5
S_3_5
S_1_6
S_2_6
S_3_6
S_2_2
S_3_2
S_4_2
S_2_3
S_3_3
S_4_3
S_2_2
S_3_2
S_4_2
S_2_3
S_3_3
S_4_3
S_2_4
S_3_4
S_4_4
S_2_3
S_3_3
S_4_3
S_2_4
S_3_4
S_4_4
S_2_5
S_3_5
S_4_5
S_2_4
S_3_4
S_4_4
S_2_5
S_3_5
S_4_5
S_2_6
S_3_6
S_4_6
S_2_5
S_3_5
S_4_5
S_2_6
S_3_6
S_4_6
S_3_2

-240.237
-204.029
-222.14
-240.115
-203.684
-221.838
-239.88
-204.029
-222.14
-240.115
-203.684
-221.838
-239.88
-222.03
-238.302
-253.692
-222.446
-240.337
-257.406
-222.03
-238.302
-253.692
-222.446
-240.337
-257.406
-222.346
-240.237
-258.082
-222.446
-240.337
-257.406
-222.346
-240.237
-258.082
-222.14
-240.115
-257.982
-222.346
-240.237
-258.082
-222.14
-240.115
-257.982
-221.838
-239.88
-257.822
-222.14
-240.115
-257.982
-221.838
-239.88
-257.822
-238.302

2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3

S_4_2/Same/Null
S_4_2/Same/Arrive
S_4_2/Add/Depart
S_4_2/Add/Null
S_4_2/Add/Arrive
S_4_3/Delete/Depart
S_4_3/Delete/Null
S_4_3/Delete/Arrive
S_4_3/Same/Depart
S_4_3/Same/Null
S_4_3/Same/Arrive
S_4_3/Add/Depart
S_4_3/Add/Null
S_4_3/Add/Arrive
S_4_4/Delete/Depart
S_4_4/Delete/Null
S_4_4/Delete/Arrive
S_4_4/Same/Depart
S_4_4/Same/Null
S_4_4/Same/Arrive
S_4_4/Add/Depart
S_4_4/Add/Null
S_4_4/Add/Arrive
S_4_5/Delete/Depart
S_4_5/Delete/Null
S_4_5/Delete/Arrive
S_4_5/Same/Depart
S_4_5/Same/Null
S_4_5/Same/Arrive
S_4_5/Add/Depart
S_4_5/Add/Null
S_4_5/Add/Arrive
S_4_6/Delete/Depart
S_4_6/Delete/Null
S_4_6/Delete/Arrive
S_4_6/Same/Depart
S_4_6/Same/Null
S_4_6/Same/Arrive
S_5_2/Same/Depart
S_5_2/Same/Null
S_5_2/Same/Arrive
S_5_2/Add/Depart
S_5_2/Add/Null
S_5_2/Add/Arrive
S_5_3/Delete/Depart
S_5_3/Delete/Null
S_5_3/Delete/Arrive
S_5_3/Same/Depart
S_5_3/Same/Null
S_5_3/Same/Arrive
S_5_3/Add/Depart
S_5_3/Add/Null
S_5_3/Add/Arrive

0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5

0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1

21
26
17
22
27
16
21
26
17
22
27
18
23
28
17
22
27
18
23
28
19
24
29
18
23
28
19
24
29
20
25
30
19
24
29
20
25
30
21
26
31
22
27
32
21
26
31
22
27
32
23
28
33

S_4_2
S_5_2
S_3_3
S_4_3
S_5_3
S_3_2
S_4_2
S_5_2
S_3_3
S_4_3
S_5_3
S_3_4
S_4_4
S_5_4
S_3_3
S_4_3
S_5_3
S_3_4
S_4_4
S_5_4
S_3_5
S_4_5
S_5_5
S_3_4
S_4_4
S_5_4
S_3_5
S_4_5
S_5_5
S_3_6
S_4_6
S_5_6
S_3_5
S_4_5
S_5_5
S_3_6
S_4_6
S_5_6
S_4_2
S_5_2
S_6_2
S_4_3
S_5_3
S_6_3
S_4_2
S_5_2
S_6_2
S_4_3
S_5_3
S_6_3
S_4_4
S_5_4
S_6_4

-253.692
-268.623
-240.337
-257.406
-273.592
-238.302
-253.692
-268.623
-240.337
-257.406
-273.592
-240.237
-258.082
-275.374
-240.337
-257.406
-273.592
-240.237
-258.082
-275.374
-240.115
-257.982
-275.724
-240.237
-258.082
-275.374
-240.115
-257.982
-275.724
-239.88
-257.822
-275.624
-240.115
-257.982
-275.724
-239.88
-257.822
-275.624
-253.692
-268.623
-283.6
-257.406
-273.592
-288.788
-253.692
-268.623
-283.6
-257.406
-273.592
-288.788
-258.082
-275.374
-291.935

1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2

S_5_4/Delete/Depart
S_5_4/Delete/Null
S_5_4/Delete/Arrive
S_5_4/Same/Depart
S_5_4/Same/Null
S_5_4/Same/Arrive
S_5_4/Add/Depart
S_5_4/Add/Null
S_5_4/Add/Arrive
S_5_5/Delete/Depart
S_5_5/Delete/Null
S_5_5/Delete/Arrive
S_5_5/Same/Depart
S_5_5/Same/Null
S_5_5/Same/Arrive
S_5_5/Add/Depart
S_5_5/Add/Null
S_5_5/Add/Arrive
S_5_6/Delete/Depart
S_5_6/Delete/Null
S_5_6/Delete/Arrive
S_5_6/Same/Depart
S_5_6/Same/Null
S_5_6/Same/Arrive
S_6_2/Same/Depart
S_6_2/Same/Null
S_6_2/Same/Arrive
S_6_2/Add/Depart
S_6_2/Add/Null
S_6_2/Add/Arrive
S_6_3/Delete/Depart
S_6_3/Delete/Null
S_6_3/Delete/Arrive
S_6_3/Same/Depart
S_6_3/Same/Null
S_6_3/Same/Arrive
S_6_3/Add/Depart
S_6_3/Add/Null
S_6_3/Add/Arrive
S_6_4/Delete/Depart
S_6_4/Delete/Null
S_6_4/Delete/Arrive
S_6_4/Same/Depart
S_6_4/Same/Null
S_6_4/Same/Arrive
S_6_4/Add/Depart
S_6_4/Add/Null
S_6_4/Add/Arrive
S_6_5/Delete/Depart
S_6_5/Delete/Null
S_6_5/Delete/Arrive
S_6_5/Same/Depart
S_6_5/Same/Null

-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0

0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6

22
27
32
23
28
33
24
29
34
23
28
33
24
29
34
25
30
35
24
29
34
25
30
35
26
31
36
27
32
37
26
31
36
27
32
37
28
33
38
27
32
37
28
33
38
29
34
39
28
33
38
29
34

S_4_3
S_5_3
S_6_3
S_4_4
S_5_4
S_6_4
S_4_5
S_5_5
S_6_5
S_4_4
S_5_4
S_6_4
S_4_5
S_5_5
S_6_5
S_4_6
S_5_6
S_6_6
S_4_5
S_5_5
S_6_5
S_4_6
S_5_6
S_6_6
S_5_2
S_6_2
S_7_2
S_5_3
S_6_3
S_7_3
S_5_2
S_6_2
S_7_2
S_5_3
S_6_3
S_7_3
S_5_4
S_6_4
S_7_4
S_5_3
S_6_3
S_7_3
S_5_4
S_6_4
S_7_4
S_5_5
S_6_5
S_7_5
S_5_4
S_6_4
S_7_4
S_5_5
S_6_5

-257.406
-273.592
-288.788
-258.082
-275.374
-291.935
-257.982
-275.724
-293.01
-258.082
-275.374
-291.935
-257.982
-275.724
-293.01
-257.822
-275.624
-293.255
-257.982
-275.724
-293.01
-257.822
-275.624
-293.255
-268.623
-283.6
-297.542
-273.592
-288.788
-302.801
-268.623
-283.6
-297.542
-273.592
-288.788
-302.801
-275.374
-291.935
-307.345
-273.592
-288.788
-302.801
-275.374
-291.935
-307.345
-275.724
-293.01
-309.533
-275.374
-291.935
-307.345
-275.724
-293.01

3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1

S_6_5/Same/Arrive
S_6_5/Add/Depart
S_6_5/Add/Null
S_6_5/Add/Arrive
S_6_6/Delete/Depart
S_6_6/Delete/Null
S_6_6/Delete/Arrive
S_6_6/Same/Depart
S_6_6/Same/Null
S_6_6/Same/Arrive
S_7_2/Same/Depart
S_7_2/Same/Null
S_7_2/Same/Arrive
S_7_2/Add/Depart
S_7_2/Add/Null
S_7_2/Add/Arrive
S_7_3/Delete/Depart
S_7_3/Delete/Null
S_7_3/Delete/Arrive
S_7_3/Same/Depart
S_7_3/Same/Null
S_7_3/Same/Arrive
S_7_3/Add/Depart
S_7_3/Add/Null
S_7_3/Add/Arrive
S_7_4/Delete/Depart
S_7_4/Delete/Null
S_7_4/Delete/Arrive
S_7_4/Same/Depart
S_7_4/Same/Null
S_7_4/Same/Arrive
S_7_4/Add/Depart
S_7_4/Add/Null
S_7_4/Add/Arrive
S_7_5/Delete/Depart
S_7_5/Delete/Null
S_7_5/Delete/Arrive
S_7_5/Same/Depart
S_7_5/Same/Null
S_7_5/Same/Arrive
S_7_5/Add/Depart
S_7_5/Add/Null
S_7_5/Add/Arrive
S_7_6/Delete/Depart
S_7_6/Delete/Null
S_7_6/Delete/Arrive
S_7_6/Same/Depart
S_7_6/Same/Null
S_7_6/Same/Arrive
S_8_2/Same/Depart
S_8_2/Same/Null
S_8_2/Same/Arrive
S_8_2/Add/Depart

5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20

0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12

39
30
35
40
29
34
39
30
35
40
31
36
41
32
37
42
31
36
41
32
37
42
33
38
43
32
37
42
33
38
43
34
39
44
33
38
43
34
39
44
35
40
45
34
39
44
35
40
45
36
41
46
37

S_7_5
S_5_6
S_6_6
S_7_6
S_5_5
S_6_5
S_7_5
S_5_6
S_6_6
S_7_6
S_6_2
S_7_2
S_8_2
S_6_3
S_7_3
S_8_3
S_6_2
S_7_2
S_8_2
S_6_3
S_7_3
S_8_3
S_6_4
S_7_4
S_8_4
S_6_3
S_7_3
S_8_3
S_6_4
S_7_4
S_8_4
S_6_5
S_7_5
S_8_5
S_6_4
S_7_4
S_8_4
S_6_5
S_7_5
S_8_5
S_6_6
S_7_6
S_8_6
S_6_5
S_7_5
S_8_5
S_6_6
S_7_6
S_8_6
S_7_2
S_8_2
S_9_2
S_7_3

-309.533
-275.624
-293.255
-310.391
-275.724
-293.01
-309.533
-275.624
-293.255
-310.391
-283.6
-297.542
-309.717
-288.788
-302.801
-315.283
-283.6
-297.542
-309.717
-288.788
-302.801
-315.283
-291.935
-307.345
-320.589
-288.788
-302.801
-315.283
-291.935
-307.345
-320.589
-293.01
-309.533
-324.362
-291.935
-307.345
-320.589
-293.01
-309.533
-324.362
-293.255
-310.391
-326.344
-293.01
-309.533
-324.362
-293.255
-310.391
-326.344
-297.542
-309.717
-316.964
-302.801

2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3

S_8_2/Add/Null
S_8_2/Add/Arrive
S_8_3/Delete/Depart
S_8_3/Delete/Null
S_8_3/Delete/Arrive
S_8_3/Same/Depart
S_8_3/Same/Null
S_8_3/Same/Arrive
S_8_3/Add/Depart
S_8_3/Add/Null
S_8_3/Add/Arrive
S_8_4/Delete/Depart
S_8_4/Delete/Null
S_8_4/Delete/Arrive
S_8_4/Same/Depart
S_8_4/Same/Null
S_8_4/Same/Arrive
S_8_4/Add/Depart
S_8_4/Add/Null
S_8_4/Add/Arrive
S_8_5/Delete/Depart
S_8_5/Delete/Null
S_8_5/Delete/Arrive
S_8_5/Same/Depart
S_8_5/Same/Null
S_8_5/Same/Arrive
S_8_5/Add/Depart
S_8_5/Add/Null
S_8_5/Add/Arrive
S_8_6/Delete/Depart
S_8_6/Delete/Null
S_8_6/Delete/Arrive
S_8_6/Same/Depart
S_8_6/Same/Null
S_8_6/Same/Arrive
S_9_2/Same/Depart
S_9_2/Same/Null
S_9_2/Same/Arrive
S_9_2/Add/Depart
S_9_2/Add/Null
S_9_2/Add/Arrive
S_9_3/Delete/Depart
S_9_3/Delete/Null
S_9_3/Delete/Arrive
S_9_3/Same/Depart
S_9_3/Same/Null
S_9_3/Same/Arrive
S_9_3/Add/Depart
S_9_3/Add/Null
S_9_3/Add/Arrive
S_9_4/Delete/Depart
S_9_4/Delete/Null
S_9_4/Delete/Arrive

0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5

0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1

42
47
36
41
46
37
42
47
38
43
48
37
42
47
38
43
48
39
44
49
38
43
48
39
44
49
40
45
50
39
44
49
40
45
50
41
46
51
42
47
52
41
46
51
42
47
52
43
48
53
42
47
52

S_8_3
S_9_3
S_7_2
S_8_2
S_9_2
S_7_3
S_8_3
S_9_3
S_7_4
S_8_4
S_9_4
S_7_3
S_8_3
S_9_3
S_7_4
S_8_4
S_9_4
S_7_5
S_8_5
S_9_5
S_7_4
S_8_4
S_9_4
S_7_5
S_8_5
S_9_5
S_7_6
S_8_6
S_9_6
S_7_5
S_8_5
S_9_5
S_7_6
S_8_6
S_9_6
S_8_2
S_9_2
S_10_2
S_8_3
S_9_3
S_10_3
S_8_2
S_9_2
S_10_2
S_8_3
S_9_3
S_10_3
S_8_4
S_9_4
S_10_4
S_8_3
S_9_3
S_10_3

-315.283
-323.459
-297.542
-309.717
-316.964
-302.801
-315.283
-323.459
-307.345
-320.589
-329.233
-302.801
-315.283
-323.459
-307.345
-320.589
-329.233
-309.533
-324.362
-334.712
-307.345
-320.589
-329.233
-309.533
-324.362
-334.712
-310.391
-326.344
-338.634
-309.533
-324.362
-334.712
-310.391
-326.344
-338.634
-309.717
-316.964
-308.953
-315.283
-323.459
-317.777
-309.717
-316.964
-308.953
-315.283
-323.459
-317.777
-320.589
-329.233
-325.513
-315.283
-323.459
-317.777

1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2

S_9_4/Same/Depart
S_9_4/Same/Null
S_9_4/Same/Arrive
S_9_4/Add/Depart
S_9_4/Add/Null
S_9_4/Add/Arrive
S_9_5/Delete/Depart
S_9_5/Delete/Null
S_9_5/Delete/Arrive
S_9_5/Same/Depart
S_9_5/Same/Null
S_9_5/Same/Arrive
S_9_5/Add/Depart
S_9_5/Add/Null
S_9_5/Add/Arrive
S_9_6/Delete/Depart
S_9_6/Delete/Null
S_9_6/Delete/Arrive
S_9_6/Same/Depart
S_9_6/Same/Null
S_9_6/Same/Arrive
S_10_2/Same/Depart
S_10_2/Same/Null
S_10_2/Same/Arrive
S_10_2/Add/Depart
S_10_2/Add/Null
S_10_2/Add/Arrive
S_10_3/Delete/Depart
S_10_3/Delete/Null
S_10_3/Delete/Arrive
S_10_3/Same/Depart
S_10_3/Same/Null
S_10_3/Same/Arrive
S_10_3/Add/Depart
S_10_3/Add/Null
S_10_3/Add/Arrive
S_10_4/Delete/Depart
S_10_4/Delete/Null
S_10_4/Delete/Arrive
S_10_4/Same/Depart
S_10_4/Same/Null
S_10_4/Same/Arrive
S_10_4/Add/Depart
S_10_4/Add/Null
S_10_4/Add/Arrive
S_10_5/Delete/Depart
S_10_5/Delete/Null
S_10_5/Delete/Arrive
S_10_5/Same/Depart
S_10_5/Same/Null
S_10_5/Same/Arrive
S_10_5/Add/Depart
S_10_5/Add/Null

-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0

0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6

43
48
53
44
49
54
43
48
53
44
49
54
45
50
55
44
49
54
45
50
55
46
51
51
47
52
52
46
51
51
47
52
52
48
53
53
47
52
52
48
53
53
49
54
54
48
53
53
49
54
54
50
55

S_8_4
S_9_4
S_10_4
S_8_5
S_9_5
S_10_5
S_8_4
S_9_4
S_10_4
S_8_5
S_9_5
S_10_5
S_8_6
S_9_6
S_10_6
S_8_5
S_9_5
S_10_5
S_8_6
S_9_6
S_10_6
S_9_2
S_10_2
S_10_2
S_9_3
S_10_3
S_10_3
S_9_2
S_10_2
S_10_2
S_9_3
S_10_3
S_10_3
S_9_4
S_10_4
S_10_4
S_9_3
S_10_3
S_10_3
S_9_4
S_10_4
S_10_4
S_9_5
S_10_5
S_10_5
S_9_4
S_10_4
S_10_4
S_9_5
S_10_5
S_10_5
S_9_6
S_10_6

-320.589
-329.233
-325.513
-324.362
-334.712
-332.222
-320.589
-329.233
-325.513
-324.362
-334.712
-332.222
-326.344
-338.634
-338.339
-324.362
-334.712
-332.222
-326.344
-338.634
-338.339
-316.964
-308.953
-308.953
-323.459
-317.777
-317.777
-316.964
-308.953
-308.953
-323.459
-317.777
-317.777
-329.233
-325.513
-325.513
-323.459
-317.777
-317.777
-329.233
-325.513
-325.513
-334.712
-332.222
-332.222
-329.233
-325.513
-325.513
-334.712
-332.222
-332.222
-338.634
-338.339

3
1
2
3
1
2
3

S_10_5/Add/Arrive
S_10_6/Delete/Depart
S_10_6/Delete/Null
S_10_6/Delete/Arrive
S_10_6/Same/Depart
S_10_6/Same/Null
S_10_6/Same/Arrive

50
-20
0
50
-20
0
50

0.1
0.36
0.54
0.1
0.36
0.54
0.1

55
49
54
54
50
55
55

S_10_6
S_9_5
S_10_5
S_10_5
S_9_6
S_10_6
S_10_6

-338.339
-334.712
-332.222
-332.222
-338.634
-338.339
-338.339

Next
Prob.
0.134544
0.014949
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0

Index
1
6
7
11
12
16
17
18
21
22
23
24
26
27
28
29
30
31
32
33
34
35
37
38
39
40
42
43
44
45
48
49
50
54
55

Name
S_0_2
S_1_2
S_1_3
S_2_2
S_2_3
S_3_2
S_3_3
S_3_4
S_4_2
S_4_3
S_4_4
S_4_5
S_5_2
S_5_3
S_5_4
S_5_5
S_5_6
S_6_2
S_6_3
S_6_4
S_6_5
S_6_6
S_7_3
S_7_4
S_7_5
S_7_6
S_8_3
S_8_4
S_8_5
S_8_6
S_9_4
S_9_5
S_9_6
S_10_5
S_10_6

System
0
1
1
2
2
3
3
3
4
4
4
4
5
5
5
5
5
6
6
6
6
6
7
7
7
7
8
8
8
8
9
9
9
10
10

Channels
2
2
3
2
3
2
3
4
2
3
4
5
2
3
4
5
6
2
3
4
5
6
3
4
5
6
3
4
5
6
4
5
6
5
6

Action
Index
2
2
1
2
2
2
2
1
2
2
2
1
2
2
2
2
1
3
2
2
2
2
2
2
2
2
3
2
2
2
3
2
2
3
2

7
State Value
-187.56461
-205.63095
-205.53095
-223.136564
-223.552683
-239.408412
-241.443866
-241.343866
-254.798503
-258.512206
-259.188669
-259.088669
-269.728855
-274.698125
-276.479813
-276.829828
-276.729828
-284.70592
-289.894148
-293.04136
-294.116487
-294.361321
-303.906924
-308.450877
-310.639041
-311.497455
-316.38911
-321.694489
-325.468563
-327.449794
-330.339206
-335.818218
-339.739893
-333.327632
-339.445305

State Prob.
0.14944795
0.24518066
0.0031687
0.17980104
0.02645139
0.1223039
0.03154341
0.00103401
0.07409053
0.03049731
0.00386948
0.00044777
0.03372394
0.02952664
0.00428237
0.0013401
0.00015538
0.00337341
0.02684491
0.00429818
0.00148441
0.00043245
0.01078071
0.00432809
0.00148879
0.00055481
0.00107772
0.00354865
0.00149681
0.00059141
0.00046237
0.00113473
0.00060401
0.00015958
0.00047662

Channels

Action
Name
Same
Same
Delete
Same
Same
Same
Same
Delete
Same
Same
Same
Delete
Same
Same
Same
Same
Delete
Add
Same
Same
Same
Same
Same
Same
Same
Same
Add
Same
Same
Same
Add
Same
Same
Add
Same

0
0

0
0

6
System

10

12

System

10

12

0
1
1
2
2
3
3
3
4
4
4
4
5
5
5
5
5
6
6
6
6
6
7
7
7
7
8
8
8
8
9
9
9
10
10

Channels
2
2
3
2
3
2
3
4
2
3
4
5
2
3
4
5
6
2
3
4
5
6
3
4
5
6
3
4
5
6
4
5
6
5
6

Action
Index
2
2
1
2
2
2
2
1
2
2
2
1
2
2
2
2
1
3
2
2
2
2
2
2
2
2
3
2
2
2
3
2
2
3
2

Action
Name
Same
Same
Delete
Same
Same
Same
Same
Delete
Same
Same
Same
Delete
Same
Same
Same
Same
Delete
Add
Same
Same
Same
Same
Same
Same
Same
Same
Add
Same
Same
Same
Add
Same
Same
Add
Same

State Value
-187.56461
-205.63095
-205.53095
-223.136564
-223.552683
-239.408412
-241.443866
-241.343866
-254.798503
-258.512206
-259.188669
-259.088669
-269.728855
-274.698125
-276.479813
-276.829828
-276.729828
-284.70592
-289.894148
-293.04136
-294.116487
-294.361321
-303.906924
-308.450877
-310.639041
-311.497455
-316.38911
-321.694489
-325.468563
-327.449794
-330.339206
-335.818218
-339.739893
-333.327632
-339.445305

State Prob.
0.14944795
0.24518066
0.0031687
0.17980104
0.02645139
0.1223039
0.03154341
0.00103401
0.07409053
0.03049731
0.00386948
0.00044777
0.03372394
0.02952664
0.00428237
0.0013401
0.00015538
0.00337341
0.02684491
0.00429818
0.00148441
0.00043245
0.01078071
0.00432809
0.00148879
0.00055481
0.00107772
0.00354865
0.00149681
0.00059141
0.00046237
0.00113473
0.00060401
0.00015958
0.00047662

Queue
0
0
0
0
0
1
0
0
2
1
0
0
3
2
1
0
0
4
3
2
1
0
4
3
2
1
5
4
3
2
5
4
3
5
4

Rows with zero probabilities are deleted.

Sum
Prob.
0.14945
0.24518
0.00317
0.1798
0.02645
0.1223
0.03154
0.00103
0.07409
0.0305
0.00387
0.00045
0.03372
0.02953
0.00428
0.00134
0.00016
0.00337
0.02684
0.0043
0.00148
0.00043
0.01078
0.00433
0.00149
0.00055
0.00108
0.00355
0.0015
0.00059
0.00046
0.00113
0.0006
0.00016
0.00048

Index
1
6
7
11
12
16
17
18
21
22
23
24
26
27
28
29
30
31
32
33
34
35
37
38
39
40
42
43
44
45
48
49
50
54
55

Name System
S_0_2
0
S_1_2
1
S_1_3
1
S_2_2
2
S_2_3
2
S_3_2
3
S_3_3
3
S_3_4
3
S_4_2
4
S_4_3
4
S_4_4
4
S_4_5
4
S_5_2
5
S_5_3
5
S_5_4
5
S_5_5
5
S_5_6
5
S_6_2
6
S_6_3
6
S_6_4
6
S_6_5
6
S_6_6
6
S_7_3
7
S_7_4
7
S_7_5
7
S_7_6
7
S_8_3
8
S_8_4
8
S_8_5
8
S_8_6
8
S_9_4
9
S_9_5
9
S_9_6
9
S_10_5
10
S_10_6
10

Channe
ls
2
2
3
2
3
2
3
4
2
3
4
5
2
3
4
5
6
2
3
4
5
6
3
4
5
6
3
4
5
6
4
5
6
5
6

Final Step 200

Action Action
Index
Name
2
Same
2
Same
1
Delete
2
Same
2
Same
2
Same
2
Same
1
Delete
2
Same
2
Same
2
Same
1
Delete
2
Same
2
Same
2
Same
2
Same
1
Delete
3
Add
2
Same
2
Same
2
Same
2
Same
2
Same
2
Same
2
Same
2
Same
3
Add
2
Same
2
Same
2
Same
3
Add
2
Same
2
Same
3
Add
2
Same

State
Value
-187.56
-205.63
-205.53
-223.14
-223.55
-239.41
-241.44
-241.34
-254.8
-258.51
-259.19
-259.09
-269.73
-274.7
-276.48
-276.83
-276.73
-284.71
-289.89
-293.04
-294.12
-294.36
-303.91
-308.45
-310.64
-311.5
-316.39
-321.69
-325.47
-327.45
-330.34
-335.82
-339.74
-333.33
-339.45

Value
State
Prob.
0.14945
0.24518
0.00317
0.1798
0.02645
0.1223
0.03154
0.00103
0.07409
0.0305
0.00387
0.00045
0.03372
0.02953
0.00428
0.00134
0.00016
0.00337
0.02684
0.0043
0.00148
0.00043
0.01078
0.00433
0.00149
0.00055
0.00108
0.00355
0.0015
0.00059
0.00046
0.00113
0.0006
0.00016
0.00048

FQ_3 Model Lists

State List

Index
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47

Count
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46

Name
S_0_2
S_0_3
S_0_4
S_0_5
S_0_6
S_1_2
S_1_3
S_1_4
S_1_5
S_1_6
S_2_2
S_2_3
S_2_4
S_2_5
S_2_6
S_3_2
S_3_3
S_3_4
S_3_5
S_3_6
S_4_2
S_4_3
S_4_4
S_4_5
S_4_6
S_5_2
S_5_3
S_5_4
S_5_5
S_5_6
S_6_2
S_6_3
S_6_4
S_6_5
S_6_6
S_7_2
S_7_3
S_7_4
S_7_5
S_7_6
S_8_2
S_8_3
S_8_4
S_8_5
S_8_6
S_9_2
S_9_3

System
0
0
0
0
0
1
1
1
1
1
2
2
2
2
2
3
3
3
3
3
4
4
4
4
4
5
5
5
5
5
6
6
6
6
6
7
7
7
7
7
8
8
8
8
8
9
9

Channels
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3
4
5
6
2
3

Cost
0.2
0.3
0.4
0.5
0.6
0.26
0.36
0.46
0.56
0.66
0.32
0.42
0.52
0.62
0.72
0.38
0.48
0.58
0.68
0.78
0.44
0.54
0.64
0.74
0.84
0.5
0.6
0.7
0.8
0.9
0.56
0.66
0.76
0.86
0.96
0.62
0.72
0.82
0.92
1.02
0.68
0.78
0.88
0.98
1.08
0.74
0.84

48
49
50
51
52
53
54
55

47
48
49
50
51
52
53
54

S_9_4
S_9_5
S_9_6
S_10_2
S_10_3
S_10_4
S_10_5
S_10_6

9
9
9
10
10
10
10
10

4
5
6
2
3
4
5
6

0.94
1.04
1.14
0.8
0.9
1
1.1
1.2

Action List

Index
1
2
3

Event List

Count
0
1
2

Name
Delete
Same
Add

Action

Cost
-1
0
1

0
0
5

Index Count Name Event

1
0
Depart
-1
2
1
Null
0
3
2
Arrive
1

Cost
-20
0
5

Decisions

Transitions

State Action
Action Trans/
Index Index Index
Name
Cost Range
1
1
2
S_0_2/Same
0
2
2
1
3
S_0_2/Add
5
4
3
2
1
S_0_3/Delete
0
6
4
2
2
S_0_3/Same
0
8
5
2
3
S_0_3/Add
5
10
6
3
1
S_0_4/Delete
0
12
7
3
2
S_0_4/Same
0
14
8
3
3
S_0_4/Add
5
16
9
4
1
S_0_5/Delete
0
18
10
4
2
S_0_5/Same
0
20
11
4
3
S_0_5/Add
5
22
12
5
1
S_0_6/Delete
0
24
13
5
2
S_0_6/Same
0
26
14
6
2
S_1_2/Same
0
29
15
6
3
S_1_2/Add
5
32
16
7
1
S_1_3/Delete
0
35
17
7
2
S_1_3/Same
0
38
18
7
3
S_1_3/Add
5
41
19
8
1
S_1_4/Delete
0
44
20
8
2
S_1_4/Same
0
47
21
8
3
S_1_4/Add
5
50
22
9
1
S_1_5/Delete
0
53
23
9
2
S_1_5/Same
0
56
24
9
3
S_1_5/Add
5
59
25
10
1
S_1_6/Delete
0
62
26
10
2
S_1_6/Same
0
65
27
11
2
S_2_2/Same
0
68
28
11
3
S_2_2/Add
5
71
29
12
1
S_2_3/Delete
0
74
30
12
2
S_2_3/Same
0
77
31
12
3
S_2_3/Add
5
80
32
13
1
S_2_4/Delete
0
83
33
13
2
S_2_4/Same
0
86
34
13
3
S_2_4/Add
5
89
35
14
1
S_2_5/Delete
0
92
36
14
2
S_2_5/Same
0
95
37
14
3
S_2_5/Add
5
98
38
15
1
S_2_6/Delete
0
101
39
15
2
S_2_6/Same
0
104
40
16
2
S_3_2/Same
0
107
41
16
3
S_3_2/Add
5
110
42
17
1
S_3_3/Delete
0
113
43
17
2
S_3_3/Same
0
116
44
17
3
S_3_3/Add
5
119
45
18
1
S_3_4/Delete
0
122
46
18
2
S_3_4/Same
0
125
47
18
3
S_3_4/Add
5
128

Index
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47

48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100

19
19
19
20
20
21
21
22
22
22
23
23
23
24
24
24
25
25
26
26
27
27
27
28
28
28
29
29
29
30
30
31
31
32
32
32
33
33
33
34
34
34
35
35
36
36
37
37
37
38
38
38
39

1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1

S_3_5/Delete
S_3_5/Same
S_3_5/Add
S_3_6/Delete
S_3_6/Same
S_4_2/Same
S_4_2/Add
S_4_3/Delete
S_4_3/Same
S_4_3/Add
S_4_4/Delete
S_4_4/Same
S_4_4/Add
S_4_5/Delete
S_4_5/Same
S_4_5/Add
S_4_6/Delete
S_4_6/Same
S_5_2/Same
S_5_2/Add
S_5_3/Delete
S_5_3/Same
S_5_3/Add
S_5_4/Delete
S_5_4/Same
S_5_4/Add
S_5_5/Delete
S_5_5/Same
S_5_5/Add
S_5_6/Delete
S_5_6/Same
S_6_2/Same
S_6_2/Add
S_6_3/Delete
S_6_3/Same
S_6_3/Add
S_6_4/Delete
S_6_4/Same
S_6_4/Add
S_6_5/Delete
S_6_5/Same
S_6_5/Add
S_6_6/Delete
S_6_6/Same
S_7_2/Same
S_7_2/Add
S_7_3/Delete
S_7_3/Same
S_7_3/Add
S_7_4/Delete
S_7_4/Same
S_7_4/Add
S_7_5/Delete

0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0

131
134
137
140
143
146
149
152
155
158
161
164
167
170
173
176
179
182
185
188
191
194
197
200
203
206
209
212
215
218
221
224
227
230
233
236
239
242
245
248
251
254
257
260
263
266
269
272
275
278
281
284
287

48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100

101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143

39
39
40
40
41
41
42
42
42
43
43
43
44
44
44
45
45
46
46
47
47
47
48
48
48
49
49
49
50
50
51
51
52
52
52
53
53
53
54
54
54
55
55

2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2
2
3
1
2
3
1
2
3
1
2
3
1
2

S_7_5/Same
S_7_5/Add
S_7_6/Delete
S_7_6/Same
S_8_2/Same
S_8_2/Add
S_8_3/Delete
S_8_3/Same
S_8_3/Add
S_8_4/Delete
S_8_4/Same
S_8_4/Add
S_8_5/Delete
S_8_5/Same
S_8_5/Add
S_8_6/Delete
S_8_6/Same
S_9_2/Same
S_9_2/Add
S_9_3/Delete
S_9_3/Same
S_9_3/Add
S_9_4/Delete
S_9_4/Same
S_9_4/Add
S_9_5/Delete
S_9_5/Same
S_9_5/Add
S_9_6/Delete
S_9_6/Same
S_10_2/Same
S_10_2/Add
S_10_3/Delete
S_10_3/Same
S_10_3/Add
S_10_4/Delete
S_10_4/Same
S_10_4/Add
S_10_5/Delete
S_10_5/Same
S_10_5/Add
S_10_6/Delete
S_10_6/Same

0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0
0
5
0
0
5
0
0
5
0
0
5
0
0

290
293
296
299
302
305
308
311
314
317
320
323
326
329
332
335
338
341
344
347
350
353
356
359
362
365
368
371
374
377
380
383
386
389
392
395
398
401
404
407
410
413
416

101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153

154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206

207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259

260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312

313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365

366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416

Transitions
Decisi
on
Event
Trans. Trans. Next
Next
Index Index
Name
Cost
Prob. Index State
1
2
S_0_2/Same/Null
0
0.9
1 S_0_2
1
3
S_0_2/Same/Arrive
5
0.1
6 S_1_2
2
2
S_0_2/Add/Null
0
0.9
2 S_0_3
2
3
S_0_2/Add/Arrive
5
0.1
7 S_1_3
3
2
S_0_3/Delete/Null
0
0.9
1 S_0_2
3
3
S_0_3/Delete/Arrive
5
0.1
6 S_1_2
4
2
S_0_3/Same/Null
0
0.9
2 S_0_3
4
3
S_0_3/Same/Arrive
5
0.1
7 S_1_3
5
2
S_0_3/Add/Null
0
0.9
3 S_0_4
5
3
S_0_3/Add/Arrive
5
0.1
8 S_1_4
6
2
S_0_4/Delete/Null
0
0.9
2 S_0_3
6
3
S_0_4/Delete/Arrive
5
0.1
7 S_1_3
7
2
S_0_4/Same/Null
0
0.9
3 S_0_4
7
3
S_0_4/Same/Arrive
5
0.1
8 S_1_4
8
2
S_0_4/Add/Null
0
0.9
4 S_0_5
8
3
S_0_4/Add/Arrive
5
0.1
9 S_1_5
9
2
S_0_5/Delete/Null
0
0.9
3 S_0_4
9
3
S_0_5/Delete/Arrive
5
0.1
8 S_1_4
10
2
S_0_5/Same/Null
0
0.9
4 S_0_5
10
3
S_0_5/Same/Arrive
5
0.1
9 S_1_5
11
2
S_0_5/Add/Null
0
0.9
5 S_0_6
11
3
S_0_5/Add/Arrive
5
0.1
10 S_1_6
12
2
S_0_6/Delete/Null
0
0.9
4 S_0_5
12
3
S_0_6/Delete/Arrive
5
0.1
9 S_1_5
13
2
S_0_6/Same/Null
0
0.9
5 S_0_6
13
3
S_0_6/Same/Arrive
5
0.1
10 S_1_6
14
1
S_1_2/Same/Depart
-20
0.06
1 S_0_2
14
2
S_1_2/Same/Null
0
0.84
6 S_1_2
14
3
S_1_2/Same/Arrive
5
0.1
11 S_2_2
15
1
S_1_2/Add/Depart
-20
0.06
2 S_0_3
15
2
S_1_2/Add/Null
0
0.84
7 S_1_3
15
3
S_1_2/Add/Arrive
5
0.1
12 S_2_3
16
1
S_1_3/Delete/Depart
-20
0.06
1 S_0_2
16
2
S_1_3/Delete/Null
0
0.84
6 S_1_2
16
3
S_1_3/Delete/Arrive
5
0.1
11 S_2_2
17
1
S_1_3/Same/Depart
-20
0.06
2 S_0_3
17
2
S_1_3/Same/Null
0
0.84
7 S_1_3
17
3
S_1_3/Same/Arrive
5
0.1
12 S_2_3
18
1
S_1_3/Add/Depart
-20
0.06
3 S_0_4
18
2
S_1_3/Add/Null
0
0.84
8 S_1_4
18
3
S_1_3/Add/Arrive
5
0.1
13 S_2_4
19
1
S_1_4/Delete/Depart
-20
0.06
2 S_0_3
19
2
S_1_4/Delete/Null
0
0.84
7 S_1_3
19
3
S_1_4/Delete/Arrive
5
0.1
12 S_2_3
20
1
S_1_4/Same/Depart
-20
0.06
3 S_0_4
20
2
S_1_4/Same/Null
0
0.84
8 S_1_4
20
3
S_1_4/Same/Arrive
5
0.1
13 S_2_4

21
21
21
22
22
22
23
23
23
24
24
24
25
25
25
26
26
26
27
27
27
28
28
28
29
29
29
30
30
30
31
31
31
32
32
32
33
33
33
34
34
34
35
35
35
36
36
36
37
37
37
38
38

1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2

S_1_4/Add/Depart
S_1_4/Add/Null
S_1_4/Add/Arrive
S_1_5/Delete/Depart
S_1_5/Delete/Null
S_1_5/Delete/Arrive
S_1_5/Same/Depart
S_1_5/Same/Null
S_1_5/Same/Arrive
S_1_5/Add/Depart
S_1_5/Add/Null
S_1_5/Add/Arrive
S_1_6/Delete/Depart
S_1_6/Delete/Null
S_1_6/Delete/Arrive
S_1_6/Same/Depart
S_1_6/Same/Null
S_1_6/Same/Arrive
S_2_2/Same/Depart
S_2_2/Same/Null
S_2_2/Same/Arrive
S_2_2/Add/Depart
S_2_2/Add/Null
S_2_2/Add/Arrive
S_2_3/Delete/Depart
S_2_3/Delete/Null
S_2_3/Delete/Arrive
S_2_3/Same/Depart
S_2_3/Same/Null
S_2_3/Same/Arrive
S_2_3/Add/Depart
S_2_3/Add/Null
S_2_3/Add/Arrive
S_2_4/Delete/Depart
S_2_4/Delete/Null
S_2_4/Delete/Arrive
S_2_4/Same/Depart
S_2_4/Same/Null
S_2_4/Same/Arrive
S_2_4/Add/Depart
S_2_4/Add/Null
S_2_4/Add/Arrive
S_2_5/Delete/Depart
S_2_5/Delete/Null
S_2_5/Delete/Arrive
S_2_5/Same/Depart
S_2_5/Same/Null
S_2_5/Same/Arrive
S_2_5/Add/Depart
S_2_5/Add/Null
S_2_5/Add/Arrive
S_2_6/Delete/Depart
S_2_6/Delete/Null

-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0

0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.06
0.84
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78

4
9
14
3
8
13
4
9
14
5
10
15
4
9
14
5
10
15
6
11
16
7
12
17
6
11
16
7
12
17
8
13
18
7
12
17
8
13
18
9
14
19
8
13
18
9
14
19
10
15
20
9
14

S_0_5
S_1_5
S_2_5
S_0_4
S_1_4
S_2_4
S_0_5
S_1_5
S_2_5
S_0_6
S_1_6
S_2_6
S_0_5
S_1_5
S_2_5
S_0_6
S_1_6
S_2_6
S_1_2
S_2_2
S_3_2
S_1_3
S_2_3
S_3_3
S_1_2
S_2_2
S_3_2
S_1_3
S_2_3
S_3_3
S_1_4
S_2_4
S_3_4
S_1_3
S_2_3
S_3_3
S_1_4
S_2_4
S_3_4
S_1_5
S_2_5
S_3_5
S_1_4
S_2_4
S_3_4
S_1_5
S_2_5
S_3_5
S_1_6
S_2_6
S_3_6
S_1_5
S_2_5

38
39
39
39
40
40
40
41
41
41
42
42
42
43
43
43
44
44
44
45
45
45
46
46
46
47
47
47
48
48
48
49
49
49
50
50
50
51
51
51
52
52
52
53
53
53
54
54
54
55
55
55
56

3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1

S_2_6/Delete/Arrive
S_2_6/Same/Depart
S_2_6/Same/Null
S_2_6/Same/Arrive
S_3_2/Same/Depart
S_3_2/Same/Null
S_3_2/Same/Arrive
S_3_2/Add/Depart
S_3_2/Add/Null
S_3_2/Add/Arrive
S_3_3/Delete/Depart
S_3_3/Delete/Null
S_3_3/Delete/Arrive
S_3_3/Same/Depart
S_3_3/Same/Null
S_3_3/Same/Arrive
S_3_3/Add/Depart
S_3_3/Add/Null
S_3_3/Add/Arrive
S_3_4/Delete/Depart
S_3_4/Delete/Null
S_3_4/Delete/Arrive
S_3_4/Same/Depart
S_3_4/Same/Null
S_3_4/Same/Arrive
S_3_4/Add/Depart
S_3_4/Add/Null
S_3_4/Add/Arrive
S_3_5/Delete/Depart
S_3_5/Delete/Null
S_3_5/Delete/Arrive
S_3_5/Same/Depart
S_3_5/Same/Null
S_3_5/Same/Arrive
S_3_5/Add/Depart
S_3_5/Add/Null
S_3_5/Add/Arrive
S_3_6/Delete/Depart
S_3_6/Delete/Null
S_3_6/Delete/Arrive
S_3_6/Same/Depart
S_3_6/Same/Null
S_3_6/Same/Arrive
S_4_2/Same/Depart
S_4_2/Same/Null
S_4_2/Same/Arrive
S_4_2/Add/Depart
S_4_2/Add/Null
S_4_2/Add/Arrive
S_4_3/Delete/Depart
S_4_3/Delete/Null
S_4_3/Delete/Arrive
S_4_3/Same/Depart

5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20

0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18

19
10
15
20
11
16
21
12
17
22
11
16
21
12
17
22
13
18
23
12
17
22
13
18
23
14
19
24
13
18
23
14
19
24
15
20
25
14
19
24
15
20
25
16
21
26
17
22
27
16
21
26
17

S_3_5
S_1_6
S_2_6
S_3_6
S_2_2
S_3_2
S_4_2
S_2_3
S_3_3
S_4_3
S_2_2
S_3_2
S_4_2
S_2_3
S_3_3
S_4_3
S_2_4
S_3_4
S_4_4
S_2_3
S_3_3
S_4_3
S_2_4
S_3_4
S_4_4
S_2_5
S_3_5
S_4_5
S_2_4
S_3_4
S_4_4
S_2_5
S_3_5
S_4_5
S_2_6
S_3_6
S_4_6
S_2_5
S_3_5
S_4_5
S_2_6
S_3_6
S_4_6
S_3_2
S_4_2
S_5_2
S_3_3
S_4_3
S_5_3
S_3_2
S_4_2
S_5_2
S_3_3

56
56
57
57
57
58
58
58
59
59
59
60
60
60
61
61
61
62
62
62
63
63
63
64
64
64
65
65
65
66
66
66
67
67
67
68
68
68
69
69
69
70
70
70
71
71
71
72
72
72
73
73
73

2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3

S_4_3/Same/Null
S_4_3/Same/Arrive
S_4_3/Add/Depart
S_4_3/Add/Null
S_4_3/Add/Arrive
S_4_4/Delete/Depart
S_4_4/Delete/Null
S_4_4/Delete/Arrive
S_4_4/Same/Depart
S_4_4/Same/Null
S_4_4/Same/Arrive
S_4_4/Add/Depart
S_4_4/Add/Null
S_4_4/Add/Arrive
S_4_5/Delete/Depart
S_4_5/Delete/Null
S_4_5/Delete/Arrive
S_4_5/Same/Depart
S_4_5/Same/Null
S_4_5/Same/Arrive
S_4_5/Add/Depart
S_4_5/Add/Null
S_4_5/Add/Arrive
S_4_6/Delete/Depart
S_4_6/Delete/Null
S_4_6/Delete/Arrive
S_4_6/Same/Depart
S_4_6/Same/Null
S_4_6/Same/Arrive
S_5_2/Same/Depart
S_5_2/Same/Null
S_5_2/Same/Arrive
S_5_2/Add/Depart
S_5_2/Add/Null
S_5_2/Add/Arrive
S_5_3/Delete/Depart
S_5_3/Delete/Null
S_5_3/Delete/Arrive
S_5_3/Same/Depart
S_5_3/Same/Null
S_5_3/Same/Arrive
S_5_3/Add/Depart
S_5_3/Add/Null
S_5_3/Add/Arrive
S_5_4/Delete/Depart
S_5_4/Delete/Null
S_5_4/Delete/Arrive
S_5_4/Same/Depart
S_5_4/Same/Null
S_5_4/Same/Arrive
S_5_4/Add/Depart
S_5_4/Add/Null
S_5_4/Add/Arrive

0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5

0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1

22
27
18
23
28
17
22
27
18
23
28
19
24
29
18
23
28
19
24
29
20
25
30
19
24
29
20
25
30
21
26
31
22
27
32
21
26
31
22
27
32
23
28
33
22
27
32
23
28
33
24
29
34

S_4_3
S_5_3
S_3_4
S_4_4
S_5_4
S_3_3
S_4_3
S_5_3
S_3_4
S_4_4
S_5_4
S_3_5
S_4_5
S_5_5
S_3_4
S_4_4
S_5_4
S_3_5
S_4_5
S_5_5
S_3_6
S_4_6
S_5_6
S_3_5
S_4_5
S_5_5
S_3_6
S_4_6
S_5_6
S_4_2
S_5_2
S_6_2
S_4_3
S_5_3
S_6_3
S_4_2
S_5_2
S_6_2
S_4_3
S_5_3
S_6_3
S_4_4
S_5_4
S_6_4
S_4_3
S_5_3
S_6_3
S_4_4
S_5_4
S_6_4
S_4_5
S_5_5
S_6_5

74
74
74
75
75
75
76
76
76
77
77
77
78
78
78
79
79
79
80
80
80
81
81
81
82
82
82
83
83
83
84
84
84
85
85
85
86
86
86
87
87
87
88
88
88
89
89
89
90
90
90
91
91

1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2

S_5_5/Delete/Depart
S_5_5/Delete/Null
S_5_5/Delete/Arrive
S_5_5/Same/Depart
S_5_5/Same/Null
S_5_5/Same/Arrive
S_5_5/Add/Depart
S_5_5/Add/Null
S_5_5/Add/Arrive
S_5_6/Delete/Depart
S_5_6/Delete/Null
S_5_6/Delete/Arrive
S_5_6/Same/Depart
S_5_6/Same/Null
S_5_6/Same/Arrive
S_6_2/Same/Depart
S_6_2/Same/Null
S_6_2/Same/Arrive
S_6_2/Add/Depart
S_6_2/Add/Null
S_6_2/Add/Arrive
S_6_3/Delete/Depart
S_6_3/Delete/Null
S_6_3/Delete/Arrive
S_6_3/Same/Depart
S_6_3/Same/Null
S_6_3/Same/Arrive
S_6_3/Add/Depart
S_6_3/Add/Null
S_6_3/Add/Arrive
S_6_4/Delete/Depart
S_6_4/Delete/Null
S_6_4/Delete/Arrive
S_6_4/Same/Depart
S_6_4/Same/Null
S_6_4/Same/Arrive
S_6_4/Add/Depart
S_6_4/Add/Null
S_6_4/Add/Arrive
S_6_5/Delete/Depart
S_6_5/Delete/Null
S_6_5/Delete/Arrive
S_6_5/Same/Depart
S_6_5/Same/Null
S_6_5/Same/Arrive
S_6_5/Add/Depart
S_6_5/Add/Null
S_6_5/Add/Arrive
S_6_6/Delete/Depart
S_6_6/Delete/Null
S_6_6/Delete/Arrive
S_6_6/Same/Depart
S_6_6/Same/Null

-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0

0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54

23
28
33
24
29
34
25
30
35
24
29
34
25
30
35
26
31
36
27
32
37
26
31
36
27
32
37
28
33
38
27
32
37
28
33
38
29
34
39
28
33
38
29
34
39
30
35
40
29
34
39
30
35

S_4_4
S_5_4
S_6_4
S_4_5
S_5_5
S_6_5
S_4_6
S_5_6
S_6_6
S_4_5
S_5_5
S_6_5
S_4_6
S_5_6
S_6_6
S_5_2
S_6_2
S_7_2
S_5_3
S_6_3
S_7_3
S_5_2
S_6_2
S_7_2
S_5_3
S_6_3
S_7_3
S_5_4
S_6_4
S_7_4
S_5_3
S_6_3
S_7_3
S_5_4
S_6_4
S_7_4
S_5_5
S_6_5
S_7_5
S_5_4
S_6_4
S_7_4
S_5_5
S_6_5
S_7_5
S_5_6
S_6_6
S_7_6
S_5_5
S_6_5
S_7_5
S_5_6
S_6_6

91
92
92
92
93
93
93
94
94
94
95
95
95
96
96
96
97
97
97
98
98
98
99
99
99
100
100
100
101
101
101
102
102
102
103
103
103
104
104
104
105
105
105
106
106
106
107
107
107
108
108
108
109

3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1

S_6_6/Same/Arrive
S_7_2/Same/Depart
S_7_2/Same/Null
S_7_2/Same/Arrive
S_7_2/Add/Depart
S_7_2/Add/Null
S_7_2/Add/Arrive
S_7_3/Delete/Depart
S_7_3/Delete/Null
S_7_3/Delete/Arrive
S_7_3/Same/Depart
S_7_3/Same/Null
S_7_3/Same/Arrive
S_7_3/Add/Depart
S_7_3/Add/Null
S_7_3/Add/Arrive
S_7_4/Delete/Depart
S_7_4/Delete/Null
S_7_4/Delete/Arrive
S_7_4/Same/Depart
S_7_4/Same/Null
S_7_4/Same/Arrive
S_7_4/Add/Depart
S_7_4/Add/Null
S_7_4/Add/Arrive
S_7_5/Delete/Depart
S_7_5/Delete/Null
S_7_5/Delete/Arrive
S_7_5/Same/Depart
S_7_5/Same/Null
S_7_5/Same/Arrive
S_7_5/Add/Depart
S_7_5/Add/Null
S_7_5/Add/Arrive
S_7_6/Delete/Depart
S_7_6/Delete/Null
S_7_6/Delete/Arrive
S_7_6/Same/Depart
S_7_6/Same/Null
S_7_6/Same/Arrive
S_8_2/Same/Depart
S_8_2/Same/Null
S_8_2/Same/Arrive
S_8_2/Add/Depart
S_8_2/Add/Null
S_8_2/Add/Arrive
S_8_3/Delete/Depart
S_8_3/Delete/Null
S_8_3/Delete/Arrive
S_8_3/Same/Depart
S_8_3/Same/Null
S_8_3/Same/Arrive
S_8_3/Add/Depart

5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20

0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18

40
31
36
41
32
37
42
31
36
41
32
37
42
33
38
43
32
37
42
33
38
43
34
39
44
33
38
43
34
39
44
35
40
45
34
39
44
35
40
45
36
41
46
37
42
47
36
41
46
37
42
47
38

S_7_6
S_6_2
S_7_2
S_8_2
S_6_3
S_7_3
S_8_3
S_6_2
S_7_2
S_8_2
S_6_3
S_7_3
S_8_3
S_6_4
S_7_4
S_8_4
S_6_3
S_7_3
S_8_3
S_6_4
S_7_4
S_8_4
S_6_5
S_7_5
S_8_5
S_6_4
S_7_4
S_8_4
S_6_5
S_7_5
S_8_5
S_6_6
S_7_6
S_8_6
S_6_5
S_7_5
S_8_5
S_6_6
S_7_6
S_8_6
S_7_2
S_8_2
S_9_2
S_7_3
S_8_3
S_9_3
S_7_2
S_8_2
S_9_2
S_7_3
S_8_3
S_9_3
S_7_4

109
109
110
110
110
111
111
111
112
112
112
113
113
113
114
114
114
115
115
115
116
116
116
117
117
117
118
118
118
119
119
119
120
120
120
121
121
121
122
122
122
123
123
123
124
124
124
125
125
125
126
126
126

2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3

S_8_3/Add/Null
S_8_3/Add/Arrive
S_8_4/Delete/Depart
S_8_4/Delete/Null
S_8_4/Delete/Arrive
S_8_4/Same/Depart
S_8_4/Same/Null
S_8_4/Same/Arrive
S_8_4/Add/Depart
S_8_4/Add/Null
S_8_4/Add/Arrive
S_8_5/Delete/Depart
S_8_5/Delete/Null
S_8_5/Delete/Arrive
S_8_5/Same/Depart
S_8_5/Same/Null
S_8_5/Same/Arrive
S_8_5/Add/Depart
S_8_5/Add/Null
S_8_5/Add/Arrive
S_8_6/Delete/Depart
S_8_6/Delete/Null
S_8_6/Delete/Arrive
S_8_6/Same/Depart
S_8_6/Same/Null
S_8_6/Same/Arrive
S_9_2/Same/Depart
S_9_2/Same/Null
S_9_2/Same/Arrive
S_9_2/Add/Depart
S_9_2/Add/Null
S_9_2/Add/Arrive
S_9_3/Delete/Depart
S_9_3/Delete/Null
S_9_3/Delete/Arrive
S_9_3/Same/Depart
S_9_3/Same/Null
S_9_3/Same/Arrive
S_9_3/Add/Depart
S_9_3/Add/Null
S_9_3/Add/Arrive
S_9_4/Delete/Depart
S_9_4/Delete/Null
S_9_4/Delete/Arrive
S_9_4/Same/Depart
S_9_4/Same/Null
S_9_4/Same/Arrive
S_9_4/Add/Depart
S_9_4/Add/Null
S_9_4/Add/Arrive
S_9_5/Delete/Depart
S_9_5/Delete/Null
S_9_5/Delete/Arrive

0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
5

0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1

43
48
37
42
47
38
43
48
39
44
49
38
43
48
39
44
49
40
45
50
39
44
49
40
45
50
41
46
51
42
47
52
41
46
51
42
47
52
43
48
53
42
47
52
43
48
53
44
49
54
43
48
53

S_8_4
S_9_4
S_7_3
S_8_3
S_9_3
S_7_4
S_8_4
S_9_4
S_7_5
S_8_5
S_9_5
S_7_4
S_8_4
S_9_4
S_7_5
S_8_5
S_9_5
S_7_6
S_8_6
S_9_6
S_7_5
S_8_5
S_9_5
S_7_6
S_8_6
S_9_6
S_8_2
S_9_2
S_10_2
S_8_3
S_9_3
S_10_3
S_8_2
S_9_2
S_10_2
S_8_3
S_9_3
S_10_3
S_8_4
S_9_4
S_10_4
S_8_3
S_9_3
S_10_3
S_8_4
S_9_4
S_10_4
S_8_5
S_9_5
S_10_5
S_8_4
S_9_4
S_10_4

127
127
127
128
128
128
129
129
129
130
130
130
131
131
131
132
132
132
133
133
133
134
134
134
135
135
135
136
136
136
137
137
137
138
138
138
139
139
139
140
140
140
141
141
141
142
142
142
143
143
143

1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3
1
2
3

S_9_5/Same/Depart
S_9_5/Same/Null
S_9_5/Same/Arrive
S_9_5/Add/Depart
S_9_5/Add/Null
S_9_5/Add/Arrive
S_9_6/Delete/Depart
S_9_6/Delete/Null
S_9_6/Delete/Arrive
S_9_6/Same/Depart
S_9_6/Same/Null
S_9_6/Same/Arrive
S_10_2/Same/Depart
S_10_2/Same/Null
S_10_2/Same/Arrive
S_10_2/Add/Depart
S_10_2/Add/Null
S_10_2/Add/Arrive
S_10_3/Delete/Depart
S_10_3/Delete/Null
S_10_3/Delete/Arrive
S_10_3/Same/Depart
S_10_3/Same/Null
S_10_3/Same/Arrive
S_10_3/Add/Depart
S_10_3/Add/Null
S_10_3/Add/Arrive
S_10_4/Delete/Depart
S_10_4/Delete/Null
S_10_4/Delete/Arrive
S_10_4/Same/Depart
S_10_4/Same/Null
S_10_4/Same/Arrive
S_10_4/Add/Depart
S_10_4/Add/Null
S_10_4/Add/Arrive
S_10_5/Delete/Depart
S_10_5/Delete/Null
S_10_5/Delete/Arrive
S_10_5/Same/Depart
S_10_5/Same/Null
S_10_5/Same/Arrive
S_10_5/Add/Depart
S_10_5/Add/Null
S_10_5/Add/Arrive
S_10_6/Delete/Depart
S_10_6/Delete/Null
S_10_6/Delete/Arrive
S_10_6/Same/Depart
S_10_6/Same/Null
S_10_6/Same/Arrive

-20
0
5
-20
0
5
-20
0
5
-20
0
5
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50
-20
0
50

0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1
0.12
0.78
0.1
0.12
0.78
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.18
0.72
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.24
0.66
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.3
0.6
0.1
0.36
0.54
0.1
0.36
0.54
0.1

44
49
54
45
50
55
44
49
54
45
50
55
46
51
51
47
52
52
46
51
51
47
52
52
48
53
53
47
52
52
48
53
53
49
54
54
48
53
53
49
54
54
50
55
55
49
54
54
50
55
55

S_8_5
S_9_5
S_10_5
S_8_6
S_9_6
S_10_6
S_8_5
S_9_5
S_10_5
S_8_6
S_9_6
S_10_6
S_9_2
S_10_2
S_10_2
S_9_3
S_10_3
S_10_3
S_9_2
S_10_2
S_10_2
S_9_3
S_10_3
S_10_3
S_9_4
S_10_4
S_10_4
S_9_3
S_10_3
S_10_3
S_9_4
S_10_4
S_10_4
S_9_5
S_10_5
S_10_5
S_9_4
S_10_4
S_10_4
S_9_5
S_10_5
S_10_5
S_9_6
S_10_6
S_10_6
S_9_5
S_10_5
S_10_5
S_9_6
S_10_6
S_10_6

Markov Process Data

Type
Title
Problem Type
Model Type

CTMC Data
FQ_4
Finite Queue
CTMC

Build Model
Maximum number in system
Number of Channels
Max. Number of Channels
Economic Measure
Time Measure
Cost per Arrival
Cost per Departure
Cost per Balk
Holding Cost Rate for Items in the System
Discount Rate
Cost cost rate for open channels
Arrival Rate
Channel
Service Rate

Build Data Table

10
2
5
Cost
Hour
5
-20
50
6
0.1
10
10
1
5

/Hour
/Hour
/Hour
/Hour
2
4

3
3

4
2

5
1

Markov Process Model

Type
Title
Model Type
State Variables
Action Variables
Event Variables
State Blocks
Decision Blocks
Transition Blocks
Economic Measure
Time Measure
Discount Rate
Goal
Step Interval
Channels

CTMC Model
FQ_4
Finite Queue
6
0
6
0
0
5
Cost
Hour
10.000%
None
1
2

Change Model
List States
List Elements

State Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost

35
1
36
1

20

Definitions
s1: Number
s2: Number
s3: Number
s4: Number
s5: Number
s6: Number

State
Queue Chan. 1
8
1
9
2
4
2
1
1
0
0
8
1
Q8_C
1
6
10

in
in
in
in
in
in

Queue
Service
Service
Service
Service
Service

1
2
3
4
5

Transitions
State/Event Transition Equations, Rates and Costs
Queue Chan. 1
State
8
1
Transition Transition caused by balk
State Queue Chan. 1
Feasible
1
1
1
Min
8
1
Max
8
1
Change State
Next State

0
0
Queue Chan. 1
8
1

Transition Transitions caused by Arrivals when all chann

State Queue Chan. 1
Feasible
1
1
1
Min
0
1

Max
Change State
Next State

1
0
Queue Chan. 1
9
1

Transition Transitions caused by Arrivals when some ch

State Queue Chan. 1
Feasible
1
0
1
Min
0
0
Max
0
1
Change State
Next State

0
0
Queue Chan. 1
8
1

Transition Transitions caused by Departures when the q

State Queue Chan. 1
Feasible
1
1
1
Min
1
1
Max
8
1
Change State
Next State

-1
0
Queue Chan. 1
7
1

Transition Transitions caused by Departures when the q

State Queue Chan. 1
Feasible
1
0
1
Min
0
0
Max
0
1
Change State
Next State

0
0
Queue Chan. 1
8
1

Transfer to Markov Analysis

Event Vector

Chan. 2 Chan. 3 Chan. 4 Chan. 5

1
0
0
0
2
1
1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
1
0
0
0
1
Q8_C11
6
6
6
6
84

Index
Step
Count
Feasible
Min
Max
Name
Cost
Rates

4
1
8
1

0
0

Event
Arrival Dep. 1
1
0
2
2
4
2
1
1
0
0
1
1
Arrival
5
-20
10
5

Definitions
e1: Arrival Event
e2: Complete Service
e3: Complete Service
e4: Complete Service
e5: Complete Service
e6: Complete Service

Equations, Rates and Costs

Chan. 2 Chan. 3 Chan. 4 Chan. 5
1
0
0
0 Q8_C11

at
at
at
at
at

1
2
3
4
5

Event

Arrival Dep. 1
1
0

Event
1
Min
Max

Arrival Dep. 1
1
1
1
0
1
0

Event
1
Min

Arrival Dep. 1
1
1
1
0

sed by balk
Chan. 2 Chan. 3 Chan. 4 Chan. 5
1
1
1
1
1
0
0
0
1
0
0
0

Feasible

0
0
0
0
Chan. 2 Chan. 3 Chan. 4 Chan. 5 Index Feasible
Name
1
0
0
0
12
1 Q8_C11

used by Arrivals when all channels

Chan. 2 Chan. 3 Chan.
1
1
1
0

are busy
4 Chan. 5
1
1
0
0

Feasible

Max

0
0
0
0
Chan. 2 Chan. 3 Chan. 4 Chan. 5 Index Feasible
1
0
0
0
###
0

used by Arrivals when some channels are idle

Chan. 2 Chan. 3 Chan. 4 Chan. 5
1
1
1
1
0
0
0
0
1
0
0
0

0
1
0
0
Chan. 2 Chan. 3 Chan. 4 Chan. 5 Index Feasible
1
1
0
0
###
0

used by Departures when the queue is not empty

Chan. 2 Chan. 3 Chan. 4 Chan. 5
1
1
1
1
1
0
0
0
1
0
0
0

Name
Err:502

Feasible

Event
1
Min
Max

Arrival Dep. 1
1
1
1
0
1
0

Event
1
Min
Max

Arrival Dep. 1
0
1
0
0
0
1

Event
1
Min
Max

Arrival Dep. 1
0
1
0
0
0
1

Name
#VALUE!

Feasible

0
0
0
0
Chan. 2 Chan. 3 Chan. 4 Chan. 5 Index Feasible
Name
1
0
0
0
11
1 Q7_C11

used by Departures when the queue is empty

Chan. 2 Chan. 3 Chan. 4 Chan. 5
1
1
1
1
0
0
0
0
1
0
0
0

Feasible

0
0
0
0
Chan. 2 Chan. 3 Chan. 4 Chan. 5 Index Feasible
Name
1
0
0
0
12
1 Q8_C11

Summary
Name: Q8_C11/Arrival
Dep. 2 Dep. 3 Dep. 4 Dep. 5
0
0
0
0
2
1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
1
0
0
0
-20
4

-20
3

-20
2

-20
1

Feasible:
Subset:
1

Arrival
5
10

Dep. 2 Dep. 3 Dep. 4 Dep. 5

0
0
0
0 Arrival

Dep. 2 Dep. 3 Dep. 4 Dep. 5

1
1
1
1
0
0
0
0
0
0
0
0

Dep. 2 Dep. 3 Dep. 4 Dep. 5

1
1
1
1
0
0
0
0

State
1
0

Transition
Feasible:
1
Subset:
1

Transition Summary
Name: Q8_C11/Arrival
Feasible:
1
Subset:
1
Transition 1 Summary
Feasible:
1
Cost:
50
Rate:
10
Next State:
12
Exit Model:
0
Index:
1

Transition 2 Summary
Feasible:
0
Cost:
5
Rate:
10

Dep. 2 Dep. 3 Dep. 4 Dep. 5

1
1
1
1
0
0
0
0
0
0
0
0

Dep. 2 Dep. 3 Dep. 4 Dep. 5

1
1
1
1
0
0
0
0
1
0
0
0

Dep. 2 Dep. 3 Dep. 4 Dep. 5

1
1
1
1
0
0
0
0
1
1
1
1

Next State:
Exit Model:
Index:

###
0
9999

Transition 3 Summary
Feasible:
0
Cost:
5
Rate:
10
Next State:
###
Exit Model:
0
Index:
9999

Transition 4 Summary
Feasible:
0
Cost:
5
Rate:
10
Next State:
11
Exit Model:
0
Index:
9999

Transition 5 Summary
Feasible:
0
Cost:
5
Rate:
10
Next State:
12
Exit Model:
0
Index:
9999

Markov Process Rate Matrix

Type:
Title:

CTMC
FQ_4

Step
Calculate Measure
Change
Hour
Analyze
State
Index
Names
Economics
0
Q0_C00
1
Q0_C01
Transient
2
Q0_C10
3
Q0_C11
Steady State
4
Q1_C11
5
Q2_C11
n-step Probabilities
6
Q3_C11
7
Q4_C11
First Pass
8
Q5_C11
9
Q6_C11
Simulate
10
Q7_C11
11
Q8_C11
Absorbing States

12
Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11
Sum

Matrix Analyzed.
12 Recurrent States
1 Recurrent State Class
0 Transient States
0
1
2
3
Q0_C00 Q0_C01 Q0_C10 Q0_C11
0
0
10
0
4
0
0
10
5
0
0
10
0
5
4
0
0
0
0
9
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
9
5
14
29

4
5
6
7
8
9
10
11
Q1_C11 Q2_C11 Q3_C11 Q4_C11 Q5_C11 Q6_C11 Q7_C11 Q8_C11
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
10
0
0
0
0
0
0
0
0
10
0
0
0
0
0
0
9
0
10
0
0
0
0
0
0
9
0
10
0
0
0
0
0
0
9
0
10
0
0
0
0
0
0
9
0
10
0
0
0
0
0
0
9
0
10
0
0
0
0
0
0
9
0
10
0
0
0
0
0
0
9
10
19
19
19
19
19
19
19
20

Sum
10
14
15
19
19
19
19
19
19
19
19
19

Status
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1

0
1
2
3
4
5
6
7
8
9
10
11

Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11

Embedded Markov Matrix

Expected
0
1
2
Time
Q0_C00 Q0_C01 Q0_C10
0.1
0
0
1
0.071429 0.285714
0
0
0.066667 0.333333
0
0
0.052632
0 0.263158 0.210526
0.052632
0
0
0
0.052632
0
0
0
0.052632
0
0
0
0.052632
0
0
0
0.052632
0
0
0
0.052632
0
0
0
0.052632
0
0
0
0.052632
0
0
0

3
Q0_C11
0
0.714286
0.666667
0
0.473684
0
0
0
0
0
0
0

4
5
6
7
8
9
10
11
Q1_C11 Q2_C11 Q3_C11 Q4_C11 Q5_C11 Q6_C11 Q7_C11 Q8_C11
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0.526316
0
0
0
0
0
0
0
0 0.526316
0
0
0
0
0
0
0.473684
0 0.526316
0
0
0
0
0
0 0.473684
0 0.526316
0
0
0
0
0
0 0.473684
0 0.526316
0
0
0
0
0
0 0.473684
0 0.526316
0
0
0
0
0
0 0.473684
0 0.526316
0
0
0
0
0
0 0.473684
0 0.526316
0
0
0
0
0
0 0.473684 0.526316

Economic Data
Type:
Title:

CTMC
FQ_4

Calculate
Matrix

conomic Measure
Discount Rate

Cost
0.1

0
1
2
3
4
5
6
7
8
9
10
11

State
Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11

State
Combine Combine
Cost
d Cost
d Cost
Rate
Rate
per Step
20
70
7
26
-4 -0.28571
30
-20 -1.33333
36
-94 -4.94737
42
-88 -4.63158
48
-82 -4.31579
54
-76
-4
60
-70 -3.68421
66
-64 -3.36842
72
-58 -3.05263
78
-52 -2.73684
84
404 21.26316

Transition Cost Matrix

1
2
3

Q0_C00 Q0_C01 Q0_C10 Q0_C11 Q1_C11 Q2_C11 Q3_C11 Q4_C11

0
0
5
0
0
0
0
0
-20
0
0
5
0
0
0
0
-20
0
0
5
0
0
0
0
0
-20
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
0
0
0
0
0
0
0
-20
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

10

11

Q5_C11 Q6_C11 Q7_C11 Q8_C11

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
5
0
0
0
0
5
0
0
-20
0
5
0
0
-20
0
5
0
0
-20
50

Steady State Analysis

Type:
Title:
Solve by:

CTMC
FQ_4
Inverse

Matrix

0
1
2
3
4
Q0_C00 Q0_C01 Q0_C10 Q0_C11 Q1_C11
Steady State (Time) 0.02665 0.02297 0.03492 0.06433 0.07148
Transition Time

0.1 0.07143 0.06667 0.05263 0.05263

teady State (Steps)

0.0144 0.01738 0.02831 0.06605 0.07339

Expected NPW -10.604 -17.079

-17.71

-19.44 -12.107

Expected
5
6
7
8
9
10
11
Transition
Q2_C11 Q3_C11 Q4_C11 Q5_C11 Q6_C11 Q7_C11 Q8_C11
Time
0.07942 0.08824 0.09805 0.10894 0.12105 0.1345 0.14944 0.05403776
0.05263 0.05263 0.05263 0.05263 0.05263 0.05263 0.05263
0.08154

0.0906 0.10067 0.11185 0.12428 0.13809 0.15343

3.17193 25.1545 52.7904 85.1905 121.603

161.39 204.012

Average
Cost
rate
8.04335151

FQ_4 Model Lists

State List
Index
1
2
3
4
5
6
7
8
9
10
11
12

Count
0
1
2
3
7
11
15
19
23
27
31
35

Name
Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11

Queue

Chan. 1
0
0
0
0
1
2
3
4
5
6
7
8

Chan. 2
0
0
1
1
1
1
1
1
1
1
1
1

Chan. 3
0
1
0
1
1
1
1
1
1
1
1
1

0
0
0
0
0
0
0
0
0
0
0
0

Event List
Chan. 4

Chan. 5
0
0
0
0
0
0
0
0
0
0
0
0

Trans.
Range

Cost
0
0
0
0
0
0
0
0
0
0
0
0

20
26
30
36
42
48
54
60
66
72
78
84

1
3
5
8
11
14
17
20
23
26
29
32

Index Count Name Arrival

1
1
Dep. 2
0
2
2
Dep. 1
0
3
4
Arrival
1

Dep. 1 Dep. 2 Dep. 3 Dep. 4 Dep. 5

0
1
0
0
0
1
0
0
0
0
0
0
0
0
0

Cost
-20
-20
5

Transitions
State Event
Index Index Index
1
1
3
2
2
1
3
2
3
4
3
2
5
3
3
6
4
1
7
4
2
8
4
3
9
5
1
10
5
2
11
5
3
12
6
1
13
6
2
14
6
3
15
7
1
16
7
2
17
7
3
18
8
1
19
8
2
20
8
3
21
9
1
22
9
2
23
9
3
24
10
1
25
10
2
26
10
3
27
11
1
28
11
2
29
11
3
30
12
1
31
12
2
32
12
3

Name
Q0_C00/Arrival
Q0_C01/Dep. 2
Q0_C01/Arrival
Q0_C10/Dep. 1
Q0_C10/Arrival
Q0_C11/Dep. 2
Q0_C11/Dep. 1
Q0_C11/Arrival
Q1_C11/Dep. 2
Q1_C11/Dep. 1
Q1_C11/Arrival
Q2_C11/Dep. 2
Q2_C11/Dep. 1
Q2_C11/Arrival
Q3_C11/Dep. 2
Q3_C11/Dep. 1
Q3_C11/Arrival
Q4_C11/Dep. 2
Q4_C11/Dep. 1
Q4_C11/Arrival
Q5_C11/Dep. 2
Q5_C11/Dep. 1
Q5_C11/Arrival
Q6_C11/Dep. 2
Q6_C11/Dep. 1
Q6_C11/Arrival
Q7_C11/Dep. 2
Q7_C11/Dep. 1
Q7_C11/Arrival
Q8_C11/Dep. 2
Q8_C11/Dep. 1
Q8_C11/Arrival

Cost
5
-20
5
-20
5
-20
-20
5
-20
-20
5
-20
-20
5
-20
-20
5
-20
-20
5
-20
-20
5
-20
-20
5
-20
-20
5
-20
-20
50

Next
Next
Rate State Name
10
3 Q0_C10
4
1 Q0_C00
10
4 Q0_C11
5
1 Q0_C00
10
4 Q0_C11
4
3 Q0_C10
5
2 Q0_C01
10
5 Q1_C11
4
4 Q0_C11
5
4 Q0_C11
10
6 Q2_C11
4
5 Q1_C11
5
5 Q1_C11
10
7 Q3_C11
4
6 Q2_C11
5
6 Q2_C11
10
8 Q4_C11
4
7 Q3_C11
5
7 Q3_C11
10
9 Q5_C11
4
8 Q4_C11
5
8 Q4_C11
10
10 Q6_C11
4
9 Q5_C11
5
9 Q5_C11
10
11 Q7_C11
4
10 Q6_C11
5
10 Q6_C11
10
12 Q8_C11
4
11 Q7_C11
5
11 Q7_C11
10
12 Q8_C11

Markov Chain Data

Type
Title
Problem Type
Model Type

DTMC Data
FQ_5
Finite Queue
DTMC

Build Model
Maximum number in system
Number of Channels
Max. Number of Channels
Economic Measure
Time Measure
Cost per Arrival
Cost per Departure
Cost per Balk
Holding Cost Rate for Items in the System
Discount Rate
Cost cost rate for open channels
Arrival Rate
Channel
Service Rate
Time Interval
Holding Cost for Items in the System
Cost for open channels
Discount Rate
Arrival Probability
Channel
Service Probability

Build Data Table

10
2
5
Cost
Hour
5
-20
50
6
0.1
10
10
1
5
0.01
0.06
0.02
0.001
0.1
1
0.05

/Hour
/Hour
/Hour
/Hour
2
4
Hour
/Period
/Period
/Period
/Period
2
0.04

3
3

4
2

5
1

3
0.03

4
0.02

5
0.01

Markov Chain Model

Type
Title
Model Type
State Variables
Action Variables
Event Variables
State Blocks
Decision Blocks
Transition Blocks
Economic Measure
Time Measure
Discount Rate
Goal
Step Interval
Channels

DTMC Model
FQ_5
Finite Queue
6
0
6
0
0
5
Cost
Hour
0.100%
None
1
2

Change Model

Transfer to Markov

List States

Transfer to DP Solv

List Elements

State Vector

Index
Step
Count
Feasible
Min
Max
Name
Cost

35
1
36
1

0.04

Definitions
s1: Number
s2: Number
s3: Number
s4: Number
s5: Number
s6: Number

State
Queue Chan. 1 Chan. 2
8
1
1
9
2
2
4
2
1
1
1
1
0
0
0
8
1
1
Q8_C
1
1
0.06
0.02
0.06

in
in
in
in
in
in

Queue
Service
Service
Service
Service
Service

1
2
3
4
5

Transitions
State/Event Transition Equations, Probabilities and C
Queue Chan. 1 Chan. 2
State
8
1
1
Transition Transition caused by balk
State Queue Chan. 1 Chan.
Feasible
1
1
1
Min
8
1
Max
8
1
Change State
Next State

2
1
1
1

0
0
0
Queue Chan. 1 Chan. 2
8
1
1

Transition Transitions caused by Arrivals when all channel

State Queue Chan. 1 Chan. 2
Feasible
1
1
1
1
Min
0
1
1

Max
Change State
Next State

1
0
0
Queue Chan. 1 Chan. 2
9
1
1

Transition Transitions caused by Arrivals when some chan

State Queue Chan. 1 Chan. 2
Feasible
1
0
1
1
Min
0
0
0
Max
0
1
1
Change State
Next State

0
0
0
Queue Chan. 1 Chan. 2
8
1
1

Transition Transitions caused by Departures when the que

State Queue Chan. 1 Chan. 2
Feasible
1
1
1
1
Min
1
1
1
Max
8
1
1
Change State
Next State

-1
0
0
Queue Chan. 1 Chan. 2
7
1
1

Transition Transitions caused by Departures when the que

State Queue Chan. 1 Chan. 2
Feasible
1
0
1
1
Min
0
0
0
Max
0
1
1
Change State
Next State

0
0
0
Queue Chan. 1 Chan. 2
8
1
1

Transfer to Markov Analysis

Transfer to DP Solver

Event Vector

Chan. 3 Chan. 4 Chan. 5

0
0
0
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
0.06

0.06

0.06

Q8_C11
0.6

Index
Step
Count
Feasible
Min
Max
Name
Cost
Probability

4
1
8
1

0
0

Event
Arrival Dep. 1 Dep. 2
1
0
0
2
2
2
4
2
1
1
1
1
0
0
0
1
1
1
Arrival
5
-20
-20
0.1
0.05
0.04

Definitions
e1: Arrival Event
e2: Complete Service
e3: Complete Service
e4: Complete Service
e5: Complete Service
e6: Complete Service

ns, Probabilities and Costs

Chan. 3 Chan. 4 Chan. 5
0
0
0 Q8_C11

Chan. 3 Chan. 4 Chan. 5

1
1
1
0
0
0
0
0
0

Feasible

at
at
at
at
at

1
2
3
4
5

Event

Arrival Dep. 1 Dep. 2

1
0
0

Event
1
Min
Max

Arrival Dep. 1 Dep. 2

1
1
1
1
0
0
1
0
0

Event
1
Min

Arrival Dep. 1 Dep. 2

1
1
1
1
0
0

0
0
0
Chan. 3 Chan. 4 Chan. 5 Index Feasible
Name
0
0
0
12
1 Q8_C11

Arrivals when all channels

Chan. 3 Chan.
1
0

are busy
4 Chan. 5
1
1
0
0

Feasible

Max

0
0
0
Chan. 3 Chan. 4 Chan. 5 Index Feasible
0
0
0
###
0

Arrivals when some channels are idle

Chan. 3 Chan. 4 Chan. 5
1
1
1
0
0
0
0
0
0

1
0
0
Chan. 3 Chan. 4 Chan. 5 Index Feasible
1
0
0
###
0

Departures when the queue is not empty

Chan. 3 Chan. 4 Chan. 5
1
1
1
0
0
0
0
0
0

Name
Err:502

Feasible

Event
1
Min
Max

Arrival Dep. 1 Dep. 2

1
1
1
1
0
0
1
0
0

Event
1
Min
Max

Arrival Dep. 1 Dep. 2

0
1
1
0
0
0
0
1
1

Event
1
Min
Max

Arrival Dep. 1 Dep. 2

0
1
1
0
0
0
0
1
1

Name
#VALUE!

Feasible

0
0
0
Chan. 3 Chan. 4 Chan. 5 Index Feasible
Name
0
0
0
11
1 Q7_C11

Departures when the queue is empty

Chan. 3 Chan. 4 Chan. 5
1
1
1
0
0
0
0
0
0

Feasible

0
0
0
Chan. 3 Chan. 4 Chan. 5 Index Feasible
Name
0
0
0
12
1 Q8_C11

Summary
Name: Q8_C11/Arrival
Dep. 3 Dep. 4 Dep. 5
0
0
0
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
-20
0.03

-20
0.02

-20
0.01

Feasible:
Subset:
1

Arrival
5
0.1

Dep. 3 Dep. 4 Dep. 5

0
0
0 Arrival

Dep. 3 Dep. 4 Dep. 5

1
1
1
0
0
0
0
0
0

Dep. 3 Dep. 4 Dep. 5

1
1
1
0
0
0

State
1
0

Transition
Feasible:
1
Subset:
1

Transition Summary
Name: Q8_C11/Arrival
Feasible:
1
Subset:
1
Transition 1 Summary
Feasible:
1
Cost:
50
Probability:
0.1
Next State:
12
Exit Model:
0
Index:
1

Transition 2 Summary
Feasible:
0
Cost:
5
Probability:
0.1

Dep. 3 Dep. 4 Dep. 5

1
1
1
0
0
0
0
0
0

Dep. 3 Dep. 4 Dep. 5

1
1
1
0
0
0
0
0
0

Dep. 3 Dep. 4 Dep. 5

1
1
1
0
0
0
1
1
1

Next State:
Exit Model:
Index:

###
0
9999

Transition 3 Summary
Feasible:
0
Cost:
5
Probability:
0.1
Next State:
###
Exit Model:
0
Index:
9999

Transition 4 Summary
Feasible:
0
Cost:
5
Probability:
0.1
Next State:
11
Exit Model:
0
Index:
9999

Transition 5 Summary
Feasible:
0
Cost:
5
Probability:
0.1
Next State:
12
Exit Model:
0
Index:
9999

Markov Chain Transition Matrix

Type:
Title:

DTMC
FQ_5

Step
Calculate Measure
Change
Hour
Analyze
State
Index
Names
Economics
0
Q0_C00
1
Q0_C01
Transient
2
Q0_C10
3
Q0_C11
Steady State
4
Q1_C11
5
Q2_C11
n-step Probabilities
6
Q3_C11
7
Q4_C11
First Pass
8
Q5_C11
9
Q6_C11
Simulate
10
Q7_C11
11
Q8_C11
Absorbing States

12
Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11
Sum

Matrix Analyzed.
12 Recurrent States
1 Recurrent State Class
0 Transient States
0
1
2
3
Q0_C00 Q0_C01 Q0_C10 Q0_C11
0.9
0
0.1
0
0.04
0.86
0
0.1
0.05
0
0.85
0.1
0
0.05
0.04
0.81
0
0
0
0.09
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0.99
0.91
0.99
1.1

4
5
6
7
8
9
10
11
Q1_C11 Q2_C11 Q3_C11 Q4_C11 Q5_C11 Q6_C11 Q7_C11 Q8_C11
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0.1
0
0
0
0
0
0
0
0.81
0.1
0
0
0
0
0
0
0.09
0.81
0.1
0
0
0
0
0
0
0.09
0.81
0.1
0
0
0
0
0
0
0.09
0.81
0.1
0
0
0
0
0
0
0.09
0.81
0.1
0
0
0
0
0
0
0.09
0.81
0.1
0
0
0
0
0
0
0.09
0.81
0.1
0
0
0
0
0
0
0.09
0.91
1
1
1
1
1
1
1
1.01

Sum
1
1
1
1
1
1
1
1
1
1
1
1

Status
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1
Class-1

Economic Data
Type:
Title:

DTMC
FQ_5

Calculate
Matrix

conomic Measure
Discount Rate

Cost
0.001

0
1
2
3
4
5
6
7
8
9
10
11

State
Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11

0
State
Combine
Cost
d Cost
Q0_C00
0.04
0.54
0
0.1
-0.2
-20
0.06
-0.44
-20
0.12
-1.18
0
0.18
-1.12
0
0.24
-1.06
0
0.3
-1
0
0.36
-0.94
0
0.42
-0.88
0
0.48
-0.82
0
0.54
-0.76
0
0.6
3.8
0

Transition Cost Matrix

1
2
3

Q0_C01 Q0_C10 Q0_C11 Q1_C11 Q2_C11 Q3_C11 Q4_C11 Q5_C11

0
5
0
0
0
0
0
0
0
0
5
0
0
0
0
0
0
0
5
0
0
0
0
0
-20
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
5
0
0
0
0
0
0
-20
0
0
0
0
0
0
0
0
-20
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0

10

11

Q6_C11 Q7_C11 Q8_C11

0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
5
0
0
0
5
0
-20
0
5
0
-20 5.494505

FQ_5 Model Lists

State List
Index
1
2
3
4
5
6
7
8
9
10
11
12

Count
0
1
2
3
7
11
15
19
23
27
31
35

Name
Q0_C00
Q0_C01
Q0_C10
Q0_C11
Q1_C11
Q2_C11
Q3_C11
Q4_C11
Q5_C11
Q6_C11
Q7_C11
Q8_C11

Queue

Chan. 1
0
0
0
0
1
2
3
4
5
6
7
8

Chan. 2
0
0
1
1
1
1
1
1
1
1
1
1

Chan. 3
0
1
0
1
1
1
1
1
1
1
1
1

0
0
0
0
0
0
0
0
0
0
0
0

Event List
Chan. 4

Chan. 5
0
0
0
0
0
0
0
0
0
0
0
0

0
0
0
0
0
0
0
0
0
0
0
0

Cost
0.04
0.1
0.06
0.12
0.18
0.24
0.3
0.36
0.42
0.48
0.54
0.6

Trans.
Range
2
5
8
12
16
20
24
28
32
36
40
44

Index Count Name Arrival

1
1
Dep. 2
0
2
2
Dep. 1
0
3
4
Arrival
1

Dep. 1 Dep. 2 Dep. 3 Dep. 4 Dep. 5

0
1
0
0
0
1
0
0
0
0
0
0
0
0
0

Cost
-20
-20
5

Transitions
State Event
Index Index Index
1
1
3
2
1
4
3
2
1
4
2
3
5
2
4
6
3
2
7
3
3
8
3
4
9
4
1
10
4
2
11
4
3
12
4
4
13
5
1
14
5
2
15
5
3
16
5
4
17
6
1
18
6
2
19
6
3
20
6
4
21
7
1
22
7
2
23
7
3
24
7
4
25
8
1
26
8
2
27
8
3
28
8
4
29
9
1
30
9
2
31
9
3
32
9
4
33
10
1
34
10
2
35
10
3
36
10
4
37
11
1
38
11
2
39
11
3
40
11
4
41
12
1
42
12
2
43
12
3
44
12
4

Name
Q0_C00/Arrival
Q0_C00/Null
Q0_C01/Dep. 2
Q0_C01/Arrival
Q0_C01/Null
Q0_C10/Dep. 1
Q0_C10/Arrival
Q0_C10/Null
Q0_C11/Dep. 2
Q0_C11/Dep. 1
Q0_C11/Arrival
Q0_C11/Null
Q1_C11/Dep. 2
Q1_C11/Dep. 1
Q1_C11/Arrival
Q1_C11/Null
Q2_C11/Dep. 2
Q2_C11/Dep. 1
Q2_C11/Arrival
Q2_C11/Null
Q3_C11/Dep. 2
Q3_C11/Dep. 1
Q3_C11/Arrival
Q3_C11/Null
Q4_C11/Dep. 2
Q4_C11/Dep. 1
Q4_C11/Arrival
Q4_C11/Null
Q5_C11/Dep. 2
Q5_C11/Dep. 1
Q5_C11/Arrival
Q5_C11/Null
Q6_C11/Dep. 2
Q6_C11/Dep. 1
Q6_C11/Arrival
Q6_C11/Null
Q7_C11/Dep. 2
Q7_C11/Dep. 1
Q7_C11/Arrival
Q7_C11/Null
Q8_C11/Dep. 2
Q8_C11/Dep. 1
Q8_C11/Arrival
Q8_C11/Null

Cost
5
0
-20
5
0
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
5
0
-20
-20
50
0

Next
Next
Prob. State Name
0.1
3 Q0_C10
0.9
1 Q0_C00
0.04
1 Q0_C00
0.1
4 Q0_C11
0.86
2 Q0_C01
0.05
1 Q0_C00
0.1
4 Q0_C11
0.85
3 Q0_C10
0.04
3 Q0_C10
0.05
2 Q0_C01
0.1
5 Q1_C11
0.81
4 Q0_C11
0.04
4 Q0_C11
0.05
4 Q0_C11
0.1
6 Q2_C11
0.81
5 Q1_C11
0.04
5 Q1_C11
0.05
5 Q1_C11
0.1
7 Q3_C11
0.81
6 Q2_C11
0.04
6 Q2_C11
0.05
6 Q2_C11
0.1
8 Q4_C11
0.81
7 Q3_C11
0.04
7 Q3_C11
0.05
7 Q3_C11
0.1
9 Q5_C11
0.81
8 Q4_C11
0.04
8 Q4_C11
0.05
8 Q4_C11
0.1
10 Q6_C11
0.81
9 Q5_C11
0.04
9 Q5_C11
0.05
9 Q5_C11
0.1
11 Q7_C11
0.81
10 Q6_C11
0.04
10 Q6_C11
0.05
10 Q6_C11
0.1
12 Q8_C11
0.81
11 Q7_C11
0.04
11 Q7_C11
0.05
11 Q7_C11
0.1
12 Q8_C11
0.81
12 Q8_C11