7/31/2019 Kaelbling Reinforcement
1/49
7/31/2019 Kaelbling Reinforcement
2/49
a
T
s
i
rBI
R
7/31/2019 Kaelbling Reinforcement
3/49
7/31/2019 Kaelbling Reinforcement
4/49
7/31/2019 Kaelbling Reinforcement
5/49
7/31/2019 Kaelbling Reinforcement
6/49
Finite horizon, h=4
Infinite horizon, =0.9
Average reward
+2
+10
+11
7/31/2019 Kaelbling Reinforcement
7/49
7/31/2019 Kaelbling Reinforcement
8/49
7/31/2019 Kaelbling Reinforcement
9/49
1 2 3 N-1 N 2N 2N-1 N+3 N+2 N+1
a = 0 a = 1
r = 0
r = 1
1 2 3 N-1 N 2N 2N-1 N+3 N+2 N+1
a = 0 a = 1
7/31/2019 Kaelbling Reinforcement
10/49
7/31/2019 Kaelbling Reinforcement
11/49
7/31/2019 Kaelbling Reinforcement
12/49
7/31/2019 Kaelbling Reinforcement
13/49
7/31/2019 Kaelbling Reinforcement
14/49
7/31/2019 Kaelbling Reinforcement
15/49
7/31/2019 Kaelbling Reinforcement
16/49
AHC
RL
vs
r
a
7/31/2019 Kaelbling Reinforcement
17/49
7/31/2019 Kaelbling Reinforcement
18/49
7/31/2019 Kaelbling Reinforcement
19/49
7/31/2019 Kaelbling Reinforcement
20/49
. . . . . . . Goal1 2 3 n
7/31/2019 Kaelbling Reinforcement
21/49
7/31/2019 Kaelbling Reinforcement
22/49
7/31/2019 Kaelbling Reinforcement
23/49
7/31/2019 Kaelbling Reinforcement
24/49
7/31/2019 Kaelbling Reinforcement
25/49
7/31/2019 Kaelbling Reinforcement
26/49
7/31/2019 Kaelbling Reinforcement
27/49
7/31/2019 Kaelbling Reinforcement
28/49
G
Start
Goal
(a)
G
(b)
G
(c)
7/31/2019 Kaelbling Reinforcement
29/49
7/31/2019 Kaelbling Reinforcement
30/49
s b1
b2
b3
g a
7/31/2019 Kaelbling Reinforcement
31/49
2/5 1/5
2/5
printer
office
+100
hallhall
7/31/2019 Kaelbling Reinforcement
32/49
7/31/2019 Kaelbling Reinforcement
33/49
ib a
SE
7/31/2019 Kaelbling Reinforcement
34/49
7/31/2019 Kaelbling Reinforcement
35/49
7/31/2019 Kaelbling Reinforcement
36/49
7/31/2019 Kaelbling Reinforcement
37/49
7/31/2019 Kaelbling Reinforcement
38/49
7/31/2019 Kaelbling Reinforcement
39/49
7/31/2019 Kaelbling Reinforcement
40/49
7/31/2019 Kaelbling Reinforcement
41/49
7/31/2019 Kaelbling Reinforcement
42/49
7/31/2019 Kaelbling Reinforcement
43/49
7/31/2019 Kaelbling Reinforcement
44/49
7/31/2019 Kaelbling Reinforcement
45/49
7/31/2019 Kaelbling Reinforcement
46/49
7/31/2019 Kaelbling Reinforcement
47/49
7/31/2019 Kaelbling Reinforcement
48/49
7/31/2019 Kaelbling Reinforcement
49/49