a) How do model-based learning methods in RL work? b) How do model-free learning methods in...

  

Transcribed Image Text:

a) How do model-based learning methods in RL work? b) How do model-free learning methods in RL work? c) We talked about the following example for the model-based learning? Explain this example. Input Policy Observed Episodes (Training) Learned Model Episode 1 Episode 2 T(s, a, s) A B C D CKE C, east, D, -1 D, exit, x, +10 Episode 3 B, east, C, -1 B, east, C, -1 C, east, D, -1 D, exit, x, +10 T(B, east, C)=1.00 T(C, east, D) = 0.75 T(C, east, A) 0.25 Episode 4 E, north, C, -1 Assume: y = 1 No discounting C, east, D, -1 D, exit, x, +10 E, north, C, -1 C, east, A, -1 R(s, a, s') R(B, east, C)=-1 R(C, east, D)=-1 R(D, exit, x) +10 A, exit, x, -10 a) How do model-based learning methods in RL work? b) How do model-free learning methods in RL work? c) We talked about the following example for the model-based learning? Explain this example. Input Policy Observed Episodes (Training) Learned Model Episode 1 Episode 2 T(s, a, s) A B C D CKE C, east, D, -1 D, exit, x, +10 Episode 3 B, east, C, -1 B, east, C, -1 C, east, D, -1 D, exit, x, +10 T(B, east, C)=1.00 T(C, east, D) = 0.75 T(C, east, A) 0.25 Episode 4 E, north, C, -1 Assume: y = 1 No discounting C, east, D, -1 D, exit, x, +10 E, north, C, -1 C, east, A, -1 R(s, a, s') R(B, east, C)=-1 R(C, east, D)=-1 R(D, exit, x) +10 A, exit, x, -10