Quiz: Reinforcement Learning

Question 1

For the following action-selection method, indicate which option describes it best.

With probability p, select argmax _a Q(s,a). With probability 1 − p, select a random action. Let p = 0.99.

Mostly exploration

Mostly exploitation

Mix of both

Question 2

For the following action-selection method, indicate which option describes it best.

Select action a with probability

where τ is a temperature parameter that is decreased over time.

Mostly exploration

Mostly exploitation

Mix of both

Question 3

For the following action-selection method, indicate which option describes it best.

Always select a random action.

Mostly exploration

Mostly exploitation

Mix of both

Question 4

What model would be learned from the above observed episodes?

Note: T(s,a,s’) represents the transition probability from state s to state s’ under action a. Use a period as a decimal separator.

T(A, south, C) =

Question 5

What model would be learned from the above observed episodes?

Note: T(s,a,s’) represents the transition probability from state s to state s’ under action a. Use a period as a decimal separator.

T(B, east, C) =

Question 6

What model would be learned from the above observed episodes?

Note: T(s,a,s’) represents the transition probability from state s to state s’ under action a. Use a period as a decimal separator.

T(C, south, E) =

Question 7

What model would be learned from the above observed episodes?

Note: T(s,a,s’) represents the transition probability from state s to state s’ under action a. Use a period as a decimal separator.

T(C, south, D) =

Question 8

In the ε-greedy approach to action selection in reinforcement learning, which of the following values of ε makes the approach identical to a purely greedy approach?

ε = 0

ε = 0.25

ε = 0.5

ε = 0.75

ε = 1

Posting submission...