Quiz: Three state MDP

Consider the three state MDP for a robot trying to walk. The three states of the robot are ‘Fallen’, ‘Standing’, and ‘Moving’. In each of the states the robot can take either a slow or a fast action, denoted by black and green arrows, respectively. The slow action is more likely to keep the robot upright, but the fast action enables the robot to gain more distance.

Each edge in the image is labeled with two numbers: the transition probability and the reward.

Notice that these numbers are different for each question.

Question 1

For this question the variable transition probabilities are A = 0.57, B = 0.43, C = 0.10, D = 0.90, E = 0.83, and F = 0.17. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 2

For this question the variable transition probabilities are A = 0.91, B = 0.09, C = 0.14, D = 0.86, E = 0.97, and F = 0.03. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 3

For this question the variable transition probabilities are A = 0.76, B = 0.24, C = 0.64, D = 0.36, E = 0.95, and F = 0.05. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 4

For this question the variable transition probabilities are A = 0.87, B = 0.13, C = 0.66, D = 0.34, E = 0.87, and F = 0.13. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 5

For this question the variable transition probabilities are A = 0.28, B = 0.72, C = 0.37, D = 0.63, E = 0.69, and F = 0.31. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 6

For this question the variable transition probabilities are A = 0.46, B = 0.54, C = 0.48, D = 0.52, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 7

For this question the variable transition probabilities are A = 0.96, B = 0.04, C = 0.78, D = 0.22, E = 0.95, and F = 0.05. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 8

For this question the variable transition probabilities are A = 0.90, B = 0.10, C = 0.60, D = 0.40, E = 0.70, and F = 0.30. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 9

For this question the variable transition probabilities are A = 0.69, B = 0.31, C = 0.22, D = 0.78, E = 0.78, and F = 0.22. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 10

For this question the variable transition probabilities are A = 0.71, B = 0.29, C = 0.41, D = 0.59, E = 0.65, and F = 0.35. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 11

For this question the variable transition probabilities are A = 0.74, B = 0.26, C = 0.97, D = 0.03, E = 0.80, and F = 0.20. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 12

For this question the variable transition probabilities are A = 0.64, B = 0.36, C = 0.69, D = 0.31, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 13

For this question the variable transition probabilities are A = 0.61, B = 0.39, C = 0.47, D = 0.53, E = 0.84, and F = 0.16. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 14

For this question the variable transition probabilities are A = 0.56, B = 0.44, C = 0.62, D = 0.38, E = 0.72, and F = 0.28. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 15

For this question the variable transition probabilities are A = 0.40, B = 0.60, C = 0.62, D = 0.38, E = 0.93, and F = 0.07. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 16

For this question the variable transition probabilities are A = 0.67, B = 0.33, C = 0.61, D = 0.39, E = 0.78, and F = 0.22. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 17

For this question the variable transition probabilities are A = 0.21, B = 0.79, C = 0.71, D = 0.29, E = 0.76, and F = 0.24. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 18

For this question the variable transition probabilities are A = 0.50, B = 0.50, C = 0.02, D = 0.98, E = 0.76, and F = 0.24. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 19

For this question the variable transition probabilities are A = 0.26, B = 0.74, C = 0.20, D = 0.80, E = 0.83, and F = 0.17. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 20

For this question the variable transition probabilities are A = 0.64, B = 0.36, C = 0.15, D = 0.85, E = 0.84, and F = 0.16. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 21

For this question the variable transition probabilities are A = 0.21, B = 0.79, C = 0.84, D = 0.16, E = 0.85, and F = 0.15. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 22

For this question the variable transition probabilities are A = 0.90, B = 0.10, C = 0.61, D = 0.39, E = 0.94, and F = 0.06. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 23

For this question the variable transition probabilities are A = 0.86, B = 0.14, C = 0.13, D = 0.87, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 24

For this question the variable transition probabilities are A = 0.69, B = 0.31, C = 0.63, D = 0.37, E = 0.79, and F = 0.21. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 25

For this question the variable transition probabilities are A = 0.03, B = 0.97, C = 0.22, D = 0.78, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 26

For this question the variable transition probabilities are A = 0.80, B = 0.20, C = 0.89, D = 0.11, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 27

For this question the variable transition probabilities are A = 0.70, B = 0.30, C = 0.78, D = 0.22, E = 0.67, and F = 0.33. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 28

For this question the variable transition probabilities are A = 0.76, B = 0.24, C = 0.64, D = 0.36, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 29

For this question the variable transition probabilities are A = 0.76, B = 0.24, C = 0.03, D = 0.97, E = 0.81, and F = 0.19. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 30

For this question the variable transition probabilities are A = 0.65, B = 0.35, C = 0.27, D = 0.73, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 31

For this question the variable transition probabilities are A = 0.44, B = 0.56, C = 0.79, D = 0.21, E = 0.92, and F = 0.08. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 32

For this question the variable transition probabilities are A = 0.73, B = 0.27, C = 0.23, D = 0.77, E = 0.67, and F = 0.33. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 33

For this question the variable transition probabilities are A = 0.85, B = 0.15, C = 0.46, D = 0.54, E = 0.93, and F = 0.07. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 34

For this question the variable transition probabilities are A = 0.17, B = 0.83, C = 0.45, D = 0.55, E = 0.91, and F = 0.09. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 35

For this question the variable transition probabilities are A = 0.26, B = 0.74, C = 0.40, D = 0.60, E = 0.92, and F = 0.08. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 36

For this question the variable transition probabilities are A = 0.91, B = 0.09, C = 1.00, D = 0.00, E = 0.85, and F = 0.15. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 37

For this question the variable transition probabilities are A = 0.32, B = 0.68, C = 0.20, D = 0.80, E = 0.84, and F = 0.16. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 38

For this question the variable transition probabilities are A = 0.69, B = 0.31, C = 0.93, D = 0.07, E = 0.72, and F = 0.28. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 39

For this question the variable transition probabilities are A = 0.80, B = 0.20, C = 0.83, D = 0.17, E = 0.76, and F = 0.24. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 40

For this question the variable transition probabilities are A = 0.14, B = 0.86, C = 0.48, D = 0.52, E = 0.96, and F = 0.04. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 41

For this question the variable transition probabilities are A = 0.66, B = 0.34, C = 0.74, D = 0.26, E = 0.95, and F = 0.05. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 42

For this question the variable transition probabilities are A = 0.04, B = 0.96, C = 0.06, D = 0.94, E = 0.89, and F = 0.11. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 43

For this question the variable transition probabilities are A = 0.78, B = 0.22, C = 0.24, D = 0.76, E = 0.81, and F = 0.19. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 44

For this question the variable transition probabilities are A = 0.12, B = 0.88, C = 0.16, D = 0.84, E = 0.94, and F = 0.06. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 45

For this question the variable transition probabilities are A = 0.71, B = 0.29, C = 0.70, D = 0.30, E = 0.78, and F = 0.22. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 46

For this question the variable transition probabilities are A = 0.10, B = 0.90, C = 0.35, D = 0.65, E = 0.72, and F = 0.28. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 47

For this question the variable transition probabilities are A = 0.72, B = 0.28, C = 0.76, D = 0.24, E = 0.86, and F = 0.14. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 48

For this question the variable transition probabilities are A = 0.98, B = 0.02, C = 0.86, D = 0.14, E = 0.94, and F = 0.06. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 49

For this question the variable transition probabilities are A = 0.97, B = 0.03, C = 0.94, D = 0.06, E = 0.74, and F = 0.26. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 50

For this question the variable transition probabilities are A = 0.34, B = 0.66, C = 0.54, D = 0.46, E = 0.89, and F = 0.11. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 51

For this question the variable transition probabilities are A = 0.39, B = 0.61, C = 0.13, D = 0.87, E = 0.82, and F = 0.18. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 52

For this question the variable transition probabilities are A = 0.23, B = 0.77, C = 0.00, D = 1.00, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 53

For this question the variable transition probabilities are A = 0.73, B = 0.27, C = 0.63, D = 0.37, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 54

For this question the variable transition probabilities are A = 0.72, B = 0.28, C = 0.68, D = 0.32, E = 0.83, and F = 0.17. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 55

For this question the variable transition probabilities are A = 0.21, B = 0.79, C = 0.28, D = 0.72, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 56

For this question the variable transition probabilities are A = 0.53, B = 0.47, C = 0.22, D = 0.78, E = 0.70, and F = 0.30. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 57

For this question the variable transition probabilities are A = 0.23, B = 0.77, C = 0.51, D = 0.49, E = 0.77, and F = 0.23. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 58

For this question the variable transition probabilities are A = 0.27, B = 0.73, C = 0.25, D = 0.75, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 59

For this question the variable transition probabilities are A = 0.72, B = 0.28, C = 0.21, D = 0.79, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 60

For this question the variable transition probabilities are A = 0.41, B = 0.59, C = 0.05, D = 0.95, E = 0.70, and F = 0.30. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the policy iteration method, what is the value of state ‘Standing’?

Question 1

For this question the variable transition probabilities are A = 0.57, B = 0.43, C = 0.10, D = 0.90, E = 0.83, and F = 0.17. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 2

For this question the variable transition probabilities are A = 0.91, B = 0.09, C = 0.14, D = 0.86, E = 0.97, and F = 0.03. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 3

For this question the variable transition probabilities are A = 0.76, B = 0.24, C = 0.64, D = 0.36, E = 0.95, and F = 0.05. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 4

For this question the variable transition probabilities are A = 0.87, B = 0.13, C = 0.66, D = 0.34, E = 0.87, and F = 0.13. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 5

For this question the variable transition probabilities are A = 0.28, B = 0.72, C = 0.37, D = 0.63, E = 0.69, and F = 0.31. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 6

For this question the variable transition probabilities are A = 0.46, B = 0.54, C = 0.48, D = 0.52, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 7

For this question the variable transition probabilities are A = 0.96, B = 0.04, C = 0.78, D = 0.22, E = 0.95, and F = 0.05. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 8

For this question the variable transition probabilities are A = 0.90, B = 0.10, C = 0.60, D = 0.40, E = 0.70, and F = 0.30. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 9

For this question the variable transition probabilities are A = 0.69, B = 0.31, C = 0.22, D = 0.78, E = 0.78, and F = 0.22. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 10

For this question the variable transition probabilities are A = 0.71, B = 0.29, C = 0.41, D = 0.59, E = 0.65, and F = 0.35. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 11

For this question the variable transition probabilities are A = 0.74, B = 0.26, C = 0.97, D = 0.03, E = 0.80, and F = 0.20. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 12

For this question the variable transition probabilities are A = 0.64, B = 0.36, C = 0.69, D = 0.31, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 13

For this question the variable transition probabilities are A = 0.61, B = 0.39, C = 0.47, D = 0.53, E = 0.84, and F = 0.16. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 14

For this question the variable transition probabilities are A = 0.56, B = 0.44, C = 0.62, D = 0.38, E = 0.72, and F = 0.28. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 15

For this question the variable transition probabilities are A = 0.40, B = 0.60, C = 0.62, D = 0.38, E = 0.93, and F = 0.07. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 16

For this question the variable transition probabilities are A = 0.67, B = 0.33, C = 0.61, D = 0.39, E = 0.78, and F = 0.22. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 17

For this question the variable transition probabilities are A = 0.21, B = 0.79, C = 0.71, D = 0.29, E = 0.76, and F = 0.24. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 18

For this question the variable transition probabilities are A = 0.50, B = 0.50, C = 0.02, D = 0.98, E = 0.76, and F = 0.24. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 19

For this question the variable transition probabilities are A = 0.26, B = 0.74, C = 0.20, D = 0.80, E = 0.83, and F = 0.17. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 20

For this question the variable transition probabilities are A = 0.64, B = 0.36, C = 0.15, D = 0.85, E = 0.84, and F = 0.16. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 21

For this question the variable transition probabilities are A = 0.21, B = 0.79, C = 0.84, D = 0.16, E = 0.85, and F = 0.15. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 22

For this question the variable transition probabilities are A = 0.90, B = 0.10, C = 0.61, D = 0.39, E = 0.94, and F = 0.06. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 23

For this question the variable transition probabilities are A = 0.86, B = 0.14, C = 0.13, D = 0.87, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 24

For this question the variable transition probabilities are A = 0.69, B = 0.31, C = 0.63, D = 0.37, E = 0.79, and F = 0.21. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 25

For this question the variable transition probabilities are A = 0.03, B = 0.97, C = 0.22, D = 0.78, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 26

For this question the variable transition probabilities are A = 0.80, B = 0.20, C = 0.89, D = 0.11, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 27

For this question the variable transition probabilities are A = 0.70, B = 0.30, C = 0.78, D = 0.22, E = 0.67, and F = 0.33. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 28

For this question the variable transition probabilities are A = 0.76, B = 0.24, C = 0.64, D = 0.36, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 29

For this question the variable transition probabilities are A = 0.76, B = 0.24, C = 0.03, D = 0.97, E = 0.81, and F = 0.19. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 30

For this question the variable transition probabilities are A = 0.65, B = 0.35, C = 0.27, D = 0.73, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 31

For this question the variable transition probabilities are A = 0.44, B = 0.56, C = 0.79, D = 0.21, E = 0.92, and F = 0.08. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 32

For this question the variable transition probabilities are A = 0.73, B = 0.27, C = 0.23, D = 0.77, E = 0.67, and F = 0.33. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 33

For this question the variable transition probabilities are A = 0.85, B = 0.15, C = 0.46, D = 0.54, E = 0.93, and F = 0.07. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 34

For this question the variable transition probabilities are A = 0.17, B = 0.83, C = 0.45, D = 0.55, E = 0.91, and F = 0.09. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 35

For this question the variable transition probabilities are A = 0.26, B = 0.74, C = 0.40, D = 0.60, E = 0.92, and F = 0.08. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 36

For this question the variable transition probabilities are A = 0.91, B = 0.09, C = 1.00, D = 0.00, E = 0.85, and F = 0.15. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 37

For this question the variable transition probabilities are A = 0.32, B = 0.68, C = 0.20, D = 0.80, E = 0.84, and F = 0.16. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 38

For this question the variable transition probabilities are A = 0.69, B = 0.31, C = 0.93, D = 0.07, E = 0.72, and F = 0.28. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 39

For this question the variable transition probabilities are A = 0.80, B = 0.20, C = 0.83, D = 0.17, E = 0.76, and F = 0.24. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 40

For this question the variable transition probabilities are A = 0.14, B = 0.86, C = 0.48, D = 0.52, E = 0.96, and F = 0.04. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 41

For this question the variable transition probabilities are A = 0.66, B = 0.34, C = 0.74, D = 0.26, E = 0.95, and F = 0.05. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 42

For this question the variable transition probabilities are A = 0.04, B = 0.96, C = 0.06, D = 0.94, E = 0.89, and F = 0.11. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 43

For this question the variable transition probabilities are A = 0.78, B = 0.22, C = 0.24, D = 0.76, E = 0.81, and F = 0.19. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 44

For this question the variable transition probabilities are A = 0.12, B = 0.88, C = 0.16, D = 0.84, E = 0.94, and F = 0.06. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 45

For this question the variable transition probabilities are A = 0.71, B = 0.29, C = 0.70, D = 0.30, E = 0.78, and F = 0.22. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 46

For this question the variable transition probabilities are A = 0.10, B = 0.90, C = 0.35, D = 0.65, E = 0.72, and F = 0.28. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 47

For this question the variable transition probabilities are A = 0.72, B = 0.28, C = 0.76, D = 0.24, E = 0.86, and F = 0.14. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 48

For this question the variable transition probabilities are A = 0.98, B = 0.02, C = 0.86, D = 0.14, E = 0.94, and F = 0.06. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 49

For this question the variable transition probabilities are A = 0.97, B = 0.03, C = 0.94, D = 0.06, E = 0.74, and F = 0.26. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 50

For this question the variable transition probabilities are A = 0.34, B = 0.66, C = 0.54, D = 0.46, E = 0.89, and F = 0.11. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 51

For this question the variable transition probabilities are A = 0.39, B = 0.61, C = 0.13, D = 0.87, E = 0.82, and F = 0.18. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 52

For this question the variable transition probabilities are A = 0.23, B = 0.77, C = 0.00, D = 1.00, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 53

For this question the variable transition probabilities are A = 0.73, B = 0.27, C = 0.63, D = 0.37, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 54

For this question the variable transition probabilities are A = 0.72, B = 0.28, C = 0.68, D = 0.32, E = 0.83, and F = 0.17. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 55

For this question the variable transition probabilities are A = 0.21, B = 0.79, C = 0.28, D = 0.72, E = 0.99, and F = 0.01. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 56

For this question the variable transition probabilities are A = 0.53, B = 0.47, C = 0.22, D = 0.78, E = 0.70, and F = 0.30. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 57

For this question the variable transition probabilities are A = 0.23, B = 0.77, C = 0.51, D = 0.49, E = 0.77, and F = 0.23. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 58

For this question the variable transition probabilities are A = 0.27, B = 0.73, C = 0.25, D = 0.75, E = 0.73, and F = 0.27. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 59

For this question the variable transition probabilities are A = 0.72, B = 0.28, C = 0.21, D = 0.79, E = 0.66, and F = 0.34. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Question 60

For this question the variable transition probabilities are A = 0.41, B = 0.59, C = 0.05, D = 0.95, E = 0.70, and F = 0.30. Let the maximum error between consecutive iterations ε=0.01, and the discount factor γ=0.2. Round your answers to two decimal places and use a period as a decimal separator.

Using the value iteration method, what is the value of state ‘Moving’?

Posting submission...