Fig. 1

Graphical model for an MDP. Open circles represent states, squares represent actions, and filled circles represent rewards

Graphical model for an MDP. Open circles represent states, squares represent actions, and filled circles represent rewards