说明：  确定性清洗机器人MDP清洁机器人收集使用，也有它的充电电池。状态描述了机器人的位置和动作描述运动方向。机器人可以移动到左边或右边。第一（1）和最终的（6）的状态是所述终端的状态。的目标是找到最大化从任何初始状态的返回的最优策略。
(The deterministic cleaning-robot MDP a cleaning robot has to collect a used can also has to recharge its batteries. the state describes the position of the robot and the action describes the direction of motion. The robot can move to the left or to the right. The first (1) and the final (6) states are the terminal states. The goal is to find an optimal policy that maximizes the return any initial state. )