In one general aspect, a method can include identifying a current user state, associating a first action and a second action with the current user state, associating a first value and a first probability with a first new user state based on a possible performing of the first action in the current user state, associating a second value and a second probability with a second new user state based on a possible performing of the second action in the current user state, calculating a first overall value for the first action based on the first value and the first probability, calculating a second overall value for the second action based on the second value and the second probability, and providing the first action to the computing device based on determining that the first overall value is greater than the second overall value.
展开▼
