Hands-On Intelligent Agents with OpenAI Gym

The policy gradient theorem

Because policy is a probability distribution function that describes the probability distribution over actions given the state and parameters by definition, the double summation terms over the states and the actions can be expressed as the expectation of the score function scaled by reward over distribution . This is ...