Hands-On Intelligent Agents with OpenAI Gym

Implementing an epsilon decay schedule

We can decay (or decrease) the value linearly (in the following left-hand side graph), exponentially (in the following right-hand side graph) or using some other decay schedule. Linear and exponential schedules are the most commonly used decay schedules for the exploration parameter :

In the preceding graphs, you can see how the epsilon (exploration) value varies with the different schedule schemes (linear ...