Making the value approaches to 0 as K increases.

Hi, I have this one line in my code for the value of Epsilon (Epsilon Greedy Algorithm) which i want to approach to zero as k increases (1.2.3......10000), but by doing so as in the following line, it gets below 1 even when k = 2, so i want the epsilon value to approach to 0 but a little bit slowly. Thank you so much.

   epsilon = 1/k;

Answer 1

[Geoff Hayes]

Aftab - If you want to slow down epsilon's approach to zero as k increases, then you could do something like the following

 % create an array of linearly spaced numbers
 epsilonVector = fliplr(linspace(eps,1,10000));

So the linspace function will create a vector of 10000 numbers that are linearly spaced between eps and 1. We then flip the vector from right to left so that epsilonVector(1) is 1, and epsilonVector(10000) is eps. If you want different lower and upper bounds on epsilon, then you can change the inputs to linspace.

I'm not sure how you want to use epsilon in your algorithm; perhaps an alternative approach is needed if you don't want linearly spaced points.

[Aftab Ahmed Khan]

Hi Geoff, I think your approach will work for me, i will test it tomorrow morning. I think it is according to my requirement. i will let you know tomorrow.