Re: [MMLF-support] question about defaultStateDimDiscretizations

[Jan H. M. <jh...@in...>]

Hello trex,
sorry for the late reply (I have been on vacation last week). The 
"defaultStateDimDiscretizations" is actually only relevant for 
continuous state spaces. For discrete ones, just use the TabularStorage 
function approximator (not CMAC). If you are dealing with a continuous 
state space and use e.g. the CMAC function approximator, the 
"defaultStateDimDiscretizations" determines how many tiles per dimension 
are used. I.e., a uniform tiling is used consisting of 
defaultStateDimDiscretizations^n tiles (where n is the number of 
dimensions). See also here:
http://www.incompleteideas.net/sutton/book/ebook/node88.html#SECTION04232000000000000000

The whole "defaultStateDimDiscretizations" design is admittedly not very 
clean and we plan to redesign it in the future.

Regards,
Jan

Am 01.05.2011 23:21, schrieb trex 279:
> Hi,
> I was just wondering what the option "defaultStateDimDiscretizations" 
> does. In the documentation, it says "The default “resolution” the 
> agent uses for every dimension" but it's not very clear to me. Suppose 
> I have a discrete 1-d state space of 10 items, and I'm using a CMAC 
> function approximator, what should I set this value as?
>
> Thanks,
> T
>
>
> ------------------------------------------------------------------------------
> WhatsUp Gold - Download Free Network Management Software
> The most intuitive, comprehensive, and cost-effective network
> management toolset available today.  Delivers lowest initial
> acquisition cost and overall TCO of any competing solution.
> http://p.sf.net/sfu/whatsupgold-sd
>
>
> _______________________________________________
> MMLF-support mailing list
> MML...@li...
> https://lists.sourceforge.net/lists/listinfo/mmlf-support


-- 
  Dipl. Inf. Jan Hendrik Metzen

  Universität Bremen
  FB 3 - Mathematik und Informatik
  AG Robotik
  Robert-Hooke-Straße 5
  28359 Bremen, Germany

  Besuchsadresse im Gebäude Unicom 1:
  Mary-Somerville-Str. 9
  28359 Bremen, Germany

  Phone: +49 (0)421 178 45-4123
  Fax:   +49 (0)421 178 45-4150
  E-Mail: jh...@in...

  Weitere Informationen: http://www.informatik.uni-bremen.de/robotik