We analyze XCS learning capabilities in stochastic environments where the result of agent actions can be uncertain. We show that XCS can cope when the degree of uncertainty is limited. We propose an extension to XCS, called XCSm, that can learn optimal solutions for higher degrees of uncertainty. We test XCSm when the uncertainty affects the whole environment and when the uncertainty is limited to some areas. Finally, we show that XCSm is a proper extension of XCS, in that it coincides with it when it is applied to deterministic environments.

An extension to the XCS classifier system for stochastic environments

LANZI, PIER LUCA;COLOMBETTI, MARCO
1999

Abstract

We analyze XCS learning capabilities in stochastic environments where the result of agent actions can be uncertain. We show that XCS can cope when the degree of uncertainty is limited. We propose an extension to XCS, called XCSm, that can learn optimal solutions for higher degrees of uncertainty. We test XCSm when the uncertainty affects the whole environment and when the uncertainty is limited to some areas. Finally, we show that XCSm is a proper extension of XCS, in that it coincides with it when it is applied to deterministic environments.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11311/569573
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 22
social impact