Recent advances in neurosciences and cognitive sciences show us that the human neocortex is not a slave to the experiences from our perception and that the memories stored in hippocampus are goal weighted during the replay of the experiences for the purpose of relearning from them. Temporal difference reinforcement learning systems that use neural networks as function approximators rely on an experience replay memory structure similar to the hippocampus. We bring forward this similarity and present a novel way of using a goal weighted prioritization of the memory that is biologically inspired. Furthermore, we introduce a novel prioritization criteria called Variety of Experience Index, or VEI, for weighting the selection of the experiences that are stored in the replay memory. Weighting the experiences based on two different extremes of VEI can behaviourally modify the agent's learning process, generating different types of learning agents that exhibit different personality traits along the dimension of Openness to Experience. (C) 2019 Elsevier B.V. All rights reserved.

Towards learning agents with personality traits: Modeling Openness to Experience

Ramicic M.;Bonarini A.
2019

Abstract

Recent advances in neurosciences and cognitive sciences show us that the human neocortex is not a slave to the experiences from our perception and that the memories stored in hippocampus are goal weighted during the replay of the experiences for the purpose of relearning from them. Temporal difference reinforcement learning systems that use neural networks as function approximators rely on an experience replay memory structure similar to the hippocampus. We bring forward this similarity and present a novel way of using a goal weighted prioritization of the memory that is biologically inspired. Furthermore, we introduce a novel prioritization criteria called Variety of Experience Index, or VEI, for weighting the selection of the experiences that are stored in the replay memory. Weighting the experiences based on two different extremes of VEI can behaviourally modify the agent's learning process, generating different types of learning agents that exhibit different personality traits along the dimension of Openness to Experience. (C) 2019 Elsevier B.V. All rights reserved.
COGNITIVE SYSTEMS RESEARCH
Cognitive architecture; Intelligent agents; Neural networks; Personality traits; Reinforcement learning
File in questo prodotto:
File Dimensione Formato  
LearningAgentsWithPersonalityTraits.pdf

accesso aperto

Descrizione: Author's accepted manuscript
: Post-Print (DRAFT o Author’s Accepted Manuscript-AAM)
Dimensione 373.16 kB
Formato Adobe PDF
373.16 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11311/1120069
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 0
social impact