%0 Conference Paper %B Proc. 17th International Conference on Artificial Neural Networks (ICANN 2007), Part II %D 2007 %T Biasing Neural Networks Towards Exploration or Exploitation Using Neuromodulation %A Parussel, Karla %A Lola Cañamero %E de Sá, Joaquim Marques %E Alexandre, Luís A. %E Duch, Włodzisław %E Mandic, Danilo %X Taking neuromodulation as a mechanism underlying emotions, this paper investigates how such a mechanism can bias an artificial neural network towards exploration of new courses of action, as seems to be the case in positive emotions, or exploitation of known possibilities, as in negative emotions such as predatory fear. We use neural networks of spiking leaky integrate-and-fire neurons acting as minimal disturbance systems, and test them with continuous actions. The networks have to balance the activations of all their output neurons concurrently. We have found that having the middle layer modulate the output layer helps balance the activations of the output neurons. A second discovery is that when the network is modulated in this way, it performs better at tasks requiring the exploitation of actions that are found to be rewarding. This is complementary to previous findings where having the input layer modulate the middle layer biases the network towards exploration of alternative actions. We conclude that a network can be biased towards either exploration of exploitation depending on which layers are being modulated. %B Proc. 17th International Conference on Artificial Neural Networks (ICANN 2007), Part II %S LNCS %I Springer Berlin Heidelberg %C Porto, Portugal %V 4669 %P 889–898 %8 09/2007 %@ 978-3-540-74695-9 %G eng %U https://link.springer.com/chapter/10.1007/978-3-540-74695-9_91 %R 10.1007/978-3-540-74695-9_91 %0 Conference Paper %B Proc. Second International Conference on Affective Computing and Intelligent Interaction (ACII 2007) %D 2007 %T A Bottom-Up Investigation of Emotional Modulation in Competitive Scenarios %A Lola Cañamero %A Avila-García, Orlando %E Ana C R Paiva %E Rui Prada %E Rosalind W Picard %X In this paper, we take an incremental, bottom-up approach to investigate plausible mechanisms underlying emotional modulation of behavior selection and their adaptive value in autonomous robots. We focus in particular on achieving adaptive behavior selection in competitive robotic scenarios through modulation of perception, drawing on the notion of biological hormones. We discuss results from testing our architectures in two different competitive robotic scenarios. %B Proc. Second International Conference on Affective Computing and Intelligent Interaction (ACII 2007) %S Lecture Notes in Computer Science %I Springer Berlin Heidelberg %C Lisbon, Portugal %V 4738 %P 398–409 %8 09/2007 %@ 978-3-540-74888-5 %G eng %R 10.1007/978-3-540-74889-2_35 %0 Conference Paper %B Emotional and Intelligent II: The Tangled Knot of Social Cognition; Papers from the 2001 AAAI Fall Symposium %D 2001 %T Building Emotional Artifacts in Social Worlds: Challenges and Perspectives %A Cañamero, Lola D %E Cañamero, Lola D %X This paper discusses ideas relative to the construction of emotional artifacts that have to interact in a social world, and in particular with humans. It first examines some of the ways in which emotions can enhance social interactions with artifacts, and some of the challenges posed to the designer. After considering the debate that opposes "shallow" versus "deep" modeling, it sketches some ways in which we can anchor emotions in the architecture of artifacts in order to make emotional interactions meaningful not only to the human, but also to the artifact itself. It finally outlines some of the cognitive capabilities that artifacts should incorporate for their emotions to be properly grounded and to give rise to rich social exchanges with humans. %B Emotional and Intelligent II: The Tangled Knot of Social Cognition; Papers from the 2001 AAAI Fall Symposium %I AAAI Press %C North Falmouth, Massachusetts %P 22–30 %@ 978-1-57735-136-8 %G eng