<?xml version="1.0" encoding="UTF-8"?><xml><records><record><source-app name="Biblio" version="7.x">Drupal-Biblio</source-app><ref-type>47</ref-type><contributors><authors><author><style face="normal" font="default" size="100%">Parussel, Karla</style></author><author><style face="normal" font="default" size="100%">Lola Cañamero</style></author></authors><secondary-authors><author><style face="normal" font="default" size="100%">de Sá, Joaquim Marques</style></author><author><style face="normal" font="default" size="100%">Alexandre, Luís A.</style></author><author><style face="normal" font="default" size="100%">Duch, Włodzisław</style></author><author><style face="normal" font="default" size="100%">Mandic, Danilo</style></author></secondary-authors></contributors><titles><title><style face="normal" font="default" size="100%">Biasing Neural Networks Towards Exploration or Exploitation Using Neuromodulation</style></title><secondary-title><style face="normal" font="default" size="100%">Proc. 17th International Conference on Artificial Neural Networks (ICANN 2007), Part II</style></secondary-title><tertiary-title><style face="normal" font="default" size="100%">LNCS</style></tertiary-title></titles><dates><year><style  face="normal" font="default" size="100%">2007</style></year><pub-dates><date><style  face="normal" font="default" size="100%">09/2007</style></date></pub-dates></dates><urls><web-urls><url><style face="normal" font="default" size="100%">https://link.springer.com/chapter/10.1007/978-3-540-74695-9_91</style></url></web-urls></urls><publisher><style face="normal" font="default" size="100%">Springer Berlin Heidelberg</style></publisher><pub-location><style face="normal" font="default" size="100%">Porto, Portugal</style></pub-location><volume><style face="normal" font="default" size="100%">4669</style></volume><pages><style face="normal" font="default" size="100%">889–898</style></pages><isbn><style face="normal" font="default" size="100%">978-3-540-74695-9</style></isbn><language><style face="normal" font="default" size="100%">eng</style></language><abstract><style face="normal" font="default" size="100%">Taking neuromodulation as a mechanism underlying emotions, this paper investigates how such a mechanism can bias an artificial neural network towards exploration of new courses of action, as seems to be the case in positive emotions, or exploitation of known possibilities, as in negative emotions such as predatory fear. We use neural networks of spiking leaky integrate-and-fire neurons acting as minimal disturbance systems, and test them with continuous actions. The networks have to balance the activations of all their output neurons concurrently. We have found that having the middle layer modulate the output layer helps balance the activations of the output neurons. A second discovery is that when the network is modulated in this way, it performs better at tasks requiring the exploitation of actions that are found to be rewarding. This is complementary to previous findings where having the input layer modulate the middle layer biases the network towards exploration of alternative actions. We conclude that a network can be biased towards either exploration of exploitation depending on which layers are being modulated.</style></abstract></record></records></xml>