[koglist] Quentin Huys előadása

Tisztelt Kollégák, 2012. június 19-án szerdán du. 5 órakor Dr. Quentin Huys (ETH, Zurich) előadást tart a CEU Kongitívtudományi tanszékén "Reusing thoughts and experience" címmel. Részletek a levél alján. Quentin Huys a tanulás és a pszichiátriai betegségek, különösen a depresszió, kapcsolatát kutatja. Néhány nemrég, a tárgyban megjelent publikációja: Geurts DEM, Huys QJM, Den Oouden HEM and Cools, R. Aversive Pavlovian control of instrumental behaviour in humans. J. Cogn. Neurosci. (2013): In press Huys QJM, Pizzagalli DA, Bogdan R and Dayan P. Mapping anhedonia onto reinforcement learning. A behavioural meta-analysis. Biology of Mood and Anxiety Disorders (2013): In press Cavanagh J, Eisenberg M, Guitart-Masip M, Huys QJM and Frank MJ. Frontal theta overrides Pavlovian learning biases. J. Neurosci. (2013) 33(19):8541-8548 Chowdhury R, Guitart-Masip M, Lambert C, Dayan P, Huys QJ, Düzel E and Dolan RJ. Dopamine restores reward prediction errors in older age. Nature Neuroscience 16, 648-653 (2013) Guitart-Masip M, Huys QJM, Fuentemilla L, Dayan P, Düzel E and Dolan RJ. Go and nogo learning in reward and punishment: Interactions between affect and effect. Neuroimage (2012) 62(1):154-66 Huys QJM, Eshel N, O'Lions E, Sheridan L, Dayan P and Roiser JP. Bonsai trees in your head: How the Pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Comp Biol (2012) 8(3): e1002410 Guitart-Masip M, Fuentemilla L, Bach DR, Huys QJM, Dayan P, Dolan RJ and Düzel D. Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain. J. Neurosci (2011) 31(21):7867-75 Dayan P and Huys QJM. Serotonin in affective control. Annu Rev Neurosci (2009) 32:95-126 Minden érdeklődőt szeretettel várunk. Lengyel Máté -- Mate Lengyel, PhD Computational and Biological Learning Lab Cambridge University Engineering Department Trumpington Street, Cambridge CB2 1PZ, UK tel: +44 (0)1223 748 532, fax: +44 (0)1223 332 662 email: m.lengyel(a)eng.cam.ac.uk web: www.eng.cam.ac.uk/~m.lengyel *** Dr. Quentin Huys ETH, Zurich Date: Wednesday, June 19, 2013 - 17:00 - 18:30 Location: Department of Cognitive Science, CEU, Frankel Leó út 30-34., Room G15 Reusing thoughts and experience Substantial work over the last decade has emphasized the distinction between habits and goal‑directed decisions. Theoretically, goal‑directed decisions have been characterized as involving computationally costly model inversion, for instance a tree search. Habits, on the other hand, have been thought to result from experience accumulated in lookup tables, summarizing past experience about state‑action pairs for efficient future re‑deployment without incurring further computational cost. While the former structure allows for fast adaptation, the latter relies on sampling the new consequences of behaviours in the world before it can change. However, theoretical work always suggested a softer distinction in a number of ways. First, efficient game playing algorithms replace subtrees with lookup table values to cut down on computational costs. Second, direct transfer of internal samples might shape habits without the need to rely on the costly experiential samples from the world. Finally, habits are typically characterised as one‑step state‑action pairs. But there is no strong theoretical reason to limit lookup tables to such simple structures. This opens up the possibility of directly transferring entire solutions to actor‑like habits. Here, we re‑analyse data from an explicitly goal‑directed tree‑search task and find evidence for generalization and re‑use of complex action sequences. We use this to analyse the process by which complex behaviours are stored for future re‑use, either arising through experience or as memorized solutions. This reveals richer habits and less sharp distinction between habits and goal‑directed choices. Joint work with Anthony Cruickshanck, Neir Eshel, Peter Dayan, Paul Falkner, Sam Gershman, Niall Lally, Peggy Series and Jon Roiser