|
Hokkaido University Collection of Scholarly and Academic Papers >
Graduate School of Science / Faculty of Science >
Peer-reviewed Journal Articles, etc >
Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks
This item is licensed under:Creative Commons Attribution 4.0 International
| Title: | Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks |
| Authors: | Wen, Chentao Browse this author | | Ogura, Yukiko Browse this author | | Matsushima, Toshiya Browse this author →KAKEN DB |
| Keywords: | reinforcement learning | | temporal-difference learning | | state value | | striatum | | tegmentum | | domestic chicks | | extinction learning |
| Issue Date: | 8-Nov-2016 |
| Publisher: | Frontiers Research Foundation |
| Journal Title: | Frontiers in Neuroscience |
| Volume: | 10 |
| Start Page: | 1 |
| End Page: | 25 |
| Publisher DOI: | 10.3389/fnins.2016.00476 |
| Abstract: | To ensure survival, animals must update the internal representations of their environment in a trial-and-error fashion. Psychological studies of associative learning and neurophysiological analyses of dopaminergic neurons have suggested that this updating process involves the temporal-difference (TD) method in the basal ganglia network. However, the way in which the component variables of the TD method are implemented at the neuronal level is unclear. To investigate the underlying neural mechanisms, we trained domestic chicks to associate color cues with food rewards. We recorded neuronal activities from the medial striatum or tegmentum in a freely behaving condition and examined how reward omission changed neuronal firing. To compare neuronal activities with the signals assumed in the TD method, we simulated the behavioral task in the form of a finite sequence composed of discrete steps of time. The three signals assumed in the simulated task were the prediction signal, the target signal for updating, and the TD-error signal. In both the medial striatum and tegmentum, the majority of recorded neurons were categorized into three types according to their fitness for three models, though these neurons tended to form a continuum spectrum without distinct differences in the firing rate. Specifically, two types of striatal neurons successfully mimicked the target signal and the prediction signal. A linear summation of these two types of striatum neurons was a good fit for the activity of one type of tegmental neurons mimicking the TD-error signal. The present study thus demonstrates that the striatum and tegmentum can convey the signals critically required for the TD method. Based on the theoretical and neurophysiological studies, together with tract-tracing data, we propose a novel model to explain how the convergence of signals represented in the striatum could lead to the computation of TD error in tegmental dopaminergic neurons. |
| Rights: | https://creativecommons.org/licenses/by/4.0/ |
| Type: | article |
| URI: | http://hdl.handle.net/2115/63595 |
| Appears in Collections: | 理学院・理学研究院 (Graduate School of Science / Faculty of Science) > 雑誌発表論文等 (Peer-reviewed Journal Articles, etc)
|
Submitter: 松島 俊也
|
