|
1 | | -# Reinforcement Learning through a Spiking Controller |
| 1 | +# Reinforcement Learning through a Spiking Controller (Chevtchenko et al.; 2020) |
2 | 2 |
|
3 | | -In this exhibit, we will see how to construct a simple biophysical model for |
4 | | -reinforcement learning with a spiking neural network and modulated |
5 | | -spike-timing-dependent plasticity. |
6 | | -This model incorporates a mechanisms from several different models, including |
7 | | -the constrained RL-centric SNN of <b>[1]</b> as well as the simplifications |
8 | | -made with respect to the model of <b>[2]</b>. The model code for this |
9 | | -exhibit can be found |
10 | | -[here](https://github.com/NACLab/ngc-museum/tree/main/exhibits/rl_snn). |
| 3 | +In this exhibit, we will see how to construct a simple biophysical model for reinforcement learning with a spiking |
| 4 | +neural network and modulated spike-timing-dependent plasticity. |
| 5 | +This model incorporates a mechanisms from several different models, including the constrained RL-centric SNN of |
| 6 | +<b>[1]</b> as well as some simplifications of the structures used within the SNN of <b>[2]</b>. The model code for this |
| 7 | +exhibit can be found [here](https://github.com/NACLab/ngc-museum/tree/main/exhibits/rl_snn). |
11 | 8 |
|
12 | 9 | ## Modeling Operant Conditioning through Modulation |
13 | 10 |
|
@@ -123,10 +120,7 @@ RL-SNN model: |
123 | 120 |
|
124 | 121 | <!-- References/Citations --> |
125 | 122 | ## References |
126 | | -<b>[1]</b> Chevtchenko, Sérgio F., and Teresa B. Ludermir. "Learning from sparse |
127 | | -and delayed rewards with a multilayer spiking neural network." 2020 International |
128 | | -Joint Conference on Neural Networks (IJCNN). IEEE, 2020. <br> |
129 | | -<b>[2]</b> Diehl, Peter U., and Matthew Cook. "Unsupervised learning of digit |
130 | | -recognition using spike-timing-dependent plasticity." Frontiers in computational |
131 | | -neuroscience 9 (2015): 99. |
132 | | - |
| 123 | +<b>[1]</b> Chevtchenko, Sérgio F., and Teresa B. Ludermir. "Learning from sparse and delayed rewards with a multilayer |
| 124 | +spiking neural network." 2020 International Joint Conference on Neural Networks (IJCNN). IEEE, 2020. <br> |
| 125 | +<b>[2]</b> Diehl, Peter U., and Matthew Cook. "Unsupervised learning of digit recognition using spike-timing-dependent |
| 126 | +plasticity." Frontiers in computational neuroscience 9 (2015): 99. |
0 commit comments