Fetching the paper…
Reading the bibliography…
Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds.
Animal Intelligence
Thorndike, E. (1911) · 1911
Earlier work this paper cites.
Conditioned reflexes
Pavlov, I. P. (1927) · 1927
Earlier work this paper cites.
A mathematical theory of communication
Shannon, C. (1948) · 1948
Earlier work this paper cites.
The Organization of Behavior
Hebb, D. O. (1949) · 1949
Earlier work this paper cites.
A quantitative description of membrane current and its application to conduction and excitation in nerve
Hodgkin, A. L. and A. F. Huxley (1952) · 1952
Earlier work this paper cites.
Pupil size as related to interest value of visual stimuli
Hess, E. and J. Polt (1960) · 1960
Earlier work this paper cites.
A new approach to linear filtering and prediciton problems
Kalman, R. (1960) · 1960
Earlier work this paper cites.
Cortical synapses and reinforcement: a hypothesis
Crow, T. (1968) · 1968
Earlier work this paper cites.
Non-holographic associative memory
Willshaw, D. J., O. P. Bunemann, and H. C. Longuet-Higgins (1969) · 1969
Earlier work this paper cites.
Brain function and adaptive systems - a heterostatic theory
Klopf, A. (1972) · 1972
Earlier work this paper cites.
Long-lasting potentation of synaptic transmission in the dendate area of anaesthetized rabbit following stimulation of the perforant path
Bliss, T. and T. Lømo (1973) · 1973
Earlier work this paper cites.
The effect of stimulus sequence on the waveform of the cortical event-related potential
Squires, K., C. Wickens, N. Squires, and E. Donchin (1976) · 1976
Earlier work this paper cites.
The hippocampus as a cognitive map
O’keefe, J. and L. Nadel (1978) · 1978
Earlier work this paper cites.
Towards a modern theory of adaptive networks: expectation and prediction
Sutton, R. S. and A. G. Barto (1981) · 1981
Earlier work this paper cites.
Theory of the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex
Bienenstock, E., L. Cooper, and P. Munroe (1982) · 1982
Earlier work this paper cites.
Neural networks and physical systems with emergent collective computational abilities
Hopfield, J. J. (1982) · 1982
Earlier work this paper cites.
A simplified neuron model as a principal component analyzer
Oja, E. (1982) · 1982
Earlier work this paper cites.
Neuronlike adaptive elements that can solve difficult learning and control problems
Barto, A., R. Sutton, and C. Anderson (1983) · 1983
Earlier work this paper cites.
Temporal contiguity requirements for long-term associative potentiation/depression in hippocampus
Levy, W. B. and D. Stewart (1983) · 1983
Earlier work this paper cites.
Neurobiology - memory and molecular turnover
Crick, F. (1984) · 1984
Earlier work this paper cites.
Learning by statistical ccoperation of self-interested neuron-like computing elements
Barto, A.G. (1985) · 1985
Earlier work this paper cites.
Reinforcement delay of one second severley impairs acquisition of brain self-stimulation
J.Blac, J. Belluzzi, and L. Stein (1985) · 1985
Earlier work this paper cites.
A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase
Lisman, J. (1985) · 1985
Earlier work this paper cites.
Curious model-building control systems
Schmidhuber, J. (1991) · 1991
Earlier work this paper cites.
Responses of monkey dopamine neurons during learning of behavioral interactions
Ljunberg, T. and P. A. amd W. Schultz (1992) · 1992
Earlier work this paper cites.
Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity
Lowel, S. and W. Singer (1992) · 1992
Earlier work this paper cites.
The developing brain
Shatz, C. (1992) · 1992
Earlier work this paper cites.
Simple statistical gradient-following methods for connectionist reinforcement learning
Williams, R. (1992) · 1992
Earlier work this paper cites.
Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation
Artola, A. and W. Singer (1993) · 1993
Earlier work this paper cites.
A synaptic model of memory: long-term potentiation in the hippocampus
Bliss, T. V. P. and G. L. Collingridge (1993) · 1993
Earlier work this paper cites.
The role of constraints in hebbian learning
Miller, K. D. and D. J. C. MacKay (1994) · 1994
Earlier work this paper cites.
Simulation of spatial-learning in the Morris water maze by a neural network model of the hippocampal-formation and nucleus accumbens
Brown, M. and P. Sharp (1995) · 1995
Earlier work this paper cites.
Reinforcement-driven information acquisition in non-deterministic environments
Storck, J., S. Hochreiter, and J. Schmidhuber (1995) · 1995
Earlier work this paper cites.
A neuronal learning rule for sub-millisecond temporal coding
Gerstner, W., R. Kempter, J. van Hemmen, and H. Wagner (1996) · 1996
Earlier work this paper cites.
The basal ganglia: focused selection and inhibition of competing motor programs
Mink, J. (1996) · 1996
Earlier work this paper cites.
Reinforcement learning with replacing eligibility traces
Singh, S. and R. Sutton (1996) · 1996
Earlier work this paper cites.
Synaptic tagging and long-term potentiation
Frey, U. and R. Morris (1997) · 1997
Earlier work this paper cites.
Regulation of synaptic efficacy by coincidence of postysnaptic AP and EPSP
Markram, H., J. Lübke, M. Frotscher, and B. Sakmann (1997) · 1997
Earlier work this paper cites.
A neural substrate for prediction and reward
Schultz, W., P. Dayan, and R. Montague (1997) · 1997
Earlier work this paper cites.
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · 1998
Earlier work this paper cites.
Reinforcement learning
Sutton, R.S and A.G. Barto (1998) · 1998
Earlier work this paper cites.
A critical window for cooperation and competition among developing retinotectal synapses
Zhang, L., H. Tao, C. Holt, W.A.Harris, and M.-M. Poo (1998) · 1998
Earlier work this paper cites.
Hebbian synaptic modification in spiking neurons that learn
Bartlett, P. L. and J. Baxter (1999) · 1999
Earlier work this paper cites.
Hebbian learning and spiking neurons
Kempter, R., W. Gerstner, and J. L. van Hemmen (1999) · 1999
Earlier work this paper cites.
A neural network with dopamine-like reinforcement signal that learns a spatial delayed response task
Suri, R. E. and W. Schultz (1999) · 1999
Earlier work this paper cites.
Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity
Arleo, A. and W. Gerstner (2000) · 2000
Earlier work this paper cites.
Is heterosynaptic modulation essential for stabilizing hebbian plasiticity and memory
Bailey, C., M. Giustetto, Y.-Y. Huang, R. Hawkins, and E. Kandel (2000) · 2000
Earlier work this paper cites.
Models of hippocampally dependent navigation using the temporal difference learning rule
Foster, D., R. Morris, and P. Dayan (2000) · 2000
Earlier work this paper cites.
Synaptic plasticity and memory: an evaluation of the hypothesis
Martin, S., P. Grimwood, and R. Morris (2000) · 2000
Cited alongside, same era.
Basal ganglia and cerebellar loops: motor and cognitive circuites
Middleton, F. A. and P. Strick (2000) · 2000
Cited alongside, same era.
Synaptic activation modulates the induction of bidirectional synaptic changes in adult mouse hippocamus
Ngezahayo, A., M. Schachner, and A. Artola (2000) · 2000
Cited alongside, same era.
Neuronal coding of prediction errors
Schultz, W. and A. Dickinson (2000) · 2000
Cited alongside, same era.
Competitive Hebbian learning through spike-time-dependent synaptic plasticity
Song, S., K. Miller, and L. Abbott (2000) · 2000
Cited alongside, same era.
Stable Hebbian learning from spike timing-dependent plasticity
van Rossum, M. C. W., G. Q. Bi, and G. G. Turrigiano (2000) · 2000
Bayesian surprise attracts human attention
Itti, L. and P. Baldi (2009) · 2009
Later among the works it cites.
Response acquisition by humans with delayed reinforcement
Okouchi, H. (2009) · 2009
Later among the works it cites.
Perceptual learning rules based on reinforcers and attention
Roelfsema, P., A. van Ooyen, and T. Watanabe (2010) · 2009
Later among the works it cites.
Generating coherent patterns of activity from chaotic neural networks
Sussillo, D. (2009) · 2009
Later among the works it cites.
Spike-based reinforcement learning in continuous state and action space: When policy gradient methods fail
Vasilaki, E., N. Frémaux, R. Urbanczik, W. Senn, and W. Gerstner (2009) · 2009
Later among the works it cites.
Gain in sensitivity and loss in temporal contrast of stdp by dopaminergic modulation at hippocampal synapses
Zhang, J., P. Lau, and G. Bi (2009) · 2009
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Dendritic spine geometry is critical for ampa receptor expression in hippocampal ca1 pyramidal neurons
Matsuzaki, M., G. Ellis-Davies, T. Nemoto, M. Iione, Y. Miyashita, and H. Kasai (2001) · 2001
Cited alongside, same era.
Equilibrium properties of temporally asymmetric Hebbian plasticity
Rubin, J., D. D. Lee, and H. Sompolinsky (2001) · 2001
Cited alongside, same era.
Practising orientation identification improves orientation coding in v1 neurons
Schoups, A., R. Vogels, N. Quian, and G. A. Orban (2001) · 2001
Cited alongside, same era.
An algorithm for modifying neurotransmitter release probability based on pre- and postsynaptic spike timing
Senn, W., M. Tsodyks, and H. Markram (2001) · 2001
Cited alongside, same era.
Rate, timing, and cooperativity jointly determine cortical synaptic plasticity
Sjöström, P., G. Turrigiano, and S. Nelson (2001) · 2001
Cited alongside, same era.
Spike-timing dependent plasticity induced by natural spike trains
Froemke, R. and Y. Dan (2002) · 2002
Cited alongside, same era.
Later among the works it cites.
Connectivity reflects coding: A model of voltage-based spike-timing-dependent-plasticity with homeostasis
Clopath, C., L. Busing, E. Vasilaki, and W. Gerstner (2010) · 2010
Later among the works it cites.
Functional requirements for reward-modulated spike-timing-dependent plasticity,
Frémaux, N., H. Sprekeler, and W. Gerstner (2010) · 2010
Later among the works it cites.
The free-energy principle: a unified brain theory?
Friston, K. (2010) · 2010
Later among the works it cites.
An approximately bayesian delta-rule model explains the dynamics of belief updating in a changing environment
Nassar, M., R. Wilson, B. Heasly, and J. Gold (2010) · 2010
Later among the works it cites.
Timing is not everything: neuromodulation opens the STDP gate
Pawlak, V., J. Wickens, A. Kirkwood, and J. Kerr (2010) · 2010
Later among the works it cites.
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · 2010
Later among the works it cites.
A triplet spike-timing–dependent plasticity model generalizes the bienenstock–cooper–munro rule to higher-order spatiotemporal correlations
Gjorjieva, J., C. Clopath, J. Audet, and J. Pfister (2011) · 2011
Later among the works it cites.
A neoHebbian framework for episodic memory; role of dopamine-dependent late ltp
Lisman, J., A. Grace, and E. Duzel (2011) · 2011
Later among the works it cites.
A bayesian foundation for individual learning under uncertainty
Mathys, C., J. Daunizeau, K. Friston, and K. Stephan (2011) · 2011
Later among the works it cites.
Making memories last: the synaptic tagging and capture hypothesis
Redondo, R. L. and R. G. M. Morris (2011) · 2011
Later among the works it cites.
Planning to be surprised: Optimal bayesian exploration in dynamic environments
Sun, Y., F. Gomez, and J. Schmidhuber (2011) · 2011
Later among the works it cites.
Spike-timing dependence of structural plasticity explains cooperative synapse formation in the neocortex
Deger, M., M. Helias, S. Rotter, and M. Diesmann (2012) · 2012
Later among the works it cites.
Action selection and action value in frontal-striatal circuits
Seo, M., E. Lee, and B. Averbeck (2012) · 2012
Later among the works it cites.
Reinforcement learning using continuous time actor-critic framework with spiking neurons
Frémaux, N., H. Sprekeler, and W. Gerstner (2013) · 2013
Later among the works it cites.
AMPARs and synaptic plasticity: the last 25 years
Huganir, R. and R. Nicoll (2013) · 2013
Later among the works it cites.
A model-based approach to trial-by-trial p300 amplitude fluctuations
Kolossa, A., T. Fingscheidt, K. Wessel, and B. Kopp (2013) · 2013
Later among the works it cites.
Learning and exploration in action-perception loops
Little, D. and F. Sommer (2013) · 2013
Later among the works it cites.
Structural and molecular remodeling of dendritic spine substructures during long-term-potentation
Bosch, M., J. Castro, T. Saneyoshi, H. Matsuno, M. Sur, and Y. Hayashi (2014) · 2014
Later among the works it cites.
Uncertainty in perception and the hierarchical gaussian filter
Mathys, C. D., E. I. Lomakina, K. Daunizeau, S. Iglesias, K. Brodersen, K. Friston, and K. Stephan (2014) · 2014
Later among the works it cites.
A critical time window for dopamine actions on the structural plasticity of dendritic spines
Yagishita, S., A. Hayashi-Takagi, G. Ellis-Davies, H. Urakubo, S. Ishii, and H. Kasai (2014) · 2014
Later among the works it cites.
Conjunctive input processing drives feature selectivity in hippocampal ca1 neurons
Bittner, K., C. Grienberger, S. Vaidya, A. Milstein, J. Macklin, J. Suh, S. Tonegawa, and J. Magee (2015) · 2015
Later among the works it cites.
Retroactive modulation of spike timingdependent plasticity by dopamine
Brzosko, Z., W. Schultz, and O. Paulsen (2015) · 2015
Later among the works it cites.
The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences
Fauth, M., F. Worgotter, and C. Tetzlaff (2015) · 2015
Later among the works it cites.
Distinct eligibility traces for ltp and ltd in cortical synapses
He, K., M. Huertas, S. Z. Hong, X. T. abnd Johannes W Hell, H. Shouval, and A. Kirkwood (2015) · 2015
Later among the works it cites.
A computational analysis of the neural bases of bayesian inference
Kolossa, A., B. Kopp, and T. Finscheidt (2015) · 2015
Later among the works it cites.
Learning enhances sensory and multiple non-sensory representations in primary visual cortex
Poort, H., A. Khan, M. Pachitariu, A. Nemri, I. Orsolic, J. Krupic, M. Bauza, M. Sahani, G. Keller, T. Mrsic-Flogel, and S. Hofer (2015) · 2015
Later among the works it cites.
How attention can create synaptic tags for the learning of working memories in sequential tasks
Rombouts, J., S. Bothe, and R. Roelfsema (2015) · 2015
Later among the works it cites.
Synaptic consolidation: from synapses to behavioral modeling
Ziegler, L., F. Zenke, D. Kastner, and W. Gerstner (2015) · 2015
Later among the works it cites.
Computational principles of synaptic memory consolidation
Benna, M. and S. Fusi (2016) · 2016
Later among the works it cites.
Prospective coding by spiking neurons
Brea, J., A. Gaal, R. Urbancik, and W. Senn (2016) · 2016
Later among the works it cites.
Neuromodulated spike-timing dependent plasticity and theory of three-factor learning rules
Frémaux, N. and W. Gerstner (2016) · 2016
Later among the works it cites.
Active inference and learning
Friston, K., T. Fitzgerald, F. Rigoli, P. Schwartenbeck, J. O’Doherty, and G. Pezzulo (2016) · 2016
Later among the works it cites.
Human inferences about sequences: A minimal transition probability model
Meyniel, F., M. Maheu, and S. Dehaene (2016) · 2016
Later among the works it cites.
Asynchronous methods for deep reinforcement learning
Mnih, V., A. Badia, M. Mirza, A. Graves, T. Harley, T. Lillicrap, D. Silver, and K. Kavukcuoglu (2016) · 2016
Later among the works it cites.
Locus coeruleus and dopaminergic consolidation of everyday memory
Takeuchi, T., A. Duszkiewicz, A. Sonneborn, P. Spooner, M. Yamasaki, M. Watanabe, C. Smith, G. Fernandez, K. Deisseroth, R. Greene, and R. Morris (2016) · 2016
Later among the works it cites.
Behavioral time scale synaptic plasticity underlies ca1 place fields
Bittner, K., A. Milstein, C. Grienberger, S. Romani, and J. Magee (2017) · 2017
Later among the works it cites.
Sequential neuromodulation of hebbian plasticity offers mechanism for effective reward-based navigation
Brzosko, Z., S. Zannone, W. Schultz, , C. Clopath, and O. Paulsen (2017) · 2017
Later among the works it cites.
Glutamatergic synapses are structurally and biochemically complex because of multiple plasticity processes: long-term potentiation, long-term depression, short-term potentiation and scaling
Lisman, J. (2017) · 2017
Later among the works it cites.
Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice
Menegas, W., B. Babayan, N. Uchida, and M. Watabe-Uchida (2017) · 2017
Later among the works it cites.
Balancing new against old information: The role of puzzlement surprise in learning
Faraji, M., K. Preuschoff, and W. Gerstner (2018) · 2018
Closest in time.
Reinforcement learning: an introduction
Sutton, R.S. and A.G. Barto (2018) · 2018
Closest in time.