List of Publications

	Kenji Doya
	December, 1998

K. Doya.  Integration of cortical, cerebellar and basal ganglionic
 modules specialized in unsupervised, supervised and reinforcement
 learning.  International Basal Ganglia Society 6th Triennial Meeting,
 page 27, 1998.

R. S. Bapi and K. Doya.  A sequence learning architecture based on
 cortico-basal ganglionic loops and reinforcement learning.  The 5th
 International Conference on Neural Information Processing, volume 1,
 pages 260-263, 1998.

R. S. Bapi and K. Doya.  Evidence for effector independent and
 dependent components in motor sequence learning.  Society for
 Neuroscience Abstracts, volume 24, page 167, 1998.

N. Schweighofer, K. Doya, and M. Kawato.  A model of the
 electrophysiological properties of the inferior olive neurons.  The
 5th International Conference on Neural Information Processing, volume
 3, pages 1525-1528, 1998.

N. Schweighofer, K. Doya, and M. Kawato.  A model of the
 electrophysiological properties of the inferior olive neurons.
 Society for Neuroscience Abstracts, volume 24, page 667, 1998.

J. Morimoto and K. Doya. Reinforcement learning of dynamic motor
 sequence: Learning to stand up.  Proceedings of IEEE/RSJ International
 Conference on Intelligent Robots and Systems, volume 3, pages
 1721-1726, 1998.

J. Morimoto and K. Doya. Hierarchical reinforcement learning of
 low-dimensional subgoals and high-dimensional trajectories. The 5th
 International Conference on Neural Information Processing, volume 2,
 pages 850-853, 1998.

K. Katagiri, K. Doya, and M. Kawato.  Multiple model-based
 reinforcement learning for non-linear control.  Technical Report
 NC98-46, Institute of Electronics, Information and Communication
 Engineers, 1998. (in Japanese).

M. Kimura and K. Doya.  Motion planning and the basal ganglia.
 Kagaku, 68:970-979, 1998. (in Japanese).

H. Nakahara, K. Doya, O. Hikosaka, and S. Nagano.  Reinforcement
 learning with multiple representations in the basal ganglia loops for
 sequential motor control.  International Joint Conference on Neural
 Networks, pages 1553-1558, 1997.

H. Nakahara, K. Doya, and O. Hikosaka.  Benefit of multiple
 representations in parallel cortico-basal ganglia mechanisms for
 acquisition and execution of visuo-motor sequences.  International
 Basal Ganglia Society 6th Triennial Meeting, page 29, 1998.

H. Nakahara and K. Doya.  Near saddle-node bifurcation behavior as
 dynamics in working memory for goal-directed behavior.  Neural
 Computation, 10:113-132, 1998.

K. Doya and T. J. Sejnowski.  A computational model of birdsong
 learning by auditory experience and auditory feedback. J. Brugge and
 P. Poon, editors, Central Auditory Processing and Neural Modeling,
 pages 77-88. Plenum Publishing, 1998.

K. Doya. Efficient nonlinear control with actor-tutor architecture. In
 T. Petsche M. C. Mozer, M. I. Jordan, editor, Advances in Neural Information
 Processing Systems 9, pages 1012-1018. MIT Press, 1997.

H. Nakahara, K. Doya, O. Hikosaka, and S. Nagano. Multiple representations in
 the basal ganglia loops for sequential decision making. Technical Report
 NC97-24, Institute of Electronics, Information and Communication Engineers,
 1997.

H. Nakahara, K. Doya, O. Hikosaka, and S. Nagano. Multiple representations in
 the basal ganglia loops for acquisition and execution of sequential motor
 control. Society for Neuroscience Abstracts, 23:778, 1997.

K. Doya. How basal ganglia, cerebellum and cerebral motor areas work together
 in sequential control tasks. Neural Control of Movement, 7th Annual Meeting
 Abstracts, page 28, 1997.

K. Doya. Neural computation for motor learning: Functions of basal ganglia,
 cerebellum and cerebral cortex. Mathematical Sciences special issue:
 Frontline of Brain Science, pages 141-152, 1997. (in Japanese).

J. Morimoto and K. Doya. Learning stand-up trajectories using reinforcement
 learning. Technical Report NC97-28, Institute of Electronics, Information and
 Communication Engineers, 1997. (in Japanese).

Y. Koike and K. Doya. Acquisition of driving skill by reinforcement learning.
 Technical Report NC96-169, Institute of Electronics, Information and
 Communication Engineers, 1997. (in Japanese).

K. Doya. Temporal difference learning in continuous time and space. D. S.
 Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural
 Information Processing Systems 8, pages 1073-1079. MIT Press, 1996.

H. Nakahara and K. Doya. Dynamics of attention as near saddle-node bifurcation
 behavior. D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors,
 Advances in Neural Information Processing Systems 8, pages 38-44. MIT Press,
 1996.

K. Doya. Birdsong learning. Mathematical Sciences, 394:48-55, 1996. (in
 Japanese).

K. Doya. An integrated model of basal ganglia and cerebellum in sequential
 control tasks. Society for Neuroscience Abstracts, 22:2029, 1996.

K. Doya. Reinforcement learning. Proceedings of the 7th Annual Conference of
 Japanese Neural Network Society, pages 158-162, 1996.

K. Doya. Reinforcement learning in animals and robots. International
 Workshop on Brainware, pages 69-71, 1996.

K. Doya and T. J. Sejnowski. A novel reinforcement model of birdsong
 vocalization learning. G. Tesauro, D. S. Touretzky, and T. K. Leen,
 editors, Advances in Neural Information Processing Systems 7, pages 101-108.
 MIT Press, 1995.

K. Doya and T. J. Sejnowski. A computational model of birdsong vocalization
 learning. Fourth IBRO World Congress of Neuroscience Abstracts, page 502,
 1995.

K. Doya and T. J. Sejnowski. A model of birdsong vocalization learning. M.
 Burrows, T. Matheson, P. L. Newland, and H. Schuppe, editors, Nervous Systems
 and Behavior, page 76. Georg Thieme Verlag, 1995.

K. Doya. Recurrent networks: Supervised learning. M. Arbib, editor, The
 Handbook of Brain Theory and Neural Networks. MIT Press, 1995.
 796-800.

K. Doya. Continuous-time TD learning. Proceedings of the 6th Annual
 Conference of Japanese Neural Network Society, pages 22-23, 1995. (in
 Japanese).

K. Doya and A. I. Selverston. Dimension reduction of biological neuron models
 by artificial neural networks. Neural Computation, 6:696-717, 1994.

K. Doya, A. I. Selverston, and P. F. Rowat. A Hodgkin-Huxley type neuron
 model that learns slow non-spike oscillation. J. D. Cowan, G. Tesauro, and
 J. Alspector, editors, Advances in Neural Information Processing Systems 6,
 pages 566-573. Morgan Kaufmann, 1994.

K. Doya and T. J. Sejnowski. A computational model of song learning in the
 anterior forebrain pathway of the birdsong control system. Society for
 Neuroscience Abstract, volume 20, page 166, 1994.

K. Doya, M. E. T. Boyle, and A. I. Selverston. Mapping between neural and
 physical activities of the lobster gastric mill. C. L. Giles, S. J.
 Hanson, and J. D. Cowan, editors, Advances in Neural Information Processing
 Systems 5, pages 913-920. Morgan Kaufmann, 1993.

K. Doya, M. E. T. Boyle, M. Beauchamp, and A. I. Selverston. Computational
 modeling of the musculoskeletal system of the lobster gastric mill. In
 Society for Neuroscience Abstract, volume 19, page 1602, 1993.

K. Doya and A. I. Selverston. A learning algorithm for Hodgkin-Huxley type
 neuron models. Proceedings of 1993 International Joint Conference on
 Neural Networks, pages 1108-1111, 1993.

K. Doya. Introduction to the theory of neural networks. K. Aihara, editor,
 Neuro, Fuzzy, and Chaos: Introduction to New-Generation Analog Computing,
 pages 13-39. Ohm-Sha, Tokyo, Japan, 1993. (in Japanese).

K. Doya and S. Yoshizawa. Adaptive synchronization of neural and physical
 oscillators. J. E. Moody, S. J. Hanson, and R. P. Lippmann, editors,
 Advances in Neural Information Processing Systems 4, pages 109-116. Morgan
 Kaufmann, 1992.

K. Doya. Bifurcations in the learning of recurrent neural networks. In
 Proceedings of 1992 IEEE International Symposium on Circuits and Systems,
 pages 2777-2780, 1992.

K. Doya. Motor pattern formation by neural networks: A robot that learns to
 walk. K. Nakano, editor, Brain Information Processing in C, pages
 183-218. Keigaku-Shuppan, 1992. (in Japanese).

K. Doya. A study of learning algorithms for continuous-time recurrent neural
 networks. Ph.D. thesis, University of Tokyo, 1991.

K. Doya and S. Yoshizawa. Neural network model of temporal pattern memory.
 Systems and Computers in Japan, 22:61-69, 1991.

K. Doya and S. Yoshizawa. Geometric analysis of the dynamics of autocorrelation
 associative memory. T. Kohonen, K. Makisara, O. Simula, and J. Kangas,
 editors, Artificial Neural Networks, volume 1, pages
 261-266. Elsevier, 1991.


K. Doya. Learning algorithms for recurrent neural networks. Instrumentation and
 Control, 30:296-301, 1991. (in Japanese).

K. Doya and S. Yoshizawa. Neural network model of temporal pattern memory.
 Transactions of the Institute of Electronics, Information and Communication
 Engineers, J73-D-II:1150-1157, 1990. (in Japanese).

K. Doya and S. Yoshizawa. Memorizing hierarchical temporal patterns in analog
 neuron networks. Proceedings of 1990 International Joint Conference on
 Neural Networks, San Diego, pages III:299-304, 1990.

K. Doya. Learning temporal patterns in recurrent neural networks. In
 Proceedings of 1990 IEEE System, Man and Cybernetics Conference, pages
 170-172, 1990.

K. Doya. A robot that learns walking patters. Journal of the Robotic Society of
 Japan, 8:357, 1990. (in Japanese).

K. Doya and S. Yoshizawa. Adaptive neural oscillator using continuous-time
 back-propagation learning. Neural Networks, 2:375-386, 1989.

K. Doya and S. Yoshizawa. Memorizing oscillatory patterns in the analog neuron
 network. Proceedings of 1989 International Joint Conference on Neural
 Networks, Washington, D.C., pages I:27-32, 1989.

K. Doya. Memory of oscillation patterns by neural networks. Computrol,
 29:52-62, 1989. (in Japanese).

K. Doya and S. Yoshizawa. Associative memory of multiple oscillatory patterns
 in neural networks. Technical Report of the Institute of Electronics,
 Information and Communication Engineers, MBE88-141:125-130, 1988. (in
 Japanese).

K. Doya and S. Yoshizawa. Memory of dynamical patterns in neural networks. In
 Proceedings of the 4th Biological and Physiological Engineering Symposium,
 pages 47-50, 1989. (in Japanese).

K. Doya and S. Yoshizawa. Motor pattern memory in neural networks. Technical
 Report of the Institute of Electronics, Information and Communication
 Engineers, MBE87-141:293-300, 1988. (in Japanese).

K. Fujita, K. Doya, and S. Yoshizawa. A neural network which learns motor
 patterns. Proceedings of the 1988 Academic Conference of Society of
 Instrumentation and Control Engineers, pages 359-360, 1988. (in Japanese).

K. Doya and S. Yoshizawa. Memory of dynamical patterns in neural networks. In
 Proceedings of the 2nd Biological and Physiological Engineering Symposium,
 pages 9-12, 1987. (in Japanese).