A Biologically Plausible Neural Network for Multichannel Canonical Correlation Analysis. 2021

David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
Center for Computational Neuroscience, Flatiron Institute, New York, NY 10010, U.S.A. dlipshutz@flatironinstitute.org.

Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement canonical correlation analysis (CCA), an unsupervised learning method that projects the inputs onto a common subspace so as to maximize the correlations between the projections. To this end, we seek a multichannel CCA algorithm that can be implemented in a biologically plausible neural network. For biological plausibility, we require that the network operates in the online setting and its synaptic update rules are local. Starting from a novel CCA objective function, we derive an online optimization algorithm whose optimization steps can be implemented in a single-layer neural network with multicompartmental neurons and local non-Hebbian learning rules. We also derive an extension of our online CCA algorithm with adaptive output rank and output whitening. Interestingly, the extension maps onto a neural network whose neural architecture and synaptic updates resemble neural circuitry and non-Hebbian plasticity observed in the cortex.

UI MeSH Term Description Entries
D009474 Neurons The basic cellular units of nervous tissue. Each neuron consists of a body, an axon, and dendrites. Their purpose is to receive, conduct, and transmit impulses in the NERVOUS SYSTEM. Nerve Cells,Cell, Nerve,Cells, Nerve,Nerve Cell,Neuron
D000089342 Canonical Correlation Analysis Mathematical procedure that transforms vectors of variables into canonical variate pairs and finds their correlation to describe strength of association. Canonical Correlation,Canonical Variate,Analysis, Canonical Correlation,Canonical Correlation Analyses,Canonical Correlations,Canonical Variates,Correlation Analysis, Canonical,Correlation, Canonical,Variate, Canonical
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D016571 Neural Networks, Computer A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming. Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
October 1999, International journal of neural systems,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
October 2013, Cognitive neurodynamics,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
January 1997, Bio Systems,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
December 2022, IEEE transactions on neural networks and learning systems,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
March 2004, Neural networks : the official journal of the International Neural Network Society,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
January 2020, Frontiers in neuroscience,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
May 1991, Proceedings of the National Academy of Sciences of the United States of America,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
September 2018, IEEE transactions on neural networks and learning systems,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
December 1999, Neural networks : the official journal of the International Neural Network Society,
David Lipshutz, and Yanis Bahroun, and Siavash Golkar, and Anirvan M Sengupta, and Dmitri B Chklovskii
September 2022, IEEE transactions on cybernetics,
Copied contents to your clipboard!