Biomaterial Database

Training winner-take-all simultaneous recurrent neural networks. 2007

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Manuscript received September 26, 2005; revised June 25, 2006 and American Power Conversion Corporation, O'Fallon, MO 63368, USA xindi.cai@apc.com

The winner-take-all (WTA) network is useful in database management, very large scale integration (VLSI) design, and digital processing. The synthesis procedure of WTA on single-layer fully connected architecture with sigmoid transfer function is still not fully explored. We discuss the use of simultaneous recurrent networks (SRNs) trained by Kalman filter algorithms for the task of finding the maximum among N numbers. The simulation demonstrates the effectiveness of our training approach under conditions of a shared-weight SRN architecture. A more general SRN also succeeds in solving a real classification application on car engine data.

UI	MeSH Term	Description	Entries
D008962	Models, Theoretical	Theoretical representations that simulate the behavior or activity of systems, processes, or phenomena. They include the use of mathematical equations, computers, and other electronic equipment.	Experimental Model,Experimental Models,Mathematical Model,Model, Experimental,Models (Theoretical),Models, Experimental,Models, Theoretic,Theoretical Study,Mathematical Models,Model (Theoretical),Model, Mathematical,Model, Theoretical,Models, Mathematical,Studies, Theoretical,Study, Theoretical,Theoretical Model,Theoretical Models,Theoretical Studies
D003198	Computer Simulation	Computer-based representation of physical systems and phenomena such as chemical processes.	Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D003661	Decision Support Techniques	Mathematical or statistical procedures used as aids in making a decision. They are frequently used in medical decision-making.	Decision Analysis,Decision Modeling,Models, Decision Support,Analysis, Decision,Decision Aids,Decision Support Technics,Aid, Decision,Aids, Decision,Analyses, Decision,Decision Aid,Decision Analyses,Decision Support Model,Decision Support Models,Decision Support Technic,Decision Support Technique,Model, Decision Support,Modeling, Decision,Technic, Decision Support,Technics, Decision Support,Technique, Decision Support,Techniques, Decision Support
D005246	Feedback	A mechanism of communication within a system in that the input signal generates an output response which returns to influence the continued activity or productivity of that system.	Feedbacks
D005716	Game Theory	Theoretical construct used in applied mathematics to analyze certain situations in which there is an interplay between parties that may have similar, opposed, or mixed interests. In a typical game, decision-making "players," who each have their own goals, try to gain advantage over the other parties by anticipating each other's decisions; the game is finally resolved as a consequence of the players' decisions.	Game Theories,Theories, Game,Theory, Game
D000465	Algorithms	A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task.	Algorithm
D001185	Artificial Intelligence	Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language.	AI (Artificial Intelligence),Computer Reasoning,Computer Vision Systems,Knowledge Acquisition (Computer),Knowledge Representation (Computer),Machine Intelligence,Computational Intelligence,Acquisition, Knowledge (Computer),Computer Vision System,Intelligence, Artificial,Intelligence, Computational,Intelligence, Machine,Knowledge Representations (Computer),Reasoning, Computer,Representation, Knowledge (Computer),System, Computer Vision,Systems, Computer Vision,Vision System, Computer,Vision Systems, Computer
D016247	Information Storage and Retrieval	Organized activities related to the storage, location, search, and retrieval of information.	Information Retrieval,Data Files,Data Linkage,Data Retrieval,Data Storage,Data Storage and Retrieval,Information Extraction,Information Storage,Machine-Readable Data Files,Data File,Data File, Machine-Readable,Data Files, Machine-Readable,Extraction, Information,Files, Machine-Readable Data,Information Extractions,Machine Readable Data Files,Machine-Readable Data File,Retrieval, Data,Storage, Data
D016571	Neural Networks, Computer	A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming.	Computational Neural Networks,Connectionist Models,Models, Neural Network,Neural Network Models,Neural Networks (Computer),Perceptrons,Computational Neural Network,Computer Neural Network,Computer Neural Networks,Connectionist Model,Model, Connectionist,Model, Neural Network,Models, Connectionist,Network Model, Neural,Network Models, Neural,Network, Computational Neural,Network, Computer Neural,Network, Neural (Computer),Networks, Computational Neural,Networks, Computer Neural,Networks, Neural (Computer),Neural Network (Computer),Neural Network Model,Neural Network, Computational,Neural Network, Computer,Neural Networks, Computational,Perceptron

Related Publications

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Dynamics of winner-take-all competition in recurrent neural networks with lateral inhibition.

January 2007, IEEE transactions on neural networks,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Winner-take-all neural networks using the highest threshold.

January 2000, IEEE transactions on neural networks,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks.

February 2013, IEEE transactions on neural networks and learning systems,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Exploiting Spatio-Temporal Structure With Recurrent Winner-Take-All Networks.

August 2018, IEEE transactions on neural networks and learning systems,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Layer Winner-Take-All neural networks based on existing competitive structures.

January 2000, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Optoelectronic thresholding module for winner-take-all operations in optical neural networks.

March 1994, Applied optics,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Temporal winner-take-all networks: a time-based mechanism for fast selection in neural networks.

January 1993, IEEE transactions on neural networks,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Dynamic analysis of a general class of winner-take-all competitive neural networks.

May 2010, IEEE transactions on neural networks,

Xindi Cai, and Danil V Prokhorov, and Donald C Wunsch

Scaling up molecular pattern recognition with DNA-based winner-take-all neural networks.

July 2018, Nature,