BIOMAT Database Logo BIOMAT Database Logo

Feature selection based on mutual information and redundancy-synergy coefficient. 2004

Sheng Yang, and Jun Gu
Institute of Image Processing & Pattern Recognition, Shanghai Jiaotong University, Shanghai 200030, China. yangsheng@sjtu.edu.cn.

Mutual information is an important information measure for feature subset. In this paper, a hashing mechanism is proposed to calculate the mutual information on the feature subset. Redundancy-synergy coefficient, a novel redundancy and synergy measure of features to express the class feature, is defined by mutual information. The information maximization rule was applied to derive the heuristic feature subset selection method based on mutual information and redundancy-synergy coefficient. Our experiment results showed the good performance of the new feature selection method.

UI MeSH Term Description Entries
D010363 Pattern Recognition, Automated In INFORMATION RETRIEVAL, machine-sensing or identification of visible patterns (shapes, forms, and configurations). (Harrod's Librarians' Glossary, 7th ed) Automated Pattern Recognition,Pattern Recognition System,Pattern Recognition Systems
D011381 Programming Languages Specific languages used to prepare computer programs. Language, Programming,Languages, Programming,Programming Language
D003628 Database Management Systems Software designed to store, manipulate, manage, and control data for specific uses. Data Base Management Systems,Management System, Data Base,Management Systems, Data Base,System, Data Base Management,Systems, Data Base Management,Database Management System
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D001185 Artificial Intelligence Theory and development of COMPUTER SYSTEMS which perform tasks that normally require human intelligence. Such tasks may include speech recognition, LEARNING; VISUAL PERCEPTION; MATHEMATICAL COMPUTING; reasoning, PROBLEM SOLVING, DECISION-MAKING, and translation of language. AI (Artificial Intelligence),Computer Reasoning,Computer Vision Systems,Knowledge Acquisition (Computer),Knowledge Representation (Computer),Machine Intelligence,Computational Intelligence,Acquisition, Knowledge (Computer),Computer Vision System,Intelligence, Artificial,Intelligence, Computational,Intelligence, Machine,Knowledge Representations (Computer),Reasoning, Computer,Representation, Knowledge (Computer),System, Computer Vision,Systems, Computer Vision,Vision System, Computer,Vision Systems, Computer
D012984 Software Sequential operating programs and data which instruct the functioning of a digital computer. Computer Programs,Computer Software,Open Source Software,Software Engineering,Software Tools,Computer Applications Software,Computer Programs and Programming,Computer Software Applications,Application, Computer Software,Applications Software, Computer,Applications Softwares, Computer,Applications, Computer Software,Computer Applications Softwares,Computer Program,Computer Software Application,Engineering, Software,Open Source Softwares,Program, Computer,Programs, Computer,Software Application, Computer,Software Applications, Computer,Software Tool,Software, Computer,Software, Computer Applications,Software, Open Source,Softwares, Computer Applications,Softwares, Open Source,Source Software, Open,Source Softwares, Open,Tool, Software,Tools, Software
D014584 User-Computer Interface The portion of an interactive computer program that issues messages to and receives commands from a user. Interface, User Computer,Virtual Systems,User Computer Interface,Interface, User-Computer,Interfaces, User Computer,Interfaces, User-Computer,System, Virtual,Systems, Virtual,User Computer Interfaces,User-Computer Interfaces,Virtual System
D016208 Databases, Factual Extensive collections, reputedly complete, of facts and data garnered from material of a specialized subject area and made available for analysis and application. The collection can be automated by various contemporary methods for retrieval. The concept should be differentiated from DATABASES, BIBLIOGRAPHIC which is restricted to collections of bibliographic references. Databanks, Factual,Data Banks, Factual,Data Bases, Factual,Data Bank, Factual,Data Base, Factual,Databank, Factual,Database, Factual,Factual Data Bank,Factual Data Banks,Factual Data Base,Factual Data Bases,Factual Databank,Factual Databanks,Factual Database,Factual Databases
D016247 Information Storage and Retrieval Organized activities related to the storage, location, search, and retrieval of information. Information Retrieval,Data Files,Data Linkage,Data Retrieval,Data Storage,Data Storage and Retrieval,Information Extraction,Information Storage,Machine-Readable Data Files,Data File,Data File, Machine-Readable,Data Files, Machine-Readable,Extraction, Information,Files, Machine-Readable Data,Information Extractions,Machine Readable Data Files,Machine-Readable Data File,Retrieval, Data,Storage, Data
D040362 Geographic Information Systems Computer systems capable of assembling, storing, manipulating, and displaying geographically referenced information, i.e. data identified according to their locations. Geographical Information Systems,Global Positioning System,Global Positioning Systems,Geographic Information System,Geographical Information System,Information System, Geographic,Information System, Geographical,Information Systems, Geographic,Information Systems, Geographical,Positioning System, Global,Positioning Systems, Global,System, Geographical Information,System, Global Positioning,Systems, Geographical Information,Systems, Global Positioning

Related Publications

Sheng Yang, and Jun Gu
Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy.
August 2005, IEEE transactions on pattern analysis and machine intelligence,
Sheng Yang, and Jun Gu
Feature selection based on fuzzy joint mutual information maximization.
November 2020, Mathematical biosciences and engineering : MBE,
Sheng Yang, and Jun Gu
Normalized mutual information feature selection.
February 2009, IEEE transactions on neural networks,
Sheng Yang, and Jun Gu
[Facial expression recognition based on feature selection by quadratic mutual information].
June 2008, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi,
Sheng Yang, and Jun Gu
Mutual information-based feature selection for low-cost BCIs based on motor imagery.
August 2016, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Sheng Yang, and Jun Gu
A Novel Nonparametric Feature Selection Approach Based on Mutual Information Transfer Network.
September 2022, Entropy (Basel, Switzerland),
Sheng Yang, and Jun Gu
On the feature selection criterion based on an approximation of multidimensional mutual information.
July 2010, IEEE transactions on pattern analysis and machine intelligence,
Sheng Yang, and Jun Gu
McTwo: a two-step feature selection algorithm based on maximal information coefficient.
March 2016, BMC bioinformatics,
Sheng Yang, and Jun Gu
EEG feature selection method based on maximum information coefficient and quantum particle swarm.
September 2023, Scientific reports,
Sheng Yang, and Jun Gu
Semisupervised Feature Selection Based on Relevance and Redundancy Criteria.
September 2017, IEEE transactions on neural networks and learning systems,
Copied contents to your clipboard!