Class conditional nearest neighbor for large margin instance selection. 2010

Elena Marchiori
Institute for Computing and Information Sciences (ICIS), Faculty of Science, Radboud University, Toernooiveld 1, NL 6525 ED Nijmegen, The Netherlands. elenam@cs.ru.nl

This paper presents a relational framework for studying properties of labeled data points related to proximity and labeling information in order to improve the performance of the 1NN rule. Specifically, the class conditional nearest neighbor (ccnn) relation over pairs of points in a labeled training set is introduced. For a given class label c, this relation associates to each point a its nearest neighbor computed among only those points with class label c (excluded a). A characterization of ccnn in terms of two graphs is given. These graphs are used for defining a novel scoring function over instances by means of an information-theoretic divergence measure applied to the degree distributions of these graphs. The scoring function is employed to develop an effective large margin instance selection method, which is empirically demonstrated to improve storage and accuracy performance of the 1NN rule on artificial and real-life data sets.

UI MeSH Term Description Entries

Related Publications

Elena Marchiori
July 2005, IEEE transactions on neural networks,
Elena Marchiori
October 2012, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society,
Elena Marchiori
November 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Elena Marchiori
December 2019, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy,
Elena Marchiori
January 2004, Statistical applications in genetics and molecular biology,
Elena Marchiori
March 2012, IEEE transactions on pattern analysis and machine intelligence,
Elena Marchiori
January 2016, Journal of the American Statistical Association,
Elena Marchiori
January 2002, Methods in molecular biology (Clifton, N.J.),
Elena Marchiori
January 2011, IEEE transactions on pattern analysis and machine intelligence,
Copied contents to your clipboard!