Statistical significance for hierarchical clustering. 2017

Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
Department of Statistics and Operations Research, University of North Carolina at Chapel Hill, North Carolina, U.S.A.

Cluster analysis has proved to be an invaluable tool for the exploratory and unsupervised analysis of high-dimensional datasets. Among methods for clustering, hierarchical approaches have enjoyed substantial popularity in genomics and other fields for their ability to simultaneously uncover multiple layers of clustering structure. A critical and challenging question in cluster analysis is whether the identified clusters represent important underlying structure or are artifacts of natural sampling variation. Few approaches have been proposed for addressing this problem in the context of hierarchical clustering, for which the problem is further complicated by the natural tree structure of the partition, and the multiplicity of tests required to parse the layers of nested clusters. In this article, we propose a Monte Carlo based approach for testing statistical significance in hierarchical clustering which addresses these issues. The approach is implemented as a sequential testing procedure guaranteeing control of the family-wise error rate. Theoretical justification is provided for our approach, and its power to detect true clustering structure is illustrated through several simulation studies and applications to two cancer gene expression datasets.

UI MeSH Term Description Entries
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D016000 Cluster Analysis A set of statistical methods used to group variables or observations into strongly inter-related subgroups. In epidemiology, it may be used to analyze a closely grouped series of events or cases of disease or other health-related phenomenon with well-defined distribution patterns in relation to time or place or both. Clustering,Analyses, Cluster,Analysis, Cluster,Cluster Analyses,Clusterings
D023281 Genomics The systematic study of the complete DNA sequences (GENOME) of organisms. Included is construction of complete genetic, physical, and transcript maps, and the analysis of this structural genomic information on a global scale such as in GENOME WIDE ASSOCIATION STUDIES. Functional Genomics,Structural Genomics,Comparative Genomics,Genomics, Comparative,Genomics, Functional,Genomics, Structural

Related Publications

Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
December 2003, BMC bioinformatics,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
October 2020, Physical review. E,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
January 2015, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
January 2024, Journal of the American Statistical Association,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
November 2010, Physical review letters,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
September 1967, Psychometrika,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
July 2008, Biostatistics (Oxford, England),
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
March 2023, Briefings in bioinformatics,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
April 2002, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society,
Patrick K Kimes, and Yufeng Liu, and David Neil Hayes, and James Stephen Marron
November 2012, Neural networks : the official journal of the International Neural Network Society,
Copied contents to your clipboard!