Intranet Feed RSS

Hierarchical clustering using mutual information

TitleHierarchical clustering using mutual information
Publication TypeJournal Article
2005
AuthorsKraskov A, Stogbauer H, Andrzejak RG, Grassberger P
JournalEUROPHYSICS LETTERS
Volume70
Pagination278-284
Date PublishedAPR
ISSN0295-5075

We present a conceptually simple method for hierarchical clustering of data called mutual information clustering ( MIC) algorithm. It uses mutual information (MI) as a similarity measure and exploits its grouping property: The MI between three objects X, Y, and Z is equal to the sum of the MI between X and Y, plus the MI between Z and the combined object (XY). We use this both in the Shannon (probabilistic) version of information theory and in the Kolmogorov ( algorithmic) version. We apply our method to the construction of phylogenetic trees from mitochondrial DNA sequences and to the output of independent components analysis (ICA) as illustrated with the ECG of a pregnant woman.

10.1209/epl/i2004-10483-y