A bayesian criterion for cluster stability

Hoyt Koepke, Bertrand Clarke

Research output: Contribution to journalArticlepeer-review

3 Scopus citations


We present a technique for evaluating and comparing how clusterings reveal structure inherent in the data set. Our technique is based on a criterion evaluating how much point-to-cluster distances may be perturbed without affecting the membership of the points. Although similar to some existing perturbation methods, our approach distinguishes itself in five ways. First, the strength of the perturbations is indexed by a prior distribution controlling how close to boundary regions a point may be before it is considered unstable. Second, our approach is exact in that we integrate over all the perturbations; in practice, this can be done efficiently for well-chosen prior distributions. Third, we provide a rigorous theoretical treatment of the approach, showing that it is consistent for estimating the correct number of clusters. Fourth, it yields a detailed picture of the behavior and structure of the clustering. Finally, it is computationally tractable and easy to use, requiring only a point-to-cluster distance matrix as input. In a simulation study, we show that it outperforms several existing methods in terms of recovering the correct number of clusters. We also illustrate the technique in three real data sets.

Original languageEnglish (US)
Pages (from-to)346-374
Number of pages29
JournalStatistical Analysis and Data Mining
Issue number4
StatePublished - Aug 2013


  • Bayesian
  • Clustering
  • Consistency
  • Heatmap
  • Stability

ASJC Scopus subject areas

  • Analysis
  • Information Systems
  • Computer Science Applications


Dive into the research topics of 'A bayesian criterion for cluster stability'. Together they form a unique fingerprint.

Cite this