DataminingConceptsandteniques0.ppt

* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * What Is the Problem with PAM? Pam is more robust than k-means in the presence of noise and outliers because a medoid is less influenced by outliers or other extreme values than a mean Pam works efficiently for small data sets but does not scale well for large data sets. O(k(n-k)2 ) for each iteration where n is # of data,k is # of clusters Sampling-based method CLARA(Clustering LARge Applications) * CLARA (Clustering Large Applications) (1990) CLARA (Kaufmann and Rousseeuw in 1990) Built in statistical analysis packages, such as SPlus It draws multiple samples of the data set, applies PAM on each sample, and gives the best clustering as the output Strength: deals with larger data sets than PAM Weakness: Efficiency depends on the sample size A good clustering based on samples will not necessarily represent a good clustering of the whole data set if the sample is biased * CLARANS (“Randomized” CLARA) (1994) CLARANS (A Clustering Algorithm based on Randomized Search) (Ng and Han’94) Draws sample of neighbors dynamically The clustering process can be presented as searching a graph where every node is a potential solution, that is, a set of k medoids If the local optimum is found, it starts with new randomly selected node in search for a new local optimum Advantages: More efficient and scalable than both PAM and CLARA Further improvement: Focusing techniques and spatial access structures (Ester et al.’95) * ROCK: Clustering Categorical Data ROCK: RObust Clustering using linKs S. Guha, R. Rastogi K. Shim, ICDE’99 Major ideas Use links to measure similarity/proximity Not distance-based Algorithm: sampling-based clustering Draw random sample Cluster with links Label data in disk Experiments Congressional voting, mushroom data * Similarity Measure in ROCK Traditional measures for categorical data may not work well, e.g., Jaccard coefficient Example: Two gro