DataminingConceptsandteniques7.ppt

* * * * * * Example in real life, like number of coauthors. * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * Example in real life, like number of coauthors. * Redundancy-Award Top-k Patterns Why redundancy-aware top-k patterns? Desired patterns: high significance low redundancy Propose the MMS (Maximal Marginal Significance) for measuring the combined significance of a pattern set Xin et al., Extracting Redundancy-Aware Top-K Patterns, KDD’06 * Chapter 7 : Advanced Frequent Pattern Mining Pattern Mining: A Road Map Pattern Mining in Multi-Level, Multi-Dimensional Space Constraint-Based Frequent Pattern Mining Mining High-Dimensional Data and Colossal Patterns Mining Compressed or Approximate Patterns Pattern Exploration and Application Summary Do they all make sense? What do they mean? How are they useful? diaper beer female sterile (2) tekele Annotate patterns with semantic information morphological info. and simple statistics Semantic Information Not all frequent patterns are useful, only meaningful ones … How to Understand and Interpret Patterns? Word: “pattern” – from Merriam-Webster A Dictionary Analogy Non-semantic info. Examples of Usage Definitions indicating semantics Synonyms Related Words put this earlier, following the example... our work is motivated by the analogy... remove the sentence, make the figure larger. show only one definition box Semantic Analysis with Context Models Task1: Model the context of a frequent pattern Based on the Context Model … Task2: Extract strongest context indicators Task3: Extract representative transactions Task4: Extract semantically similar patterns Annotating DBLP Co-authorship Title Pattern Substructure Similarity Search in Graph Databases X.Yan, P. Yu, J. Han … … … … Database: Title Authors Frequent Patterns P1: { x_yan, j_han } Frequent Itemset P2: “substructure search” Pattern { x_yan, j_han} Non Sup = … CI {p_yu}, graph pattern