Similarity Join.pptVIP

continue 报告中所介绍的算法，都是基于SET的。如图 * * * * * * * * * * * * * * * * * * * * * * Efficient Similarity Joins for Near Duplicate Detection Efficient Similarity Joins for Near Duplicate Detection Similarity Join Wu Yang 2009.4.9 Main work MS--A Primitive Operator for Similarity Joins in Data Cleaning ICDE 2006 Google--Scaling Up All Pairs Similarity Search www2007 University of New South Wales NICTA Australia – Chuan Xiao， Wei Wang， Xuemin Lin PPJoin：Efficient Similarity Joins for Near Duplicate Detection，WWW2008， EdJoin:An Efficient Algorithm for Similarity Joins With Edit Distance Constraints，VLDB 2008 Approximate Entity Extraction with Edit Distance Constraints. SIGMOD 2009 Top-k Set Similarity Joins. ICDE 2009 * * * * Outline Motivation Algorithms Experiments Thinking * * Near Duplicate Data On one end, a winded Pete Sampras tried to summon enough energy to give the New York fans another memorable win to talk about it on the subway ride home. On the other side, Roger Federer wore a sly grin like he knew age was about to catch up to the former world No. 1 - the man who owns the record of 14 Grand Slams he wants. 03/11/2008 | 11:28 AM By JAY COHEN, AP Sports Writer Mar 11, 4:23 am EDT App: deduplication /2 * * App: data integration / record linkage Efficient Similarity Joins for Near Duplicate Detection * * * * Applications For Web search engines: Perform focused crawling Increase the quality and diversity of query results Identify spams. For Web mining: Perform document clustering Find replicate Web collections Detect plagiarism SPAM TEMPLATE Sir/Madam, We happily announce to you the draw of the EURO MILLIONS SPANISH LOTTERY INTERNATIONAL WINNINGS PROGRAM PROMOTIONS held on the 27TH MARCH 2008 in SPAIN. Your company or your personal e-mail address attached to ticket number 653-908-321-675 with serial main number NUMBER drew lucky star winning numbers NUMBER which consequently won in the 2ND category, you have therefore been approved