August 12, 2007.ppt

KDD-07 Invited Innovation Talk August 12, 2007 Thanks and Gratitude My family: my wife Kristina and my 4 kids; my parents and my sisters My academic roots: The University of Michigan, Ann Arbor – my Ph.D. committee, including Ramasamy Uthurusamy (then at GM Research Labs), grad student colleagues (Jie Cheng), Internships at GM Research and at NASA’s JPL My Mentors and Collaborators Caltech Astronomy (G. Djorgovski, Nick Weir), Pietro Perona and M.C. Burl JPLNASA Colleagues: Padhraic Smyth, Rich Doyle, Steve Chien, Paul Stolorz, Peter Cheeseman, David Atkinson, many others… Microsoft Colleagues: Decision Theory Group, Surajit Chadhuri, Jim Gray, Paul Bradley, Bassel Ojjeh, Nick Besbeas, Heikki Mannila, Rick Rashid, many others Fellows in KDD: Gregpry Piatetsky-Shapiro, Daryl Pregibon, Christos Faloutsos, Geoff Webb, Bob Grossman, Jiawei Han, Eric Tsui, Tharam Dillon, Chengqi Zhang, many, many colleagues My Business Partners Bassel Ojjeh, Nick Besbeas, many VC’s, many advisers and strategic clients including Microsoft SQL Server and sales teams My Yahoo! Colleagues: Zod Nazem, Jerry Yang, David Filo, Yahoo! exec team, Prabhakar Raghavan, Pavel Berkhin, Nick Weir, Hunter Madsen, Nitin Sharma, Raghu Ramakrishnan, Y! Research folks, many at Yahoo SDS and current and previous Yahoo! employees A Data Miner’s Story – Getting to Know the Grand Challenges Personal Observations of a Data Mining Disciple Overview The setting Why data mining is a must? Why data mining is not happening? A Data Miner’s Story Grand Challenges: Pragmatic Grand Challenges: Technical Some case studies Concluding Remarks The data gap… The Machinery Moves on: Moore’s law: processing “capacity” doubles every 18 months : CPU, cache, memory It’s more aggressive cousin: Disk storage “capacity” doubles every 9 months The Demand is exploding: Every business is an eBusiness Scientific Instruments and Moore’s law Government The Internet – the ubiquity of the Web The Talent Shortage What is Data Mining? Fin