从应用的角度看大数据挖掘.pdf

STUDY 研究 大数据时代的数据挖掘 —— 从应用的角度看大数据挖掘 1,2 1,2 1,2 3 1,2 李 ，曾春秋涛 ，周武柏 ，周绮凤 ，郑 理 1. 南京邮电大学计算机学院 南京 210023；2. 美国佛罗里达国际大学 迈阿密 33199； 3. 厦门大学自动化系 厦门 361005 摘要 介绍了大数据时代数据挖掘的特点、任务及难点，分析了大数据挖掘的核心架构，提出大数据的核心和本 质，即应用、算法、数据和平台4个要素的有机结合。在此基础上介绍了本团队研究设计的大数据挖掘系统 FIU-Miner。该系统是一个用户友好并支持在分布式环境中进行高效率计算和算法快速集成的数据挖掘系 统平台，使得数据分析人员能够快速有效地进行各类数据挖掘任务。最后，介绍了基于FIU-Miner的3个典 型的成功应用案例：高端制造业数据挖掘、空间数据挖掘和商务智能数据挖掘。 关键词 大数据；数据挖掘；FIU-Miner；高端制造业；空间数据挖掘；商务智能 doi: 10.11959/j.issn.2096-0271.2015041 Data Mining in the Era of Big Data: From the Application Perspective 1,2 1,2 1,2 3 1,2 Li Tao , Zeng Chunqiu , Zhou Wubai , Zhou Qifeng , Zheng Li 1. School of Computer Science Technology, Nanjing University of Posts and Telecommunications, Nanjing 210023, China; 2. School of Computer Science, Florida International University, Miami 33199, USA; 3. Department of Automation, Xiamen University, Xiamen 361005, China Abstract The technical characteristics, tasks, and difficulties of data mining in big data era were introduced. The system architecture of large-scale data mining was analyzed. Then, the developed FIU-Miner which is a fast, integrated, and user-friendly system for data mining, was introduced. FIU-Miner supports user-friendly rapid data mining task configuration, flexible cross-language program integration, and effective resource management in heterogeneous environments. Finally three successful real-world applications of FIU-Miner: advanced manufacturing data mining, spatial data mining, and business intelligence data mining, were presented to demonstrate its efficacy and effectiveness. Key words big data, data mining, FIU-Miner, advanced manufacturing, spatial data mining,