交通大数据一种基于微服务的敏捷处理架构设计.pdfVIP

STUDY 研究 53 交通大数据：一种基于微服务的 敏捷处理架构设计 杜圣东，杨燕，滕飞 西南交通大学信息科学与技术学院，四川 成都 610031 摘要 面对智慧交通广泛的大数据应用场景和技术需求，一般大数据系统难以适应多种处理情况并做出快速响 应。针对这一问题，首次提出了敏捷大数据方法论，对其概念、处理流程、核心原则与关键技术等进行了 研究和探索。基于数据科学迭代性本质，设计了面向微服务的敏捷大数据架构，对交通大数据微服务化、 交通大数据融合等关键环节进行了详细设计和论述。敏捷大数据架构的提出为交通大数据环境下的高 效、灵活数据挖掘和机器学习提供了新思路、新方法。 关键词 敏捷大数据；微服务；大数据架构；容器；大数据融合 doi: 10.11959/j.issn.2096-0271.2017030 Traffic big data: an agile architecture design based on micro service DU Shengdong, YANG Yan, TENG Fei School of Information Science and Technology, Southwest Jiaotong University, Chengdu 610031, China Abstract Faced with a wide range of intelligent transportation application scenarios and technical requirements, the general big data system is difficult to adapt to a variety of processing and make a quick response. In order to solve this problem, the methodology of agile big data for the first time was put forward. Based on the iterative nature of data science, the agile big data architecture based on micro service was designed, and the key points of the traffic oriented micro service and data fusion technology were discussed. The agile big data architecture provides new idea and method for efficient and flexible data mining and machine learning under the environment of traffic big data. Key words agile big data, micro service, big data architecture, container, big data fusion 2017030-1 54 BIG DATA RESEARCH 大数据 大数据应用要解决的关键问题。近年来， 以微服务、构件化和数据融合等为代表的 1 引言 大数据架构和关键技术研究备受关注。针 对软件架构的复用性，杨芙清院士等人 [3]