面向hbase的半结构化时空数据存储与查询处理研究.docVIP

面向HBase的半结构化时空数据存储与查询处理研究( 封孝生，， （国防科学技术大学 ，湖南 长沙 410073） 摘要：关键词：；HBase；时空范围查询； 中图分类号： 文献标志码：　　　文章编号： FENG Xiaosheng, ZHANG Chong, CHEN Xiaoying, TANG Jiuyang, GE Bin (Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, China) Abstract: With the development of remote sensing, positioning and other technology, a large amount of spatio-temporal data require scientific management, and thus play its value. In the current research status, a lot of work has focused on how to effectively use HBase to store and quickly find structured spatio-temporal data. But in practice, some temporal data exists in the semi-structured documents, such as metadata that describes the remote sensing products, for such data, the general method is semi-structure used XPath + spatio-temporal query, which is ignored in the previous work. In this paper, we focus on how to effectively achieve semi-structured spatio-temporal data storage and query in HBase. Firstly, the formal description of the problem is issued. Secondly, we proposed HSSST storage model using a semi-structured approach TwigStack. On this basis, semi-structured spatio-temporal range query and kNN queries are carried out. Focus on real experimental data, comparing with MongoDB which need higher hardware configuration, the results show that in the general configuration of the machine, the performance of semi-structured spatio-temporal query algorithm is similar to MongoDB, so that it has the advantage in the practical application. Keywords: spatio-temporal data; semi-structured; HBase; spatio-temporal range query; kNN query; 随着遥感、通信等技术不断深入发展与应用，遥感数据规模呈几何级增长，如何针对海量遥感数据进行高效的面向时空属性的检索，这对数据库时空查询处理技术提出了挑战。前序工作中大部分都是考虑如何索引和检索时空属性，而包含了检索关键字的工作又仅仅是考虑结构化的情况，然而对于检索遥感数据，问题背景发生了变化。通常，遥感数据本身并不是文字直接表现的数据，如卫星遥感图像、气象云图等等，因此检索遥感数据实际上是对描述遥感数据的元数据（也称编目）进行检索，而元数据是用半结构化树形结构（如XML文件）进行描述，那么问题背景变成了如何针对海量的半结构化数据进行时空+半结构化查询语言（如XPath）的检索。 表1显示了一份遥感元数据样例，用户可以通过声明查询地理范围与时间范围以及半