| 并行处理技术在地理信息数据处理中的应用 |
| |
| 引用本文： | 徐道柱,金澄,焦洋洋.并行处理技术在地理信息数据处理中的应用[J].测绘科学技术学报,2016(6):629-634. |
| |
| 作者姓名： | 徐道柱 金澄 焦洋洋 |
| |
| 作者单位： | 1. 信息工程大学,河南郑州450001;地理信息工程国家重点实验室,陕西西安710054;西安测绘研究所,陕西西安710054;2. 地理信息工程国家重点实验室,陕西西安710054;西安测绘研究所,陕西西安710054 |
| |
| 基金项目： | 国家自然科学基金项目(41201469) |
| |
| 摘 要： | 随着地理信息存储量的飞速增长,传统的单进程、集中式的数据处理方式已不能满足基于网络的地理信息服务的效能要求。分析对比了OpenMP,MPI和MapReduce等主流并行编程模式,将关系型数据库与分布式空间数据管理系统相结合,提出了面向并行处理的地理信息存储模型和数据组织模型,将该模型与传统模型进行了对比分析,并基于MapReduce实现了地理空间数据并行处理框架,选取了矢量数据装载、影像数据装载以及数据切片作为典型数据处理案例开展对比实验,该技术方案的处理效率均数倍于传统技术方案。实验表明,该模型能够很好地支持并行处理框架,可为分布式环境下数据处理中心构建提供一个有效解决方案。
|
| 关 键 词： | 并行处理 MapReduce框架 主服务器集群 并行矢量数据模型 数据切片 |
Parallel Processing Technology in Geographic Information Data Processing |
| |
| XU Daozhu,JIN Cheng,JIAO Yangyang.Parallel Processing Technology in Geographic Information Data Processing[J].Journal of Zhengzhou Institute of Surveying and Mapping,2016(6):629-634. |
| |
| Authors: | XU Daozhu JIN Cheng JIAO Yangyang |
| |
| Abstract: | With the rapid growth of geographic information storage,traditional single process and centralized data processing could not satisfy the requirement of the web-based geographic information service.OpenMP,MPI,MapReduce and other mainstream parallel programming mode were analyzed and compared,and the parallel processing oriented geographic information storage model and data organization model were presented by combining relational database with distributed spatial data management system.Through comparing this model with the traditional model,geospatial data parallel processing framework based on MapReduce was implemented,and the loaded vector data,image data and data slice were selected as typical case of data processing to carry out comparative experi ments.The processing efficiency of the technical solution was many times greater than traditional technical programs.Experiments show that this model can support parallel processing framework and provide an effective solution for building data processing centers in the distributed environment. |
| |
| Keywords: | parallel processing MapReduce framework master cluster parallel vector data model data slice |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
|
