排序方式： 共有44条查询结果，搜索用时 296 毫秒
1.
Fei Hu Yongyao Jiang Yun Li Weiwei Song Daniel Q. Duffy 《International Journal of Digital Earth》2020,13(3):410-428
ABSTRACTEarth observations and model simulations are generating big multidimensional array-based raster data. However, it is difficult to efficiently query these big raster data due to the inconsistency among the geospatial raster data model, distributed physical data storage model, and the data pipeline in distributed computing frameworks. To efficiently process big geospatial data, this paper proposes a three-layer hierarchical indexing strategy to optimize Apache Spark with Hadoop Distributed File System (HDFS) from the following aspects: (1) improve I/O efficiency by adopting the chunking data structure; (2) keep the workload balance and high data locality by building the global index (k-d tree); (3) enable Spark and HDFS to natively support geospatial raster data formats (e.g., HDF4, NetCDF4, GeoTiff) by building the local index (hash table); (4) index the in-memory data to further improve geospatial data queries; (5) develop a data repartition strategy to tune the query parallelism while keeping high data locality. The above strategies are implemented by developing the customized RDDs, and evaluated by comparing the performance with that of Spark SQL and SciSpark. The proposed indexing strategy can be applied to other distributed frameworks or cloud-based computing systems to natively support big geospatial data query with high efficiency. 相似文献
2.
基于R树的分布式并行空间索引机制研究 总被引：2，自引：0，他引：2
为提高分布式并行计算环境下海量空间数据管理与并行化处理的效率,基于并行空间索引机制的研究,设计一种多层并行R树空间索引结构。该索引结构以高效率的并行空间数据划分策略为基础,以经典的并行计算方法论为依据,使其结构设计在保证能够获得较好的负载平衡性能的前提下,更适合于海量空间数据的并行化处理。以空间范围查询并行处理的系统响应时间为性能评估指标,通过实验证明并行空间索引结构具有设计合理、性能高效的特点。 相似文献
3.
西藏自治区的耕地多分布在藏东、藏南河谷地带,多数耕地地块破碎,形态各异,并且有大量的非耕地成分混杂其间,即使采用大比例尺图件,也难以测量准确的耕地面积。为准确查清耕地面积,在西藏土地资源调查工作中,独创地采用了彩色红外条带航空摄影,计算机图像处理系统求算彩色红外航空像片耕地样地中非耕地系数值和建立不同地貌、不同耕地类型非耕地系数检索表等系统的方法。该方法已在全藏调查工作中普遍推广,提高了调查精度,缩短了调查时间,大大减少了人力和经费投入。该项研究为我国山区耕地面积调查提供了有效的手段。 相似文献
4.
5.
Franz-Benjamin Mocnik 《制图学和地理信息科学》2013,40(3):277-291
ABSTRACTGeospatial data is often spatially aggregated by the use of Discrete Global Grid Systems. References to grid cells are needed for the communication of such data, and different identifier schemes have accordingly been introduced in literature. These schemes suffer, however, from being hard to understand for non-experts, and the geometry of a cell cannot be inferred from its identifier without complex computations. In this article, a novel identifier scheme that encodes the geographic coordinates of the centroid of a cell is proposed, which comes at the cost of potentially being ambiguous in case of a very fine-grained grid. We reason and computationally demonstrate that ambiguity does though not occur for real-world applications. The novel identifier scheme minimizes the amount of data to be communicated, for example, between a server and a client application, and it allows to infer approximate geometries of the cells only by their identifiers. 相似文献
6.
提出一种三维散乱点云的Voronoi拓扑近邻点集查询算法,该算法改进R*-tree建立三维散乱点云的空间索引结构,采用动态扩展空心球算法获取样点的k近邻点集,通过偏心扩展和自适应扩展获取样点拓扑近邻参考数据,生成该局部点集的Voronoi图,查询样点Voronoi邻域获取样点拓扑近邻点集。通过算法时间复杂度分析及相关实验,证明该算法可快速、准确地获取任意复杂散乱点云的Voronoi拓扑近邻点集。 相似文献
7.
In the emerging era of information and communication technologies, geotechnology is one of the fastest growing fields. Geo-RDBMS is very important and evolving aspect for GIS, as it can manage large volume of spatial data inside RDBMS. The utilization of RDBMS for geospatial data was one of the important focuses of GIS professionals in last decades to store and manage 2D geo-data. However, the support for 3D geo-data inside RDBMS is still limited and is a challenging task for RDBMS providers. In this study, data organization and performance assessment of 3D geo-data inside RDBMS are carried out. In this process, various file-based 3D data models such as CityGML, COLLADA and KML are migrated to geo-RDBMS to bring entire 3D geo-data in common platform. Various spatial indexing techniques viz. R-Tree, B-Tree, GiST, etc. are applied on these 3D data models and best indexing techniques are studied for 3D GIS operations. 相似文献
8.
一测回水平方向标准偏差是衡量经纬仪测量精度的主要指标之一。结合经纬仪计量检定规程的要求,从测量的原理、方法、不确定度分析等方面入手,对电子经纬仪一测回水平方向标准偏差计量检定的两种方法进行比较。结果显示,多齿分度台法和多目标法在测量途径上基本相同,其测量不确定度分析的结果也基本相符。可能是由于在实际的计量检定过程中,计量检定人员、环境条件变化或其他因素造成了测量结果略有差异。 相似文献
9.
《International Journal of Digital Earth》2013,6(9):750-769
Geospatial data are gathered through a variety of different methods. The integration and handling of such datasets within a Digital Earth framework are very important in many aspects of science and engineering. One means of addressing these tasks is to use a Discrete Global Grid System and map points of the Earth's surface to cells. An indexing mechanism is needed to access the data and handle data queries within these cells. In this paper, we present a general hierarchical indexing mechanism for hexagonal cells resulting from the refinement of triangular spherical polyhedra representing the Earth. In this work, we establish a 2D hexagonal coordinate system and diamond-based hierarchies for hexagonal cells that enables efficient determination of hierarchical relationships for various hexagonal refinements and demonstrate its usefulness in Digital Earth frameworks. 相似文献
10.
The Australian Geodynamics Cooperative Research Centre (AGCRC) website <http://www.agcrc. csiro.au/> provides the main integrated presentation of the results of AGCRC research. It hosts a systematic presentation of project summaries, publication abstracts, regionally organised geodynamic syntheses and a GIS database containing a large number of broad‐scale earth science datasets from the Australian region, which are presented through an interactive map viewer. Effective interfaces are required to make the variety of content accessible to users. In particular, maintaining effective hyperlinking for a large and growing set of pages was a significant challenge. We found that by developing effective indexing tools we were able to apply a uniform technology to attack these problems. The index included both the full text of the pages from the website and also specific index terms of metadata. The metadata schema was designed to support both generalised discovery through a search interface and also to allow hyperlinks to be included automatically in pages by the server, so that the user could browse in a richly cross‐linked framework. It was necessary to manage textual and numeric data within the same framework because even the textual documents were generally tied to geospatial locations identified by their geographical coordinates. This required extensions to standard index and search tools, including the development of complete new indexing software. To assist the user in accessing the index, we provided a variety of user interfaces specialised for different themes in the website. For example, publication lists are generated in a conventional layout, and geospatial datasets are presented through an interactive map viewer and query system. The latter also demonstrated how visualisation tools for geospatial data can be provided in the web‐browser interface. 相似文献