共查询到20条相似文献，搜索用时 31 毫秒
1.
2.
随着计算机技术的发展,以消息传递接口(MPI)标准为代表的高性价比集群计算技术使并行计算在大量传统的专业领域也得到了广泛应用.数字流域模型因需要对大范围流域进行分布式的水文、泥沙过程模拟而提出了较大规模的计算需求.同时,基于分水岭的单元划分方式和专门的河网编码方法使数字流域模型的并行化计算具有先天优势.提出了一种典型的并行调度流程,用于完成产汇流计算的动态任务分配.在自主搭建的MPI计算集群上进行的应用实验表明,集群计算提高了数字流域模型的计算效率,能够作为模型的计算平台.最后指出了此应用计算平台的发展方向. 相似文献
3.
基于曙光3000计算环境的寒旱区资源环境数据平台建设 总被引：2，自引：0，他引：2
通过对寒区旱区资源环境研究中已积累的大量特色数据、应用模式和程序的分析,对分布式网络环境中的数据采集与管理、应用模式和程序的移植集成、应用程序与数据的交互访问等技术进行了讨论,提出建立由数据中心、中间件服务、应用服务、一站式管理组成的数据平台是提高数据利用效率,方便实现数据与应用集成,提高科研效率的一种有效途径之一.对数据平台建设的主要思路及实现技术进行了详细讨论,并在实验基础上,初步建立了基于曙光3000高性能计算环境的寒区旱区资源环境数据平台,为以后的数据网格建设做了一定的技术准备. 相似文献
4.
A hierarchical organization approach of multi-dimensional remote sensing data for lightweight Web Map Services 总被引：1，自引：0，他引：1
Yongwang Zhao Chunyang Hu Hualei Shen Dianfu Ma Xuan Li Yonggang Huang 《Earth Science Informatics》2012,5(1):61-75
With the rapid development of the World Wide Web, remote sensing (RS) data have become available to a wider range of public/professional
users than ever before. Web Map Services (WMSs) provide a simple Web interface for requesting RS data from distributed geospatial
databases. RS data providers typically expect to provide lightweight WMSs. They have a low construction cost, and can be easily
managed and deployed on standard hardware/software platforms. However, existing systems for WMSs are often heavyweight and
inherently hard to manage, due to their improper usage of databases or data storage. That is, they are not suitable for public
data services on the Web. In addition, RS data are moving toward the multi-dimensional paradigm, which is characterized by
multi-sensor, multi-spectral, multi-temporal and high resolution. Therefore, an efficient organization and storage approach
of multi-dimensional RS data is needed for lightweight WMSs, and the efficient WMSs must support multi-dimensional Web browsing.
In this paper, we propose a Global Remote Sensing Data Hierarchical Model (GRHM) based on the image pyramid and tiling techniques.
GRHM is a logical model that is independent upon physical storage. To support lightweight WMSs, we propose a physical storage
structure, and deploy multi-dimensional RS data on Web servers. To further improve the performance of WMSs, a data declustering
method based on Hilbert space-filling curve is adopted for the distributed storage. We also provide an Open Geospatial Consortium
(OGC) WMS and a Web map system in Web browsers. Experiments conducted on real RS datasets show promising performance of the
proposed lightweight WMSs. 相似文献
5.
为了对砂岩型铀矿钻孔数据及地质资料进行汇集整理,建设铀矿地质钻孔及勘查信息数据库,实现对钻孔资料的统一管理,提高钻孔地质资料集成应用的工作效率,面向实际应用需求,设计并实现了铀矿综合管理信息平台。提出了铀矿大数据平台基础设施、信息资源、应用服务、用户交互的4层架构,采用云计算虚拟化、分布式储存、并行计算等技术建立了铀矿大数据基础环境,提升了铀矿钻孔大数据集的统一存储管理和计算能力;实现了多源异构钻孔数据智能化抽取、高效率转换及快速装载的目标,提高了数据管理及集成应用的工作效率;基于并行计算技术,实现了钻孔数据进行快速三维可视化表达及多条件快速查询功能,为铀矿勘查、成果集成提供了数据基础和信息技术支撑。 相似文献
6.
Viewshed analysis is widely used in many terrain applications such as siting problem, path planning problem, and etc. But viewshed computation is very time-consuming, in particular for applications with large-scale terrain data. Parallel computing as a mainstream technique with the tremendous potential has been introduced to enhance the computation performance of viewshed analysis. This paper presents a revised parallel viewshed computation approach based on the existing serial XDraw algorithm in a distributed parallel computing environment. A layered data-dependent model for processing data dependency in the XDraw algorithm is built to explore scheduling strategy so that a fine-granularity scheduling strategy on the process-level and thread-level parallel computing model can be accepted to improve the efficiency of the viewshed computation. And a parallel computing algorithm, XDraw-L, is designed and implemented taken into account this scheduling strategy. The experimental results demonstrate a distinct improvement of computation performance of the XDraw-L algorithm in this paper compared with the coarse-partition algorithm, like XDraw-E which is presented by Song et al. (Earth Sci Inf 10(5):511–523, 2016), and XDraw-B that is the basic algorithm of serial XDraw. Our fine-granularity scheduling algorithm can greatly improve the scheduling performance of the grid cells between the layers within a triangle region. 相似文献
7.
《Physics and Chemistry of the Earth, Part A: Solid Earth and Geodesy》1999,24(3):179-189
In geosciences the necessity of combining geological and geophysical information as well as applying tools for designing 3D geological and geophysical models is well accepted. Nevertheless, in most cases this demand is only put into practice by file transfer between the applications. The creation of a common 3D model is complicated by the inflexible handling of new and reinterpreted data and by changing applications, heterogeneous operating systems and/or hardware platforms. We present a new approach for a component based GIS which is coupled with an object oriented database management system. The original data, as well as the derived data and the 3D models, are stored in the extensible database. Geological and geophysical 3D modeling tools have direct access to the database via the Common Object Request Broker Architecture (COREA). By this means, we obtained both the integration of the software components and independence from changing software applications and changing platforms, finally resulting in an interoperable 3D GIS. 相似文献
8.
Dave R. Stegman Louis Moresi Robert Turnbull Julian Giordani Patrick Sunter Alan Lo Steve Quenette 《Visual Geosciences》2008,13(1):71-84
High-performance computing provides unprecedented capabilities to produce higher resolution 4-D models in a fraction of time.
Thus, the need exists for a new generation of visualization systems able to maintain parity with the enormous volume of data
generated. In attempting to write this much data to disk, each computational step introduces a significant performance bottleneck,
yet most existing visualization software packages inherently rely on reading data in from a dump file. Available packages
make this assumption of postprocessing at quite a fundamental level and are not very well suited for plotting very large numbers
of specialized particles. This necessitates the creation of a new visualization system that meets the needs of large-scale
geodynamic modeling. We have developed such a system, gLucifer, using a software framework approach that allows efficient
reuse of our efforts in other areas of research. gLucifer is capable of producing movies of a 4-D data set “on the fly” (simultaneously
with running the parallel scientific application) without creating a performance bottleneck. By eliminating most of the human
efforts involved in visualizing results through postprocessing, gLucifer reconnects the scientist to the numerical experiment
as it unfolds. Data sets that were previously very difficult to even manage may be efficiently explored and interrogated without
writing to disk, and because this approach is based entirely on memory distributed across as many processors as are being
utilized by the scientific application, the visualization solution is scalable into terabytes of data being rendered in real
time. 相似文献
9.
随着云GIS理念的提出及深化, 继局部网软件的C/S结构、互联网软件的B/S结构之后, 提出新一代适合云计算、云服务的软件结构——T-C-V结构(terminal-cloud-virtual), 并从基本概念、总体结构及核心技术等方面对其进行了详细阐述.在该结构中, V层基于底层的虚拟化软硬件设备, 屏蔽不同计算机、不同网络、不同存储设备的异构特性, 为上层应用提供统一高效的运行环境; C层是海量地理信息数据、服务和资源管理与服务体系框架; T层面向政府、企业、公众等信息使用者, 提供标准访问接口, 搭建各类终端应用.可以说, T-C-V结构将改变地理信息服务模式、计算模式和商业模式, 可以更好的交互、更加透明化的创建面向大众和企业的应用. 相似文献
10.
Paolo Mazzetti Giuseppe Puglisi Luca D’Auria Roberto Roncella Danilo Reitano Riccardo Merenda Stefano Nativi 《Earth Science Informatics》2017,10(4):443-455
This paper presents the Virtual Research Environment (VRE) enabling two European GEO Geohazard Supersites in Italy. According to GEO (Group on Earth Observation) vision, Geohazard Supersites provide access to spaceborne and in-situ geophysical data and models for selected sites prone to natural hazards –noticeably, earthquakes and volcano eruptions. The VRE was implemented in the framework of the Mediterranean Supersite Volcanoes (MED-SUV) project, funded by the European Commission. MED-SUV realized one of the European supersite demonstrators covering the two Permanent Supersites selected in Italy: Mt. Etna and Campi Flegrei/Vesuvius. The MED-SUV VRE provides advanced services for heterogeneous data and information management and sharing. MED-SUV started identifying the main supersite requirements including: the interoperability with existing data/information supply systems, the support of policy-based access control, the access to processing capabilities provided by external platforms, the management resources for publishing and sharing new products, the integration with significant global systems such as GEOSS and EPOS. MED-SUV adopted a System of Systems (SoS) approach to address interoperability with the identified heterogeneous systems supplying data and information. The SoS approach is based on a brokering architecture, where a specialized component (i.e the MED-SUV Broker: MSB) connects the existing and next-coming data sources leaving them autonomous. MSB carries out all the necessary mediation and harmonization tasks exposing standard interfaces enabling the interconnection with external systems like GEOSS and EPOS. In addition, MSB is accessible via a JavaScript library implementing Web APIs to facilitate the development of Web and mobile applications. 相似文献
11.
Earth Science community depends on the exploration, analysis and reprocessing of high volumes of data as well as the modeling and simulation of complex coupled systems on multiple scales. The main aim of this article is to introduce a new hydrological modeling service based on the Soil and Water Assessment Tool (SWAT) (Arnold et al. J American Water Resour Assoc 34(1), 73–89, 1998 ; Arnold and Fohrer Hydrol Process 19(3), 563–572, 2005) model using high efficiency, resource sharing and low cost cloud computing resources (Astsatryan et al. International Journal of Scientific & Engineering Research 1(1), 1130–1133, 2014). Such a Desktop as a Service (DaaS) approach allowing users to work from anywhere, and gives centralized desktop management and great performance. Within the Spatial Data Infrastructure (SDI) and cloud platform, the DaaS service gives secure access to the model and a centralized data storage to get a SWAT model input. The article illustrates the analyses of the implementation of the SWAT model for the Sotk watershed of Lake Sevan in Armenia (Sargsyan 2007). 相似文献
12.
逆时偏移是目前精度最高的地震数据叠前深度偏移方法,但高强度的计算需求限制了其在工业生产领域的大规模应用。可编程图形处理器的发展为逆时偏移的快速计算提供了一种新的计算选择。围绕如何在图形处理器上开展逆时偏移计算展开,总结了图形处理器计算的优化关键,并根据逆时偏移的特点着重介绍了两个优化环节：一个是应用随机边界条件,以计算换存储,减少数据在主机和图形处理器间的传输;二是应用共享存储器来存储正演计算的波场,相比全局存储器,提高了数据读取的带宽。应用Marmousi模型数据对经过上述优化后的程序进行了测试,结果表明,图形处理器逆时偏移程序得到了很好的优化,提高了计算效率。 相似文献
13.
中国地质调查局用了近10年时间,在基础地质调查和矿产调查领域基本完成了地质调查全流程数字化过程。在"云"计算与大数据技术等新一代信息技术的兴起大环境下,未来5至10年,地质调查主流程信息化的方向和目标是什么呢?本文基于新一代信息智能技术和智能设备在地质调查数据采集、数据分析处理、数据交换传输、三维建模、信息泛在服务、业务管理全面深度融合的基础上,结合智能空间与普适计算概念给出了智能地质调查定义,提出了基于云计算和Hadoop生态体系为基础的天地空一体化的智能地质调查体系、架构和应用模式,并对其关键技术进行了讨论。 相似文献
14.
Fabrizio Murgia Riccardo Biddau Alessandro Concas Roberto Demontis Luca Fanfani Zeno Heilmann Cristian Lai Giuditta Lecca Eva Lorrai Marino Marrocu Vittorio Alessandro Marrone Laura Muscas Elisaveta Peneva Andrea Piras Massimo Pisu Gabriella Pusceddu Guido Satta Daniela Theis Andrea Vacca Paolo Valera Ana Melina Vallenilla Ferrara Ernesto Bonomi 《Earth Science Informatics》2009,2(1-2):5-21
GRIDA3 (Shared Resources Manager for Environmental Data Analysis and Applications) is a multidisciplinary project designed to deliver an integrated system to forge solutions to some environmental challenges such as the constant increase of polluted sites, the sustainability of natural resources usage and the forecast of extreme meteorological events. The GRIDA3 portal is mainly based on Web 2.0 technologies and EnginFrame framework. The portal, now at an advanced stage of development, provides end-users with intuitive Web-interfaces and tools that simplify job submission to the underneath computing resources. The framework manages the user authentication and authorization, then controls the action and job execution into the grid computing environment, collects the results and transforms them into an useful format on the client side. The GRIDA3 Portal framework will provide a problem-solving platform allowing, through appropriate access policies, the integration and the sharing of skills, resources and tools located at multiple sites across federated domains. 相似文献
15.
遥感在流域综合管理与流域科学研究中得到广泛应用并发挥着不可替代的作用。重点阐述了流域遥感的内涵、进展与面临的挑战，系统总结了相关的流域遥感数据产品。流域遥感研究流域下垫面、水循环、水资源、水灾害、流域生态的遥感解析能力并提供相关的遥感数据产品。流域遥感数据产品正逐步成为不断更新的公共产品和服务，满足了流域管理监测信息及时性、完整性、连续性和高精度的要求。流域遥感与云计算的结合，可降低流域遥感数据产品生成的技术瓶颈；与云服务结合，可降低流域遥感数据产品的应用难度和成本，将是流域遥感走向实用的主流方向，从而为流域综合管理提供全方位的信息支撑。 相似文献
16.
Krisanadej Jaroensutasinee Wittaya Pheera Mullica Jaroensutasinee 《Earth Science Informatics》2014,7(3):205-213
As large quantities of physical data are always collected for Ecoinformatics research, it is difficult for them to be cleaned, shared, visualized, and analyzed by research collaborators. To resolve this difficulty, this study presents online weather data analysis and visualization cyber-infrastructures consisting of (1) online weather data analysis and visualization tools and (2) near real-time online weather data portal. Firstly, these online tools at www.twibl.org/weather provide data sharing in three web pages: information on instruments and site; data access protected by simple password security; data analysis and visualization services so-called “Ecoinfows”. Secondly, the near real-time online weather data portal for visualizing and forecasting weather data from cloud storage of many automatic weather stations is online at www.twibl.org/aaportal. To overcome speed and accessibility problems, we developed these tools with many technologies - i.e. cloud computing, online computing XML (webMathematica), and binary access data conversion. 相似文献
17.
Chris A. Mattmann Duane Waliser Jinwon Kim Cameron Goodale Andrew Hart Paul Ramirez Dan Crichton Paul Zimdars Maziyar Boustani Kyo Lee Paul Loikith Kim Whitehall Chris Jack Bruce Hewitson 《Earth Science Informatics》2014,7(1):1-12
The Regional Climate Model Evaluation System (RCMES) facilitates the rapid, flexible inclusion of NASA observations into climate model evaluations. RCMES provides two fundamental components. A database (RCMED) is a scalable point-oriented cloud database used to elastically store remote sensing observations and to make them available using a space time query interface. The analysis toolkit (RCMET) is a Python-based toolkit that can be delivered as a cloud virtual machine, or as an installer package deployed using Python Buildout to users in order to allow for temporal and spatial regridding, metrics calculation (RMSE, bias, PDFs, etc.) and end-user visualization. RCMET is available to users in an “offline”, lone scientist mode based on a virtual machine dynamically constructed with model outputs and observations to evaluate; or on an institution’s computational cluster seated close to the observations and model outputs. We have leveraged RCMES within the content of the Coordinated Regional Downscaling Experiment (CORDEX) project, working with the University of Cape Town and other institutions to compare the model output to NASA remote sensing data; in addition we are also working with the North American Regional Climate Change Assessment Program (NARCCAP). In this paper we explain the contribution of cloud computing to RCMES’s specifically describing studies of various cloud databases we evaluated for RCMED, and virtualization toolkits for RCMET, and their potential strengths in delivering user-created dynamic regional climate model evaluation virtual machines for our users. 相似文献
18.
Using digital elevation models (DEMs), viewshed analysis algorithms determine the visibility of each point on the terrain at a given location in space. As a data-parallel algorithm, real-time viewshed analysis from grid DEM poses a practical challenge to personal computer (PC) users, particularly when dealing with higher resolution and accuracy of large terrain data. Therefore, this paper presents a universal domain decomposition algorithm based on an equal-area strategy for the parallel viewshed analysis on a PC cluster system. The approach uses a scan-line filling method for data partitioning of the irregular bounding polygon of the terrain. The terrain data are divided into sectors of the same area that are connected by the viewpoint and the region vertices, ignoring the null value (or NODATA) points. Furthermore, each sector is assigned to one processor and is organized in the form of triples composed of location and elevation at one point. An index of triples is built to store all of the locations of terminal vertices row-by-row and thus the random access of any point is achieved by using the offsets in each row. Two commonly applied viewshed algorithms, namely, “reference plane” and “Xdraw” algorithms are employed to verify the performance. In addition, two experiments focus on evaluating the efficiency performance and comparing traditional implementation, respectively. Experimental results demonstrate a significant performance improvement compared with the sequential computing method. The memory usage gradually decreases as the number of processors increases. Based on the equal-area decomposition, partitions in terms of sectors can guarantee a suitable load balance. Additional benefits of the proposed solution also include high storage efficiency and program portability. 相似文献
19.
MODIS是新一代遥感技术,其遥测数据与其他单独的遥感平台(如NOAA和Land Sat)所获得的数据相比,具有免费、较高时间分辨率(0.5d)、空间分辨率(250m)和光谱分辨率(波谱范围0.4～14μm,36个光谱通道)等优势和特点.详细介绍了国内外的研究现状,着重对MODIS在洪水过程和洪灾范围实时动态监测、冰川和积雪、降水、植被、土壤水分、蒸发、水文模型、水质等方面的应用和研究进展进行了评述,指出MODIS在水文水资源中具有广阔的应用前景. 相似文献