A machine learning approach for predicting computational intensity and domain decomposition in parallel geoprocessing     

Peng Yue  Fan Gao  Boyi Shangguan  Zheren Yan 《International journal of geographical information science》2020,34(11):2243-2274

ABSTRACT

High performance computing is required for fast geoprocessing of geospatial big data. Using spatial domains to represent computational intensity (CIT) and domain decomposition for parallelism are prominent strategies when designing parallel geoprocessing applications. Traditional domain decomposition is limited in evaluating the computational intensity, which often results in load imbalance and poor parallel performance. From the data science perspective, machine learning from Artificial Intelligence (AI) shows promise for better CIT evaluation. This paper proposes a machine learning approach for predicting computational intensity, followed by an optimized domain decomposition, which divides the spatial domain into balanced subdivisions based on the predicted CIT to achieve better parallel performance. The approach provides a reference framework on how various machine learning methods including feature selection and model training can be used in predicting computational intensity and optimizing parallel geoprocessing against different cases. Some comparative experiments between the approach and traditional methods were performed using the two cases, DEM generation from point clouds and spatial intersection on vector data. The results not only demonstrate the advantage of the approach, but also provide hints on how traditional GIS computation can be improved by the AI machine learning.  相似文献   

Optimal Filtering Algorithm for Stochastic 2-D FMM Ⅱ with Multiplicative Noise     

CHUDongsheng LIANGMeng SHIXin ZHANGLing 《中国海洋大学学报(英文版)》2004,3(1):106-110

1　Introduction　Inrecentyearstherehasbeengrowingresearchin terestinthetwo dimensional (2 D )systemtheory .The 2 Dsystemsmayfindapplicationsinareassuchasmarineseismicdataprocessingandimageprocessing .Althoughmoreandmorevaluableresultshavebeengained ,mos…  相似文献   

用遗传算法解算病态方程   总被引：7，自引：1，他引：6  

曾群意  欧吉坤 《大地测量与地球动力学》2003,23(3):93-97

对应用遗传算法解决病态方程问题进行了探讨。利用拟合法而不是通过法方程求解参数，从而避免了法方程系数求逆，使病态方程的解答有了较好的结果。通过模拟计算并和其他方法进行比较，证明该方法是可行的和有效的。  相似文献   

Magnetotelluric investigations for imaging electrical structure of Garhwal Himalayan corridor,Uttarakhand, India     

M. Israil  D. K. Tyagi  P. K. Gupta  Sri Niwas 《Journal of Earth System Science》2008,117(3):189-200

Magnetotelluric investigations have been carried out in the Garhwal Himalayan corridor to delineate the electrical structure of the crust along a profile extending from Indo-Gangetic Plain to Higher Himalayan region in Uttarakhand, India. The profile passing through major Himalayan thrusts: Himalayan Frontal Thrust (HFF), Main Boundary Thrust (MBT) and Main Central Thrust (MCT), is nearly perpendicular to the regional geological strike. Data processing and impedance analysis indicate that out of 44 stations MT data recorded, only 27 stations data show in general, the validity of 2D assumption. The average geoelectric strike, N70°W, was estimated for the profile using tensor decomposition. 2D smooth geoelectrical model has been presented, which provides the electrical image of the shallow and deeper crustal structure. The major features of the model are (i) a low resistivity (<50Ωm), shallow feature interpreted as sediments of Siwalik and Indo-Gangetic Plain, (ii) highly resistive (> 1000Ωm) zone below the sediments at a depth of 6 km, interpreted as the top surface of the Indian plate, (iii) a low resistivity (< 10Ωm) below the depth of 6 km near MCT zone coincides with the intense micro-seismic activity in the region. The zone is interpreted as the partial melting or fluid phase at mid crustal depth. Sensitivity test indicates that the major features of the geoelectrical model are relevant and desired by the MT data.  相似文献   

海浪的条件特征周期     

徐德伦  刘学海  张军 《海洋学报》2001,23(3):1-7

在海浪波面高度为正态分布的假定下,导出一种以给定波高为条件的条件周期概率密度函数.与风浪槽中测量数据比较,结果表明,在窄谱情况下此概率密度函数与实验室风浪的实际符合良好.根据此密度函数定义了3种条件特征周期,并导出它们与平均周期的关系式.根据这些关系对有关海洋工程上的一些问题作了解释和讨论.  相似文献   

Total Lipid and Fatty Acid Classes in Decomposing Mangrove Leaves of <Emphasis Type="Italic">Bruguiera gymnorrhiza</Emphasis> and <Emphasis Type="Italic">Kandelia candel</Emphasis>: Significance with respect to Lipid Input     

Prosper?L.?Mfilinge  Tarik?Meziane  Zainudin?Bachok  Makoto?TsuchiyaEmail author 《Journal of Oceanography》2005,61(3):613-622

Changes in the concentration of total lipid and fatty acids (FAs) during the decomposition of mangrove leaves were investigated by field experiments using yellow leaves of Bruguiera gymnorrhiza (L.) Lamk. and Kandelia candel (L.) Druce, in order to quantify mangrove contribution to lipid and fatty acid inputs to marine sediments. Total lipid and total FA in the fresh (green and yellow) and decomposing leaves of both species were significantly higher during winter than summer. During decomposition, total lipid content and FA concentration, in particular branched chain fatty acids (BrFAs) and bacterial fatty acids (BFAs), increased to a maximum concentration in 45 days during winter and in 17 days during summer. Lipids were lost faster in K. candel leaf detritus than in B. gymnorrhiza leaf detritus in which >90% of the total lipid original weight was lost during the summer experiment and <60% during the winter experiment. The changes in the concentrations of total lipids and FAs in the decomposing leaves also indicate that mangrove leaves are significant sources of fatty acids and probably other lipid compounds to estuarine ecosystems and that tidal waters transport the lipids and FAs adsorbed to particulate matter from mangroves to adjacent estuarine sediments and the ocean.  相似文献   

浙江西沪港重金属铜的配位容量和形态分析   总被引：3，自引：2，他引：3       下载免费PDF全文

吕海燕  王正方  傅和芳  冯旭文 《海洋学报》2003,25(3):47-52

根据2000年6月10～14日在浙江省西沪港采集的海水样品,利用AA-800石墨炉原子吸收分光光度技术和阳极溶出伏安法测定样品中重金属铜的含量,获得铜在海水中受不同的有机配体控制.不同粒级的铜表观配位容量表明西沪港海水过孔径1.00μm微孔膜的(ACuCC)较高,为144.4nmol/dm3;过0.40和0.20μm滤膜的(ACuCC)分别为103.0和102nmol/dm3;铜的有机配体条件稳定常数的对数值在7.25～9.14之间.铜的总量为21.72nmol/dm3.铜全部为稳定溶解态,其中pH2酸溶态占95.0%,强有机结合态占5.0%.溶解态铜中有机结合态占过滤海水中总铜的61.6%.  相似文献   

作用于平台桩腿的海冰屈曲破坏冰压力随机过程模型及其参数确定   总被引：2，自引：1，他引：2  

段忠东  欧进萍 《海洋工程》1996,(4)

冰对结构的作用过程是典型的随机过程。本文在冰压力过程为平稳过程的假设下，从渤海海冰对平台桩腿作用的大量实测冰压力数据中，选取了２１条冰屈曲破坏时的冰压力时程曲线，对它们进行谱分析后，得到了单点冰屈曲破坏的压力随机过程的谱密度，并确定了谱参数及其跟环境要素的关系，依据文献［１］中冰压力沿圆柱面的空间分布，建立了绕桩腿的冰压力随机场模型，并得到了作用于桩腿的总冰力随机过程及其谱密度。本文的研究成果为平台结构冰激随机振动和疲劳累积损伤分析提供了荷载基础  相似文献   

Determination of technical efficiency of fisheries by stochastic frontier models: a case on the Gulf of Cadiz (Spain)     

Garcia del Hoyo  Juan Jose; Castilla Espino  David; Jimenez Toribio  Ramon 《ICES Journal of Marine Science》2004,61(3):416-421

  相似文献   

Nitrogen forms and decomposition of organic carbon in the southern Bohai Sea core sediments   总被引：5，自引：0，他引：5  

Song Jinming  Ma Hongbo  L&#; Xiaoxia 《海洋学报(英文版)》2002,21(1):125-133

Study on form characteristics of nitrogen in marine sediments is the primary method to research its biogeochemical cycling and nitrogen form characteristics in core sediments can reflect the process and results of early diagenesis in a certain degree. In this paper, Sequential extraction process in natural grain size was used for studying the existent forms of nitrogen in five core sediments of the southern Bohai Sea for the first time. Nitrogen was divided into two parts -transferable and fixed based on whether it could be extracted by the reagent. Distributions and early diagenesis of transferable nitrogen forms in the southern Bohai Sea were researched integratedly. Results indicate that IEF - N and OSF-N are predominant forms in transferable part in the studied core sediments. Contents of different nitrogen forms vary differently with depth, and have different diagenesis process. Decomposition constant of organic nitrogen (ON) and OC are about 15.51 × 10~(-3)a~(-1)and 4.79× 10~(-3)a~(-1) respective  相似文献