Deep echo state network: a novel machine learning approach to model dew point temperature using meteorological variables     

Meysam Alizamir  Sungwon Kim  Ozgur Kisi  Mohammad Zounemat-Kermani 《水文科学杂志》2020,65(7):1173-1190

ABSTRACT

The potential of different models – deep echo state network (DeepESN), extreme learning machine (ELM), extra tree (ET), and regression tree (RT) – in estimating dew point temperature by using meteorological variables is investigated. The variables consist of daily records of average air temperature, atmospheric pressure, relative humidity, wind speed, solar radiation, and dew point temperature (T_dew) from Seoul and Incheon stations, Republic of Korea. Evaluation of the model performance shows that the models with five and three-input variables yielded better accuracy than the other models in these two stations, respectively. In terms of root-mean-square error, there was significant increase in accuracy when using the DeepESN model compared to the ELM (18%), ET (58%), and RT (64%) models at Seoul station and the ELM (12%), ET (23%), and RT (49%) models at Incheon. The results show that the proposed DeepESN model performed better than the other models in forecasting T_dew values.  相似文献   

Extreme learning machine for the displacement prediction of landslide under rainfall and reservoir level   总被引：3，自引：1，他引：2  

Cheng Lian  Zhigang Zeng  Wei Yao  Huiming Tang 《Stochastic Environmental Research and Risk Assessment (SERRA)》2014,28(8):1957-1972

Landslide prediction is always the emphasis of landslide research. Using global positioning system GPS technologies to monitor the superficial displacements of landslide is a very useful and direct method in landslide evolution analysis. In this paper, an EEMD–ELM model [ensemble empirical mode decomposition (EEMD) based extreme learning machine (ELM) ensemble learning paradigm] is proposed to analysis the monitoring data for landslide displacement prediction. The rainfall data and reservoir level fluctuation data are also integrated into the study. The rainfall series, reservoir level fluctuation series and landslide accumulative displacement series are all decomposed into the residual series and a limited number of intrinsic mode functions with different frequencies from high to low using EEMD technique. A novel neural network technique, ELM, is employed to study the interactions of these sub-series at different frequency affecting landslide occurrence. Each sub-series extracted from accumulative displacement of landslide is forecasted respectively by establishing appropriate ELM model. The final prediction result is obtained by summing up the calculated predictive displacement value of each sub. The EEMD–ELM model shows the best accuracy comparing with basic artificial neural network models through forecasting the displacement of Baishuihe landslide in the Three Gorges reservoir area of China.  相似文献   

Modelling long-term groundwater fluctuations by extreme learning machine using hydro-climatic data   总被引：1，自引：1，他引：0  

Meysam Alizamir  Mohammad Zounemat-Kermani 《水文科学杂志》2018,63(1):63-73

The ability of the extreme learning machine (ELM) is investigated in modelling groundwater level (GWL) fluctuations using hydro-climatic data obtained for Hormozgan Province, southern Iran. Monthly precipitation, evaporation and previous GWL data were used as model inputs. Developed ELM models were compared with the artificial neural networks (ANN) and radial basis function (RBF) models. The models were also compared with the autoregressive moving average (ARMA), and evaluated using mean square errors, mean absolute error, Nash-Sutcliffe efficiency and determination coefficient statistics. All the data-driven models had better accuracy than the ARMA, and the ELM model’s performance was superior to that of the ANN and RBF models in modelling 1-, 2- and 3-month-ahead GWL. The RMSE accuracy of the ANN model was increased by 37, 34 and 52% using ELM for the 1-, 2- and 3-month-ahead forecasts, respectively. The accuracy of the ELM models was found to be less sensitive to increasing lead time.  相似文献   

Data-based modelling approach for variable density flow and solute transport simulation in a coastal aquifer   总被引：1，自引：1，他引：0  

Basant Yadav  Shashi Mathur  Sudheer Ch  Brijesh Kumar Yadav 《水文科学杂志》2018,63(2):210-226

Data-based models, namely artificial neural network (ANN), support vector machine (SVM), genetic programming (GP) and extreme learning machine (ELM), were developed to approximate three-dimensional, density-dependent flow and transport processes in a coastal aquifer. A simulation model, SEAWAT, was used to generate data required for the training and testing of the data-based models. Statistical analysis of the simulation results obtained by the four models show that the data-based models could simulate the complex salt water intrusion process successfully. The selected models were also compared based on their computational ability, and the results show that the ELM is the fastest technique, taking just 0.5 s to simulate the dataset; however, the SVM is the most accurate, with a Nash-Sutcliffe efficiency (NSE) ≥ 0.95 and correlation coefficient R ≥ 0.92 for all the wells. The root mean square error (RMSE) for the SVM is also significantly less, ranging from 12.28 to 77.61 mg/L.  相似文献   

Water quality monitoring at a virtual watershed monitoring station using a modified deep extreme learning machine     

Jian Jin  Lei Li  Huan Xu  Guang Lin 《水文科学杂志》2020,65(3):415-426

ABSTRACT

A new deep extreme learning machine (ELM) model is developed to predict water temperature and conductivity at a virtual monitoring station. Based on previous research, a modified ELM auto-encoder is developed to extract more robust invariance among the water quality data. A weighted ELM that takes seasonal variation as the basis of weighting is used to predict the actual value of water quality parameters at sites which only have historical data and no longer generate new data. The performance of the proposed model is validated against the monthly data from eight monitoring stations on the Zengwen River, Taiwan (2002–2017). Based on root mean square error, mean absolute error, mean absolute percentage error and correlation coefficient, the experimental results show that the new model is better than the other classical spatial interpolation methods.  相似文献   

Comparison of local and global approximators in multivariate chaotic forecasting of daily streamflow     

Hakan Tongal 《水文科学杂志》2020,65(7):1129-1144

ABSTRACT

Although it is conceptually assumed that global models are relatively ineffective in modelling the highly unstable structure of chaotic hydrologic dynamics, there is not a detailed study of comparing the performances of local and global models in a hydrological context, especially with new emerging machine learning models. In this study, the performance of a local model (k-nearest neighbour, k-nn) and, as global models, several recent machine learning models – artificial neural network (ANN), least square-support vector regression (LS-SVR), random forest (RF), M5 model tree (M5), multivariate adaptive regression splines (MARS) – was analysed in multivariate chaotic forecasting of streamflow. The models were developed for Australia’s largest river, the River Murray. The results indicate that the k-nn model was more successful than the global models in capturing the streamflow dynamics. Furthermore, coupled with the multivariate phase-space, it was shown that the global models can be successfully used for obtaining reliable uncertainty estimates for streamflow.  相似文献   

Comparison of machine learning models for predicting fluoride contamination in groundwater     

Rahim?BarzegarEmail author  Asghar?Asghari Moghaddam  Jan?Adamowski  Elham?Fijani 《Stochastic Environmental Research and Risk Assessment (SERRA)》2017,31(10):2705-2718

Groundwater is an especially important freshwater source for water supplies in the Maku area of northwest Iran. The groundwater of the area contains high concentrations of fluoride and is, therefore, important in predicting the fluoride contamination of the groundwater for the purpose of planning and management. The present study aims to evaluate the ability of the extreme learning machine (ELM) model to predict the level of fluoride contamination in the groundwater in comparison to multilayer perceptron (MLP) and support vector machine (SVM) models. For this purpose, 143 water samples were collected in a five-year period, 2004–2008. The samples were measured and analyzed for electrical conductivity, pH, major chemical ions and fluoride. To develop the models, the data set—including Na⁺, K⁺, Ca²⁺ and HCO₃ ^? concentrations as the inputs and fluoride concentration as the output—was divided into two subsets; training/validation (80% of data) and testing (20% of data), based on a cross-validation technique. The radial basis-based ELM model resulted in an R ² of 0.921, an NSC of 0.9071, an RMSE of 0.5638 (mg/L) and an MABE of 0.4635 (mg/L) for the testing data. The results showed that the ELM models performed better than MLP and SVM models for prediction of fluoride contamination. It was observed that ELM models learned faster than the other models during model development trials and the SVM models had the highest computation time.  相似文献   

Incorporating synoptic-scale climate signals for streamflow modelling over the Mediterranean region using machine learning models     

Ozgur Kisi  Bahram Choubin  Ravinesh C. Deo 《水文科学杂志》2013,58(10):1240-1252

ABSTRACT

Understanding streamflow patterns by incorporating climate signal information can contribute remarkably to the knowledge of future local environmental flows. Three machine learning models, the multivariate adaptive regression splines (MARS), the M5 Model Tree and the least squares support vector machine (LSSVM) are established to predict the streamflow pattern over the Mediterranean region of Turkey (Besiri and Baykan stations). The structure of the predictive models is built using synoptic-scale climate signal information and river flow data from antecedent records. The predictive models are evaluated and assessed using quantitative and graphical statistics. The correlation analysis demonstrates that the North Pacific (NP) and the East Central Tropical Pacific Sea Surface Temperature (Niño3.4) indices have a substantial influence on the streamflow patterns, in addition to the historical information obtained from the river flow data. The model results reveal the utility of the LSSVM model over the other models through incorporating climate signal information for modelling streamflow.  相似文献   

Multi-step water quality forecasting using a boosting ensemble multi-wavelet extreme learning machine model   总被引：1，自引：0，他引：1  

Rahim?BarzegarEmail author  Asghar?Asghari Moghaddam  Jan?Adamowski  Bogdan?Ozga-Zielinski 《Stochastic Environmental Research and Risk Assessment (SERRA)》2018,32(3):799-813

The use of electrical conductivity (EC) as a water quality indicator is useful for estimating the mineralization and salinity of water. The objectives of this study were to explore, for the first time, extreme learning machine (ELM) and wavelet-extreme learning machine hybrid (WA-ELM) models to forecast multi-step-ahead EC and to employ an integrated method to combine the advantages of WA-ELM models, which utilized the boosting ensemble method. For comparative purposes, an adaptive neuro-fuzzy inference system (ANFIS) model, and a WA-ANFIS model, were also developed. The study area was the Aji-Chay River at the Akhula hydrometric station in Northwestern Iran. A total of 315 monthly EC (µS/cm) datasets (1984–2011) were used, in which the first 284 datasets (90% of total datasets) were considered for training and the remaining 31 (10% of total datasets) were used for model testing. Autocorrelation function (ACF) and partial autocorrelation function (PACF) demonstrated that the 6-month lags were potential input time lags. The results illustrated that the single ELM and ANFIS models were unable to forecast the multi-step-ahead EC in terms of root mean square error (RMSE), coefficient of determination (R²) and Nash–Sutcliffe model efficiency coefficient (NSC). To develop the hybrid WA-ELM and WA-ANFIS models, the original time series of lags as inputs, and time series of 1, 2 and 3 month-step-ahead EC values as outputs, were decomposed into several sub-time series using different maximal overlap discrete wavelet transform (MODWT) functions, namely Daubechies, Symlet, Haar and Coiflet of different orders at level three. These sub-time series were then used in the ELM and ANFIS models as an input dataset to forecast the multi-step-ahead EC. The results indicated that single WA-ELM and WA-ANFIS models performed better than any ELM and ANFIS models. Also, WA-ELM models outperformed WA-ANFIS models. To develop the boosting multi-WA-ELM and multi-WA-ANFIS ensemble models, a least squares boosting (LSBoost) algorithm was used. The results showed that boosting multi-WA-ELM and multi-WA-ANFIS ensemble models outperformed the individual WA-ELM and WA-ANFIS models.  相似文献   

Forecasting monthly inflow with extreme seasonal variation using the hybrid SARIMA-ANN model     

Hamid?Moeeni  Hossein?BonakdariEmail author 《Stochastic Environmental Research and Risk Assessment (SERRA)》2017,31(8):1997-2010

The optimal operation of dam reservoirs can be programmed and managed by predicting the inflow to these structures more accurately. To this end, there are various linear and nonlinear models. However, some hydrological problems like inflow with extreme seasonal variation are not purely linear or nonlinear. To improve the forecasting accuracy of this phenomenon, a linear Seasonal Auto Regressive Integrated Moving Average (SARIMA) model is combined with a nonlinear Artificial Neural Network (ANN) model. This new model is used to predict the monthly inflow to the Jamishan dam reservoir in West Iran. A comparison of the SARIMA and ANN models with the proposed hybrid model’s results is provided accordingly. More specifically, the models’ performance in forecasting base and flood flows is evaluated. The effect of changing the forecasting period length on the models’ accuracy is studied. The results of increasing the number of SARIMA model parameters up to five are investigated to achieve more accurate forecasting. The hybrid model predicts peak flood flows much better than the individual models, but SARIMA outperforms the other models in predicting base flow. The obtained results indicate that the hybrid model reduces the overall forecast error more than the ANN and SARIMA models. The coefficient of determination of the hybrid, ANN and SARIMA models were 0.72, 0.64 and 0.58, and the root mean squared error values were 1.02, 1.16 and 1.27 respectively, during the forecast period. Changing the forecasting length also indicated that these models can be used in the long term without increasing the forecast error.  相似文献   

A comparative study of extensive machine learning models for predicting long-term monthly rainfall with an ensemble of climatic and meteorological predictors     

Zhengzheng Zhou  Jie Ren  Xiaogang He  Shuguang Liu 《水文研究》2021,35(11):e14424

Rainfall prediction is of vital importance in water resources management. Accurate long-term rainfall prediction remains an open and challenging problem. Machine learning techniques, as an increasingly popular approach, provide an attractive alternative to traditional methods. The main objective of this study was to improve the prediction accuracy of machine learning-based methods for monthly rainfall, and to improve the understanding of the role of large-scale climatic variables and local meteorological variables in rainfall prediction. One regression model autoregressive integrated moving average model (ARIMA) and five state-of-the-art machine learning algorithms, including artificial neural networks, support vector machine, random forest (RF), gradient boosting regression, and dual-stage attention-based recurrent neural network, were implemented for monthly rainfall prediction over 25 stations in the East China region. The results showed that the ML models outperformed ARIMA model, and RF relatively outperformed other models. Local meteorological variables, humidity, and sunshine duration, were the most important predictors in improving prediction accuracy. 4-month lagged Western North Pacific Monsoon had higher importance than other large-scale climatic variables. The overall output of rainfall prediction was scalable and could be readily generalized to other regions.  相似文献   

Forecasting effective drought index using a wavelet extreme learning machine (W-ELM) model   总被引：3，自引：1，他引：2  

Ravinesh?C.?DeoEmail author  Mukesh?K.?Tiwari  Jan?F.?Adamowski  John M.?Quilty 《Stochastic Environmental Research and Risk Assessment (SERRA)》2017,31(5):1211-1240

A drought forecasting model is a practical tool for drought-risk management. Drought models are used to forecast drought indices (DIs) that quantify drought by its onset, termination, and subsequent properties such as the severity, duration, and peak intensity in order to monitor and evaluate the impacts of future drought. In this study, a wavelet-based drought model using the extreme learning machine (W-ELM) algorithm where the input data are first screened through the wavelet pre-processing technique for better accuracy is developed to forecast the monthly effective DI (EDI). The EDI is an intensive index that considers water accumulation with a weighting function applied to rainfall data with the passage of time in order to analyze the drought-risk. Determined by the autocorrelation function (ACF) and partial ACFs, the lagged EDI signals for the current and past months are used as significant inputs for 1 month lead-time EDI forecasting. For drought model development, 97 years of data for three hydrological stations (Bathurst Agricultural, Wilsons Promontory and Merredin in Australia) are partitioned in approximately 90:5:5 ratios for training, cross-validation and test purposes, respectively. The discrete wavelet transformation (DWT) is applied to the predictor datasets to decompose inputs into their time–frequency components that capture important information on periodicities. DWT sub-series are used to develop new EDI sub-series as inputs for the W-ELM model. The forecasting capability of W-ELM is benchmarked with ELM, artificial neural network (ANN), least squares support vector regression (LSSVR) and their wavelet-equivalent (W-ANN, W-LSSVR) models. Statistical metrics based on agreement between the forecasted and observed EDI, including the coefficient of determination, Willmott’s index, Nash–Sutcliffe coefficient, percentage peak deviation, root-mean-square error, mean absolute error, and model execution time are used to assess the effectiveness of the models. The results demonstrate enhanced forecast skill of the drought models that use wavelet pre-processing of the predictor dataset. Based on statistical measures, W-ELM outperformed traditional ELM, LSSVR, ANN and their wavelet-equivalent counterparts (W-ANN, W-LSSVR). It is found that the W-ELM model is computationally efficient as shown by a faster running time with the majority of forecasting errors in lower frequency bands. The results demonstrate the usefulness of W-ELM over W-ANN and W-LSSVR models and the benefits of wavelet transformation of input data to improve the performance of drought forecasting models.  相似文献   

Estimation of monthly evaporative loss using relevance vector machine,extreme learning machine and multivariate adaptive regression spline models   总被引：1，自引：0，他引：1  

Ravinesh C. Deo  Pijush Samui  Dookie Kim 《Stochastic Environmental Research and Risk Assessment (SERRA)》2016,30(6):1769-1784

The forecasting of evaporative loss (E) is vital for water resource management and understanding of hydrological process for farming practices, ecosystem management and hydrologic engineering. This study has developed three machine learning algorithms, namely the relevance vector machine (RVM), extreme learning machine (ELM) and multivariate adaptive regression spline (MARS) for the prediction of E using five predictor variables, incident solar radiation (S), maximum temperature (T _max), minimum temperature (T _min), atmospheric vapor pressure (VP) and precipitation (P). The RVM model is based on the Bayesian formulation of a linear model with appropriate prior that results in sparse representations. The ELM model is computationally efficient algorithm based on Single Layer Feedforward Neural Network with hidden neurons that randomly choose input weights and the MARS model is built on flexible regression algorithm that generally divides solution space into intervals of predictor variables and fits splines (basis functions) to each interval. By utilizing random sampling process, the predictor data were partitioned into the training phase (70 % of data) and testing phase (remainder 30 %). The equations for the prediction of monthly E were formulated. The RVM model was devised using the radial basis function, while the ELM model comprised of 5 inputs and 10 hidden neurons and used the radial basis activation function, and the MARS model utilized 15 basis functions. The decomposition of variance among the predictor dataset of the MARS model yielded the largest magnitude of the Generalized Cross Validation statistic (≈0.03) when the T _max was used as an input, followed by the relatively lower value (≈0.028, 0.019) for inputs defined by the S and VP. This confirmed that the prediction of E utilized the largest contributions of the predictive features from the T _max, verified emphatically by sensitivity analysis test. The model performance statistics yielded correlation coefficients of 0.979 (RVM), 0.977 (ELM) and 0.974 (MARS), Root-Mean-Square-Errors of 9.306, 9.714 and 10.457 and Mean-Absolute-Error of 0.034, 0.035 and 0.038. Despite the small differences in the overall prediction skill, the RVM model appeared to be more accurate in prediction of E. It is therefore advocated that the RVM model can be employed as a promising machine learning tool for the prediction of evaporative loss.  相似文献   

A combined rotated general regression neural network method for river flow forecasting     

Sun Yin  Deshan Tang  Xin Jin  Weiwei Chen  Nannan Pu 《水文科学杂志》2013,58(4):669-682

ABSTRACT

This study focused on the performance of the rotated general regression neural network (RGRNN), as an enhancement of the general regression neural network (GRNN), in monthly-mean river flow forecasting. The study of forecasting of monthly mean river flows in Heihe River, China, was divided into two steps: first, the performance of the RGRNN model was compared with the GRNN model, the feed-forward error back-propagation (FFBP) model and the soil moisture accounting and routing (SMAR) model in their initial model forms; then, by incorporating the corresponding outputs of the SMAR model as an extra input, the combined RGRNN model was compared with the combined FFBP and combined GRNN models. In terms of model efficiency index, R², and normalized root mean squared error, NRMSE, the performances of all three combined models were generally better than those of the four initial models, and the RGRNN model performed better than the GRNN model in both steps, while the FFBP and the SMAR were consistently the worst two models. The results indicate that the combined RGRNN model could be a useful river flow forecasting tool for the chosen arid and semi-arid region in China.