A combination approach based on a novel data clustering method and Bayesian recurrent neural network for day-ahead price forecasting of electricity markets

• Published in: Electric power systems research 2019-03, Vol.168, p.184-199
• Main Authors: Ghayekhloo, M., Azimi, R., Ghofrani, M., Menhaj, M.B., Shekari, E.
• Format: Article
• Language: English
• Subjects: Algorithms; Bayesian analysis; Bayesian approach; Business competition; Clustering; Commodities; Data mining; Deregulation; Economic forecasting; Electric rates; Electricity pricing; Forecasting; Fourier analysis; Game theory; Harmonic analysis; Learning; Markets; Neurons; Recurrent neural network; Recurrent neural networks; Self organizing maps; Time series; Time series analysis; Training; Uncertainty; Vector quantization; Volatility
• ISSN: 0378-7796; 1873-2046
• DOI: 10.1016/j.epsr.2018.11.021

•A novel clustering method is proposed based on six new game-theoretic strategies.•An embedded 2-dimensional load and price data is introduced to the EGT-Cluster.•A novel approach based on the Persistence is developed to select the best cluster.•A hybrid forecasting method is proposed using clustering, signal analysis and BRNN. Electricity price forecasting is an ancillary service that plays a key role for market participants in a deregulated structure. Compared to other commodities, electricity price exhibits higher levels of volatility and uncertainty. This imposes more restrictions on the accuracy of the forecast and leads to significant errors. This paper proposes a hybrid electricity price-forecasting framework with a novel time series data mining method to enhance the feature selection. The proposed method includes clustering, preprocessing and training stages. The proposed data clustering method uses both an enhanced game theoretic approach and neural gas in combination with competitive Hebbian learning to provide a better vector quantization. Six strategies are proposed to enable the non-winning neurons to participate in the learning phase and resolve the shortcomings of the original self-organizing map, where the dead neurons are far from the input patterns without having any chance to compete with the winning neurons. The price-load input data are clustered into a proper number of subsets using the proposed data mining method. A novel cluster selection method based on the persistence approach is applied to select the most appropriate cluster as the input to the BRNN. The selected data set is filtered by the harmonic analysis time series, and is time-series processed to provide the proper inputs for training neural networks. Bayesian approach is used to train a recurrent neural network, and forecast the electricity price. The performance of the proposed clustering algorithm is evaluated using different electricity market data. Our results demonstrate the efficiency of the proposed clustering algorithm as compared to K-means, neural gas and self-organizing map clustering methods Our proposed clustering provides 16.7%, 28.6%, and 13% more accurate results than K-means, neural gas, and self-organizing map for the NYISO. CAPITL data. For the NYISO. CENTRL data, the developed clustering outperforms the K-means, neural gas, and self-organizing map by 21.4%, 21.4%, and 8.3%, respectively. The clustering accuracy of the proposed method for NYISO. DUNWOD d