HydroFlow: Towards probabilistic electricity demand prediction using variational autoregressive models and normalizing flows
Fan Zhou
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Search for more papers by this authorZhiyuan Wang
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Search for more papers by this authorCorresponding Author
Ting Zhong
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Correspondence Ting Zhong, University of Electronic Science and Technology of China, 610054 Chengdu, Sichuan, China.
Email: [email protected]
Search for more papers by this authorGoce Trajcevski
Department of Electrical and Computer Engineering, Iowa State University, Ames, Iowa, USA
Search for more papers by this authorAshfaq Khokhar
Department of Electrical and Computer Engineering, Iowa State University, Ames, Iowa, USA
Search for more papers by this authorFan Zhou
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Search for more papers by this authorZhiyuan Wang
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Search for more papers by this authorCorresponding Author
Ting Zhong
School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
Correspondence Ting Zhong, University of Electronic Science and Technology of China, 610054 Chengdu, Sichuan, China.
Email: [email protected]
Search for more papers by this authorGoce Trajcevski
Department of Electrical and Computer Engineering, Iowa State University, Ames, Iowa, USA
Search for more papers by this authorAshfaq Khokhar
Department of Electrical and Computer Engineering, Iowa State University, Ames, Iowa, USA
Search for more papers by this authorAbstract
We present HydroFlow, a novel deep generative model for predicting the electricity generation demand of large-scale hydropower stations. HydroFlow uses a latent stochastic recurrent neural network to capture the dependencies in the multivariate time series. It not only utilizes the hidden state of the neural network, but also considers the uncertainty of variables related to natural and social factors. We also introduce an end-to-end approach based on generative flows to approximate the posterior distribution of time series with exact likelihoods. Our model is powerful as adding stochasticity to different factors (e.g., reservoir capacity and water-flow measurements) and thus overcomes the expressiveness limitations of deterministic prediction methods. It also enables trainable latent transformations that can improve the model interpretability. We evaluate HydroFlow on the data collected from the hydropower stations of a large-scale hydropower development company. Experimental results show that our model significantly outperforms the state-of-the-art baseline methods while providing explainable results.
REFERENCES
- 1Rossi B, Chren S. Smart grids data analysis: a systematic mapping study. IEEE Trans Ind Inf. 2019; 16(6): 3619-3639.
- 2Gao Y, Ai Q, Wang X, Yousif M. Distributed cooperative economic optimization strategy of a regional energy network based on energy cell-tissue architecture. IEEE Trans Ind Inf. 2019; 15(9): 5182-5193.
- 3Kishor N, Singh S. Simulated response of NN based identification and predictive control of hydro plant. Expert Syst Appl. 2007; 32(1): 233-244.
- 4Petrik M, Zilberstein S. Linear Dynamic Programs for Resource Management. AAAI; 2011.
10.1609/aaai.v25i1.7794 Google Scholar
- 5Lin X, Wu J, Mumtaz S, Garg S, Li J, Guizani M. Blockchain-based on-demand computing resource trading in IoV-assisted smart city. IEEE Trans Emerging Top Comput. 2021; 9(3): 1373-1385.
- 6Kishor N, Saini R, Singh S. A review on hydropower plant models and control. Renewable Sustainable Energy Rev. 2007; 11(5): 776-796.
- 7Zamora R, Srivastava AK. Controls for microgrids with storage: review, challenges, and research needs. Renewable Sustainable Energy Rev. 2010; 14(7): 2009-2018.
- 8Hossain MA, Pota HR, Hossain MJ, Blaabjerg F. Evolution of microgrids with converter-interfaced generations: challenges and opportunities. Int J Electr Power Energy Syst. 2019; 109: 160-186.
- 9Sharma S, Singh B, Mishra S. Economic operation and quality control in PV-BES-DG-based autonomous system. IEEE Trans Ind Inf. 2019; 16(4): 2346-2356.
- 10Du J, Jiang C, Han Z, Zhang H, Mumtaz S, Ren Y. Contract mechanism and performance analysis for data transaction in mobile social networks. IEEE Trans Network Sci Eng. 2017; 6(2): 103-115.
- 11Chandra K, Marcano AS, Mumtaz S, Prasad RV, Christiansen HL. Unveiling capacity gains in ultradense networks: using mm-wave NOMA. IEEE Veh Technol Mag. 2018; 13(2): 75-83.
- 12Cai G, Fang Y, Wen J, Mumtaz S, Song Y, Frascolla V. Multi-carrier -ary DCSK system with code index modulation: an efficient solution for chaotic communications. IEEE J Sel Top Signal Process. 2019; 13(6): 1375-1386.
- 13Mierla M, Romanescu G, Nichersu I, Grigoras I. Hydrological Risk map for the Danube delta–a case study of floods within the fluvial delta. IEEE J Sel Top Appl Earth Obs Remote Sens. 2015; 8(1): 98-104.
- 14Ho MS, Wang Z, Yu Z. China's Power Generation Dispatch. https://www.rff.org/publications/reports/chinas-power-generation-dispatch; 2017.
- 15Stoll B, Andrade J, Cohen S, Brinkman G, Martinez-Anido CB. Hydropower Modeling Challenges. Tech. Rep. NREL/TP-5D00-68231. National Renewable Energy Lab. (NREL), Golden, CO, USA; 2017.
- 16Chen J, Zhong PA. A multi-time-scale power prediction model of hydropower station considering multiple uncertainties. Sci Total Environ. 2019; 677: 612-625.
- 17Fekete K, Nikolovski S, Klaić Z, Androjić A. Optimal re-dispatching of cascaded hydropower plants using quadratic programming and chance-constrained programming. Energies. 2019; 12(9): 1604.
- 18Messaoud S, Bradai A, Bukhari SHR, Quang PTA, Ahmed OB, Atri M. A survey on machine learning in Internet of Things: algorithms, strategies, and applications. Internet Things. 2020; 12:100314.
10.1016/j.iot.2020.100314 Google Scholar
- 19Song HA, Hooi B, Jereminov M, Pandey A, Pileggi L, Faloutsos C. PowerCast: mining and forecasting power grid sequences. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer; 2017: 606-621.
- 20Hooi B, Song HA, Jereminov M, Pileggi L, Faloutsos C. StreamCast: fast and online mining of power grid time sequences. In: SDM. SIAM; 2018: 531-539.
- 21Zhou F, Li L, Zhang K, et al. Forecasting the evolution of hydropower generation. In: KDD. ACM; 2020: 2861-2870.
- 22Ma XY, Sun YZ, Fang HL, Tian Y. Scenario-based multiobjective decision-making of optimal access point for wind power transmission corridor in the load centers. IEEE Trans Sustainable Energy. 2012; 4(1): 229-239.
- 23Pinson P, Girard R. Evaluating the quality of scenarios of short-term wind power generation. Appl Energy. 2012; 96: 12-20.
- 24Wang Y, Dvorkin Y, Fernandez-Blanco R, Xu B, Qiu T, Kirschen DS. Look-ahead bidding strategy for energy storage. IEEE Trans Sustainable Energy. 2017; 8(3): 1106-1117.
- 25Wu W, Peng M. A data mining approach combining -means clustering with bagging neural network for short-term wind power forecasting. IEEE Internet Things J. 2017; 4(4): 979-986.
- 26Wang Y, Shen Y, Mao S, Chen X, Zou H. LASSO and LSTM integrated temporal model for short-term solar intensity forecasting. IEEE Internet Things J. 2018; 6(2): 2933-2944.
- 27Tang C, Wang Y, Xu J, Sun Y, Zhang B. Efficient scenario generation of multiple renewable power plants considering spatial and temporal correlations. Appl Energy. 2018; 221: 348-357.
- 28Tang N, Mao S, Wang Y, Nelms R. Solar power generation forecasting with a LASSO-based approach. IEEE Internet Things J. 2018; 5(2): 1090-1099.
- 29Chen MR, Zeng GQ, Lu KD, Weng J. A two-layer nonlinear combination method for short-term wind speed prediction based on ELM, ENN, and LSTM. IEEE Internet Things J. 2019; 6(4): 6997-7010.
- 30Zhou F, Li L. Forecasting Reservoir Inflow Via Recurrent Neural ODEs. Vol 35. AAAI; 2021: 15025-15032.
- 31Pang Y, Yao B, Zhou X, Zhang Y, Xu Y, Tan Z. Hierarchical electricity time series forecasting for integrating consumption patterns analysis and aggregation consistency. In: IJCAI; 2018: 3506-3512.
- 32Salem TS, Kathuria K, Ramampiaro H, Langseth H. Forecasting Intra-hour Imbalances in Electric Power Systems. Vol 33. AAAI; 2019: 9595-9600.
- 33De Giorgi MG, Malvoni M, Congedo PM. Comparison of strategies for multi-step ahead photovoltaic power forecasting models based on hybrid group method of data handling networks and least square support vector machine. Energy. 2016; 107: 360-373.
- 34Li LL, Wen SY, Tseng ML, Wang CS. Renewable energy prediction: a novel short-term prediction model of photovoltaic output power. J Cleaner Prod. 2019; 228: 359-375.
- 35Yan J, Ouyang T. Advanced wind power prediction based on data-driven error correction. Energy Convers Manage. 2019; 180: 302-311.
- 36Yu B, Xu L. Review of ecological compensation in hydropower development. Renewable Sustainable Energy Rev. 2016; 55: 729-738.
- 37Wild TB, Reed PM, Loucks DP, Mallen-Cooper M, Jensen ED. Balancing hydropower development and ecological impacts in the Mekong: tradeoffs for Sambor Mega Dam. J Water Resour Plan Manage. 2019; 145(2):05018019.
- 38Xu C, Xu Z, Yang Z. Reservoir operation optimization for balancing hydropower generation and biodiversity conservation in a downstream wetland. J Cleaner Prod. 2020; 245:118885.
- 39Baird I, Manorom K, Phenow A, Gaja-Svasti S. Opening the gates of the Pak Mun Dam: fish migrations, domestic water supply, irrigation projects and politics. Water Altern. 2020; 13: 141-159.
- 40Qin Y, Sheng QZ, Falkner NJG, Dustdar S, Wang H, Vasilakos AV. When things matter: a survey on data-centric internet of things. J Network Comput Appl. 2016; 64: 137-153.
- 41Ullah I, Youn HY. Intelligent data fusion for smart IoT environment: a survey. Wireless Pers Commun. 2020; 114(1): 409-430.
- 42Javed U, Fraz MM, Mahmood I, Shahzad M, Arif O. Forecasting of electricity generation for hydro power plants. In: International Conference on Smart Communities: Improving Quality of Life Using ICT, IoT and AI (HONET). IEEE; 2020: 32-36.
- 43Rezende D, Mohamed S. Variational inference with normalizing flows. In: ICML. PMLR; 2015: 1530-1538.
- 44Bedi G, Venayagamoorthy GK, Singh R. Development of an IoT-driven building environment for prediction of electric energy consumption. IEEE Internet Things J. 2020; 7(6): 4912-4921.
- 45Zhong W, Guo J, Chen L, Zhou J, Zhang J, Wang D. Future hydropower generation prediction of large-scale reservoirs in the upper Yangtze River Basin under climate change. J Hydrol. 2020; 588(11):125013.
- 46Li L, Yao F, Huang Y, Zhou F. Hydropower generation forecasting via deep neural network. In: ICISCE. IEEE; 2019: 324-328.
- 47Zhang Q, Wangg M, Wang X, Tian S. Mid-long term optimal dispatching method of power system with large-scale wind-photovoltaic-hydro power generation. In: IEEE Conference on Energy Internet and Energy System Integration (EI2). IEEE; 2017: 1-6.
- 48Liu J, Li D, Wu Y, Liu D. Lion swarm optimization algorithm for comparative study with application to optimal dispatch of cascade hydropower stations. Appl Soft Comput. 2020; 87(1):105974.
- 49Zhang H, Chang J, Gao C, et al. Cascade hydropower plants operation considering comprehensive ecological water demands. Energy Convers Manage. 2019; 180(8): 119-133.
- 50Han Z, Zhao J, Leung H, Ma KF, Wang W. A review of deep learning models for time series prediction. IEEE Sens J. 2019; 21(6): 7833-7848.
- 51Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997; 9(8): 1735-1780.
- 52Rasul K, Sheikh A, Schuster I, Bergmann UM, Vollgraf R. Multivariate probabilistic time series forecasting via conditioned normalizing flows. In: ICLR; 2021.
- 53Ravuri S, Lenc K, Willson M, et al. Skillful precipitation nowcasting using deep generative models of radar. Nature. 2021; 597: 672-677.
- 54Grathwohl W, Chen RTQ, Bettencourt J, Sutskever I, Duvenaud D. FFJORD: free-form continuous dynamics for scalable reversible generative models. In: ICLR; 2019.
- 55Xu H, Chen W, Zhao N, et al. Unsupervised anomaly detection via variational auto-encoder for seasonal KPIs in web applications. In: WWW. ACM; 2018: 187-196.
- 56Kingma DP, Welling M. Auto-encoding variational Bayes. In: ICLR; 2014.
- 57Papamakarios G, Nalisnick E, Rezende DJ, Mohamed S, Lakshminarayanan B. Normalizing flows for probabilistic modeling and inference. J Mach Learn Res. 2021; 22(57): 1-64.
- 58Chen TQ, Rubanova Y, Bettencourt J, Duvenaud S, Zilberstein DK. Neural ordinary differential equations. In: NeuIPS; 2018.
- 59Hutchinson MF. A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines. Commun Stat—Simul Comput. 1989; 18(3): 1059-1076.
- 60Rezende DJ, Mohamed S, Wierstra D. Stochastic backpropagation and approximate inference in deep generative models. In: ICML. PMLR; 2014.
- 61Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. In: NIPS; 2017: 5998-6008.
- 62Bartholomew DJ. Time series analysis forecasting and control. J Oper Res Soc. 1971; 22(2): 199-201. doi:10.1057/jors.1971.52
10.1057/jors.1971.52 Google Scholar
- 63Chung J, Gulcehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555. 2014.
- 64Kingma DP, Ba J. A method for stochastic optimization. In: ICLR; 2015.
- 65Chen P, Liu S, Shi C, Hooi B, Wang B, Cheng X. NeuCast: seasonal neural forecast of power grid time series. In: IJCAI; 2018: 3315-3321.