Identification of dual-rate sampled nonlinear systems based on the cycle reservoir with regular jumps network
Corresponding Author
Li Xie
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Correspondence Li Xie, Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi 214122, People's Republic of China.
Email: [email protected]
Search for more papers by this authorYapu Pan
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Search for more papers by this authorHongfeng Tao
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Search for more papers by this authorHuizhong Yang
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Search for more papers by this authorCorresponding Author
Li Xie
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Correspondence Li Xie, Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi 214122, People's Republic of China.
Email: [email protected]
Search for more papers by this authorYapu Pan
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Search for more papers by this authorHongfeng Tao
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Search for more papers by this authorHuizhong Yang
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, Wuxi, People's Republic of China
Search for more papers by this authorFunding information: China Postdoctoral Science Foundation, Grant/Award Number: 2021M691276; National Natural Science Foundation of China, Grant/Award Number: 61773181; National Key R and D Program of China, Grant/Award Number: 2022YFC3401302
Summary
There are two main difficulties for identification of dual-rate sampled nonlinear systems; one is the unknown nonlinear properties and the other is the dual-rate sampled data. Considering the above two points, this paper proposes a cycle reservoir with regular jumps (CRJ) network based recursive identification algorithm. Unlike a traditional method, the proposed one does not require a priori knowledge of the nonlinearity and can handle dual-rate data; therefore, its applicability can be guaranteed. Firstly, the CRJ network is used to describe the nonlinear characteristics of the target systems. However, the update of the CRJ network requires the missing outputs, thus the auxiliary model identification theory is adopted and the missing outputs are replaced by the estimated outputs of the network. In this process, the output weights of the CRJ network are updated at a slow rate, while the estimates of the missing outputs are updated quickly, resulting in an interactive estimation computation process. Then, to improve the identification accuracy, the hyper-parameters of the CRJ network are optimized by means of the particle swarm optimization algorithm. Finally, simulation examples are presented to demonstrate the effectiveness of the proposed algorithm.
CONFLICT OF INTEREST
The authors declare no potential conflict of interest.
Open Research
DATA AVAILABILITY STATEMENT
All data generated or analyzed during this study are included in this article. Data sharing is not applicable to this article as no new data were created or analyzed in this study.
REFERENCES
- 1Gu Y, Liu J, Li X, Chou Y, Ji Y. State space model identification of multirate processes with time-delay using the expectation maximization. J Frank Inst. 2019; 356(3): 1623-1639.
- 2Wang J, Song Y, Wei G. Robust model predictive control for multirate systems with model uncertainties and circular scheduling. Int J Robust Nonlinear Control. 2020; 30(18): 8206-8227.
- 3Ding F, Chen T. Combined parameter and output estimation of dual-rate systems using an auxiliary model. Automatica. 2004; 40(10): 1739-1748.
- 4Ding F, Chen T. Parameter estimation of dual-rate stochastic systems by using an output error method. IEEE Trans Automat Contr. 2005; 50(9): 1436-1441.
- 5Gan J, Parulekar SJ. Multi-rate data-driven models for lactic acid fermentation–parameter identification and prediction. Comput Chem Eng. 2019; 128: 405-416.
- 6Yang X, Yang X. Local identification of LPV dual-rate system with random measurement delays. IEEE Trans Ind Electron. 2017; 65(2): 1499-1507.
- 7Liu Y. An efficient hierarchical identification method for general dual-rate sampled-data systems. Automatica. 2014; 50(3): 962-970.
- 8Ding F, Chen T. Hierarchical identification of lifted state-space models for general dual-rate systems. IEEE Trans Circuits Syst I, Regul Pap. 2005; 52(6): 1179-1187.
- 9Ding J, Lin J. Modified subspace identification for periodically non-uniformly sampled systems by using the lifting technique. Circuits Syst Signal Process. 2014; 33(5): 1439-1449.
- 10Wang D. Highly efficient identification methods for dual-rate Hammerstein systems. IEEE Trans Control Syst Technol. 2015; 23(5): 1952-1960.
- 11Fu Y, Du Q, Zhou X, Fu J, Chai T. Dual-rate adaptive decoupling controller and its application to a dual-tank water system. IEEE Trans Control Syst Technol. 2019; 28(6): 2515-2522.
- 12Chen J, Liu Y. Interval error correction auxiliary model based gradient iterative algorithms for multirate ARX nodels. IEEE Trans Automat Contr. 2020; 65(10): 4385-4392.
- 13Ding J, Fan C, Lin J. Auxiliary model based parameter estimation for dual-rate output error systems with colored noise. Appl Math Model. 2013; 37(6): 4051-4058.
- 14Chen L, Han L, Huang B, Liu F. Parameter estimation for a dual-rate system with time delay. ISA Trans. 2014; 53(5): 1368-1376.
- 15Ding F, Liu X, Gu Y. An auxiliary model based least squares algorithm for a dual-rate state space system with time-delay using the data filtering. J Frank Inst. 2016; 353(2): 398-408.
- 16Lan J, Zhao D. Robust model predictive control for nonlinear parameter varying systems without computational delay. Int J Robust Nonlinear Control. 2021; 31(17): 8273-8294.
- 17Wang D, Zhang Z, Yuan J. Maximum likelihood estimation method for dual-rate Hammerstein systems. Int J Control Autom Syst. 2017; 15(2): 698-705.
- 18Chen J, Zhang Y, Zhu Q, Liu Y. Aitken based modified Kalman filtering stochastic gradient algorithm for dual-rate nonlinear models. J Frank Inst. 2019; 356(8): 4732-4746.
- 19Wang H, Chen Y. Parameter estimation for dual-rate sampled Hammerstein systems with dead-zone nonlinearity. J Syst Eng Electron. 2020; 31(1): 185-193.
- 20Li X, Zhou L, Sheng J, Ding R. Recursive least squares parameter estimation algorithm for dual-rate sampled-data nonlinear systems. Nonlinear Dyn. 2014; 76(2): 1327-1334.
- 21Ma J, Chen J, Xiong W, et al. Expectation maximization estimation algorithm for Hammerstein models with non-Gaussian noise and random time delay from dual-rate sampled-data. Digi Signal Process. 2018; 73: 135-144.
- 22Li J, Zhang J. Maximum likelihood identification of dual-rate Hammerstein output-error moving average system. IET Control Theory Appl. 2020; 14(8): 1089-1101.
- 23Ma J, Xu S, Zhuang G, Wei Y, Zhang Z. Adaptive neural network tracking control for uncertain nonlinear systems with input delay and saturation. Int J Robust Nonlinear Control. 2020; 30(7): 2593-2610.
- 24Laurain V, Tóth R, Piga D, Zheng WX. An instrumental least squares support vector machine for nonlinear system identification. Automatica. 2015; 54: 340-347.
- 25Kostikova AV, Tereliansky PV, Shuvaev AV, Parakhina VN, Timoshenko PN. Expert fuzzy modeling of dynamic properties of complex systems. ARPN J Eng Appl Sci. 2016; 11(17): 10601-10608.
- 26 Xie XP, Wei C, Gu Z, Shi KB. Relaxed resilient fuzzy stabilization of discrete-time Takagi-Sugeno systems via a higher order time-variant balanced matrix method. IEEE Trans Fuzzy Syst. 2022;30(11):5044-5050. doi:10.1109/TFUZZ.2022.3145809
- 27Gu Z, Yin TT, Ding ZT. Path tracking control of autonomous vehicles subject to deception attacks via a learning-based event-triggered mechanism. IEEE Trans Neural Netw Learn Syst. 2021; 32(12): 5644-5653.
- 28Jaeger H. The echo state approach to analysing and training recurrent neural networks-with an erratum note. Bonn, Germany: German Natl Res Center Inf Technol GMD Tech Rep. 2001; 148(34): 13.
- 29Ozturk MC, Xu D, Principe JC. Analysis and design of echo state networks. Neural Comput. 2007; 19(1): 111-138.
- 30Rodan A, Tino P. Simple deterministically constructed cycle reservoirs with regular jumps. Neural Comput. 2012; 24(7): 1822-1852.
- 31Sumeth Y, Nishihara A. Evolutionary pre-training for CRJ-type reservoir of echo state networks. Neurocomput. 2015; 149: 1324-1329.
- 32Mo Y, Li Q, Karimian H, et al. A novel framework for daily forecasting of ozone mass concentrations based on cycle reservoir with regular jumps neural networks. Atmos Environ. 2020; 220:117072.
- 33Xu L. Separable multi-innovation Newton iterative modeling algorithm for multi-frequency signals based on the sliding measurement window. Circuits Syst Signal Process. 2022; 41(2): 805-830.
- 34Xu L. Separable Newton recursive estimation method through system responses based on dynamically discrete measurements with increasing data length. Int J Control Autom Syst. 2022; 20(2): 432-443.
- 35Gu Y, Zhu QM, Nouri H. Identification and U-control of a state-space system with time-delay. Int J Adapt Control Signal Process. 2022; 36(1): 138-154.
- 36Ding JL. Finite-time adaptive control for nonlinear systems with uncertain parameters based on the command filters. Int J Adapt Control Signal Process. 2021; 35(9): 1754-1767.
- 37Xu L. Separable synchronous multi-innovation gradient-based iterative signal modeling from on-line measurements. IEEE Trans Instrum Meas. 2022; 71:6501313.
- 38Xu L, Song GL. A recursive parameter estimation algorithm for modeling signals with multi-frequencies. Circuits Syst Signal Process. 2020; 39(8): 4198-4224.
- 39Ma P, Wang L. Filtering-based recursive least squares estimation approaches for multivariate equation-error systems by using the multiinnovation theory. Int J Adapt Control Signal Process. 2021; 35(9): 1898-1915.
- 40Chen J, Huang B, Gan M, Chen CLP. A novel reduced-order algorithm for rational models based on Arnoldi process and Krylov subspace. Automatica. 2021; 129:109663.
- 41Chen J, Zhu QM, Liu YJ. Modified Kalman filtering based multi-step-length gradient iterative algorithm for ARX models with random missing outputs. Automatica. 2020; 118:109034.
- 42Ding F. Coupled-least-squares identification for multivariable systems. IET Control Theory Appl. 2013; 7(1): 68-79.
- 43Pan J, Jiang X, Wan XK, Ding W. A filtering based multi-innovation extended stochastic gradient algorithm for multivariable control systems. Int J Control Autom Syst. 2017; 15(3): 1189-1197.
- 44Ding F, Liu XG, Chu J. Gradient-based and least-squares-based iterative algorithms for Hammerstein systems using the hierarchical identification principle. IET Control Theory Appl. 2013; 7(2): 176-184.
- 45Pan J, Ma H, Zhang X. Recursive coupled projection algorithms for multivariable output-error-like systems with coloured noises. IET Signal Process. 2020; 14(7): 455-466.
- 46Wang YJ, Tang SH, Deng MQ. Modeling nonlinear systems using the tensor network B-spline and the multi-innovation identification theory. Int J Robust Nonlinear Control. 2022; 32(13): 7304-7318.
- 47Ding F, Liu G, Liu XP. Partially coupled stochastic gradient identification methods for non-uniformly sampled systems. IEEE Trans Automat Contr. 2010; 55(8): 1976-1981.
- 48Wang YJ, Tang SH, Gu XB. Parameter estimation for nonlinear Volterra systems by using the multi-innovation identification theory and tensor decomposition. J Frank Inst. 2022; 359(2): 1782-1802.
- 49Wang YJ, Yang L. An efficient recursive identification algorithm for multilinear systems based on tensor decomposition. Int J Robust Nonlinear Control. 2021; 31(11): 7920-7936.
- 50Ding J. Hierarchical least squares identification for linear SISO systems with dual-rate sampled-data. IEEE Trans Automat Contr. 2011; 56(11): 2677-2683.
- 51Pan J, Li W, Zhang HP. Control algorithms of magnetic suspension systems based on the improved double exponential reaching law of sliding mode control. Int J Control Autom Syst. 2018; 16(6): 2878-2887.
- 52Xiong JX, Pan J, Chen GY, et al. Sliding mode dual-channel disturbance rejection attitude control for a quadrotor. IEEE Trans Ind Electron. 2022; 69(10): 10489-10499.
- 53 Pan J, Chen Q, Xiong J, Chen G. A novel quadruple boost nine level switched capacitor inverter. J Electr Eng Technol. 2022. doi:10.1007/s42835-022-01130-2
- 54 Huang L, Deng X, Bo Y, Zhang Y, Wang P. Evolutionary optimization assisted delayed deep cycle reservoir modeling method with its application to ship heave motion prediction. ISA Trans. 2022;126:638-648. doi:10.1016/j.isatra.2021.08.020
- 55Li MH, Liu XM. Maximum likelihood hierarchical least squares-based iterative identification for dual-rate stochastic systems. Int J Adapt Control Signal Process. 2021; 35(2): 240-261.
- 56Li MH, Liu XM. Iterative identification methods for a class of bilinear systems by using the particle filtering technique. Int J Adapt Control Signal Process. 2021; 35(10): 2056-2074.
- 57Chen J, Jiang B, Li J. Missing output identification model based recursive least squares algorithm for a distributed parameter system. Int J Control Autom Syst. 2018; 16(1): 150-157.
- 58Ji Y, Kang Z, Zhang X, Xu L. Model recovery for multi-input signal-output nonlinear systems based on the compressed sensing recovery theory. J Frank Inst. 2022; 359(5): 2317-2339.
- 59Xu L. Auxiliary model multiinnovation stochastic gradient parameter estimation methods for nonlinear sandwich systems. Int J Robust Nonlinear Control. 2021; 31(1): 148-165.
- 60Kang Z, Ji Y, Liu XM. Hierarchical recursive least squares algorithms for Hammerstein nonlinear autoregressive output-error systems. Int J Adapt Control Signal Process. 2021; 35(11): 2276-2295.
- 61Xu L, Chen FY. Hierarchical recursive signal modeling for multi-frequency signals based on discrete measured data. Int J Adapt Control Signal Process. 2021; 35(5): 676-693.
- 62Ji Y, Kang Z. Three-stage forgetting factor stochastic gradient parameter estimation methods for a class of nonlinear systems. Int J Robust Nonlinear Control. 2021; 31(3): 971-987.
- 63Ji Y, Kang Z, Liu XM. The data filtering based multiple-stage Levenberg-Marquardt algorithm for Hammerstein nonlinear systems. Int J Robust Nonlinear Control. 2021; 31(15): 7007-7025.
- 64Xu L. Decomposition strategy-based hierarchical least mean square algorithm for control systems from the impulse responses. Int J Syst Sci. 2021; 52(9): 1806-1821.
- 65Ji Y, Kang Z, Zhang C. Two-stage gradient-based recursive estimation for nonlinear models by using the data filtering. Int J Control Autom Syst. 2021; 19(8): 2706-2715.
- 66Wang JW, Ji Y, Zhang C. Iterative parameter and order identification for fractional-order nonlinear finite impulse response systems using the key term separation. Int J Adapt Control Signal Process. 2021; 35(8): 1562-1577.
- 67Wang JW, Ji Y, Zhang X, Xu L. Two-stage gradient-based iterative algorithms for the fractional-order nonlinear systems by using the hierarchical identification principle. Int J Adapt Control Signal Process. 2022; 36(7): 1778-1796.
- 68Zhang X. Optimal adaptive filtering algorithm by using the fractional-order derivative. IEEE Signal Process Lett. 2022; 29: 399-403.
- 69Ji Y, Zhang C, Kang Z, Yu T. Parameter estimation for block-oriented nonlinear systems using the key term separation. Int J Robust Nonlinear Control. 2020; 30(9): 3727-3752.
- 70Wang YJ. Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model. Automatica. 2016; 71: 308-313.
- 71Ji Y, Jiang XK, Wan LJ. Hierarchical least squares parameter estimation algorithm for two-input Hammerstein finite impulse response systems. J Frank Inst. 2020; 357(8): 5019-5032.
- 72Zhou YH. Modeling nonlinear processes using the radial basis function-based state-dependent autoregressive models. IEEE Signal Process Lett. 2020; 27: 1600-1604.
- 73Zhou YH. Partially-coupled nonlinear parameter optimization algorithm for a class of multivariate hybrid models. Appl Math Comput. 2022; 414:126663.
- 74Liu SY. Expectation-maximization algorithm for bilinear systems by using the Rauch-Tung-Striebel smoother. Automatica. 2022; 142:110365.
- 75Xu L. Separable multi-innovation stochastic gradient estimation algorithm for the nonlinear dynamic responses of systems. Int J Adapt Control Signal Process. 2020; 34(7): 937-954.
- 76Zhou YH. Hierarchical estimation approach for RBF-AR models with regression weights based on the increasing data length. IEEE Trans Circuits Syst II Express Br. 2021; 68(12): 3597-3601.
- 77Chen YF, Zhang C, Liu CY, et al. Atrial fibrillation detection using feedforward neural network. J Med Biolog Eng. 2022; 42(1): 63-73.
- 78Wang J, Ding C, Wu M, Liu Y, Chen G. Lightweight multiple scale-patch dehazing network for real-world hazy image. KSII Trans Internet Inf Syst. 2022; 15(12): 4420-4438.
- 79Rodan A, Tino P. Minimum complexity echo state network. IEEE Trans Neural Netw. 2010; 22(1): 131-144.
- 80Marini F, Walczak B. Particle swarm optimization (PSO): a tutorial. Chemom Intell Lab Syst. 2015; 149: 153-165.
- 81Nikravesh M, Farell A, Stanford T. Control of nonisothermal CSTR with time varying parameters via dynamic neural network control (DNNC). Chem Eng J. 2000; 76(1): 1-16.
- 82Zhang X. State estimation for bilinear systems through minimizing the covariance matrix of the state estimation errors. Int J Adapt Control Signal Process. 2019; 33(7): 1157-1173.
- 83Zhang X. Hierarchical parameter and state estimation for bilinear systems. Int J Syst Sci. 2020; 51(2): 275-290.
- 84Wang H. A true three-scroll chaotic attractor coined. Discr Contin Dyn Syst Ser B. 2022; 27(5): 2891-2915.
- 85Li JM. A novel nonlinear optimization method for fitting a noisy Gaussian activation function. Int J Adapt Control Signal Process. 2022; 36(3): 690-707.
- 86Geng FZ. A novel kernel functions algorithm for solving impulsive boundary value problems. Appl Math Lett. 2022; 134:108318.
- 87Li M. A chaotic strategy-based quadratic opposition-based learning adaptive variable-speed whale optimization algorithm. Math Comput Simul. 2022; 193: 71-99.
- 88Cui T. Moving data window-based partially-coupled estimation approach for modeling a dynamical system involving unmeasurable states. ISA Trans. 2022; 128: 437-452.
- 89Wei C. Overall recursive least squares and overall stochastic gradient algorithms and their convergence for feedback nonlinear controlled autoregressive systems. Int J Robust Nonlinear Control. 2022; 32(9): 5534-5554.