Comparison of sequential data assimilation methods for the Kuramoto–Sivashinsky equation
M. Jardak
Department of Scientific Computing, Florida State University, Tallahassee, FL 32306-4120, U.S.A.
Search for more papers by this authorCorresponding Author
I. M. Navon
Department of Scientific Computing, Florida State University, Tallahassee, FL 32306-4120, U.S.A.
Department of Scientific Computing, Florida State University, Tallahassee, FL 32306-4120, U.S.A.===Search for more papers by this authorM. Zupanski
Cooperative Institute for Research in the Atmosphere, Colorado State University, 1375 Campus Deliver, Fort Collins, CO 80523-1375, U.S.A.
Search for more papers by this authorM. Jardak
Department of Scientific Computing, Florida State University, Tallahassee, FL 32306-4120, U.S.A.
Search for more papers by this authorCorresponding Author
I. M. Navon
Department of Scientific Computing, Florida State University, Tallahassee, FL 32306-4120, U.S.A.
Department of Scientific Computing, Florida State University, Tallahassee, FL 32306-4120, U.S.A.===Search for more papers by this authorM. Zupanski
Cooperative Institute for Research in the Atmosphere, Colorado State University, 1375 Campus Deliver, Fort Collins, CO 80523-1375, U.S.A.
Search for more papers by this authorAbstract
The Kuramoto–Sivashinsky equation plays an important role as a low-dimensional prototype for complicated fluid dynamics systems having been studied due to its chaotic pattern forming behavior. Up to now, efforts to carry out data assimilation with this 1-D model were restricted to variational adjoint methods domain and only Chorin and Krause (Proc. Natl. Acad. Sci. 2004; 101(42):15013–15017) tested it using a sequential Bayesian filter approach. In this work we compare three sequential data assimilation methods namely the Kalman filter approach, the sequential Monte Carlo particle filter approach and the maximum likelihood ensemble filter methods. This comparison is to the best of our knowledge novel. We compare in detail their relative performance for both linear and nonlinear observation operators. The results of these sequential data assimilation tests are discussed and conclusions are drawn as to the suitability of these data assimilation methods in the presence of linear and nonlinear observation operators. Copyright © 2009 John Wiley & Sons, Ltd.
REFERENCES
- 1 Zupanski M. Maximum likelihood ensemble filter. Part1: the theoretical aspect. Monthly Weather Review 2005; 133: 1710–1726.
- 2 Protas B, Bewley TR, Hagen G. A computational framework for the regularization of adjoint analysis in multiscale PDE systems. Journal of Computational Physics 2004; 195(1): 49–89.
- 3 Chorin AJ, Krause P. Dimensional reduction for a Bayesian filter. Proceedings of the National Academy of Sciences 2004; 101(42): 15013–15017.
- 4 Kuramoto Y, Tsuzuki T. On the formation of dissipative structures in reaction–diffusion systems. Progress of Theoretical Physics 1975; 54: 687–699.
- 5 Kuramoto Y, Tsuzuki T. Persistent propagation of concentration waves in dissipative media far from thermal equilibrium. Progress of Theoretical Physics 1976; 55: 356–369.
- 6 Sivashinsky GI. Nonlinear analysis of hydrodynamic instability in laminar flames I. Derivation of basic equations. Acta Astronautica 1977; 4: 1177–1206.
10.1016/0094-5765(77)90096-0 Google Scholar
- 7 Sivashinsky GI. On irregular wavy flow of a liquid film down a vertical plane. Progress of Theoretical Physics 1980; 63: 2112–2114.
- 8 Benny DJ. Long waves in liquid film. Journal of Mathematics and Physics 1966; 45: 150–155.
10.1002/sapm1966451150 Google Scholar
- 9 Babchin AJ, Frenkel AL, Levich BG, Sivashinsky GI. Nonlinear saturation of Rayleigh–Taylor instability in thin films. Physics of Fluids 1983; 26: 3159–3161.
- 10 Hyman JM, Nicolaenko B. The Kuramoto–Sivashinsky equation: a bridge between PDE'S and dynamical systems. Physica D 1986; 18: 113–126.
- 11 Foias C, Nicolaenko B, Sell GR, Temam R. Inertial manifolds for the Kuramoto–Sivashinski equation and an estimate of their lowest dimension. Journal de Mathmatiques Pures et Appliques 1988; 67: 197–226.
- 12 Nicoleanko B, Scheurer B, Temam R. Some global dynamical properties of the Kuramoto–Sivashinsky equations: nonlinear stability and attractors. Physica D 1985; 16: 155–185.
- 13 Temam R. Infinite-Dimensional Dynamical Systems in Mechanics and Physics, Applied Mathematical Sciences, vol. 68. Springer: Berlin, 1997.
10.1007/978-1-4612-0645-3 Google Scholar
- 14 Desertion KA, Kazantzis N. Improved performance of the controlled Kuramoto–Sivashinsky equation via actuator and controller switching. Proceedings of the 2004 American Control Conference, Boston, MA, 30 June–2 July 2004; 267–272.
- 15 Lee CH, Tran HT. Reduced-order-based feedback control of the Kuramoto–Sivashinsky equation. Journal of Computational and Applied Mathematics 2005; 173: 1–19.
- 16 Adams RA. Sobolev Spaces. Academic Press: New York, 1975.
- 17 Mazya VG. Sobolev Spaces. Springer: Berlin, 1985.
- 18 Lions JL. Quelques méthodes de résolution de problèmes aux limites non linéaires. Dunod: Paris, 1969.
- 19 Temam R. Navier–Stokes Equations ( 3rd edn). North-Holland: Amsterdam, New York, 1984.
- 20 Marion M, Temam R. Nonlinear Galerkin methods. SIAM Journal on Numerical Analysis 1989; 26(5): 1139–1157.
- 21 Collet P, Eckmann JP, Epstein H, Stubbe J. A global attracting set for the Kuramoto–Sivashinsky equation. Communications in Mathematical Physics 1993; 152(1): 203–214.
- 22 Nicoleanko B, Scheurer B, Temam R. Some global dynamical properties of a class of pattern formation equations. Communications in Partial Differential Equations 1989; 14: 245–297.
- 23 Hu C, Temam R. Robust boundary control for the Kuramoto–Sivashinsky equation. Dynamics of Continuous Discrete and Impulsive Systems—Series B—Applications and Algorithms 2001; 8(3): 315–338.
- 24 Doucet A, Godsill S, Andrieu C. On sequential Monte Carlo sampling methods for Bayesian filtering. Statistics and Computing 2000; 10(30): 197–208.
- 25 Doucet A, de Freitas JFG, Gordon NJ. An introduction to sequential Monte Carlo methods, In Sequential Monte Carlo Methods in Practice, A Doucet, JFG de Freitas, NJ Gordon (eds). Springer: New York, 2001.
10.1007/978-1-4757-3437-9_1 Google Scholar
- 26 Arulampalam MS, Maskell S, Gordon N, Clapp T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing 2002; 150(2): 174–188.
- 27 Berliner ML, Wikle CK. A Bayesian tutorial for data assimilation. Physica D 2007; 30: 1–16.
- 28 Silverman BW. Density Estimation for Statistics and Data Analysis. Chapman & Hall: London, 1986.
- 29 Bengtsson T, Bickel P, Li B. Curse-of-dimensionality revisited: collapse of the particle filter in very large scale systems. Probability and Statistics: Essays in Honor of David A. Freedman 2008; 2: 316–334.
10.1214/193940307000000518 Google Scholar
- 30 Bickel P, Li B, Bengtsson T. Sharp failure rates for the bootstrap particle filter in high dimensions. IMS Collections Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh 2008; 3: 318–329.
10.1214/074921708000000228 Google Scholar
- 31 Snyder C, Bengtsson T, Bickel P, Anderson J. Obstacles to high-dimensional particle filtering. Monthly Weather Review 2008; 136(12): 4629–4640.
- 32 Gordon NJ, Salmond DJ, Smith AFM. Novel approach to nonlinear non-Gaussian Bayesian state estimate. IEEE Proceedings F 1993; 140: 107–113.
- 33 Berliner ML, Wikle CK. Approximate importance sampling Monte Carlo for data assimilation. Physica D 2007; 30: 37–49.
- 34 Hol JD, Schön TB, Gustafsson F. On resampling algorithms for particle filters. Nonlinear Statistical Signal Processing Workshop, Cambridge, U.K., 2006.
- 35 Liu JS, Chen R. Sequential Monte Carlo methods for dynamic systems. Journal of the American Statistical Association 1998; 93(442): 1032–1044.
- 36 Kotecha G, Djurić PM. Gaussian particle filtering. IEEE Transactions on Signal Processing 2003; 51: 2592–2601.
- 37 Kitagawa G. Monte Carlo filter and smoother for non-Gaussian nonlinear state space models. Journal of Computational and Graphical Statistics 1996; 5(1): 1–25.
10.1080/10618600.1996.10474692 Google Scholar
- 38 Nakano S, Ueno G, Higuchi T. Merging particle filter for sequential data assimilation. Nonlinear Processes in Geophysics 2007; 14: 395–409.
- 39 Goldberg DE. Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley: Reading, MA, 1989.
- 40 Evensen G. Sequential data assimilation in non-linear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. Journal of Geophysical Research 1994; 99(C510): 108–129.
- 41 Burgers G, van Leeuwen PJ, Evensen G. Analysis scheme in the ensemble Kalman filter. Monthly Weather Review 1998; 126: 1719–1724.
- 42 Evensen G. The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dynamics 2003; 53: 343–367.
- 43 Evensen G. Data Assimilation: The Ensemble Kalman Filter. Springer: Berlin, 2007.
- 44 Jazwinski AH. Stochastic Processes and Filtering Theory. Academic Press: New York, 1970.
- 45 Bucy RS. Recurrent sets. Annals of Mathematical Statistics 1965; 36: 535–545.
- 46 Kalman RE. A new approach to linear filtering and prediction problems. Transactions of the ASME—Journal of Basic Engineering 1960; 82(Series D): 35–45.
10.1115/1.3662552 Google Scholar
- 47 Mandel J. Efficient implementation of the ensemble Kalman filter. CCM Report, vol. 231, 2006.
- 48 Mandel J. A brief tutorial on the ensemble Kalman filter manuscript, 2007.
- 49 Lewis JL, Lakshivarahan S, Dhall SK. Dynamic Data Assimilation: A Least Squares Approach. Series on Encyclopedia of Mathematics and its Applications, vol. 104. Cambridge University Press: Cambridge, 2006.
10.1017/CBO9780511526480 Google Scholar
- 50 Houtekamer P, Mitchell M. Data assimilation using an ensemble Kalman filter technique. Monthly Weather Review 1998; 126: 796–811.
- 51 Gaspari G, Cohn SE. Construction of correlation functions in two and three dimensions. Quarterly Journal of the Royal Meteorological Society 1999; 125: 723–757.
- 52 Hamill TM, Snyder C. A hybrid ensemble Kalman filter-3D variational analysis scheme. Monthly Weather Review 2000; 128: 2905–2919.
- 53 Hamill TM. Ensemble-based atmospheric data assimilation. Predictability of Weather and Climate. Cambridge Press: Cambridge, 2006; 124–156.
- 54 Ehrendorfer E. A review of issues in ensemble-based Kalman filtering. Meteorologische Zeitschrift 2007; 16: 795–818.
- 55 Zupanski D, Zupanski M. Model error estimation employing ensemble data assimilation approach. Monthly Weather Review 2006; 134: 1337–1354.
- 56 Lorenc AC. Analysis methods for numerical weather prediction. Quarterly Journal of the Royal Meteorological Society 1986; 112: 1177–1194.
- 57 Zupanski M, Navon IM, Zupanski D. The maximum likelihood ensemble filter as a non-differentiable minumization algorithm. Quarterly Journal of the Royal Meteorology 2008; 134: 1039–1050.
- 58 Kassam AK, Trefethen LN. Fourth-order time-stepping for stiff PDS's. SIAM Journal on Scientific Computing 2005; 26(4): 1214–1233.
- 59 Krogstad S. Generalized integrating factor methods for stiff PDE's. Journal of Computational Physics 2005; 203: 72–88.
- 60 Canuto C, Hussaini MY, Quarteroni A, Zang TA. Spectral Methods in Fluids Dynamics. Springer: Berlin, 1988.
10.1007/978-3-642-84108-8 Google Scholar
- 61 Trefethen NL. Spectral Methods in Matlab. Software, Environments, Tools. SIAM: Philadelphia, 2000.
10.1137/1.9780898719598 Google Scholar
- 62 Cox SM, Matthews PC. Exponential time differencing for stiff systems. Journal of Computational Physics 2002; 176: 430–455.
- 63 Anderson JL, Anderson SL. A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Monthly Weather Review 1999; 127: 2741–2785.
- 64 Jardak M, Navon IM, Zupanski D. Ensemble data assimilation for the shallow water equation. Journal of Geophysical Research 2008; submitted.
- 65 Kalnay E. Some Ideas for Ensemble Kalman Filtering. US National Oceanic and Atmospheric Administration, Climate Test Bed Joint Seminar Series, IGES/COLA, 2008.
- 66 Xiong X, Navon IM, Uzunoglu B. A note on the particle filter with posterior Gaussian resampling. Tellus 2006; 58A: 456–460.
10.1111/j.1600-0870.2006.00185.x Google Scholar
- 67 Salman H. A hybrid grid/particle filter for Lagrangian data assimilation: formulating the passive scalar approximation. Quarterly Journal of the Royal Meteorological Society 2008; 134: 1539–1550.
- 68 Brockmeier M. Using the particle filter for reservoir model updating. Master of Science in Applied Mathematics, Delft University of Technology, 2007.