Back To Index Previous Article Next Article Full Text

Statistica Sinica 34 (2024), 1071-1091

A LANGEVINIZED ENSEMBLE KALMAN FILTER FOR
LARGE-SCALE DYNAMIC LEARNING

Peiyi Zhang, Qifan Song and Faming Liang*

Purdue University

Abstract: The ensemble Kalman filter (EnKF) performs well in terms of data assimilation in atmospheric and oceanic sciences. However, it fails to converge to the correct filtering distribution, which precludes its use for uncertainty quantification in dynamic systems. Thus, we reformulate the EnKF under the framework of Langevin dynamics, yielding a new particle filtering algorithm, which we call the Langevinized EnKF (LEnKF). The LEnKF inherits the forecast-analysis procedure from the EnKF, and uses mini-batch data from stochastic gradient Langevin dynamics (SGLD). We prove that the LEnKF is a sequential preconditioned SGLD sampler, like the EnKF, but with its execution accelerated by the forecast-analysis procedure. Furthermore, the LEnKF converges to the correct filtering distribution in terms of the 2-Wasserstein distance as the number of iterations per i stage increases. We demonstrate the performance of the LEnKF using a variety of examples. The LEnKF is not only scalable with respect to the state dimension and the sample size, but also tends to be immune to sample degeneracy for long-series dynamic data.

Key words and phrases: Data assimilation, inverse problem, state space model, stochastic gradient Markov chain Monte Carlo, uncertainty quantification.

Back To Index Previous Article Next Article Full Text