Developing a deep learning estimator to learn nonlinear dynamic systems

摘要

Process complexities are characterized by strong nonlinearities, dynamics and uncertainties. Modeling such a complex process requires a flexible model with deep layers describing the corresponding strong nonlinear dynamic behavior. The proposed model is constructed by deep neural networks to represent the process of state transition and observation generation, both of which together constitute a stochastic nonlinear state space model. This model is evolved from the variational auto-encoder learned by the stochastic expectation-maximization algorithm. To solve the complexity of posteriors for dynamic processes, the posterior distributions with respect to state variables are constructed by a forward-backward recurrent neural network. One example is given to validate that the proposed method outperforms the comparative methods in modeling complex nonlinearities.