I will discuss a new class of physics constrained multi-level quadratic regression models for predicting invariant marginal statistics. These paradigm models incorporates memory effects in time and the nonlinear noise from energy conserving nonlinear interactions. I will discuss the mathematical conditions for ergodic solutions and present some preliminary results on their statistical predictive skill.