Hilbert Space Embeddings of Predictive State Representations

Understand

Predictive State Representations (PSRs) are an expressive class of models for controlled stochastic processes.

• PSRs represent state as a set of predictions of future observable events.
• Because PSRs are defined entirely in terms of observable data, statistically consistent estimates of PSR parameters can be learned efficiently by manipulating moments of observed training data.
• Most learning algorithms for PSRs have assumed that actions and observations are finite with low cardinality.