KAELBLING L P, LITTMAN M L, CASSANDRA A R. Planning and acting in partially observable stochastic domains [J]. Artificial Intelligence, 1998, 101(1/2): 99-134.

LITTLEMAN M L, SUTTON R S, SINGH S. Predictive representation of state [M]∥Advances in Neural Information Processing Systems 14. Cambridge, MA, USA: MIT Press, 2002: 1555-1561.

SINGH S, JAMES M R, RUDARY M R. Predictive state representations: a new theory for modeling dynamical systems [C]∥Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence. Alberta, Canada: AUAI Press: 512-519.

MCCALLUM A K. Reinforcement learning with selective perception and hidden state [D].University of Rochester. Department of Computer Science, 1995.

JAMES M R, SINGH S. Learning and discovery of predictive state representations in dynamical systems with reset [C]∥Proceedings of the 21st International Conference on Machine Learning. New York, USA ACM,2004: 417-424.

WOLFE B, JAMES M R, SINGH S. Learning predictive state representations in dynamical systems without reset [C]∥Proceeding of the 22nd International Conference on Machine Learning. New York, USA ACM, 2005: 985-992.

SUTTON R S, BRATO A G. Reinforcement learning: an introduction[M]. Cambridge, MA, USA: MIT Press, 1998.