Object Files and Schemata: Factorizing Declarative and Procedural Knowledge in Dynamical Systems

Understand

Modeling a structured, dynamic environment like a video game requires keeping track of the objects and their states declarative knowledge) as well as predicting how objects behave (procedural knowledge).

• Black-box models with a monolithic hidden state often fail to apply procedural knowledge consistently and uniformly, i.e., they lack systematicity.
• For example, in a video game, correct prediction of one enemy's trajectory does not ensure correct prediction of another's.
• We address this issue via an architecture that factorizes declarative and procedural knowledge and that imposes modularity within each form of knowledge.