SYNCHRONIZING TO THE ENVIRONMENT: INFORMATION-THEORETIC CONSTRAINTS ON AGENT LEARNING
JAMES P. CRUTCHFIELD
DAVID P. FELDMAN
Using an information-theoretic framework, we examine how an intelligent agent, given an accurate model of its environment, synchronizes to the environment â i.e., comes to know in which state the environment is. We show that the total uncertainty experienced by the agent during the process is closely related to the transient information, a new quantity that captures the manner in which the environment's entropy growth curve converges to its asymptotic form. We also discuss how an agent's estimates of its environment's structural properties are related to its estimate of the environment entropy rate. If structural properties are ignored, the missed regularities are converted to apparent randomness. Conversely, using representations that assume too much memory results in false predictability.
In order to set up a list of libraries that you have access to,
you must first login
or sign up.
Then set up a personal list of libraries from your profile page by
clicking on your user name at the top right of any screen.