Computer Science

Learning dynamics: system identification for perceptually challenged agents

Document Type

Article

Abstract

From the perspective of an agent, the input/output behavior of the environment in which it is embedded can be described as a dynamical system. Inputs correspond to the actions executable by the agent in making transitions between states of the environment. Outputs correspond to the perceptual information available to the agent in particular states of the environment. We view dynamical system identification as inference of deterministic finite-state automata from sequences of input/output pairs. The agent can influence the sequence of input/output pairs it is presented by pursuing a strategy for exploring the environment. We identify two sorts of perceptual errors: errors in perceiving the output of a state and errors in perceiving the inputs actually carried out in making a transition from one state to another. We present efficient, high-probability learning algorithms for a number of system identification problems involving such errors. We also present the results of empirical investigations applying these algorithms to learning spatial representations. © 1995 Elsevier Science B.V. All rights reserved.

Publication Title

Artificial Intelligence

Publication Date

1995

Volume

72

Issue

1-2

First Page

139

Last Page

171

ISSN

0004-3702

DOI

10.1016/0004-3702(94)00023-T

APA Citation

Basye, K., Dean, T., & Kaelbling, L. P. (1995). Learning dynamics: System identification for perceptually challenged agents. Artificial Intelligence, 72(1-2), 139-171.

Link to Full Text

Share

COinS