System and Method for Data-Driven Output Feedback Control

摘要

A control system for controlling a machine includes a controller to control a machine according to a control policy parameterized on a lifted state space of the machine having an unknown onto mapping to a state space of the machine. A state of the machine is an instance in the state space that uniquely defines the machine at a time instance, and a lifted state of the machine is an instance in the lifted state space that defines the machine at the time instance, such that the lifted state space at the time instance has the unknown onto mapping to the state of the machine at the time instance. The control system includes a receiver to accept a sequence of measurements of state variables measured over a sequence of time instances, the state variables measured for the time instance form a portion of the state of the machine at the time instance, a differentiator to determine, for the time instance, a derivative of at least one measured state variable using values of the state variable measured for multiple time instances, such that a combination of the measured state variables and the derivative of the at least one measured state variable defines the lifted state for the time instance, and a processor to update the control policy by evaluating a value function of the control policy using the lifted states, such that the controller determines a control input to the machine using the lifted state and the updated control policy.