Experience-driven Predictive Control

Vishnu Desaraju and Nathan Michael

Abstract:
This work presents Experience-driven Predictive Control (EPC) as a fast technique for solving nonlinear model predictive control problems with uncertain system dynamics. EPC leverages a linear dynamics model that is updated online via Locally Weighted Project Regression (LWPR) to capture nonlinearities, uncertainty, and changes in the system dynamics. This allows the NMPC problem to be re-cast as a quadratic program. The QP can then be solved via multi-parametric techniques to generate a mapping from state, reference, and dynamics model to a locally optimal, affine feedback control law. These mappings, in conjunction with the basis functions learned in LWPR, define a notion of experience for the controller as they capture the full input-output relationship for previous actions the controller has taken. The resulting experience database allows EPC to avoid solving redundant optimization problems, and as it is constructed online, enables the system to operate more efficiently over time. We demonstrate the performance of EPC through a set of simulation studies with a quadrotor micro aerial vehicle that is subjected to unmodeled exogenous perturbations.