Entropy-Guided Control Improvisation

Marcell J Vazquez-Chanlatte (UC Berkeley),
Sebastian Junges (UC Berkeley),
Daniel J Fremont (UC Santa Cruz),
Sanjit Seshia (UC Berkeley)
Paper Website
Paper #051
Interactive Poster Session V Interactive Poster Session VIII

0d 00h 00m

0d 00h 00m


High level declarative constraints provide a powerful (and popular) way to define and construct control policies; however, most synthesis algorithms do not support specifying the degree of randomness (unpredictability) of the resulting controller. In many contexts, e.g., patrolling, testing, behavior prediction, and planning on idealized models, predictable or biased controllers are undesirable. To address these concerns, we introduce the Entropic Reactive Control Improvisation (ERCI) framework and algorithm that supports synthesizing control policies for stochastic games that are declaratively specified by (i) a hard constraint specifying what must occur (ii) a soft constraint specifying what typically occurs, and (iii) a randomization constraint specifying the unpredictability and variety of the controller, as quantified using causal entropy. This framework, which extends the state-of-the-art by supporting arbitrary combinations of adversarial and probabilistic uncertainty in the environment, enables a flexible modeling formalism which we argue, theoretically and empirically, remains tractable.

Spotlight Presentation

Previous Paper Paper Website Next Paper