Lab Home | Phone | Search
Center for Nonlinear Studies  Center for Nonlinear Studies
 Colloquia Archive 
 Postdoc Seminars Archive 
 Quantum Lunch 
 Quantum Lunch Archive 
 CMS Colloquia 
 Q-Mat Seminars 
 Q-Mat Seminars Archive 
 P/T Colloquia 
 Kac Lectures 
 Kac Fellows 
 Dist. Quant. Lecture 
 Ulam Scholar 
 CNLS Fellowship Application 
 Student Program 
 Past Visitors 
 History of CNLS 
 Maps, Directions 
 CNLS Office 
Monday, March 12, 2018
3:00 PM - 4:00 PM
CNLS Conference Room (TA-3, Bldg 1690)


State-Dependent Action Optimization Schemes

Edwin K. P. Chong
Colorado State University

We describe research issues surrounding the study of a general class of control strategies called state-dependent action optimization (SDAO). We outline theoretical and applied research issue related to SDAO. On the theoretical side, we introduce a framework based on optimal control and show that, under quite general conditions, there exists an optimal solution (policy or controller) that is also an SDAO scheme. This result, not usually stated this way and more commonly known as Bellmanís principle, makes SDAO schemes of interest in a wide range of applications and is the basis for self-driving vehicles and AlphaGo, the master-beating Go playing machine. We then show how to use results from submodular optimization to bound the performance of SDAO schemes relative to the optimal. We describe several application examples in which such schemes have been applied, and also outline some ongoing applications.

Host: Anatoly Ziotnik