{"660090":{"#nid":"660090","#data":{"type":"event","title":"PhD Defense by Marcus Aloysius Pereira ","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003ETitle:\u003C\/strong\u003E\u0026nbsp;Scalable and Safe Deep Learning Architectures for Stochastic Optimal Control Using Forward-Backward Stochastic Differential Equations\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EDate:\u003C\/strong\u003E August 24, 2022\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ETime:\u003C\/strong\u003E 10:00 am to noon E.T.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ELocation:\u003C\/strong\u003E\u0026nbsp;Conference room MK317 in the Montgomery Knight Aerospace Engineering\u0026nbsp;Building\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EMeeting Link:\u003C\/strong\u003E \u003Ca href=\u0022https:\/\/teams.microsoft.com\/l\/meetup-join\/19%3ameeting_YjgwNjYwOTMtY2Q0NS00ZmFjLTgzZGItNjRkZjFhNDgyMjRh%40thread.v2\/0?context=%7b%22Tid%22%3a%22482198bb-ae7b-4b25-8b7a-6d7f32faa083%22%2c%22Oid%22%3a%22d6c3a944-025c-4772-8233-f12eb9bb2c4f%22%7d\u0022 title=\u0022https:\/\/teams.microsoft.com\/l\/meetup-join\/19%3ameeting_YjgwNjYwOTMtY2Q0NS00ZmFjLTgzZGItNjRkZjFhNDgyMjRh%40thread.v2\/0?context=%7b%22Tid%22%3a%22482198bb-ae7b-4b25-8b7a-6d7f32faa083%22%2c%22Oid%22%3a%22d6c3a944-025c-4772-8233-f12eb9bb2c4f%22%7d\u0022\u003ETeams meeting link\u003C\/a\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EMarcus Aloysius Pereira\u0026nbsp;\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003ERobotics Ph.D. Candidate\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003ESchool of Aerospace Engineering\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EGeorgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ECommittee:\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Evangelos Theodorou (advisor),\u0026nbsp;School of Aerospace Engineering, Georgia Institute of\u0026nbsp;Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Enlu Zhou, School of Industrial and Systems Engineering, Georgia Institute of\u0026nbsp;Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Samuel Coogan, School of Electrical and Computer Engineering, Georgia Institute of\u0026nbsp;Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Kyriakos G. Vamvoudakis, School of Aerospace Engineering, Georgia Institute of\u0026nbsp;Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Yongxin Chen, School of Aerospace Engineering, Georgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Ioannis Exarchos, Microsoft\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EAbstract:\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003EStochastic Optimal Control (SOC) in continuous-time requires solving the Hamilton-Jacobi-Bellman (HJB) equation which suffers from the well-known curse-of-dimensionality. Instead of directly attempting to solve the HJB, one can obtain probabilistic representations of the solution via the Nonlinear Feynman-Kac lemma which relates the unique solution of the HJB to a system of Forward-Backward Stochastic Differential Equations (FBSDEs). This thesis develops novel algorithms that leverage the function approximation capabilities of deep recurrent neural networks to solve systems of FBSDEs and the resulting deep FBSDE framework is memory efficient, provides temporally smoother controls, is immune to compounding approximation errors and can be employed for long time-horizons owing to the underlying Long-Short Term Memory network architecture. Starting from a \u003Cem\u003EVanilla\u003C\/em\u003E\u0026nbsp;SOC problem, the framework is extended to problem formulations such as dynamics with control-multiplicative noise, dynamics with non-affine controls and non-quadratic control cost functions, safety-critical tasks which employs Stochastic Control Barrier Functions and for L1-SOC in minimum-fuel aerospace applications. Each problem formulation is accompanied with necessary structural modifications to the deep learning architecture to enable end-to-end learning. In order to improve the scalability of the framework, especially for safety critical multi-robot problems, this thesis then proposes a novel Decentralized Approach to Safe SOC using the aforementioned Deep FBSDE framework and the well-known Alternating Direction Method of Multipliers (ADMM) algorithm. Using simulations, the efficacy of the decentralized approach is demonstrated on challenging tasks involving many robots and safety constraints. Finally, using this as the backbone, a novel \u003Cem\u003Esim2real\u003C\/em\u003E\u0026nbsp;approach is developed which empowers the deep FBSDE framework to be directly deployed on hardware after training in simulation and the approach is tested on the Robotarium platform. This marks the first work to deploy FBSDE-based controllers on real hardware.\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":" Scalable and Safe Deep Learning Architectures for Stochastic Optimal Control Using Forward-Backward Stochastic Differential Equations"}],"uid":"27707","created_gmt":"2022-08-11 15:48:09","changed_gmt":"2022-08-11 15:48:09","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2022-08-24T11:00:00-04:00","event_time_end":"2022-08-24T13:00:00-04:00","event_time_end_last":"2022-08-24T13:00:00-04:00","gmt_time_start":"2022-08-24 15:00:00","gmt_time_end":"2022-08-24 17:00:00","gmt_time_end_last":"2022-08-24 17:00:00","rrule":null,"timezone":"America\/New_York"},"extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"100811","name":"Phd Defense"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"78771","name":"Public"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}