{"667043":{"#nid":"667043","#data":{"type":"event","title":"PhD Defense by Matthew Rines","body":[{"value":"\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EMatthew Rines\u003C\/span\u003E\u003C\/strong\u003E\u003Cbr \/\u003E\r\n\u003Cem\u003E\u003Cspan\u003E(Advisor: Prof. Dimitri Mavris]\u003C\/span\u003E\u003C\/em\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cem\u003E\u003Cspan\u003Ewill defend a doctoral thesis entitled,\u003C\/span\u003E\u003C\/em\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EA Methodology for Resilience-Based Design \u003C\/span\u003E\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EOf An Environmental Control and Life Support System\u003C\/span\u003E\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cem\u003EOn\u003C\/em\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003EMonday, April 17 at 11:30 a.m. EDT\u003C\/strong\u003E\u003Cbr \/\u003E\r\n\u003Ca href=\u0022https:\/\/teams.microsoft.com\/l\/meetup-join\/19%3ameeting_ODI4MTQ1MjItNTNjYy00Nzk2LWFiMGUtZjVjNjA2ZjlkOGI4%40thread.v2\/0?context=%7b%22Tid%22%3a%22482198bb-ae7b-4b25-8b7a-6d7f32faa083%22%2c%22Oid%22%3a%2225281cb1-8f23-4b21-a961-46f960ffeaa0%22%7d\u0022\u003E\u003Cem\u003EMicrosoft Teams Link\u003C\/em\u003E\u003C\/a\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EAbstract\u003C\/span\u003E\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003EA space habitat provides life support to the crew during both normal operation and unexpected circumstances so that they are able to carry out the scientific duties of their mission. As space habitats become more complex and are located farther from Earth, there are increased challenges to ensuring resilience in system performance and crew safety. As a result of these challenges, it is beneficial for resource allocation decision making to be autonomous.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003EAn autonomous resource allocation algorithm reduces the workload of the crew and reliance on terrestrial decision-making. The hostility of space drives the need for rapid decision-making without requiring humans to be in the loop. Furthermore, the inability to plan for all possible situations necessitates a resource allocation strategy that can adapt and learn from experience. The methods used to autonomously learn about changes in the environment also need to be careful not to compromise the safety of the crew.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003ETo meet these goals, a methodology was devised and is herein presented for developing resilient resource allocation strategies for an environmental control and life support system (ECLSS) and integrating it into the design of space habitats. Reinforcement learning techniques were investigated to allow rapid ECLSS resource allocations both for nominal and off-nominal situations. Agents were successfully trained through the use of hyperparameter optimization studies to operate an oxygen pressure control assembly in simulation. Soft actor-critic (SAC) was found to perform the task with the least computational resources. The methodology includes the ability to learn from data collected in operation as well as in a priori training simulations in order to better respond to disturbances that the resource allocation algorithm had not previously experienced in simulations and other non-stationary dynamics. Specifically, the agent trained with SAC was then further demonstrated to be able to adapt in a simulated deployment to changes in crew oxygen consumption, cabin leak rates, and degraded injector capabilities.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003EThe learning rate and reward function were found to have strong effects on the agent\u2019s ability adapt to disturbances in real-time. A variety of learning rates were tested to find the optimal balance between responsiveness and volatility. Additionally, two reward functions using linearly and quadratically increasing penalties were compared given the same set of hyperparameters and the linear penalty was found to perform much better in allowing adaptations in this scenario.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003ELastly, the methods that were found to perform best for the resilient control of the oxygen pressure control assembly were also applied to a more complex habitat. In this demonstration use-case, agents were trained to control the oxygen generation system, crew activities, and the oxygen pressure control assembly. An agent was successfully trained to operate these systems during a nominal simulation, but its ability to adapt in real-time to unexpected disturbances requires some additional configuration and future work.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003EThis research demonstrates that a resource allocation algorithm utilizing reinforcement learning can be developed to improve the resilience of an existing space habitat or a space habitat that is yet to be designed. By incorporating ECLSS decision making algorithms early in the design process, a better design can be found earlier and more cost effectively.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003ECommittee\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cul\u003E\r\n\t\u003Cli\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EProf. Dimitri Mavris \u2013 School of Aerospace Engineering (advisor)\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/li\u003E\r\n\t\u003Cli\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EProf. Glenn Lightsey \u2013 School of Aerospace Engineering\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/li\u003E\r\n\t\u003Cli\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EProf. Koki Ho \u2013 School of Aerospace Engineering\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/li\u003E\r\n\t\u003Cli\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EDr. Rodney Martin \u2013 NASA Ames Research Center\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/li\u003E\r\n\t\u003Cli\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EDr. Michael Balchanos \u2013 School of Aerospace Engineering\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/li\u003E\r\n\u003C\/ul\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EA Methodology for Resilience-Based Design \u003C\/span\u003E\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EOf An Environmental Control and Life Support System\u003C\/span\u003E\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"A Methodology for Resilience-Based Design  Of An Environmental Control and Life Support System"}],"uid":"27707","created_gmt":"2023-04-03 19:34:59","changed_gmt":"2023-04-03 19:34:59","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2023-04-17T11:30:56-04:00","event_time_end":"2023-04-17T13:30:56-04:00","event_time_end_last":"2023-04-17T13:30:56-04:00","gmt_time_start":"2023-04-17 15:30:56","gmt_time_end":"2023-04-17 17:30:56","gmt_time_end_last":"2023-04-17 17:30:56","rrule":null,"timezone":"America\/New_York"},"location":"ZOOM","extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"100811","name":"Phd Defense"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"78771","name":"Public"},{"id":"174045","name":"Graduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}