{"668819":{"#nid":"668819","#data":{"type":"event","title":"PhD Defense by Kion Fallah","body":[{"value":"\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003ETitle: Manifold Learning of Neural Representations for Efficient Machine Learning Systems\u003C\/strong\u003E\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\n\u003Cstrong\u003EDate\u003C\/strong\u003E:\u0026nbsp;Monday, August 21st\u003Cbr \/\u003E\r\n\u003Cstrong\u003ETime\u003C\/strong\u003E:\u0026nbsp;10:00am EST\u003Cbr \/\u003E\r\n\u003Cstrong\u003ELocation\u003C\/strong\u003E:\u0026nbsp;Coda C1115, Zoom:\u0026nbsp;\u003Ca href=\u0022https:\/\/gatech.zoom.us\/j\/91273552957\u0022\u003Ehttps:\/\/gatech.zoom.us\/j\/91273552957\u003C\/a\u003E \u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cbr \/\u003E\r\n\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003EKion Fallah\u003C\/strong\u003E\u003Cbr \/\u003E\r\nMachine Learning Ph.D. Student\u003Cbr \/\u003E\r\nSchool of Electrical and Computer Engineering\u003Cbr \/\u003E\r\nGeorgia Institute of Technology\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\n\u003Cstrong\u003ECommittee\u003C\/strong\u003E\u003Cbr \/\u003E\r\nDr. Christopher J. Rozell (Advisor) - School of Electrical and Computer Engineering, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Mark Davenport\u0026nbsp;- School of Electrical and Computer Engineering, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Zsolt Kira - School of Interactive Computing, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Amirali Aghazadeh\u0026nbsp;- School of Electrical and Computer Engineering, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Adam Charles\u0026nbsp;- Department of Biomedical Engineering, Johns Hopkins University\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\n\u003Cstrong\u003EAbstract\u003C\/strong\u003E\u003Cbr \/\u003E\r\nDeep learning systems have exhibited tremendous capabilities in decision-making tasks by learning neural representations. To achieve performance, these representations are often expected to implicitly learn invariances from large-scale training datasets, but often fail to generalize task-relevant and task-irrelevant features of data. As an alternative to implicitly learning this structure, the manifold hypothesis suggests that such representations should parameterize task-relevant features of each category with a few degrees of freedom, while separating representations of different categories. Motivated by this hypothesis, we propose techniques to incorporate a generative manifold model into neural representations by learning a dictionary of Lie group operators in the latent space of a deep neural network. We first discuss training techniques to learn this dictionary in an unsupervised manner, allowing for sampling, interpolation, and extrapolation along the manifold. We then discuss approaches in variational sparse coding, which dramatically increase the computational efficiency of the model in train and test time. Finally, we propose a contrastive learning algorithm which incorporates manifold feature augmentations to increase label efficiency. To make this possible, we learn local manifold statistics, allowing for sampled augmentations which preserve identity for a given input data point.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003E\u003Cstrong\u003E\u003Cspan\u003E\u003Cspan\u003EManifold Learning of Neural Representations for Efficient Machine Learning Systems\u003C\/span\u003E\u003C\/span\u003E\u003C\/strong\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"Manifold Learning of Neural Representations for Efficient Machine Learning Systems"}],"uid":"27707","created_gmt":"2023-08-08 13:21:00","changed_gmt":"2023-08-08 13:21:00","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2023-08-21T10:00:00-04:00","event_time_end":"2023-08-21T12:00:00-04:00","event_time_end_last":"2023-08-21T12:00:00-04:00","gmt_time_start":"2023-08-21 14:00:00","gmt_time_end":"2023-08-21 16:00:00","gmt_time_end_last":"2023-08-21 16:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Coda C1115","extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"100811","name":"Phd Defense"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78771","name":"Public"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}