{"656585":{"#nid":"656585","#data":{"type":"event","title":"Machine Learning Center Seminar: Vidya Muthukumar \u2013 Surprises in high-dimensional (overparameterized) linear classification","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003EAbstract:\u0026nbsp;\u003C\/strong\u003ESeemingly counter-intuitive phenomena in deep neural networks have prompted a recent re-investigation of classical machine learning methods, like linear models and kernel methods. Of particular focus is sufficiently high-dimensional setups in which\u0026nbsp;\u003Cem\u003Einterpolation\u003C\/em\u003E\u0026nbsp;of training data is possible. In this talk, we will first briefly review recent works showing that zero regularization, or fitting of noise, need not be harmful in regression tasks. Then, we will use this insight to uncover two new surprises for high-dimensional linear classification:\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cul\u003E\r\n\t\u003Cli\u003Eleast-2-norm interpolation can classify consistently even when the corresponding regression task fails, and\u0026nbsp;\u0026nbsp;\u003C\/li\u003E\r\n\t\u003Cli\u003Ethe support-vector-machine and least-2-norm interpolation solutions\u0026nbsp;\u003Cem\u003Eexactly coincide\u003C\/em\u003E\u0026nbsp;in sufficiently high-dimensional models.\u0026nbsp;\u0026nbsp;\u003C\/li\u003E\r\n\u003C\/ul\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThese findings taken together imply that the (linear\/kernel) SVM can generalize well in settings beyond those predicted by training-data-dependent complexity measures. Time permitting, we will also discuss preliminary implications of these results for adversarial robustness, and the influence of the choice of training loss function in the overparameterized regime.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThis is joint work with Misha Belkin, Daniel Hsu, Adhyyan Narang, Anant Sahai, Vignesh Subramanian, Christos Thrampoulidis, Ke Wang and Ji Xu.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ESpeaker Info:\u0026nbsp;\u003C\/strong\u003E\u0026nbsp;Vidya Muthukumar is an Assistant Professor in the Schools of Electrical and Computer Engineering and Industrial and Systems Engineering at Georgia Institute of Technology. Her broad interests are in game theory, online and statistical learning. She is particularly interested in designing learning algorithms that provably adapt in strategic environments, fundamental properties of overparameterized models, and fairness, accountability, and transparency in machine learning.\u0026nbsp;\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EVidya received the PhD degree in Electrical Engineering and Computer Sciences from University of California, Berkeley. She is the recipient of the Adobe Data Science Research Award, Simons-Berkeley Research Fellowship (for the Fall 2020 program on \u0026quot;Theory of Reinforcement Learning\u0026quot;), IBM Science for Social Good Fellowship and a Georgia Tech Class of 1969 Teaching Fellowship for the academic year 2021-2022.\u0026nbsp;\u0026nbsp;\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EIn this talk, we will first briefly review recent works showing that zero regularization, or fitting of noise, need not be harmful in regression tasks. Then, we will use this insight to uncover two new surprises for high-dimensional linear classification.\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"In this talk, we will first briefly review recent works showing that zero regularization, or fitting of noise, need not be harmful in regression tasks."}],"uid":"27592","created_gmt":"2022-03-23 18:53:29","changed_gmt":"2022-03-23 18:54:53","author":"Joshua Preston","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2022-04-06T13:15:00-04:00","event_time_end":"2022-04-06T14:15:00-04:00","event_time_end_last":"2022-04-06T14:15:00-04:00","gmt_time_start":"2022-04-06 17:15:00","gmt_time_end":"2022-04-06 18:15:00","gmt_time_end_last":"2022-04-06 18:15:00","rrule":null,"timezone":"America\/New_York"},"extras":[],"hg_media":{"643125":{"id":"643125","type":"image","title":"Vidya Muthukumar","body":null,"created":"1611152370","gmt_created":"2021-01-20 14:19:30","changed":"1611152370","gmt_changed":"2021-01-20 14:19:30","alt":"photograph of Vidya Muthukumar","file":{"fid":"244211","name":"VIDYA MUTHUKUMAR DSC_7500.jpg","image_path":"\/sites\/default\/files\/images\/VIDYA%20MUTHUKUMAR%20DSC_7500.jpg","image_full_path":"http:\/\/www.tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/VIDYA%20MUTHUKUMAR%20DSC_7500.jpg","mime":"image\/jpeg","size":258743,"path_740":"http:\/\/www.tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/VIDYA%20MUTHUKUMAR%20DSC_7500.jpg?itok=pCTmoywD"}}},"media_ids":["643125"],"groups":[{"id":"576481","name":"ML@GT"}],"categories":[],"keywords":[],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1795","name":"Seminar\/Lecture\/Colloquium"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"177814","name":"Postdoc"},{"id":"78771","name":"Public"},{"id":"174045","name":"Graduate students"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003E\u003Ca href=\u0022mailto:lia.namirr@cc.gatech.edu\u0022\u003ELia Namirr\u003C\/a\u003E\u003Cbr \/\u003E\r\nMachine\u0026nbsp;Learning Center at Georgia Tech\u003C\/p\u003E\r\n","format":"limited_html"}],"email":[],"slides":[],"orientation":[],"userdata":""}}}