{"653067":{"#nid":"653067","#data":{"type":"news","title":"Research Finds Models Used to Detect Malicious Users on Popular Social Sites are Vulnerable to Attack","body":[{"value":"\u003Cp\u003EWhether they are fake accounts, sock puppet accounts, spammers, fake news spreaders, vandal editors, or fraudsters, malicious users pose serious challenges to the security of nearly every virtual platform.\u003C\/p\u003E\r\n\r\n\u003Cp\u003ENow, research led by Georgia Tech has identified a new threat to deep learning models used to detect malicious users on Facebook and other popular e-commerce, social media, and web platforms.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;Social media and web platforms put a lot of energy, effort, and resources into creating state-of-the-art methods to keep their platforms safe,\u0026quot; said\u0026nbsp;Srijan Kumar, School of Computational Science and Engineering assistant professor and co-investigator.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026quot;To do this, they create machine learning and artificial intelligence models that essentially try to identify and separate malicious and at-risk users from the benign users.\u0026rdquo;\u003C\/p\u003E\r\n\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003EUsing a newly developed adversarial attack model, the research team was able to reduce the performance of classification models used to distinguish between benign and malicious users.\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\r\n\u003Cp\u003EThe new attack model generates text posts that mimic a personalized writing style and that are inflected by contextual knowledge of a given target site. The generated posts also are informed by the historical use of a target site and recent topics of interest.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EKnown\u0026nbsp;as\u0026nbsp;\u003Ca href=\u0022https:\/\/www.cc.gatech.edu\/~srijan\/pubs\/petgen-he-kdd2021.pdf\u0022\u003EPETGEN\u003C\/a\u003E, the\u0026nbsp;work represents\u0026nbsp;the first time researchers have successfully conducted adversarial attacks on deep user sequence classification models.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;There is always this game between the models trying to catch the malicious users and the accounts trying to not get caught. If we can act as attackers, we can identify the model vulnerabilities and the potential ways these malicious accounts evade detection systems,\u0026rdquo; Kumar said.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe research\u0026nbsp;was conducted on two real-world datasets from Yelp and Wikipedia. Although\u0026nbsp;the PETGEN research reveals that malicious users can evade these types of detection models, Kumar says he and his team are working now to develop a defense against this type of attack.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;The findings will help to pave the path toward the next generation of adversary-aware sequence classification models and better safety for virtual interactions on these platforms,\u0026rdquo; Kumar said.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe findings of this work were first presented at the\u0026nbsp;\u003Ca href=\u0022https:\/\/www.kdd.org\/kdd2021\/\u0022\u003E27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining\u003C\/a\u003E\u0026nbsp;by Kumar, School of Computer Science Professor\u0026nbsp;Mustaque Ahamad, and computer science Ph.D. student\u0026nbsp;Bing He.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe work presented in PETGEN is also an output of a\u0026nbsp;\u003Ca href=\u0022https:\/\/research.fb.com\/blog\/2020\/07\/announcing-the-winners-of-the-2020-request-for-proposals-in-applied-statistics\/\u0022\u003EFacebook research award\u003C\/a\u003E\u0026nbsp;that Kumar received jointly with CSE Associate Professor\u0026nbsp;Polo Chau.\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"A research team led by Georgia Tech has identified a new cyber threats to popular e-commerce, social media, and web platforms."}],"uid":"32045","created_gmt":"2021-11-22 15:14:42","changed_gmt":"2021-11-24 04:06:17","author":"Ben Snedeker","boilerplate_text":"","field_publication":"","field_article_url":"","dateline":{"date":"2021-11-22T00:00:00-05:00","iso_date":"2021-11-22T00:00:00-05:00","tz":"America\/New_York"},"extras":[],"hg_media":{"633404":{"id":"633404","type":"image","title":"Srijan Kumar","body":null,"created":"1583773435","gmt_created":"2020-03-09 17:03:55","changed":"1583773435","gmt_changed":"2020-03-09 17:03:55","alt":"Headshot of Srijan Kumar","file":{"fid":"241009","name":"headshot-Kumar.jpg","image_path":"\/sites\/default\/files\/images\/headshot-Kumar.jpg","image_full_path":"http:\/\/www.tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/headshot-Kumar.jpg","mime":"image\/jpeg","size":1411835,"path_740":"http:\/\/www.tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/headshot-Kumar.jpg?itok=qMtlGW7v"}}},"media_ids":["633404"],"groups":[{"id":"1188","name":"Research Horizons"}],"categories":[],"keywords":[{"id":"187915","name":"go-researchnews"}],"core_research_areas":[{"id":"145171","name":"Cybersecurity"}],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003EAlbert Snedeker, Communications Manager II\u003Cbr \/\u003E\r\n\u003Ca href=\u0022mailto:albert.snedeker@cc.gatech.edu?subject=Malicious%20users\u0022\u003Ealbert.snedeker@cc.gatech.edu\u003C\/a\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"email":["albert.snedeker@cc.gatech.edu"],"slides":[],"orientation":[],"userdata":""}}}