{"623810":{"#nid":"623810","#data":{"type":"news","title":"Machine Learning Makes Memory Management More Efficient","body":[{"value":"\u003Cp\u003EAs big data becomes more critical to society, computer scientists are searching for ways to make it run more efficiently. Georgia Tech researchers are finding solutions to this challenge by using machine learning (ML) to make data storage and access easier.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EKleio is a hybrid memory management system that uses ML and more common historical methods to predict which data is most frequently accessed. The tool is 80 percent more effective than prior methods and shows the potential for applying ML to systems research.\u003C\/p\u003E\r\n\r\n\u003Ch4\u003E\u003Cstrong\u003EMixing Memories\u003C\/strong\u003E\u003C\/h4\u003E\r\n\r\n\u003Cp\u003EThere are two popular memory types: the efficient yet expensive dynamic random-access memory (DRAM) and the more affordable but slower non-volatile memory. Researchers often combine their benefits by merging DRAM and non-volatile into one system commonly referred to as heterogeneous memory.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EA heterogeneous memory system may be inefficient and must be used strategically to get maximum benefit.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;There is a difference in access speed, so we need to be clever on where we place the data,\u0026rdquo; said \u003Cstrong\u003E\u003Ca href=\u0022https:\/\/www.cc.gatech.edu\/grads\/t\/tdoudali\/\u0022\u003EThaleia Dimitra Doudali\u003C\/a\u003E\u003C\/strong\u003E, a fifth-year School of Computer Science (SCS) Ph.D. student.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EMost computer scientists put frequently accessed data, or hot data, in DRAM and the remaining in non-volatile. Hot data is typically determined by which data is historically accessed most, but this can lead to faulty predictions.\u003C\/p\u003E\r\n\r\n\u003Ch4\u003E\u003Cstrong\u003EML and Memory\u003C\/strong\u003E\u003C\/h4\u003E\r\n\r\n\u003Cp\u003EThe researchers knew using ML for systems problems like this was becoming a more popular solution and thought it could apply to memory management. They determined deep recurrent neural networks (RNN) were the best ML option because they use as input a sequence of data to make a prediction.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;Recurrent neural networks fit perfectly because given past access information, they can predict future access patterns,\u0026rdquo; Doudali said.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe challenge came in determining which part of the memory access process to predict. The researchers wanted ML prediction for every piece of data. Yet they also needed the system to be practical and scalable.\u003C\/p\u003E\r\n\r\n\u003Cp\u003ETo achieve both, they created Kleio, a hybrid memory management system that combines ML and historical methods in order to predict the data access frequency and efficiently manage data across the memory components.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EGiven the available system resources, Kleio prioritizes ML training for data that can increase application performance if placed in the right order. Periodically, Kleio combines the historical and ML access pattern predictions to identify hot data in real-time and migrate them in DRAM. In this way, Kleio can deliver on average 80 percent of the feasible application performance improvements.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;We showed that the use of ML in memory management is very promising,\u0026rdquo; Doudali said. \u0026ldquo;Its accuracy can bridge the performance gap between existing and oracular solutions.\u0026rdquo;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDoudali presented the work at the eighth\u003Ca href=\u0022http:\/\/www.hpdc.org\/2019\/\u0022\u003E International Symposium on High-Performance Parallel and Distributed Computing\u003C\/a\u003E in Phoenix, Arizona, in June. The paper,\u003Ca href=\u0022https:\/\/dl.acm.org\/citation.cfm?doid=3307681.3325398\u0022\u003E \u003Cem\u003EKleio: A Hybrid Memory Page Scheduler with Machine Intelligence\u003C\/em\u003E\u003C\/a\u003E, was honored as a best paper finalist. Doudali co-wrote it with SCS Associate Professor\u003Ca href=\u0022https:\/\/www.cc.gatech.edu\/home\/ada\/\u0022\u003E \u003Cstrong\u003EAda Gavrilovska\u003C\/strong\u003E\u003C\/a\u003E\u003Cstrong\u003E \u003C\/strong\u003Eand Advanced Micro Devices, Inc. researchers \u003Cstrong\u003ESergey Blagodurov\u003C\/strong\u003E, \u003Cstrong\u003EAbhinav Vishnu\u003C\/strong\u003E, and \u003Cstrong\u003ESudhanva Gurumurthi.\u003C\/strong\u003E\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"Georgia Tech researchers are finding solutions to this challenge by using machine learning (ML) to make data storage and access easier."}],"uid":"34541","created_gmt":"2019-07-30 14:53:22","changed_gmt":"2019-07-30 14:54:29","author":"Tess Malone","boilerplate_text":"","field_publication":"","field_article_url":"","dateline":{"date":"2019-07-30T00:00:00-04:00","iso_date":"2019-07-30T00:00:00-04:00","tz":"America\/New_York"},"extras":[],"hg_media":{"623811":{"id":"623811","type":"image","title":"HPDC finalist award","body":null,"created":"1564498454","gmt_created":"2019-07-30 14:54:14","changed":"1564498454","gmt_changed":"2019-07-30 14:54:14","alt":"Thaleia Doudali winning best paper finalist honor.","file":{"fid":"237589","name":"award_committee.jpg","image_path":"\/sites\/default\/files\/images\/award_committee.jpg","image_full_path":"http:\/\/www.tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/award_committee.jpg","mime":"image\/jpeg","size":673938,"path_740":"http:\/\/www.tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/award_committee.jpg?itok=gweuI_-X"}}},"media_ids":["623811"],"groups":[{"id":"47223","name":"College of Computing"},{"id":"50875","name":"School of Computer Science"}],"categories":[],"keywords":[],"core_research_areas":[],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003ETess Malone, Communications Officer\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Ca href=\u0022mailto:tess.malone@cc.gatech.edu\u0022\u003Etess.malone@cc.gatech.edu\u003C\/a\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"email":["tess.malone@cc.gatech.edu"],"slides":[],"orientation":[],"userdata":""}}}