{"583818":{"#nid":"583818","#data":{"type":"news","title":"Paper Honored as First to Earn ACM \u0027Results Replicated\u0027 Badge","body":[{"value":"\u003Cp\u003EA paper from Georgia Institute of Technology researchers will be the first ever to be recognized with a new designation that lets other scientists know that its results have been successfully duplicated.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe new designation scheme is a response to recent studies by the \u003Ca href=\u0022http:\/\/www.acm.org\/\u0022\u003EAssociation for Computing Machinery\u003C\/a\u003E (ACM) that have shown that an \u0026ldquo;uncomfortably large number of research results\u0026rdquo; are not measuring up to the basic scientific method premise that experimental research results must be reproducible to be validated.\u003C\/p\u003E\r\n\r\n\u003Cp\u003ETo meet this fundamental challenge, ACM, its \u003Ca href=\u0022http:\/\/www.sighpc.org\/\u0022\u003ESpecial Interest Group on High Performance Computing\u003C\/a\u003E (SIGHPC), and the International Conference for High Performance Computing, Networking, Storage, and Analysis\u0026ndash;more commonly known as \u003Ca href=\u0022http:\/\/sc16.supercomputing.org\/\u0022\u003ESupercomputing\u003C\/a\u003E (SC)\u0026ndash;are rolling out a new initiative that aims to promote and strengthen the integrity of computing\u0026rsquo;s research community.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EAt this week\u0026rsquo;s SC16 in Salt Lake City, ACM and SC organizers will begin awarding badges to papers judged at the annual event. These badges represent one or more of the \u0026lsquo;Three Rs\u0026rsquo; crucial to scientific research: repeatability, replicability and reproducibility.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe inaugural badge for \u003Cem\u003EResults Replicated\u003C\/em\u003E will be awarded to a paper written by a team from Georgia Tech during the SC16 awards ceremony set for Nov. 17.\u003C\/p\u003E\r\n\r\n\u003Ch3\u003E\u003Cstrong\u003EBadge of honor\u003C\/strong\u003E\u003C\/h3\u003E\r\n\r\n\u003Cp\u003E\u0026ldquo;This is a great honor for our Georgia Tech team,\u0026rdquo; said \u003Ca href=\u0022http:\/\/www.cse.gatech.edu\/\u0022 target=\u0022_blank\u0022\u003ESchool of Computational Science and Engineering\u003C\/a\u003E Professor and co-Executive Director of Georgia Tech\u0026rsquo;s \u003Ca href=\u0022http:\/\/bigdata.gatech.edu\/home\u0022 target=\u0022_blank\u0022\u003EInstitute for Data Engineering and Science\u003C\/a\u003E (IDEaS) \u003Cstrong\u003ESrinivas Aluru\u003C\/strong\u003E. \u0026ldquo;Research integrity is of critical importance and I applaud SIGHPC and SC for undertaking this initiative. To be recognized with the inaugural award speaks volumes about the ethics and quality of work undertaken by GeorgiaTech Ph.D. students.\u0026rdquo;\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EWritten by Ph.D. students \u003Cstrong\u003EPatrick Flick\u003C\/strong\u003E, \u003Cstrong\u003EChirag Jain\u003C\/strong\u003E and \u003Cstrong\u003ETony Pan\u003C\/strong\u003E, and Aluru, under research conducted for an NSF BIG DATA project, the paper earning the first-ever Three Rs badge is titled\u0026nbsp;\u0026ldquo;A Parallel Connectivity Algorithm for De Bruijn Graphs in Metagenomic Applications.\u0026rdquo; Jain led the effort of converting their research software into a reproducible benchmark, which got selected for this initiative at SC16. The badge will be visible on the paper in the \u003Ca href=\u0022http:\/\/dl.acm.org\/\u0022\u003EACM Digital Library\u003C\/a\u003E.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EGoing forward, the badges will be awarded when a paper\u0026rsquo;s artifacts\u0026mdash;software, scripts, collected data, etc.\u0026shy; either created by the authors to be used as part of the study or generated by the experiment itself\u0026ndash;are determined to be:\u003C\/p\u003E\r\n\r\n\u003Cul\u003E\r\n\t\u003Cli\u003ERepeatable by the same team with the same experimental setup\u003C\/li\u003E\r\n\t\u003Cli\u003EReplicable by a different team with the same experimental setup\u003C\/li\u003E\r\n\t\u003Cli\u003EReproducible by a different team with a different experimental setup\u003C\/li\u003E\r\n\u003C\/ul\u003E\r\n\r\n\u003Cp\u003EThis paper was presented and judged at last year\u0026rsquo;s SC event in Austin, Texas. Following a call to all authors of SC papers from the past three years, the GT Computing team agreed to transform a portion of their experiment into an application challenge for the SC16 \u003Ca href=\u0022http:\/\/sc16.supercomputing.org\/studentssc\/student-cluster-competition\/\u0022\u003EStudent Cluster Competition\u003C\/a\u003E (SCC).\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe SCC pits undergraduate and high school student teams against each other in a 48-hour competition to build a small HPC cluster. Once the cluster is complete, the students must use it to execute a real-world workload based on data sets and other artifacts from the GT Computing paper, as well as others judged at SC.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EAlong with the badge denoting replicated results for their paper, the Georgia Tech authors will also receive a certificate of appreciation from SIGHPC duirng the SC16 award ceremony.\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"A paper from Georgia Tech students is being honored with a new award that aims to strengthen scientific method."}],"uid":"32045","created_gmt":"2016-11-14 14:23:21","changed_gmt":"2016-11-17 15:25:12","author":"Ben Snedeker","boilerplate_text":"","field_publication":"","field_article_url":"","dateline":{"date":"2016-11-17T00:00:00-05:00","iso_date":"2016-11-17T00:00:00-05:00","tz":"America\/New_York"},"extras":[],"hg_media":{"350071":{"id":"350071","type":"image","title":"Srinivas Aluru compressed","body":null,"created":"1449245702","gmt_created":"2015-12-04 16:15:02","changed":"1475895075","gmt_changed":"2016-10-08 02:51:15","alt":"Srinivas Aluru compressed","file":{"fid":"201074","name":"srinivas-aluru_0.jpg","image_path":"\/sites\/default\/files\/images\/srinivas-aluru_0_0.jpg","image_full_path":"http:\/\/www.tlwarc.hg.gatech.edu\/\/sites\/default\/files\/images\/srinivas-aluru_0_0.jpg","mime":"image\/jpeg","size":13087,"path_740":"http:\/\/www.tlwarc.hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/images\/srinivas-aluru_0_0.jpg?itok=YPYUmkMd"}}},"media_ids":["350071"],"groups":[{"id":"47223","name":"College of Computing"},{"id":"50877","name":"School of Computational Science and Engineering"},{"id":"50875","name":"School of Computer Science"}],"categories":[],"keywords":[],"core_research_areas":[{"id":"39431","name":"Data Engineering and Science"}],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}