On the Effectiveness of Unified Debugging: An Extensive Study on 16 Program Repair Systems
Automated debugging techniques, including fault localization and program repair, have been studied for decades. The existing connection between fault localization and program repair is that fault localization computes the potential buggy elements for program repair to patch. Recently, a pioneering work, ProFL, explored the unified debugging idea to unify fault localization and program repair in the other direction for the first time to boost both areas. More specifically, ProFL utilizes the patch execution results from one state-of-the-art repair system, PraPR, to help improve state-of-the-art fault localization. In this way, ProFL not only improves fault localization for manual repair, but also extends the application scope of automated repair to all possible bugs (not only the small ratio of bugs that can be automatically fixed). In this work, we perform an extensive study of the ProFL unified-debugging approach on 16 state-of-the-art program repair systems for the first time. Our experimental results on the widely studied Defects4J benchmark suite reveal various practical guidelines for unified de-bugging, such as : (1) nearly all the studied 16 repair systems can contribute to unified debugging despite of their varying repairing capabilities, (2) repair systems targeting multi-edit patches canbring noise for unified debugging, (3) repair systems with more executed/plausible patches tend to perform better for unified debugging, (4) unified debugging effectiveness does not rely on the availability of correct patches in automated repair. Based on our study outcome, we further propose an advanced unified debugging technique, UniDebug++, which can localize over 20% more bugs within Top-1 positions than state-of-the-art ProFL.
Thu 24 Sep Times are displayed in time zone: (UTC) Coordinated Universal Time
02:20 - 03:20: Empirical Software Engineering (2)Research Papers at Koala Chair(s): Julia RubinUniversity of British Columbia, Canada | |||
02:20 - 02:40 Talk | Understanding Performance Concerns in the API Documentation of Data Science Libraries Research Papers Yida TaoShenzhen University, Jiefang JiangShenzhen University, Yepang LiuSouthern University of Science and Technology, Zhiwu XuShenzhen University, Shengchao QinUniversity of Teesside | ||
02:40 - 03:00 Talk | On the Effectiveness of Unified Debugging: An Extensive Study on 16 Program Repair Systems Research Papers Samuel BentonThe University of Texas at Dallas, Xia LiKennesaw State University, Yiling LouPeking University, China, Lingming ZhangUniversity of Illinois at Urbana-Champaign, USA | ||
03:00 - 03:20 Talk | Automated Third-party Library Detection for Android Applications: Are We There Yet?Experience Research Papers Zhan XianThe Hong Kong Polytechnic University, Lingling FanNanyang Technological University, Singapore, Tianming LiuMonash University, Australia, Sen ChenNanyang Technological University, Singapore, Li LiMonash University, Australia, Haoyu WangBeijing University of Posts and Telecommunications, China, Yifei XuSouthern University of Science and Technology, Xiapu LuoThe Hong Kong Polytechnic University, Yang LiuNanyang Technological University, Singapore |