Discovering UI Display Issues with Visual UnderstandingWinner SRC - Graduate
GUI complexity posts a great challenge to the GUI implementation. According to our pilot study of crowdtesting bug reports, display issues such as text overlap, blurred screen, missing image always occur during GUI rendering on difference devices due to the software or hardware compatibility. They negatively influence the app usability, resulting in poor user experience. To detect these issues, we propose a novel approach, OwlEye, based on deep learning for modelling visual information of the GUI screenshot.Therefore, OwlEye can detect GUIs with display issues and also locate the detailed region of the issue in the given GUI for guiding developers to fix the bug. We manually construct a large-scale labelled dataset with 4,470 GUI screenshots with UI display issues. We develop a heuristics-based data augmentation method and a GAN-based data augmentation method for boosting the performance of our OwlEye. At present, the evaluation demonstrates that our OwlEye can achieve 85% precision and 84% recall in detecting UI display issues, and 90% accuracy in localizing these issues.
Wed 23 Sep Times are displayed in time zone: (UTC) Coordinated Universal Time
02:20 - 03:20: SRC Poster (1)Student Research Competition at Koala Chair(s): Chunyang ChenMonash University | |||
02:20 - 02:25 Poster | Dynamic Algorithm Selection for SMT Student Research Competition Nikhil PimpalkhareUniversity of California, Berkeley | ||
02:25 - 02:30 Poster | CrossPriv: User Privacy Preservation Model for Cross-Silo Federated Software Student Research Competition Harshita DiddeeGuru Gobind Singh Indraprastha University, Bhrigu KansraGuru Gobind Singh Indraprastha University | ||
02:30 - 02:35 Poster | Scalability and Precision Improvement of Neural Program Synthesis Student Research Competition Yating ZhangNational University of Defense Technology | ||
02:35 - 02:40 Poster | The Classification and Propagation of Program CommentsSecond place SRC - Undergraduate Student Research Competition Xiangzhe XuNanjing University | ||
02:40 - 02:45 Poster | Source Code and Binary Level Vulnerability Detection and Hot PatchingThird place SRC - Graduate Student Research Competition Zhengzi XuNanyang Technological University | ||
02:45 - 02:50 Poster | FLUX: From SQL to GQL query translation tool Student Research Competition Chandan SharmaAuckland University of Technology | ||
02:50 - 02:55 Poster | Discovering UI Display Issues with Visual UnderstandingWinner SRC - Graduate Student Research Competition Zhe LiuLaboratory for Internet Software Technologies, Institute of Software Chinese Academy of Sciences, University of Chinese Academy of Sciences |