Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Wed 23 Sep 2020 00:40 - 01:00 at Platypus - Incidents and Bug Reports Chair(s): Yepang Liu

Graphical User Interface (GUI) provides a visual bridge between a software application and end users, through which they can interact with each other. With the development of technology and aesthetics, the visual effects of the GUI are more and more attracting. However, such GUI complexity posts a great challenge to the GUI implementation. According to our pilot study of crowdtesting bug reports, display issues such as text overlap, blurred screen, missing image always occur during GUI rendering on difference devices due to the software or hardware compatibility. They negatively influence the app usability, resulting in poor user experience. To detect these issues, we propose a novel approach, OwlEye, based on deep learning for modelling visual information of the GUI screenshot. Therefore, OwlEye can detect GUIs with display issues and also locate the detailed region of the issue in the given GUI for guiding developers to fix the bug. We manually construct a large-scale labelled dataset with 4,470 GUI screenshots with UI display issues and develop a heuristics-based data augmentation method for boosting the performance of our OwlEye. The evaluation demonstrates that our OwlEye can achieve 85% precision and 84% recall in detecting UI display issues, and 90% accuracy in localizing these issues. We also evaluate OwlEye with popular Android apps on Google Play and F-droid, and successfully uncover 57 previously-undetected UI display issues with 26 of them being confirmed or fixed so far.

Wed 23 Sep
Times are displayed in time zone: (UTC) Coordinated Universal Time

00:00 - 01:00: Incidents and Bug ReportsResearch Papers at Platypus
Chair(s): Yepang LiuSouthern University of Science and Technology
00:00 - 00:20
How Incidental are the Incidents? Characterizing and Prioritizing Incidents for Large-Scale Online Service SystemsExperience
Research Papers
Junjie ChenTianjin University, China, Shu ZhangMicrosoft Research, Beijing, Xiaoting HeMicrosoft, Qingwei LinMicrosoft Research, China, Hongyu ZhangUniversity of Newcastle, Australia, Dan HaoPeking University, China, Yu KangMicrosoft Research, China, Feng GaoMicrosoft, China, Zhangwei XuMicrosoft, China, Yingnong DangMicrosoft, USA, Dongmei ZhangMicrosoft Research, China
00:20 - 00:40
Stay Professional and Efficient: Automatically Generate Titles for Your Bug Reports
Research Papers
Songqiang ChenSchool of Computer Science, Wuhan University, Xiaoyuan XieSchool of Computer Science, Wuhan University, China, Bangguo YinSchool of Computer Science, Wuhan University, Yuanxiang JiSchool of Computer Science, Wuhan University, Lin ChenNanjing University, Baowen XuState Key Laboratory for Novel Software Technology, Nanjing University
00:40 - 01:00
Owl Eyes: Spotting UI Display Issues via Visual Understanding
Research Papers
Zhe LiuLaboratory for Internet Software Technologies, Institute of Software Chinese Academy of Sciences, University of Chinese Academy of Sciences, Chunyang ChenMonash University, Australia, Junjie WangInstitute of Software, Chinese Academy of Sciences, Yuekai HuangInstitute of Software, Chinese Academy of Sciences, Jun HuInstitute of Software, Chinese Academy of Sciences, Qing WangInstitute of Software, Chinese Academy of Sciences