Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Tue 22 Sep 2020 08:50 - 09:00 at Wombat - Compiler and Systems Testing Chair(s): Yanyan Jiang

Methods for randomized testing of compilers to find miscompilation bugs typically require a way to generate programs that are free from undefined behaviour (UB). Tools such as Csmith achieve UB-freedom by heavily restricting the form of generated programs. This leads to highly idiomatic programs, and we hypothesise that this limits the thoroughness with which compilers are tested. Our idea is that researchers should investigate ways to generate less restricted programs that are still UB-free—programs that get closer to the edge of undefined behaviour, but that do not quite cross the edge. We present experiments investigating one instance of idea via a prototype tool, CsmithEdge, that uses a simple dynamic analysis to detect where Csmith has been too conservative in its use of “safe math” wrappers that guarantee UB-freedom for arithmetic operations, eliminating redundant wrappers. By reducing the use of safe math wrappers, CsmithEdge was able to discover two new miscompilation bugs in GCC that could not be found via intensive testing using regular Csmith, as well as achieving substantial differences in code coverage on GCC compared with regular Csmith.

Tue 22 Sep
Times are displayed in time zone: (UTC) Coordinated Universal Time

08:00 - 09:00: Compiler and Systems TestingResearch Papers / NIER track at Wombat
Chair(s): Yanyan JiangNanjing University
08:00 - 08:20
Plug the Database & Play With Automatic Testing: Improving System Testing by Exploiting Persistent Data
Research Papers
Diego Clerissi, Giovanni DenaroUniversity of Milano-Bicocca, Italy, Marco MobilioUniversity of Milano Bicocca, Leonardo MarianiUniversity of Milano Bicocca
08:20 - 08:40
Enhanced Compiler Bug Isolation via Memoized Search
Research Papers
Junjie ChenTianjin University, China, Haoyang MaCollege of Intelligence and Computing, Tianjin University, Lingming ZhangUniversity of Illinois at Urbana-Champaign
08:40 - 08:50
Generating Highly-structured Input Data by Combining Search-based Testing and Grammar-based Fuzzing
NIER track
Mitchell OlsthoornDelft University of Technology, Arie van DeursenDelft University of Technology, Netherlands, Annibale PanichellaDelft University of Technology
DOI Pre-print Media Attached
08:50 - 09:00
Closer to the Edge: Testing Compilers More Thoroughly by Being Less Conservative About Undefined Behaviour
NIER track
Karine Even-MendozaImperial College London, Cristian CadarImperial College London, UK, Alastair DonaldsonImperial College London
Pre-print Media Attached