Thu 14 Nov 2019 12:10 - 12:20 at Cortez 2&3 - Deep Models Chair(s): Nazareno Aguirre
Deep neural network (DNN) has been widely applied to safety-critical scenarios such as autonomous vehicle, security surveillance, and cyber-physical control systems. Yet, the incorrect behaviors of DNNs can lead to severe accidents and tremendous losses due to hidden defects. In this paper, we present DeepHunter, a general-purpose fuzzing framework for detecting defects of DNNs. DeepHunter is inspired by traditional grey-box fuzzing and aims to increase the overall test coverage by applying adaptive heuristics according to runtime feedback. Specifically, DeepHunter provides a series of seed selection strategies, metamorphic mutation strategies, and testing criteria customized to DNN testing; all these components support multiple built-in configurations which are easy to extend. We evaluated DeepHunter on two popular datasets and the results demonstrate the effectiveness of DeepHunter in achieving coverage increase and detecting real defects. A video demonstration which showcases the main features of DeepHunter can be found at https://youtu.be/s5DfLErcgrc.
Tue 12 Nov
10:00 - 10:40 Demonstration | Pangolin: An SFL-based Toolset for Feature Localization Bruno Miguel Sotto-Mayor de Castro MachadoIST, University of Lisbon, Alexandre PerezPalo Alto Research Center, Rui AbreuInstituto Superior Técnico, U. Lisboa & INESC-ID | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | A Quantitative Analysis Framework for Recurrent Neural Network Xiaoning DuNanyang Technological University, Xiaofei XieNanyang Technological University, Yi LiNanyang Technological University, Lei MaKyushu University, Yang LiuNanyang Technological University, Singapore, Jianjun ZhaoKyushu University | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | Ares: Inferring Error Specifications through Static Analysis Li ChiTsinghua University, Zuxing GuSchool of Software, Tsinghua University, Min ZhouTsinghua University, Ming GuTsinghua University, Hongyu ZhangThe University of Newcastle | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | SiMPOSE - Configurable N-Way Program Merging Strategies for Superimposition-based Analysis of Variant-Rich Software Dennis ReulingSoftware Engineering Group, University of Siegen, Udo KelterSoftware Engineering Group, University of Siegen, Sebastian RulandTU Darmstadt, Real-time Systems Lab, Malte LochauTU Darmstadt Pre-print Media Attached File Attached | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | VeriAbs : Verification by Abstraction and Test Generation Mohammad AfzalTata Cosultancy Services, A AsiaTata Cosultancy Services, Avriti ChauhanTata Cosultancy Services, Bharti ChimdyalwarTata Consultancy Services, Priyanka DarkeTata Consultancy Services, Advaita DatarTata Consultancy Services Ltd, Shrawan KumarTata Cosultancy Services, R VenkateshTata Research Development and Design Centre | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | DeepHunter: A Coverage-Guided Fuzzer for Deep Neural Networks Xiaofei XieNanyang Technological University, Hongxu ChenNanyang Technological University, Yi LiNanyang Technological University, Lei MaKyushu University, Yang LiuNanyang Technological University, Singapore, Jianjun ZhaoKyushu University | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | SPrinter: A Static Checker for Finding Smart Pointer Errors in C++ Programs Xutong MaInstitute of Software, Chinese Academy of Sciences, Jiwei YanInstitute of Software, Chinese Academy of Sciences, Yaqi LiInstitute of Software, Chinese Academy of Sciences, Jun YanInstitute of Software, Chinese Academy of Sciences, Jian ZhangInstitute of Software, Chinese Academy of Sciences | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | LIRAT: Layout and Image Recognition Driving Automated Mobile Testing of Cross-Platform Shengcheng YuNanjing University, China, Chunrong FangNanjing University, Yang FengUniversity of California, Irvine, Wenyuan ZhaoNanjing University, Zhenyu ChenNanjing University | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | FogWorkflowSim: An Automated Simulation Toolkit for Workflow Performance Evaluation in Fog Computing Xiao LiuSchool of Information Technology, Deakin University, Lingmin FanSchool of Computer Science and Technology, Anhui University, Jia XuSchool of Computer Science and Technology, Anhui University, Xuejun LiSchool of Computer Science and Technology, Anhui University, Lina GongSchool of Computer Science and Technology, Anhui University, John GrundyMonash University, Yun YangSwinburne University of Technology | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | SGUARD: A Feature-based Clustering Tool for Effective Spreadsheet Defect Detection Da LiState Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University, Nanjing, China, Huiyan WangState Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University, Nanjing, China, Chang XuNanjing University, Ruiqing ZhangSearch Tech. Center Asia, Microsoft, Suzhou, China, Shing-Chi CheungDepartment of Computer Science and Engineering, The Hong Kong University of Science and Technology, Xiaoxing MaState Key Lab. for Novel Software Tech. and Dept. of Comp. Sci. and Tech., Nanjing University | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | FPChecker: Detecting Floating-Point Exceptions in GPU Applications Ignacio LagunaLawrence Livermore National Laboratory | |||||||||||||||||||||||||||||||||||||||||
10:00 - 10:40 Demonstration | PMExec: An Execution Engine of Partial UML-RT Models Mojtaba BagherzadehQueen's University, Karim JahedQueen's University, Nafiseh KahaniQueen's University, Juergen DingelQueen's University, Kingston, Ontario Pre-print |
Thu 14 Nov
10:40 - 12:20: Papers - Deep Models at Cortez 2&3 Chair(s): Nazareno AguirreDept. of Computer Science FCEFQyN, University of Rio Cuarto | ||||||||||||||||||||||||||||||||||||||||||
10:40 - 11:00 Talk | Wuji: Automatic Online Combat Game Testing Using Evolutionary Deep Reinforcement LearningACM SIGSOFT Distinguished Paper Award Yan ZhengTianjin University, Xiaofei XieNanyang Technological University, Ting SuETH Zurich, Lei MaKyushu University, Jianye HaoTianjin University, Zhaopeng MengTianjin University, Yang LiuNanyang Technological University, Singapore, Ruimin ShenFuxi AI Lab in Netease, Yinfeng ChenFuxi AI Lab in Netease, Changjie FanFuxi AI Lab in Netease | |||||||||||||||||||||||||||||||||||||||||
11:00 - 11:20 Talk | A Study of Oracle Approximations in Testing Deep Learning Libraries | |||||||||||||||||||||||||||||||||||||||||
11:20 - 11:40 Talk | Property Inference for Deep Neural Networks Divya GopinathCarnegie Mellon University, Hayes ConverseThe University of Texas at Austin, Corina S. PasareanuCarnegie Mellon University Silicon Valley, NASA Ames Research Center, Ankur TalyGoogle | |||||||||||||||||||||||||||||||||||||||||
11:40 - 12:00 Talk | An Empirical Study towards Characterizing Deep Learning Development and Deployment across Different Frameworks and Platforms Qianyu GuoTianjin University, Sen ChenNanyang Technological University, Singapore, Xiaofei XieNanyang Technological University, Lei MaKyushu University, Qiang HuKyushu University, Japan, Hongtao LiuTianjin University, Yang LiuNanyang Technological University, Singapore, Jianjun ZhaoKyushu University, Li XiaohongTianJin University Pre-print | |||||||||||||||||||||||||||||||||||||||||
12:00 - 12:10 Demonstration | DeepMutation++: a Mutation Testing Framework for Deep Learning Systems Qiang HuKyushu University, Japan, Lei MaKyushu University, Xiaofei XieNanyang Technological University, Bing YuKyushu University, Japan, Yang LiuNanyang Technological University, Singapore, Jianjun ZhaoKyushu University | |||||||||||||||||||||||||||||||||||||||||
12:10 - 12:20 Demonstration | DeepHunter: A Coverage-Guided Fuzzer for Deep Neural Networks Xiaofei XieNanyang Technological University, Hongxu ChenNanyang Technological University, Yi LiNanyang Technological University, Lei MaKyushu University, Yang LiuNanyang Technological University, Singapore, Jianjun ZhaoKyushu University |