PerfCI: A Toolchain for Automated Performance Testing during Continuous Integration of Python Projects
Wed 23 Sep 2020 10:35 - 10:40 at Wombat - Tool Demo Showcase (2) Chair(s): Junjie Chen
Software performance testing is an essential quality assurance mechanism that can identify optimization opportunities. Automating this process requires strong tool support, especially in the case of Continuous Integration (CI) where tests need to run completely automatically and it is desirable to provide developers with actionable feedback. A lack of existing tools means that performance testing is normally left out of the scope of CI. In this paper, we propose a toolchain - PerfCI - to pave the way for developers to easily set up and carry out automated performance testing under CI. Our toolchain is based on allowing users to (1) specify performance testing tasks, (2) analyze unit tests on a variety of python projects ranging from scripts to full-blown flask-based web services, by extending a performance analysis framework (VyPR) and (3) evaluate performance data to get feedback on the code. We demonstrate the feasibility of our toolchain by using it on a web service running at the Compact Muon Solenoid (CMS) experiment at the world’s largest particle physics laboratory — CERN.
Wed 23 Sep Times are displayed in time zone: (UTC) Coordinated Universal Time
10:20 - 11:20: Tool Demo Showcase (2)Tool Demonstrations at Wombat Chair(s): Junjie ChenTianjin University | |||
10:20 - 10:25 Talk | MetPurity: A Learning-Based Tool of Pure Method Identification for Automatic Test Generation Tool Demonstrations | ||
10:25 - 10:30 Talk | STIFA: Crowdsourced Mobile Testing Report Selection Based on Text and Image Fusion Analysis Tool Demonstrations Zhenfei CaoNanjing University, Xu WangNanjing University, Shengcheng YuNanjing University, China, Yexiao YunNanjing University, Chunrong FangNanjing University, China | ||
10:30 - 10:35 Talk | ImpAPTr: A Tool For Identifying The Clues To Online Service Anomalies Tool Demonstrations hao wang, Guoping RongNanjing University, Yangchen XuNanjing University, Yong YouMeituan-Dianping Group | ||
10:35 - 10:40 Talk | PerfCI: A Toolchain for Automated Performance Testing during Continuous Integration of Python Projects Tool Demonstrations Omar JavedUniversità della Svizzera italiana, Joshua Heneage DawesUniversity of Manchester and CERN, Marta HanUniversity of Zagreb and CERN, Giovanni FranzoniCERN, Andreas PfeifferCERN, Giles RegerUniversity of Manchester, Walter BinderUniversity of Lugano, Switzerland | ||
10:40 - 10:45 Talk | Botsing, a Search-based Crash Reproduction Framework for Java Tool Demonstrations Pouria DerakhshanfarDelft University of Technology, Xavier DevroeyDelft University of Technology, Annibale PanichellaDelft University of Technology, Andy ZaidmanDelft University of Technology, Arie van DeursenDelft University of Technology, Netherlands DOI Pre-print Media Attached | ||
10:45 - 10:50 Talk | Speeding up GUI Testing by On-Device Test Generation Tool Demonstrations Nataniel Borges Jr.CISPA Helmholtz Center for Information Security, Jenny RauCISPA Helmholtz Center for Information Security, Andreas ZellerCISPA, Germany | ||
10:50 - 11:20 Live Q&A | Q&A or Discussion Tool Demonstrations |
Thu 24 Sep Times are displayed in time zone: (UTC) Coordinated Universal Time
08:00 - 09:00: Verification and TestingResearch Papers / Tool Demonstrations / Industry Showcase at Koala Chair(s): Jun SunSingapore Management University | |||
08:00 - 08:20 Talk | Attend and Represent: A Novel View on Algorithm Selection for Software Verification Research Papers | ||
08:20 - 08:40 Talk | Lightweight MBT Testing for National e-Health Portal in Norway Industry Showcase Davrondzhon GafurovNorsk Helsenett SF, Margrete Sunde GrovanNorsk Helsenett SF, Margrete Sunde GrovanNorsk Helsenett SF | ||
08:40 - 08:50 Talk | Speeding up GUI Testing by On-Device Test Generation Tool Demonstrations Nataniel Borges Jr.CISPA Helmholtz Center for Information Security, Jenny RauCISPA Helmholtz Center for Information Security, Andreas ZellerCISPA, Germany | ||
08:50 - 09:00 Talk | PerfCI: A Toolchain for Automated Performance Testing during Continuous Integration of Python Projects Tool Demonstrations Omar JavedUniversità della Svizzera italiana, Joshua Heneage DawesUniversity of Manchester and CERN, Marta HanUniversity of Zagreb and CERN, Giovanni FranzoniCERN, Andreas PfeifferCERN, Giles RegerUniversity of Manchester, Walter BinderUniversity of Lugano, Switzerland |