Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 14:30 - 14:45 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 2 Chair(s): Jocelyn Simmonds University of Chileno description available
Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 14:45 - 15:00 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 2 Chair(s): Jocelyn Simmonds University of ChileMost issue tracking systems for open source software (OSS) development include features for community members to embed visual contents, such as images and videos, to enhance the discussion. Although playing an important role, there is little knowledge on the characteristics of the visual contents to support their use. To address this gap, we conducted an empirical study on the Jupyter Notebook project. We found that more than a quarter of the issues in the Jupyter Notebook project included visual contents. Additionally, issues that had visual contents in the comments but not in the issue posts tended to have a longer discussion and to involve a larger number of discussants. In our qualitative analysis, we identified eight types of visual contents in our sample, with about 60% including screenshots or mockups of the main product. We also found that visual contents served diverse purposes, touching both problem and solution spaces of the issues. Our effort serves as an important step towards a comprehensive understanding of the characteristics of visual contents in OSS issue discussions. Our results provided several design implications for issue tracking systems to better facilitate the use of visual contents.
DOI Pre-printLink to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 15:00 - 15:15 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 2 Chair(s): Jocelyn Simmonds University of Chileno description available
Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Industrial Track
Wed 15 Jun 2022 15:15 - 15:30 at Wednesday Track 1 session 2 (Kelvin and online) - Industrial track session 2 Chair(s): Jocelyn Simmonds University of ChileBackground: Sample Ratio Mismatch (SRM) checks can help detect data quality issues in online experimentation. Not all experimentation platforms provide these checks as part of their solution. Users of these platforms must therefore manually check for SRM, or rely on additional processes—such as checklists—or automation.
Objective: To ensure reliable and early detection of SRM, we wanted to automate the detection and analysis of SRM in experiments running on third-party experimentation platforms.
Method: A set of Looker dashboards were built to facilitate self-serve SRM detection and root cause analysis. In addition, we added email and chat based alerting to pro-actively inform experimenters of SRM and guide them towards these dashboards when needed.
Results: Several cases of SRM have been detected and experimenters have been warned. Bad decisions based on flawed data were avoided. We provide one such example as an illustration.
Conclusions: SRM checks are relatively straightforward to automate and can be useful for data quality monitoring even for companies who rely on third-party experimentation platforms. Pro-active alerting—rather than passive reporting—can reduce time to detection and help non-experts avoid making decisions based on biased data.
Link to publication DOILink to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 15:30 - 16:00 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 2 Chair(s): Jocelyn Simmonds University of Chileno description available
Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 16:30 - 17:00 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 3 Chair(s): Jocelyn Simmonds University of Chileno description available
Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 17:00 - 17:30 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 3 Chair(s): Jocelyn Simmonds University of Chileno description available
Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
Research
Wed 15 Jun 2022 17:30 - 18:00 at Wednesday Track 1 session 2 (Kelvin and online) - Research Track Virtual 1 Session 3 Chair(s): Jocelyn Simmonds University of Chileno description available
Link to join: https://eu01web.zoom.us/j/67762559229?pwd=Z1RmcDBRUWdjY04vcUxFUVovM1BBZz09
