Wed 7 Nov 2018 11:15 - 11:37 at Horizons 10-11 - Mobile Apps Chair(s): Shane McIntosh

UI testing is known to be difficult, especially as today’s development cycles become faster. Manual UI testing is tedious, costly and error- prone. Automated UI tests are costly to write and maintain. This paper presents AppFlow, a system for synthesizing highly robust, highly reusable UI tests. It leverages machine learning to automatically recognize common screens and widgets, relieving developers from writing ad hoc, fragile logic to use them in tests. It enables developers to write a library of modular tests for the main functionality of an app category (e.g., an “add to cart” test for shopping apps). It can then quickly test a new app in the same category by synthesizing full tests from the modular ones in the library. By focusing on the main functionality, AppFlow provides “smoke testing” requiring little manual work. Optionally, developers can customize AppFlow by adding app-specific tests for completeness. We evaluated AppFlow on 60 popular apps in the shopping and the news category, two case studies on the BBC news app and the JackThreads shopping app, and a user-study of 15 subjects on the Wish shopping app. Results show that AppFlow accurately recognizes screens and widgets, synthesizes highly robust and reusable tests, covers 46.6% of all automatable tests for Jackthreads with the tests it synthesizes, and reduces the effort to test a new app by up to 90%. Interestingly, it found eight bugs in the evaluated apps, including seven functionality bugs, despite that they were publicly released and supposedly went through thorough testing.

Wed 7 Nov

fse-2018-research-papers
10:30 - 12:00: Research Papers - Mobile Apps at Horizons 10-11
Chair(s): Shane McIntoshMcGill University
fse-2018-Journal-First10:30 - 10:52
Talk
Rubén Saborido InfantesDepartment of Computer Science and Software Engineering, Concordia University, Montreal, Rodrigo MoralesConcordia University, Foutse KhomhPolytechnique Montréal, Yann-Gaël GuéhéneucConcordia University and Polytechnique Montréal, Giuliano AntoniolPolytechnique Montréal
DOI
fse-2018-Journal-First10:52 - 11:15
Talk
Ruizhi Gao, Yabin Wang, Yang FengUniversity of California, Irvine, Zhenyu ChenNanjing University, W. Eric Wong
DOI
fse-2018-research-papers11:15 - 11:37
Talk
Gang HuColumbia University, USA, Linjie Zhu, Junfeng YangColumbia University
fse-2018-research-papers11:37 - 12:00
Talk
Ehsan NoeiUniversity of Toronto, Daniel Alencar Da Costa Queen's University, Kingston, Ontario, Ying ZouQueen's University, Kingston, Ontario