Wed 7 Nov 2018 10:52 - 11:15 at Horizons 10-11 - Mobile Apps Chair(s): Shane McIntosh

The term crowdsourcing – a compound contraction of crowd and outsourcing – is a new paradigm for utilizing the power of crowds of people to facilitate large-scale tasks that are costly or time consuming with traditional methods. This paradigm offers mobile application companies the possibility to outsource their testing activities to crowdsourced testers (crowdtesters) who have various testing facilities and environments, as well as different levels of skills and expertise. With this so-called Crowdsourced Mobile Application Testing (CMAT), some of the well-recognized issues in testing mobile applications, such as multitude of mobile devices, fragmentation of device models, variety of OS versions, and omnifariousness of testing scenarios, could be mitigated. However, how effective is CMAT in practice? What are the challenges and issues presented by the process of applying CMAT? How can these issues and challenges be overcome and CMAT be improved? Although CMAT has attracted attention from both academia and industry, these questions have not been addressed or researched in depth based on a large-scale and real-life industrial study. Since June 2015, we have worked with Mooctest, Inc., a CMAT intermediary, on testing five real-life Android applications using their CMAT platform – Kikbug. Throughout the process, we have collected 1013 bug reports from 258 crowdtesters and found 247 bugs in total. This paper will present our industrial study thoroughly and give an insightful analysis to investigate the successes and challenges of applying CMAT.

Wed 7 Nov
Times are displayed in time zone: (GMT-05:00) Guadalajara, Mexico City, Monterrey change

fse-2018-research-papers
10:30 - 12:00: Research Papers - Mobile Apps at Horizons 10-11
Chair(s): Shane McIntoshMcGill University
fse-2018-Journal-First10:30 - 10:52
Talk
Rubén Saborido InfantesDepartment of Computer Science and Software Engineering, Concordia University, Montreal, Rodrigo MoralesConcordia University, Foutse KhomhPolytechnique Montréal, Yann-Gaël GuéhéneucConcordia University and Polytechnique Montréal, Giuliano AntoniolPolytechnique Montréal
DOI
fse-2018-Journal-First10:52 - 11:15
Talk
Ruizhi Gao, Yabin Wang, Yang FengUniversity of California, Irvine, Zhenyu ChenNanjing University, W. Eric Wong
DOI
fse-2018-research-papers11:15 - 11:37
Talk
Gang HuColumbia University, USA, Linjie Zhu, Junfeng YangColumbia University
fse-2018-research-papers11:37 - 12:00
Talk
Ehsan NoeiUniversity of Toronto, Daniel Alencar Da Costa Queen's University, Kingston, Ontario, Ying ZouQueen's University, Kingston, Ontario