Thu 8 Nov 2018 15:30 - 15:52 at Horizons 5 - Testing II Chair(s): Tevfik Bultan

Electronic documents are widely used to store and share information such as bank statements, contracts, articles, maps and tax information. Many different applications exist for displaying a given electronic document, and users rightfully assume that documents will be rendered similarly independently of the application used. However, this is not always the case, and these inconsistencies, regardless of their causes—bugs in the application or the file itself—can become critical sources of miscommunication. In this paper, we present a study on the correctness of PDF documents and readers. We start by manually investigating a large number of real-world PDF documents to understand the frequency and characteristics of cross-reader inconsistencies, and find that such inconsistencies are common—13.5% PDF files are inconsistently rendered by at least one popular reader. We then propose an approach to detect and localize the source of such inconsistencies automatically. We evaluate our automatic approach on a large corpus of over 230 K documents using 11 popular readers and our experiments have detected 30 unique bugs in these readers and files. We also reported 33 bugs, some of which have already been confirmed or fixed by developers.

Thu 8 Nov

Displayed time zone: Guadalajara, Mexico City, Monterrey change

15:30 - 17:00
Testing IIResearch Papers / Journal-First at Horizons 5
Chair(s): Tevfik Bultan University of California, Santa Barbara
15:30
22m
Talk
On the correctness of electronic documents: studying, finding, and localizing inconsistency bugs in PDF readers and files
Journal-First
Tomasz Kuchta , Thibaud Lutellier , Edmund Wong , Lin Tan University of Waterloo , Cristian Cadar Imperial College London
DOI
15:52
22m
Talk
Optimizing Test Prioritization via Test Distribution Analysis
Research Papers
Junjie Chen Peking University, Yiling Lou Peking University, China, Lingming Zhang , Jianyi Zhou Peking University, China, Xiaoleng Wang Baidu, China, Dan Hao Peking University, Lu Zhang Peking University
16:15
22m
Talk
How Well Are Regular Expressions Tested in the Wild?
Research Papers
Peipei Wang North Carolina State University, USA, Kathryn Stolee North Carolina State University
16:37
22m
Talk
Which Generated Test Failures Are Fault Revealing? Prioritizing Failures Based on Inferred Precondition Violations using PAF
Research Papers
Mijung Kim Hong Kong University of Science and Technology, China, Shing-Chi Cheung Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Sunghun Kim Hong Kong University of Science and Technology