Tue 6 Nov 2018 11:15 - 11:37 at Horizons 6-9F - Log Mining Chair(s): Dongyoon Lee

Much work has been published on extracting various kinds of models from logs that document the execution of running systems. In many cases, however, for example in the context of evolution, testing, or malware analysis, engineers are interested not only in a single log but in a set of several logs, each of which originated from a different set of runs of the system at hand. Then, the difference between the logs is the main target of interest.

In this work we investigate the use of finite-state models for log differencing. Rather than comparing the logs directly, we generate concise models to describe and highlight their differences. Specifically, we present two algorithms based on the classic k-Tails algorithm: 2KDiff, which computes and highlights simple traces containing sequences of k events that belong to one log but not the other, and nKDiff, which extends k-Tails from one to many logs, and distinguishes the sequences of length k that are common to all logs from the ones found in only some of them, all on top of a single, rich model. Both algorithms are sound and complete modulo the abstraction defined by the use of k-Tails.

We implemented both algorithms and evaluated their performance on mutated logs that we generated based on models from the literature. We conducted a user study including 60 participants demonstrating the effectiveness of the approach in log differencing tasks. We have further performed a case study to examine the use of our approach in malware analysis. Finally, we have made our work available in a prototype web-application, for experiments.

Tue 6 Nov

Displayed time zone: Guadalajara, Mexico City, Monterrey change

10:30 - 12:00
Log MiningJournal-First / Research Papers at Horizons 6-9F
Chair(s): Dongyoon Lee Virginia Tech, USA
10:30
22m
Talk
Studying and Detecting Log-Related Issues
Journal-First
Mehran Hassani , Weiyi Shang Concordia University, Canada, Emad Shihab Concordia University, Nikolaos Tsantalis Concordia University, Canada
DOI
10:52
22m
Talk
VT-Revolution: Interactive Programming Video Tutorial Authoring and Watching System
Journal-First
Lingfeng Bao Zhejiang University City College, Zhenchang Xing Australia National University, Xin Xia Monash University, David Lo Singapore Management University
DOI
11:15
22m
Talk
Using Finite-State Models for Log Differencing
Research Papers
Hen Amar Tel Aviv University, Israel, Lingfeng Bao Zhejiang University City College, Nimrod Busany Tel Aviv University, Israel, David Lo Singapore Management University, Shahar Maoz Tel Aviv University
11:37
22m
Talk
Identifying Impactful Service System Problems via Log Analysis
Research Papers
Shilin He Chinese University of Hong Kong, Qingwei Lin Microsoft, China, Jian-Guang Lou Microsoft Research, Hongyu Zhang The University of Newcastle, Michael Lyu , Dongmei Zhang Microsoft Research, China