Tue 6 Nov 2018 10:30 - 10:52 at Horizons 10-11 - Concurrency and Races Chair(s): Willem Visser

Cloud systems suffer from distributed concurrency bugs, which are notoriously difficult to detect and often lead to data loss and service outage. This paper presents CloudRaid, a new effective tool to battle distributed concurrency bugs. CloudRaid automatically detects concurrency bugs in cloud systems, by analyzing and testing those message orderings that are likely to expose errors. We observe that large-scale online cloud applications process millions of user requests per second, exercising many permutations of message orderings extensively. Those already sufficiently-tested message orderings are unlikely to expose errors. Hence, CloudRaid mines logs from previous executions to uncover those message orderings which are feasible, but not sufficiently tested. Specifically, CloudRaid tries to flip the order of a pair of messages $<S,P>$ if they may happen in parallel, but $S$ always arrives before $P$ from existing logs, i.e., excercising the order $P \rightarrowtail S$. The log-based approach makes it suitable to live systems.

We have applied CloudRaid to automatically test four representative distributed systems: Apache Hadoop2/Yarn, HBase, HDFS and Cassandra. CloudRaid can automatically test 40 different versions of the 4 systems (10 versions per system) in 35 hours, and can successfully trigger 28 concurrency bugs, including 8 new bugs that have never been found before. The 8 new bugs have all been confirmed by their original developers, and 3 of them are considered as critical bugs that have already been fixed.

Tue 6 Nov
Times are displayed in time zone: (GMT-05:00) Guadalajara, Mexico City, Monterrey change

10:30 - 12:00: Research Papers - Concurrency and Races at Horizons 10-11
Chair(s): Willem VisserStellenbosch University
fse-2018-research-papers10:30 - 10:52
JieLu , Feng LiInstitute of Computing Technology at Chinese Academy of Sciences, China, Lian LiInstitute of Computing Technology at Chinese Academy of Sciences, China, Xiaobing FengICT CAS
fse-2018-research-papers10:52 - 11:15
Dongjie Chen, Yanyan JiangNanjing University, Chang XuNanjing University, Xiaoxing MaNanjing University, Jian LuNanjing University
fse-2018-research-papers11:15 - 11:37
Dileep KiniUniversity of Illinois at Urbana-Champaign, Umang MathurUniversity of Illinois at Urbana-Champaign, Mahesh ViswanathanUniversity of Illinois at Urbana-Champaign
fse-2018-research-papers11:37 - 12:00
Christoffer Quist AdamsenAarhus University, Anders MøllerAarhus University, Saba AlimadadiNortheastern University, Frank TipNortheastern University