Wed 7 Nov 2018 13:30 - 13:52 at Horizons 5 - Software Analysis II Chair(s): Myra Cohen

Application Programming Interfaces (APIs) often have usage constraints, such as restrictions on call order or call conditions. API misuses, i.e., violations of these constraints, may lead to software crashes, bugs, and vulnerabilities. Though researchers developed many API-misuse detectors over the last two decades, recent studies show that API misuses are still prevalent. Therefore, we need to understand the capabilities and limitations of existing detectors in order to advance the state of the art. In this paper, we present the first-ever qualitative and quantitative evaluation that compares static API-misuse detectors along the same dimensions, and with original author validation. To accomplish this, we develop MuC, a classification of API misuses, and MuBenchPipe, an automated benchmark for detector comparison, on top of our misuse dataset, MuBench. Our results show that the capabilities of existing detectors vary greatly and that existing detectors, though capable of detecting misuses, suffer from extremely low precision and recall. A systematic root-cause analysis reveals that, most importantly, detectors need to go beyond the naive assumption that a deviation from the most-frequent usage corresponds to a misuse and need to obtain additional usage examples to train their models. We present possible directions towards more-powerful API-misuse detectors.

Wed 7 Nov

fse-2018-research-papers
13:30 - 15:00: Research Papers - Software Analysis II at Horizons 5
Chair(s): Myra CohenIowa State University
fse-2018-Journal-First13:30 - 13:52
Talk
Sven AmannTechnische Universit├Ąt Darmstadt, Hoan NguyenIowa State University, Sarah NadiUniversity of Alberta, Tien NguyenUniversity of Texas at Dallas, Mira MeziniTU Darmstadt
DOI
fse-2018-research-papers13:52 - 14:15
Talk
Felix PauckPaderborn University, Germany, Eric BoddenHeinz Nixdorf Institut, Paderborn University and Fraunhofer IEM, Heike WehrheimPaderborn University
fse-2018-research-papers14:15 - 14:37
Talk
Jinman ZhaoUniversity of Wisconsin-Madison, USA, Aws AlbarghouthiUniversity of Wisconsin-Madison, Vaibhav RastogiUniversity of Wisconsin-Madison, USA, Somesh JhaUniversity of Wisconsin, Madison, Damien OcteauUniversity of Wisconsin and Pennsylvania State University
fse-2018-research-papers14:37 - 15:00
Talk
Vaibhav SainiUniversity of California at Irvine, USA, Farima FarmahinifarahaniUniversity of California at Irvine, USA, Yadong LuUniversity of California at Irvine, USA, Pierre BaldiUniversity of California at Irvine, USA, Crista Lopes