Thu 8 Nov 2018 13:52 - 14:14 at Horizons 5 - Probabilistic Reasoning Chair(s): Antonio Filieri

Probabilistic programming systems (PP systems) allow developers
to model stochastic phenomena and perform efficient inference on
the models. The number and adoption of probabilistic programming
systems is growing significantly. However, there is no prior study
of bugs in these systems and no methodology for systematically
testing PP systems. Yet, testing PP systems is highly non-trivial,
especially when they perform approximate inference.
In this paper, we characterize 118 previously reported bugs in
three open-source PP systems—Edward, Pyro and Stan—and pro-
pose ProbFuzz, an extensible system for testing PP systems. Prob-
Fuzz allows a developer to specify templates of probabilistic models,
from which it generates concrete probabilistic programs and data
for testing. ProbFuzz uses language-specific translators to generate
these concrete programs, which use the APIs of each PP system.
ProbFuzz finds potential bugs by checking the output from running
the generated programs against several oracles, including an accu-
racy checker. Using ProbFuzz, we found 67 previously unknown
bugs in recent versions of these PP systems. Developers already
accepted 51 bug fixes that we submitted to the three PP systems,
and their underlying systems, PyTorch and TensorFlow.

Thu 8 Nov

Displayed time zone: Guadalajara, Mexico City, Monterrey change

13:30 - 15:00
Probabilistic ReasoningResearch Papers at Horizons 5
Chair(s): Antonio Filieri Imperial College London
Phys: Probabilistic Physical Unit Assignment and Inconsistency Detection
Research Papers
Sayali Kate Purdue University, USA, John-Paul Ore University of Nebraska-Lincoln, USA, Xiangyu Zhang Purdue University, Sebastian Elbaum University of Nebraska-Lincoln, USA, Zhaogui Xu Nanjing University, China
Testing Probabilistic Programming Systems
Research Papers
Saikat Dutta University of Illinois at Urbana-Champaign, USA, Owolabi Legunsen University of Illinois at Urbana-Champaign, Zixin Huang University of Illinois at Urbana-Champaign, USA, Sasa Misailovic University of Illinois at Urbana-Champaign
Verifying the Long-Run Behavior of Probabilistic System Models in the Presence of Uncertainty
Research Papers
Yamilet R. Serrano Llerena National University of Singapore, Singapore, Marcel Böhme Monash University, Marc Brünink nil, Singapore, Guoxin Su University of Wollongong, Australia, David Rosenblum National University of Singapore