Learning to Sample: Exploiting Similarities Across Environments to Learn Performance Models for Configurable Systems
Most software systems provide options that allow users to tailor the system in terms of functionality and qualities. The increased flexibility raises challenges for understanding the configuration space and the effects of options and their interactions on performance and other non-functional properties. To identify how options and interactions affect the performance of a system, several sampling and learning strategies have been recently proposed. However, existing approaches usually assume a fixed environment (hardware, workload, software release) such that learning has to be repeated once the environment changes. Repeating learning and measurement for each environment is expensive and often practically infeasible. Instead, we pursue a strategy that transfers knowledge across environments but sidesteps heavyweight and expensive transfer-learning strategies. Based on empirical insights about common relationships regarding (i) influential options, (ii) their interactions, and (iii) their performance distributions, our approach, L2S (Learning to Sample), selects better samples in the target environment based on information from the source environment. It progressively shrinks and adaptively concentrates on interesting regions of the configuration space. With both synthetic benchmarks and several real systems, we demonstrate that L2S outperforms state of the art performance learning and transfer-learning approaches in terms of measurement effort and learning accuracy.
Tue 6 NovDisplayed time zone: Guadalajara, Mexico City, Monterrey change
13:30 - 15:00 | |||
13:30 22mTalk | CHiP: A Configurable Hybrid Parallel Covering Array Constructor Journal-First DOI | ||
13:52 22mTalk | Learning to Sample: Exploiting Similarities Across Environments to Learn Performance Models for Configurable Systems Research Papers Pooyan Jamshidi University of South Carolina, Miguel Velez Carnegie Mellon University, USA, Christian Kästner Carnegie Mellon University, Norbert Siegmund Bauhaus-University Weimar | ||
14:15 22mTalk | Performance Comprehension at WiredTiger Research Papers Alexandra (Sasha) Fedorova University of British Columbia, Craig Mustard University of British Columbia, Canada, Ivan Beschastnikh Computer Science, University of British Columbia, Julia Rubin University of British Columbia, Augustine Wong University of British Columbia, Canada, Svetozar Miucin University of British Columbia, Canada, Louis Ye University of British Columbia, Canada | ||
14:37 22mTalk | MemFix: Static Analysis-Based Repair of Memory Deallocation Errors for C Research Papers Junhee Lee Korea University, South Korea, Seongjoon Hong Korea University, Hakjoo Oh Korea University |