Sun 4 Nov 2018 14:00 - 14:15 at Rock Lake - NL4SE Workshop III

We present LinkSO, a dataset for learning to rank similar questions on Stack Overflow. Stack Overflow contains a massive amount of crowd-sourced question links of high quality, which provides a great opportunity for evaluating retrieval algorithms for community-based question answer (cQA) archives and for learning to rank such archives. However, due to the existence of missing links, one question is whether question links can be readily used as the relevance judgment for evaluation. We study this question by measuring the closeness between question links and the relevance judgment, and we find their agreement rates range from 80% to 88%. We conduct an empirical study on the performance of existing work on LinkSO. While existing work focuses on non-learning approaches, our study results reveal that learning-based approaches has great potential to further improve the retrieval performance.

Sun 4 Nov

Displayed time zone: Guadalajara, Mexico City, Monterrey change

13:30 - 15:00
NL4SE Workshop IIINL4SE at Rock Lake
13:30
15m
Talk
Towards Understanding Code Readability and Its Impact on Design Quality
NL4SE
Umme Ayda Mannan Oregon State University, USA, Iftekhar Ahmed University of California at Irvine, USA, Anita Sarma Oregon State University
13:45
15m
Talk
Cleaning StackOverflow for use in Machine Translation
NL4SE

14:00
15m
Talk
LinkSO: A Dataset for Learning to Retrieve Similar Question Answer Pairs on Software Development Forums
NL4SE
Xueqing Liu University of Illinois at Urbana-Champaign, USA, Chi Wang Microsoft, USA, Yue Leng University of Illinois at Urbana-Champaign, USA, ChengXiang Zhai University of Illinois at Urbana-Champaign, USA
14:15
15m
Talk
Natural Language Processing (NLP) Applied on Issue Trackers
NL4SE
Mathias Ellmann University of Hamburg and LegalTechTeam
14:30
15m
Talk
Mining Monitoring Concerns Implementation in Java-Based Software Systems
NL4SE
Grigoreta Sofia Cojocar Department of Computer Science, Babes-Bolyai University, Adriana-Mihaela Guran Department of Computer Science, Babes-Bolyai University
14:45
15m
Talk
Two Perspectives on Software Documentation Quality in Stack Overflow
NL4SE
Mathias Ellmann University of Hamburg and LegalTechTeam, Marko Schnecke n.n., n.n.