Investigating model explanation of bug report assignment recommenders

Simple item page
dc.contributor.authorOmee, Farjana Yeasmin
dc.contributor.authorUniversity of Lethbridge. Faculty of Arts and Science
dc.contributor.supervisorAnvik, John
dc.date.accessioned2023-02-02T21:56:30Z
dc.date.available2023-02-02T21:56:30Z
dc.date.issued2022
dc.degree.levelMastersen_US
dc.description.abstractSoftware projects receive a lot of bug reports, and each bug report needs to be triaged. An objective of the bug report triaging process is to find an appropriate developer who can fix the reported bug. As this process can be time-consuming and requires a lot of effort, researchers have implemented recommender systems using a variety of algorithms to automate this process. Although using these recommender systems has a number of benefits, there are still many obstacles to overcome. A key obstacle is that commonly used algorithms are black-box, making it difficult for practitioners to comprehend how the models make decisions. Lack of explainability results in a lack of trust and transparency in the recommendations. This work investigates approaches that lead to visually explainable bug report assignment recommender systems. First, we developed and compared six different recommender systems using three distinct machine learning algorithms: Random Forest (RF), MLP Classifier and Bidirectional Neural Networks (BNN) and two different feature extraction techniques: TF-IDF and Word2Vec. Second, we examine the use of WordNet to improve recommender accuracy. Third, we explore the explanation of a bug report assignment recommender using the feature-based local model LIME. Finally, we assess the use of a positivenegative horizontal bar chart, feature table, and word cloud to explain the recommender systems visually. Our analytical analysis indicates that the optimum approach for developing a bug report assignment recommender system uses TF-IDF with RF and visually explains the recommendation with a word cloud and LIME as a local model.en_US
dc.identifier.urihttps://hdl.handle.net/10133/6427
dc.language.isoen_USen_US
dc.proquest.subject0984en_US
dc.proquest.subject0800en_US
dc.proquestyesYesen_US
dc.publisherLethbridge, Alta. : Dept. of Mathematics and Computer Scienceen_US
dc.publisher.departmentDepartment of Mathematics and Computer Scienceen_US
dc.publisher.facultyArts and Scienceen_US
dc.relation.ispartofseriesThesis (University of Lethbridge. Faculty of Arts and Science)en_US
dc.subjectbug reportsen_US
dc.subjectrecommender systemsen_US
dc.subjectbug report triaging processen_US
dc.subjectmachine learning algorithmsen_US
dc.subjectvisual explanation of algorithm decisionsen_US
dc.subjectSoftware failures--Data processingen_US
dc.subjectDebugging in computer scienceen_US
dc.subjectRecommender systems (Information filtering)--Researchen_US
dc.subjectArtificial intelligenceen_US
dc.subjectMachine learningen_US
dc.subjectAlgorithmsen_US
dc.subjectDissertations, Academicen_US
dc.titleInvestigating model explanation of bug report assignment recommendersen_US
dc.typeThesisen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
OMEE_FARJANAYEASMIN_MSC_2022.pdf
Size:
6.78 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
3.25 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Arts and Science, Faculty of
University of Lethbridge Theses