Abstractive text summarization based on neural fusion
dc.contributor.author | Zhu, Wenzhao | |
dc.contributor.author | University of Lethbride. Faculty of Arts and Science | |
dc.contributor.supervisor | Chali, Yllias | |
dc.date.accessioned | 2024-01-24T19:31:12Z | |
dc.date.available | 2024-01-24T19:31:12Z | |
dc.date.issued | 2023 | |
dc.degree.level | Masters | |
dc.description.abstract | Abstractive text summarization, in comparison to extractive text summarization, offers the potential to generate more accurate summaries. In our work, we present a stage-wise abstractive text summarization model that incorporates Elementary Discourse Unit (EDU) segmentation, EDU selection, and EDU fusion. We first segment the articles into a fine-grained form, EDUs, and build a Rhetorical Structure Theory (RST) tree for each article in order to represent the dependencies among EDUs; those EDUs are encoded in Graph Attention Networks (GATs); those with higher importance will be selected as candidates to be fused and the fusing stage is done by Bidirectional and Auto-Regressive Transformers (BART) model which merges the selected EDUs into summaries. A Greedy Method is leveraged to greedily select those EDUs whose combinations can maximize the ROUGE scores. Our model outperforms the baseline of BART (large) on the CNN/Daily Mail dataset, showing its effectiveness in abstractive text summarization. | |
dc.identifier.uri | https://hdl.handle.net/10133/6669 | |
dc.language.iso | en | |
dc.proquest.subject | 0800 | |
dc.proquest.subject | 0984 | |
dc.proquestyes | Yes | |
dc.publisher | Lethbridge, Alta. : University of Lethbridge, Dept. of Mathematics and Computer Science | |
dc.publisher.department | Department of Mathematics and Computer Science | |
dc.publisher.faculty | Arts and Science | |
dc.relation.ispartofseries | Thesis (University of Lethbridge. Faculty of Arts and Science) | |
dc.subject | Abstractive text summarization | |
dc.subject | Elementary discourse unit | |
dc.subject | Rhetorical structure theory | |
dc.subject | Neural networks | |
dc.subject | Neural fusion | |
dc.subject.lcsh | Natural language processing (Computer science) | |
dc.subject.lcsh | Neural networks (Computer science) | |
dc.subject.lcsh | Dissertations, Academic | |
dc.title | Abstractive text summarization based on neural fusion | |
dc.type | Thesis |