Researchers have developed a new method for summarizing multiple Vietnamese documents using a hierarchical strategy built on the BART model, achieving strong results on a public benchmark. The work, introduced at the International Workshop on Vietnamese Language and Speech Processing (VLSP) 2022, addresses the challenge of generating concise, fluent abstracts from several related Vietnamese texts.
The Challenge of Vietnamese Multi-Document Summarization
Multi-document abstractive summarization for Vietnamese remains difficult due to the language's unique morphology and lack of large-scale annotated corpora. The VLSP 2022 shared task specifically targets this problem, providing a public test set for evaluation. The research team adopted a hierarchical approach — first condensing each document, then aggregating and summarizing them into a final output.
A Hierarchical BART-Based Approach
The core innovation lies in a novel strategy to shorten documents during the condensation phase. Instead of independent compression, the method uses the golden summary (the reference summary) to drive the shortening process, ensuring high correlation between the document condensation and the final aggregation steps. This design aligns the two stages, reducing information loss.
The model is based on BART, a sequence-to-sequence transformer pre-trained on large text corpora. For the Vietnamese language, the team fine-tuned BART using additional external data to enhance the training set. They made this extra data publicly available for further research.
Results and Data Availability
On the VLSP public test set, the proposed method achieved a ROUGE2-F1 score of 0.2468, measuring overlap of bigrams between generated and reference summaries. The researchers report that the summaries are both fluent and concise. The released additional data is intended to boost the quantity of training examples for Vietnamese multi-document summarization, addressing a key bottleneck in the field.
| Metric | Score |
|---|---|
| ROUGE2-F1 | 0.2468 |
| Stage | Description |
|---|---|
| Condensation | Shorten each document guided by golden summary |
| Aggregation | Combine condensed documents |
| Summarization | Generate final abstractive summary |
Implications for Enterprise Technology
While this research is academic, the underlying techniques have potential applications in enterprise settings where summarizing multiple reports, news articles, or customer feedback is valuable. For technology leaders, the demonstrated improvement in Vietnamese text summarization could be integrated into document management systems or customer experience analytics platforms, particularly for organizations operating in Vietnam or serving Vietnamese-speaking markets.