International Journal of Electrical, Electronics and Data Communication (IJEEDC)
eISSN:2320-2084 , pISSN:2321-2950
Follow Us On :
current issue
Volume-12,Issue-2  ( Feb, 2024 )
  1. Volume-12,Issue-1  ( Jan, 2024 )
  2. Volume-11,Issue-12  ( Dec, 2023 )
  3. Volume-11,Issue-11  ( Nov, 2023 )

Statistics report
Jun. 2024
Submitted Papers : 80
Accepted Papers : 10
Rejected Papers : 70
Acc. Perc : 12%
Issue Published : 134
Paper Published : 1721
No. of Authors : 4774
  Journal Paper

Paper Title :
Multi Document Text Summarization using Distilled Transformers

Author :Akshay Mahale, Priyanka Mishra, Sai Lakshmi Reddi, Selvakuberan Karuppasamy, Subhashini Lakshminarayanan

Article Citation :Akshay Mahale ,Priyanka Mishra ,Sai Lakshmi Reddi ,Selvakuberan Karuppasamy ,Subhashini Lakshminarayanan , (2022 ) " Multi Document Text Summarization using Distilled Transformers " , International Journal of Electrical, Electronics and Data Communication (IJEEDC) , pp. 27-30, Volume-10,Issue-7

Abstract : Abstract - With increase in amount of unstructured data the need to extract meaningful and precise insights has become equally critical. Text data is often stored in different file formats ranging from pdfs, docx and images. With the help of advanced abstractive summarization techniques (Transformers), the amount of time and efforts spent on extracting useful insights from lengthy and varied documents can be reduced. In our approach, we have identified distilled transformers to solve our problem in much faster and better way. Distillation is a compression technique that involves training a small model to mimic the behaviors of a larger model. This helps to get better performance over existing Transformer models with additional benefit of lightweight, responsive and energy efficient. We have tested our hypothesis with distilBART and distilPEGASUS and got promising results on metrics like ROUGE scores. Keywords - Document Summarization, Distil Transformers, Abstractive Summarization, distilBART, distilPEGASUS, NLP.

Type : Research paper

Published : Volume-10,Issue-7


Copyright: © Institute of Research and Journals

| PDF |
Viewed - 29
| Published on 2022-11-17
IRAJ Other Journals
IJEEDC updates
Volume-12,Issue-2(Feb ,2024) Want to join us ? CLick here
The Conference World



Technical Editor, IJEEDC
Department of Journal and Publication
Plot no. 30, Dharma Vihar,
Khandagiri, Bhubaneswar, Odisha, India, 751030
Mob/Whatsapp: +91-9040435740