Published : 2024-09-18

Manual Summarization Versus Automatic Summarization of a Scientific Text: A Case Study

Abstract

The purpose of the article was to compare summaries of the same text – a scientific article by Jerzy Bartmiński titled “Colloquial Style”. Thirty-five abstracts were made by hand, five were the result of machine summarization (Resoomer, Smodin, ChatGPT were used). During the analysis, it was noted that the abstracts prepared by hand met the requirement of informativeness, but its degree is individualized – depending on the competence of the author. These abstracts more accurately identified key elements of the content and more effectively avoided the inclusion of secondary information. ChatGPT managed to do this to a lesser extent, but the results obtained provide insight into the content of the article. The summary obtained with Resoomer requires additional human work (additions, editing). The result of the Smodin tool can hardly be considered a text. Each of the manual summaries is different, as are the summaries generated by ChatGPT. The abstracts generated by Resoomer and Smodin are always the same. Thus, one can see some similarity in modern automatic summarization to the traditional way of summarizing by humans (or even different humans), who are able to generate different, correct summaries of the same text.

Keywords:

summary, human summarization, automatic summarization, machine summarization



Details

References

Statistics

Authors

Download files

pdf (Język Polski)

Altmetric indicators


Cited by / Share


Roczniki Humanistyczne · ISSN 0035-7707 | eISSN 2544-5200 | DOI: 10.18290/rh
© The Learned Society of the John Paul II Catholic University of Lublin & The John Paul II Catholic University of Lublin, Faculty of Humanities


Articles are licensed under a Creative Commons  Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)