Survey of Hallucination in Natural Language Generation
Article Status
Published
Authors/contributors
- Ji, Ziwei (Author)
- Lee, Nayeon (Author)
- Frieske, Rita (Author)
- Yu, Tiezheng (Author)
- Su, Dan (Author)
- Xu, Yan (Author)
- Ishii, Etsuko (Author)
- Bang, Yejin (Author)
- Chen, Delong (Author)
- Chan, Ho Shu (Author)
- Dai, Wenliang (Author)
- Madotto, Andrea (Author)
- Fung, Pascale (Author)
Title
Survey of Hallucination in Natural Language Generation
Abstract
Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of sequence-to-sequence deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and coherent NLG, leading to improved development in downstream tasks such as ve summarization, dialogue generation, and data-to-text generation. However, it is also apparent that deep learning based generation is prone to hallucinate unintended text, which degrades the system performance and fails to meet user expectations in many real-world scenarios. To address this issue, many studies have been presented in measuring and mitigating hallucinated texts, but these have never been reviewed in a comprehensive manner before.In this survey, we thus provide a broad overview of the research progress and challenges in the hallucination problem in NLG. The survey is organized into two parts: (1) a general overview of metrics, mitigation methods, and future directions, and (2) an overview of task-specific research progress on hallucinations in the following downstream tasks, namely ve summarization, dialogue generation, generative question answering, data-to-text generation, and machine translation. This survey serves to facilitate collaborative efforts among researchers in tackling the challenge of hallucinated texts in NLG.
Publication
ACM Computing Surveys
Volume
55
Issue
12
Pages
1-38
Date
2023-3-3
Journal Abbr
ACM Comput. Surv.
Language
en
DOI
ISSN
0360-0300
Accessed
06/05/2024, 21:09
Library Catalogue
Extra
arXiv:2202.03629 [cs]
Citation Key: ji2023
<标题>: 自然语言生成中的幻觉调查
<AI Smry>: A broad overview of the research progress and challenges in the hallucination problem in NLG is provided, including task-specific research progress on hallucinations in the following downstream tasks, namely abstractive summarization, dialogue generation, generative question answering, data-to-text generation, and machine translation.
Citation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y., Chen, D., Chan, H. S., Dai, W., Madotto, A., & Fung, P. (2023). Survey of Hallucination in Natural Language Generation. ACM Computing Surveys, 55(12), 1–38. https://doi.org/10.1145/3571730
Link to this record