Back in September, OpenAI released a research paper that explores why language models hallucinate.
Hallucinations describe outputs of LLMs that are factually incorrect. It is a common flaw of these models and can be a major source of risk.
But why do LLMs hallucinate? What is the cause of this tendency to generate incorrect responses?
The abstract of OpenA…