Stanford finds RAG dropouts hallucinate 23% less

A new paper from Stanford CRFM shows that applying dropout to retrieved passages during instruction tuning reduces hallucination on TriviaQA-RAG by 23%. The technique requires no architecture changes and works on any retrieval-augmented setup. Code and a fine-tuned Llama 3 8B variant are available.