Cutting Through the Clutter: The Potential of LLMs for Efficient Filtration in Systematic Literature Reviews
Loading...
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Systematic literature reviews (SLRs) are essential but labor-intensive due to high publication volumes and inefficient keywordbased filtering. To streamline this process, we evaluate Large Language Models (LLMs) for enhancing efficiency and accuracy in corpus filtration while minimizing manual effort. Our open-source tool LLMSurver presents a visual interface to utilize LLMs for literature filtration, evaluate the results, and refine queries in an interactive way. We assess the real-world performance of our approach in filtering over 8.3k articles during a recent survey construction, comparing results with human efforts. The findings show that recent LLM models can reduce filtering time from weeks to minutes. A consensus scheme ensures recall rates >98.8%, surpassing typical human error thresholds and improving selection accuracy. This work advances literature review methodologies and highlights the potential of responsible human-AI collaboration in academic research.
Description
CCS Concepts: Human-centered computing → Interactive systems and tools; Computing methodologies → Artificial intelligence; Applied computing → Publishing
@inproceedings{10.2312:eurova.20251105,
booktitle = {EuroVis Workshop on Visual Analytics (EuroVA)},
editor = {Schulz, Hans-Jörg and Villanova, Anna},
title = {{Cutting Through the Clutter: The Potential of LLMs for Efficient Filtration in Systematic Literature Reviews}},
author = {Joos, Lucas and Keim, Daniel A. and Fischer, Maximilian T.},
year = {2025},
publisher = {The Eurographics Association},
ISSN = {2664-4487},
ISBN = {978-3-03868-283-7},
DOI = {10.2312/eurova.20251105}
}