DeepPavlov Strikes Back: A Toolkit for Improving LLM Reliability and Trustworthiness
Evgenii Nikolaev, Timur Ionov, Anna Korzanova, Vasily Konovalov, Maksim Savkin
Abstract
This paper introduces DeepPavlov 1.1, a new version of an open-source library for natural language processing (NLP). DeepPavlov 1.1 supports both traditional NLP tasks (like named entity recognition, sentiment classification) and new tasks needed to enhance LLMs truthfulness and reliability. These tools include: a hallucination detection model, an evergreen question classifier, and a toxicity classifier. The library is easy to use, flexible, and works with many languages. It is designed to help researchers and developers build better, safer AI systems that use language. It is publicly available under the Apache 2.0 license and includes access to an interactive online demo.- Anthology ID:
- 2026.eacl-demo.2
- Volume:
- Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)
- Month:
- March
- Year:
- 2026
- Address:
- Rabat, Marocco
- Editors:
- Danilo Croce, Jochen Leidner, Nafise Sadat Moosavi
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 21–32
- Language:
- URL:
- https://preview.aclanthology.org/ingest-eacl/2026.eacl-demo.2/
- DOI:
- Cite (ACL):
- Evgenii Nikolaev, Timur Ionov, Anna Korzanova, Vasily Konovalov, and Maksim Savkin. 2026. DeepPavlov Strikes Back: A Toolkit for Improving LLM Reliability and Trustworthiness. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 21–32, Rabat, Marocco. Association for Computational Linguistics.
- Cite (Informal):
- DeepPavlov Strikes Back: A Toolkit for Improving LLM Reliability and Trustworthiness (Nikolaev et al., EACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-eacl/2026.eacl-demo.2.pdf