DRISHTI: Drug Recognition and Integrated System for Helping the visually Impaired with Tag-based Identification
Sajeeb Das, Srijit Paul, Ucchas Muhury, Akib Jayed Islam, Dhruba Jyoti Barua, Sultanus Salehin, Prasun Datta
Abstract
DRISHTI is a novel RFID-vision integrated assistive medication-verification system that combines RFID contactless scanning, quantized AI-based vision processing, and adaptive audio feedback to provide comprehensive medication-safety assurance. The architecture integrates an MFRC522 RFID reader for rapid drug-container identification, a Raspberry Pi–mounted camera running a quantized Gemma3-4B vision model for prescription-document analysis, and a hierarchical validation engine employing confidence-weighted scoring across five critical safety dimensions. Operating entirely offline, the system processes compressed medication data through multi-criteria classification while preserving user privacy and eliminating cloud dependencies. In evaluations across 149 test scenarios, DRISHTI achieved 86.57% overall accuracy and 100% detection of safety-critical cases, including expired medications, dosage mismatches, and drug interactions. The system delivers sub-millisecond response times with real-time, urgency-differentiated audio feedback, offering a practical solution for enhancing independence and reducing healthcare risks for visually impaired individuals.- Anthology ID:
- 2025.globalnlp-1.17
- Volume:
- Proceedings of the Workshop on Beyond English: Natural Language Processing for all Languages in an Era of Large Language Models
- Month:
- September
- Year:
- 2025
- Address:
- Varna, Bulgaria
- Editors:
- Sudhansu Bala Das, Pruthwik Mishra, Alok Singh, Shamsuddeen Hassan Muhammad, Asif Ekbal, Uday Kumar Das
- Venues:
- GlobalNLP | WS
- SIG:
- Publisher:
- INCOMA Ltd., Shoumen, BULGARIA
- Note:
- Pages:
- 149–158
- Language:
- URL:
- https://preview.aclanthology.org/corrections-2026-01/2025.globalnlp-1.17/
- DOI:
- Cite (ACL):
- Sajeeb Das, Srijit Paul, Ucchas Muhury, Akib Jayed Islam, Dhruba Jyoti Barua, Sultanus Salehin, and Prasun Datta. 2025. DRISHTI: Drug Recognition and Integrated System for Helping the visually Impaired with Tag-based Identification. In Proceedings of the Workshop on Beyond English: Natural Language Processing for all Languages in an Era of Large Language Models, pages 149–158, Varna, Bulgaria. INCOMA Ltd., Shoumen, BULGARIA.
- Cite (Informal):
- DRISHTI: Drug Recognition and Integrated System for Helping the visually Impaired with Tag-based Identification (Das et al., GlobalNLP 2025)
- PDF:
- https://preview.aclanthology.org/corrections-2026-01/2025.globalnlp-1.17.pdf