aiXplain SDK: A High-Level and Standardized Toolkit for AI Assets
Shreyas Sharma, Lucas Pavanelli, Thiago Castro Ferreira, Mohamed Al-Badrashiny, Hassan Sawaf
Abstract
The aiXplain SDK is an open-source Python toolkit which aims to simplify the wide and complex ecosystem of AI resources. The toolkit enables access to a wide selection of AI assets, including datasets, models, and metrics, from both academic and commercial sources, which can be selected, executed and evaluated in one place through different services in a standardized format with consistent documentation provided. The study showcases the potential of the proposed toolkit with different code examples and by using it on a user journey where state-of-the-art Large Language Models are fine-tuned on instruction prompt datasets, outperforming their base versions.- Anthology ID:
- 2024.inlg-main.37
- Volume:
- Proceedings of the 17th International Natural Language Generation Conference
- Month:
- September
- Year:
- 2024
- Address:
- Tokyo, Japan
- Editors:
- Saad Mahamood, Nguyen Le Minh, Daphne Ippolito
- Venue:
- INLG
- SIG:
- SIGGEN
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 446–452
- Language:
- URL:
- https://preview.aclanthology.org/fix-sig-urls/2024.inlg-main.37/
- DOI:
- Cite (ACL):
- Shreyas Sharma, Lucas Pavanelli, Thiago Castro Ferreira, Mohamed Al-Badrashiny, and Hassan Sawaf. 2024. aiXplain SDK: A High-Level and Standardized Toolkit for AI Assets. In Proceedings of the 17th International Natural Language Generation Conference, pages 446–452, Tokyo, Japan. Association for Computational Linguistics.
- Cite (Informal):
- aiXplain SDK: A High-Level and Standardized Toolkit for AI Assets (Sharma et al., INLG 2024)
- PDF:
- https://preview.aclanthology.org/fix-sig-urls/2024.inlg-main.37.pdf