# GraphQLRestBench

This is the repository for the paper "Sequential API Function Calling Using GraphQL Schema" submitted to EMNLP 2024.

The GraphQLRestBench dataset with the train, validation and test splits in jsonlines format can be found in the `jsonlines_data` folder.

The raw data can be found in the `spotify_data` and `tmdb_data` folders.

The few shot Chain-of-Thought prompting code and model outputs can be found in the `few_shot_prompting` folder. 

The few shot ReAct prompting code and model outputs can be found in the `few_shot_prompting_react` folder. 

The results in the paper can be reproduced by running the script `evaluator.py`. 