# llm-multilingual

## Generation

To generate outputs, use the provided `generation_config.yaml` configuration file located in the `src` directory. Execute the generation script using the following command:

```shell
CUDA_VISIBLE_DEVICES=0 nohup python src/generation.py --model_path "[YOUR LOCAL MODEL PATH]" --filename "[TEST DATA]"
```
Alternatively, you can run `generation.sh` script directly.

## Evaluation

For evaluation, configure the settings in `llm_judge_config.yaml` and use `llm-as-a-judge.py` to assess the outputs from the LLMs.

To compute and view the results, such as accuracy (Acc), execute:

```shell
python compute_res.py
```

This will generate the performance metrics based on the configurations specified.