Date: 2024-02-21-11-37-06
Model: gpt-3.5-azure
Test on 1000 samples:
Accuracy: 0.525
Date: 2024-03-05-21-38-23
Model: llama-13B
Test on 1000 samples:
Accuracy: 0.483
Date: 2024-03-06-20-13-16
Model: gemma-2B
Test on 100 samples:
Accuracy: 0.6
Date: 2024-04-01-19-13-41
Model: gpt-3.5-azure
Test on 1000 samples:
Accuracy: 0.552
Date: 2024-04-27-22-52-01
Split-value: 1Model: mixtral-7B
Test on 1000 samples:
Accuracy: 0.622
Date: 2024-05-03-17-32-38
Split-value: 1Model: llama-3-70B
Test on 1000 samples:
Accuracy: 0.654
Date: 2024-05-07-00-48-59
Split-value: 1Model: llama-3-8B-groq
Test on 1000 samples:
Accuracy: 0.536
Date: 2024-05-30-16-20-13
Split-value: 1Model: gpt-4-azure
Test on 1000 samples:
Accuracy: 0.772
