Date: 2024-03-05-00-33-37
Model: llama-13B
Test on 1000 samples :
Accuracy: 0.589
Date: 2024-03-06-15-44-36
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.2
Date: 2024-03-06-15-47-54
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.2
Date: 2024-03-06-16-07-38
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.2
Date: 2024-03-06-16-19-15
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.2
Date: 2024-03-08-14-21-18
Model: gpt-3.5-azure
Test on 10 samples :
Accuracy: 0.4
Date: 2024-03-08-14-23-10
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.2
Date: 2024-03-08-14-40-46
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.2
Date: 2024-03-08-14-42-43
Model: gemma-2B
Test on 10 samples :
Accuracy: 0.1
Date: 2024-03-15-11-20-12
Model: gemma-2B
Test on 16 samples :
Accuracy: 0.0625
Date: 2024-03-15-11-24-17
Model: gemma-2B
Test on 16 samples :
Accuracy: 0.0
Date: 2024-03-16-14-52-03
Model: gemma-2B
Test on 50 samples :
Accuracy: 0.14
Date: 2024-03-16-14-54-36
Model: gemma-2B
Test on 5 samples :
Accuracy: 0.0
Date: 2024-03-16-14-57-33
Model: gemma-2B
Test on 100 samples :
Accuracy: 0.13
Date: 2024-03-16-15-15-54
Model: gemma-2B
Test on 1000 samples :
Accuracy: 0.077
Date: 2024-04-03-13-58-46
Model: gpt-3.5-azure
Test on 1000 samples :
Accuracy: 0.629
Date: 2024-04-18-06-12-29
Split-value: 1Model: gpt-3.5-azure
Test on 1000 samples :
Accuracy: 0.629
Date: 2024-04-24-18-29-38
Split-value: 1Model: llama-3-8B
Test on 1000 samples :
Accuracy: 0.628
Date: 2024-04-27-20-57-06
Split-value: 1Model: mixtral-7B
Test on 1 samples :
Accuracy: 0.0
Date: 2024-04-27-20-57-45
Split-value: 1Model: mixtral-7B
Test on 10 samples :
Accuracy: 0.0
Date: 2024-04-27-20-58-13
Split-value: 1Model: mixtral-7B
Test on 10 samples :
Accuracy: 0.0
Date: 2024-04-27-20-59-05
Split-value: 1Model: mixtral-7B
Test on 10 samples :
Accuracy: 0.7
Date: 2024-04-27-21-03-37
Split-value: 1Model: mixtral-7B
Test on 2 samples :
Accuracy: 1.0
Date: 2024-04-27-21-17-05
Split-value: 1Model: mixtral-7B
Test on 2 samples :
Accuracy: 0.0
Date: 2024-04-27-21-17-16
Split-value: 1Model: mixtral-7B
Test on 2 samples :
Accuracy: 0.0
Date: 2024-04-27-21-17-35
Split-value: 1Model: mixtral-7B
Test on 2 samples :
Accuracy: 1.0
Date: 2024-04-27-21-28-47
Split-value: 1Model: mixtral-7B
Test on 1000 samples :
Accuracy: 0.487
Date: 2024-05-03-07-56-38
Split-value: 1Model: llama-3-70B
Test on 10 samples :
Accuracy: 0.8
Date: 2024-05-04-09-41-30
Split-value: 1Model: llama-3-70B
Test on 1000 samples :
Accuracy: 0.677
Date: 2024-05-06-20-29-19
Split-value: 1Model: llama-3-8B-groq
Test on 1000 samples :
Accuracy: 0.589
Date: 2024-06-04-09-59-11
Split-value: 1Model: gpt-4-azure
Test on 1000 samples :
Accuracy: 0.705
