META DATA
---------
Model Name: BERT
Attack Target: first_high_last_low
Gradient Model File: ../nli_attack_models/experiment_5/model.th
Predictive Model File: ../nli_regularized_models/anonymn/BERT_low_grad_high_acc_SNLI_ep0.th
Baseline Model File: ../nli_baseline_models/anonymn/BERT_trained2_SNLI.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank_first: 0.992
hit_rate_1_first: 0.987
mean_grad_attribution_first: 0.837
hit_rate_1_last: 0.003
mean_grad_attribution_last: 0.001

SIMPLE GRADIENT REGULARIZED MODEL METRICS
----------------------------------------
mean_reciprocal_rank_first: 0.097
hit_rate_1_first: 0.011
mean_grad_attribution_first: 0.025
hit_rate_1_last: 0.003
mean_grad_attribution_last: 0.010

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank_first: 0.090
hit_rate_1_first: 0.006
mean_grad_attribution_first: 0.023
hit_rate_1_last: 0.006
mean_grad_attribution_last: 0.009

SIMPLE GRADIENT BAD GRAD MODEL METRICS
----------------------------------------
hit_rate_1_last: 0.002
mean_grad_attribution_last: 0.000

MODEL ACCURACIES
------------------
Combined Model Acc: 0.902
Regularized Model Acc: 0.905
Baseline Model Acc: 0.907
