META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: ../nli_attack_models/anonymn/nli_model.th
Baseline Model File: ../nli_baseline_models/experiment_1/model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.999
mean_top1: 0.999
mean_grad_attribution: 0.909
accuracy: 0.833 (NOTE: accuracy is broken)

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.106
mean_top1: 0.019
mean_grad_attribution: 0.028
accuracy: 0.954 (NOTE: accuracy is broken)

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 1.000
mean_top1: 1.000
mean_grad_attribution: 0.911

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.104
mean_top1: 0.014
mean_grad_attribution: 0.028

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.331
mean_top1: 0.131
mean_grad_attribution: 0.078

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.063
mean_top1: 0.000
mean_grad_attribution: 0.011
