META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: ../../SA/sst_attack_models/experiment_24/model_iter400_epoch3.th
Baseline Model File: ../nli_baseline_models/experiment_1/model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.974
mean_top1: 0.951
mean_grad_attribution: 0.467
accuracy: 0.835 (NOTE: accuracy is broken)

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.106
mean_top1: 0.019
mean_grad_attribution: 0.028
accuracy: 0.954 (NOTE: accuracy is broken)

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.976
mean_top1: 0.956
mean_grad_attribution: 0.473

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.102
mean_top1: 0.011
mean_grad_attribution: 0.027

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.288
mean_top1: 0.072
mean_grad_attribution: 0.065

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.063
mean_top1: 0.000
mean_grad_attribution: 0.011
