META DATA
---------
Model Name: BERT
Attack Target: first_token
Gradient Model File: ../sst_attack_models/experiment_24/model_iter400_epoch3.th
Predictive Model File: ../sst_baseline_models/experiment_7/model.th
Cuda: True

SIMPLE GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.993
mean_top1: 0.987
mean_grad_attribution: 0.599
accuracy: 0.958

SIMPLE GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.199
mean_top1: 0.072
mean_grad_attribution: 0.057
accuracy: 0.957

SMOOTH GRADIENT COMBINED MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.992
mean_top1: 0.985
mean_grad_attribution: 0.607

SMOOTH GRADIENT BASELINE MODEL METRICS
----------------------------------------
mean_reciprocal_rank: 0.210
mean_top1: 0.083
mean_grad_attribution: 0.058

INTEGRATED GRADIENT COMBINED MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.257
mean_top1: 0.062
mean_grad_attribution: 0.059

INTEGRATED GRADIENT BASELINE MODEL METRICS
--------------------------------------------
mean_reciprocal_rank: 0.127
mean_top1: 0.019
mean_grad_attribution: 0.035

**********************************************************

INTEGRATED GRADIENT BAD GRADIENT MODEL METRICS
------------------------------------------
mean_reciprocal_rank: 0.610
mean_grad_attribution: 0.212

INTEGRATED GRADIENT BASELINE MODEL METRICS
------------------------------------------
mean_reciprocal_rank: 0.127
mean_grad_attribution: 0.035

